ubuntu mirror issues

Web hosting, FTP/database access, mirror services and hosted blogs
Post Reply
samarium
Posts: 376
Joined: Thu Feb 02, 2006 12:17 am

ubuntu mirror issues

Post by samarium » Tue Apr 06, 2010 6:40 pm

I would like to use the exetel ubuntu mirror as a debmirror/rsync source
however these are the things that are currently show stoppers for me:

1. no rsync access
2. missing ubuntu/dists/{*,*-proposed}/main/dist-upgrader-all
3. missing ubuntu/dists/*/main/installer-{i386,amd64}

I see that since last time I looked, the current development release is mirrored, so that is an improvement.

Getting 2&3 in place, while using debmirror is interesting, but since I don't know how Andrew is building this mirror, don't know if it is an issue or if looking at my current script would help.

I guess that I currently do 20-40 G/month external IP access with this stuff, that could be satisfied from the mirror if it was usable for me.

I currently max out my ADSL1 8192 connection doing external access, so speed isn't an issue with internal/external for me.

I wonder if any other people find themselves similarly constrained?

Dazzled
Volunteer Site Admin
Posts: 6003
Joined: Mon Nov 13, 2006 1:16 pm
Location: Sydney

Re: ubuntu mirror issues

Post by Dazzled » Tue Apr 06, 2010 7:30 pm

Not the answer, but have you seen the official list at https://launchpad.net/ubuntu/+archivemirrors? Three rsync mirrors are listed for Australia, (but not Exetel, alas).

Ravenous
Posts: 325
Joined: Thu Apr 24, 2008 4:44 pm
Location: Brisbane, Qld

Re: ubuntu mirror issues

Post by Ravenous » Tue Apr 06, 2010 10:24 pm

Dazzled wrote:Not the answer, but have you seen the official list at https://launchpad.net/ubuntu/+archivemirrors? Three rsync mirrors are listed for Australia, (but not Exetel, alas).
What's the reason for Exetel Mirror not being registered as an 'Official' mirror? I utilise Exetel Mirror via Ubuntu Tweak Source Editor (or Other Software) however it be nice to have them as fully 'Official'.

SysAdmin

Re: ubuntu mirror issues

Post by SysAdmin » Wed Apr 07, 2010 12:29 pm

samarium wrote:I see that since last time I looked, the current development release is mirrored, so that is an improvement.
Glad someone is using it. :)
Getting 2&3 in place, while using debmirror is interesting, but since I don't know how Andrew is building this mirror, don't know if it is an issue or if looking at my current script would help.
I'm using debmirror as I want to cherry pick which dists to mirror. This
would all be a lot easier with just an rsync call but that makes choosing
dists harder (impossible really as the 'pool' is mixed).

This means you now have #3 for 'current'. #2 I'm pondering about. Currently
using http to suck everything down (it seems nicer on a per-file basis on
the host than rsync) but the only way I can see debmirror working for #2 is
to get it to use rsync.
I guess that I currently do 20-40 G/month external IP access with this stuff, that could be satisfied from the mirror if it was usable for me.
Well we can give it a jolly-good-shot within the constraints we have (disk
space primarily and, since we're unofficial, niceness to the source).

Andrew

SysAdmin

Re: ubuntu mirror issues

Post by SysAdmin » Wed Apr 07, 2010 12:32 pm

Ravenous wrote:What's the reason for Exetel Mirror not being registered as an 'Official' mirror? I utilise Exetel Mirror via Ubuntu Tweak Source Editor (or Other Software) however it be nice to have them as fully 'Official'.
It's a small server that would not appreciate the brutality of the kind of popularity that that would bring it. :)

Andrew

samarium
Posts: 376
Joined: Thu Feb 02, 2006 12:17 am

Re: ubuntu mirror issues

Post by samarium » Tue Apr 20, 2010 2:50 pm

Dazzled wrote:Not the answer, but have you seen the official list at https://launchpad.net/ubuntu/+archivemirrors? Three rsync mirrors are listed for Australia, (but not Exetel, alas).
Thanks Dazzled, I looked there first before I culled it into my list, and I have a script that can automatically select between based on currently bandwidth, however I stopped doing this nightly as there is enough difference between the structure of the 3 that it causes too much local mirror thrashing.

I figure I'll check it again every 6 months or so, however my ADSL1 8Mbs connection tops out at around 6Mbs, and I can saturate that with rsync from internode, so I don't need to work any harder to work, however if the Exetel mirror gets to a suitable state, then I'm happy to use that.

jubba
Posts: 76
Joined: Sat Jun 30, 2007 8:21 pm
Location: Sydney

Re: ubuntu mirror issues

Post by jubba » Tue Apr 20, 2010 3:05 pm

i'd use an exetel mirror if there was one. But asides from potential speed benefits is there any other benefits from such a mirror.
I'm guessing it may reduce bandwidth on some parts of the exetel network.

samarium
Posts: 376
Joined: Thu Feb 02, 2006 12:17 am

Re: ubuntu mirror issues

Post by samarium » Tue Apr 20, 2010 3:25 pm

SysAdmin wrote:
samarium wrote:I see that since last time I looked, the current development release is mirrored, so that is an improvement.
Glad someone is using it. :)
Getting 2&3 in place, while using debmirror is interesting, but since I don't know how Andrew is building this mirror, don't know if it is an issue or if looking at my current script would help.
I'm using debmirror as I want to cherry pick which dists to mirror. This
would all be a lot easier with just an rsync call but that makes choosing
dists harder (impossible really as the 'pool' is mixed).

This means you now have #3 for 'current'. #2 I'm pondering about. Currently
using http to suck everything down (it seems nicer on a per-file basis on
the host than rsync) but the only way I can see debmirror working for #2 is
to get it to use rsync.
I guess that I currently do 20-40 G/month external IP access with this stuff, that could be satisfied from the mirror if it was usable for me.
Well we can give it a jolly-good-shot within the constraints we have (disk
space primarily and, since we're unofficial, niceness to the source).

Andrew
Unfortunately I'm not using the exetel development mirror of lucid given my reasons above, but I did notice that it was there!

I'm using debmirror-via-rsync + rsync. I used to use debmirror-via-=http + mirrordir-via-ftp, so current scripting is all rsync, conceptually simpler & easier to maintain.

Let me know if you want a copy of the script I use.

I'm currently only mirroring intrepid, karmic & lucid, i386/amd64
Last edited by samarium on Tue Apr 20, 2010 4:34 pm, edited 1 time in total.

SysAdmin

Re: ubuntu mirror issues

Post by SysAdmin » Tue Apr 20, 2010 3:32 pm

samarium wrote:Unfortunately I'm not using the exetel development mirror of lucid given my reasons able, but I did notice that it was there!

I'm using debmirror-via-rsync + rsync. I used to use debmirror-via-=http + mirrordir-via-ftp, so current scripting is all rsync, conceptually simpler & easier to maintain.

Let me know if you want a copy of the script I use.

I'm currently only mirroring intrepid, karmic & lucid, i386/amd64
Hmmm. There should be no difference between the transports but if you
don't mind, I'll have a look at yours anyway. Might've missed something.
Sending it via PM would probably work best.

To be honest I tried debmirror with rsync once and got the mirror box
probmptly blocked for connection spamming. I felt this was detrimental
to getting a successful update so I switched to http at that point. :)

Andrew

plice
Posts: 7
Joined: Sun Oct 25, 2009 10:29 pm
Location: Perth

Re: ubuntu mirror issues

Post by plice » Tue Apr 27, 2010 12:36 pm

um, exetel doesn't have gentoo mirror by any chance as well? ...

Dazzled
Volunteer Site Admin
Posts: 6003
Joined: Mon Nov 13, 2006 1:16 pm
Location: Sydney

Re: ubuntu mirror issues

Post by Dazzled » Tue Apr 27, 2010 12:38 pm


Post Reply