MirroringUMD

Mirroring of UMD Repositories

We provide some basic information needed in order to mirror UMD repositories

Communication

• Mailing-lists
  • for announcements (changes, new repos, etc): mirror-egi at egi.eu
  • for discussion: mirror-egi-d at egi.eu

Repos size estimates

• file.txt with "du -hs /<dir_repos>

Export License

Do we need something similar to http://fedoraproject.org/wiki/Infrastructure/Mirroring#Export_Compliance ?

Mirroring

• Using rsync
  • do we have a rsync server? seems no ("rsync: failed to connect to repository.egi.eu: Connection timed out (110)")

rsync -vaH --exclude=pattern_to_exclude --numeric-ids --delete --delete-after --delay-updates rsync://repository.egi.eu/sw/production/umd ${LOCAL_DIR}

• Using lftp
  • Depending on what repositories you want to mirror and the space you have available (see #Repos size estimates you can use something similar:
    • to create the mirror for the first time:

lftp -c mirror --verbose --exclude 'candidate/' --exclude '1/' --exclude '2/' http://repository.egi.eu/sw/production/umd/ ${LOCAL_DIR}

• • • to removes any local packages that no longer exist on the source, and only downloads newer package versions from the host mirror:

lftp -c mirror –-only-newer --ignore-time -–delete --exclude 'candidate/' --exclude '1/' --exclude '2/' http://repository.egi.eu/sw/production/umd/ ${LOCAL_DIR}