MirroringUMD
Technology | Software Component Delivery | Software Provisioning | UMD Middleware | Cloud Middleware Distribution | Containers Distribution | Technology Glossary |
Software Provisioning menu: | Software Provisioning Process | UMD Release Process | Quality Assurance | UMD | Staged Rollout |
Mirroring of UMD Repositories
We provide some basic information needed in order to mirror UMD repositories. Available repos:
Communication
- Mailing-lists
- for announcements (changes, new repos, etc): mirror-egi at egi.eu
- for discussion: mirror-egi-d at egi.eu or can we suggest FORUM - mirror-egi
Repos size estimates
- please see the content of the following file for insfo on available directories and their estimated sizes:
Export License
Do we need something similar to http://fedoraproject.org/wiki/Infrastructure/Mirroring#Export_Compliance ?
Mirroring
Using lftp
- Depending on what repositories you want to mirror and the space you have available (see #Repos size estimates you can use something similar:
- to create the mirror for the first time:
lftp -c mirror --verbose --exclude 'candidate/' --exclude '1/' --exclude '2/' http://repository.egi.eu/sw/production/umd/ ${LOCAL_DIR}
- to removes any local packages that no longer exist on the source, and only downloads newer package versions from the host mirror:
lftp -c mirror –-only-newer --ignore-time -–delete --exclude 'candidate/' --exclude '1/' --exclude '2/' http://repository.egi.eu/sw/production/umd/ ${LOCAL_DIR}
Using wget
Taking as example Fedora's tutorial on using wget to create a local mirror you can use the following [script] modify it to reflect the repositories you want to mirror, if you want to use the crearerepo or not, etc.
You can find other examples on hw to use wget for mirroring reposat:
Using rsync
- at the moment we do not offer a rsync server for UMD repositories