Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "MirroringUMD"

From EGIWiki
Jump to navigation Jump to search
Line 44: Line 44:
=== Using wget ===
=== Using wget ===
* at the moment "wget -r" will not work, please use the lftp solution described above.
* at the moment "wget -r" will not work, please use the lftp solution described above.
<!--  
<!--  
* Taking as example [http://fedoranews.org/alex/tutorial/yum/ Fedora's tutorial on using wget to create a local mirror] you can use the following [https://raw.githubusercontent.com/caifti/repos_mirror/master/UMD_yum_repository.sh script] modify it to reflect the repositories you want to mirror, if you want to use the crearerepo or not, etc.
* Taking as example [http://fedoranews.org/alex/tutorial/yum/ Fedora's tutorial on using wget to create a local mirror] you can use the following [https://raw.githubusercontent.com/caifti/repos_mirror/master/UMD_yum_repository.sh script] modify it to reflect the repositories you want to mirror, if you want to use the crearerepo or not, etc.

Revision as of 15:06, 17 December 2014

Technology Software Component Delivery Software Provisioning UMD Middleware Cloud Middleware Distribution Containers Distribution Technology Glossary


Software Provisioning menu: Software Provisioning Process UMD Release Process Quality Assurance UMD Staged Rollout





Mirroring of UMD Repositories

We provide some basic information needed in order to mirror UMD repositories. Available repos:

Communication

  • Mailing-lists
    • for announcements (changes, new repos, etc): mirror-egi at egi.eu - TO BE SET-UP
    • for discussion: FORUM - mirror-egi - TO BE SET-UP

Repos size estimates

  • please see the content of the following file for insfo on available directories and their estimated sizes:

Export License

Mirroring

Using lftp

  • Depending on what repositories you want to mirror and the space you have available (see #Repos size estimates you can use something similar:
    • to create the mirror for the first time:

lftp -c mirror --verbose --exclude 'candidate/' --exclude '1/' --exclude '2/' http://repository.egi.eu/sw/production/umd/ ${LOCAL_DIR}

    • to removes any local packages that no longer exist on the source, and only downloads newer package versions from the host mirror:

lftp -c mirror –-only-newer --ignore-time -–delete --exclude 'candidate/' --exclude '1/' --exclude '2/' http://repository.egi.eu/sw/production/umd/ ${LOCAL_DIR}

Using wget

  • at the moment "wget -r" will not work, please use the lftp solution described above.

Using rsync

  • at the moment we do not offer a rsync server for UMD repositories