Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Online Storage

From EGIWiki
Revision as of 12:51, 16 November 2017 by Spinoso (talk | contribs)
Jump to navigation Jump to search

This page collects guide lines on the way online storage can be accessed.

GridFTP

Prerequirements needed are:

  • A personal X509 certificate, signed by your organization or institute, issued by one of the grid certificate authorities (CAs) that are member of the IGTF or their affiliated registration authorities (RAs) is required for data transfers. Please ask your organisation or institute in order to acquire such a personal X.509 certificate from a Certification Authority and configure it properly on your machine.
  • The distinguished name (DN) of your X.509 certificate. After receiving your personal X.509 certificate you need to forward the certificate's DN to the HLRS personnel in order to activate access to our GridFTP servers. To determine the DN, please run:
$ openssl x509 -noout -subject -in <YOUR_PERSONAL_X509_CERTIFICATE_FILE>
  • a Linux machine with GridFTP clients installed (a User Interface installable through UMD can make the purpose)

See also $grid-proxy-init$ and voms-proxy-init to get proper credentials to perform the transfer.

globus-url-copy

globus-url-copy performs a file transfer from a source to a destination endpoint. The usage is:

globus-url-copy [options] <sourceURL> <destURL>

See globus-url-copy -help for more details. An example:

$ globus-url-copy gsiftp://exampleurl.eu/home/users/username/myfile file:///localdir/username/myfile

if the sites allow that, it should be possible to make a third party transfer, namely host client triggering a transfer between two other gridftp servers. Both URIs would use gsiftp: as the protocol:

globus-url-copy gsiftp://host1/source gsiftp://host2/destination


   SRM client guide https://www.dcache.org/manuals/Book-2.7/cookbook/cb-clients-srm.shtml
  Data Management client https://dmc.web.cern.ch/projects/gfal-2/documentation 

EGI HOWTO on cloud storage: HOWTO09 in EGI Wiki

Swift user guide: https://docs.openstack.org/cli-reference/swift.html

OneData client: https://onedata.org/docs/index.html