Difference between revisions of "HOWTO13 EUDAT B2STAGE cookbook for EGI VOs"
Line 71: | Line 71: | ||
GClocalhost=mylaptop (Your GlobusOnline.eu Connect endpoint) | GClocalhost=mylaptop (Your GlobusOnline.eu Connect endpoint) | ||
DSSfilePath=/CINECA01/home/EUDAT_STAFF/keigelis/.DSSfile (Path of the EUDAT storage server to .DSSfile) | DSSfilePath=/CINECA01/home/EUDAT_STAFF/keigelis/.DSSfile (Path of the EUDAT storage server to .DSSfile) | ||
Revision as of 09:34, 15 August 2014
About
B2STAGE service from EUDAT supports all known GridFTP command line and graphical or web based user clients (globus-url-copy, uberftp, WebFTS, globusonline, XSEDE-EUDAT File Manager).
DSS (Data Staging Script) is a command line tool which is recommended to be used if user would like to benefit from PIDs (Persistent Identification of the files which are stored on a dedicated server named EPIC server).
This cookbook provides the information about how EGI communities can benefit from the B2STAGE service offered by EUDAT.
EUDAT B2STAGE
List of EUDAT B2STAGE service endpoints.
[1] User documentation about B2STAGE service. (EUDAT website)
[2] Site Administrator documentation about B2STAGE service. (EUDAT website)
EGI VOs
Installing Data Staging Script
1. Install Python pip
ekar@ekar-VirtualBox:~# sudo apt-get install python-pip
2. Install Globus Online API
ekar@ekar-VirtualBox:~# sudo pip install globusonline-transfer-api-client
3. Install dependencies
ekar@ekar-VirtualBox:~# sudo apt-get install swig python-dev ekar@ekar-VirtualBox:~# sudo pip install m2crypto
4. Download Data Staging Script from GitHub
ekar@ekar-VirtualBox:~# mkdir DSS ekar@ekar-VirtualBox:~# sudo cd DSS ekar@ekar-VirtualBox:~/DSS$ git clone https://github.com/EUDAT-B2STAGE/B2STAGE-DataStaging-script.git ekar@ekar-VirtualBox:~/DSS$ cd B2STAGE-DataStaging-script ekar@ekar-VirtualBox:~/DSS/B2STAGE-DataStaging-script$ sudo cp m2.py /usr/local/lib/python2.7/dist-packages/globusonline/transfer/api_client/x509_proxy/m2.py
Configuring Data Staging Script
1. Ask for access to one of B2STAGE service provided endpoints.
2. datastager.cfg
[Defaults] user = ekarolis (Your GlobusOnline.eu account name) cert = ~/.globus/usercert.pem key = ~/.globus/userkey.pem certdir=~/.globus/certificates rmode= DSSfile #rmode= icommands ipath= /home/jack/CINECA/GridTools/iRODS/iRODS/clients/icommands/bin/ src_site = None src_dir = ~/ dst_site = None dst_dir = ~/ GClocalhost=mylaptop (Your GlobusOnline.eu Connect endpoint) DSSfilePath=/CINECA01/home/EUDAT_STAFF/keigelis/.DSSfile (Path of the EUDAT storage server to .DSSfile)
Using Data Staging Script
Setting up GlobusOnline.eu
Please consult Globus Online cookbook for EGI VOs. Information about how to configure EGI storage endpoints and other relevant information is briefly described. If your VO Manager does not provide you with public storage endpoints at GlobusOnline.eu, you can follow the procedure to set them up by yourself.