Difference between revisions of "HOWTO12 Globus Online cookbook for EGI VOs"
Line 1: | Line 1: | ||
{|align=right |__TOC__ |} | |||
This page contains the steps how to use GlobusOnline.eu and enable it on existing storage elements in EGI. | This page contains the steps how to use GlobusOnline.eu and enable it on existing storage elements in EGI. |
Revision as of 15:52, 1 November 2012
For VO Manager
All commands are performed using gLite UI. EGI VO "lsgrid" is used for examples.
1. Find storage elements available for your VO.
-bash-3.2$ lcg-infosites --is bdii.grid.sara.nl --vo lsgrid se Avail Space(kB) Used Space(kB) Type SE ------------------------------------------ < output truncated > 717032688 382478939 SRM se.grid.rug.nl 17542103037 460842863 SRM se.lsg.hubrecht.eu 16560797796 1442148104 SRM se.lsg.psy.vu.nl 58680692895 n.a SRM srm.grid.sara.nl 14994733204 5266796 SRM srm.grid.sara.nl n.a n.a SRM srm.grid.sara.nl
2. Find the SRM endpoint for chosen storage element.
-bash-3.2$ lcg-info --list-service --bdii ldap://bdii.grid.sara.nl:2170 --vo lsgrid --query 'ServiceType=SRM' --attrs 'ServiceEndpoint'| grep srm.grid.sara.nl - Service: httpg://srm.grid.sara.nl:8443/srm/managerv2 - ServiceEndpoint httpg://srm.grid.sara.nl:8443/srm/managerv2
3. Find your VO home directory path for the SRM endpoint.
lcg-info --list-se --bdii ldap://bdii.grid.sara.nl:2170 --vo lsgrid --query 'SE=srm.grid.sara.nl' --attrs 'VOInfoPath' - SE: srm.grid.sara.nl - VOInfoPath /pnfs/grid.sara.nl/data/lsgrid
4. Find if SRM endpoint is the real storage endpoint by attempting file copy.
-bash-3.2$ touch test -bash-3.2$ srmcp -2 file:///test srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lsgrid/test -debug Storage Resource Manager (SRM) Client version 2.1.5-16 < output truncated > copying CopyJob, source = file:///test destination = gsiftp://bee51.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/test execution of CopyJob, source = file:///test destination = gsiftp://bee51.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/test completed < output truncated >
From this line "copying CopyJob, source = file:///test destination = gsiftp://bee51.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/test" in the log we see that there is another host (bee51.grid.sara.nl) used by SRM to transfer files via GridFTP. This host (bee51.grid.sara.nl) and must be used at GlobusOnline.eu.
5. Go to GlobusOnline.eu.
a) Create account with your VO name e.g. lsgrid.
b) Go to "Manage Endpoints" and click "Add Endpoint".
c) Filling the endpoint details:
Name lsgrid# < enter name of the Storage > (e.g. SARA) Short Description: < enter description > (e.g. VO default path for this storage - /pnfs/grid.sara.nl/data/lsgrid/) Server Address gsiftp:// < storage hostname with GridFTP access > (e.g. bee51.grid.sara.nl) Visible To: Anyone (public) Set the Identity Provider to be used with this endpoint. Type: MyProxy MyProxy Hostname: < myproxy server for your VO > (e.g. px.grid.sara.nl)
For VO Members
All commands are performed using gLite UI. EGI VO "lsgrid" is used for examples.
1. Generating credentials.
Generate VOMS proxy.
-bash-3.2$ voms-proxy-init --voms lsgrid Enter GRID pass phrase: Your identity: /O=dutchgrid/O=users/O=egi/CN=Karolis Eigelis Creating temporary proxy .............................................................................................................. Done Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "lsgrid" Done Creating proxy ............................................................ Done Your proxy is valid until Fri Nov 2 02:16:10 2012
Upload VOMS proxy to MyProxy.
-bash-3.2$ myproxy-init --voms lsgrid Enter GRID pass phrase: Your identity: /O=dutchgrid/O=users/O=egi/CN=Karolis Eigelis Creating temporary proxy ............................. Done Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "lsgrid" Done Creating proxy ........................................... Done Your proxy is valid until Thu Nov 8 14:17:47 2012 verify OK Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user karolise now exists on px.grid.sara.nl.
2. Go to GlobusOnline.eu.
a) Create account for yourself
b) Go to "Manage Endpoints" and click "View All".
c) Search for your VO name e.g. lsgrid
You could see something like:
lsgrid#SARA activate
d) Click on "activate"
Fill in the details for your credentials to retrieve.
MyProxy Server: < myproxy server you have credentials at > (e.g. px.grid.sara.nl) Username: < your user on a myproxy machine > (e.g. karolise) Passphrase: < you chosen password > (e.g. You used to Enter MyProxy pass phrase in step 1.)
e) Click "Authenticate"
f) Go to "Start Transfer"
Choose your endpoint which is: lsgrid#SARA
Enter your VO path directory which is: /pnfs/grid.sara.nl/data/lsgrid/
That is it. Now using Globus Online you can access Storage Element in EGI which is used also by SRM and FTS.
What you can do ?
- Transfer files from your laptop using GlobusConnect client to SRM storage endpoint in EGI using GO.
- Transfer files from SRM endpoint in EGI using GO to your laptop using GlobusConnect client.
- Transfer files from one SRM endpoint in EGI to another SRM endpoint in EGI or to any other Infrastructure using GO and receive nice notifications by email