Jointly exploit EGI and EUDAT services

From EGIWiki
Jump to: navigation, search
Overview For users For resource providers Infrastructure status Site-specific configuration Architecture


EGI and EUDAT interoperability

This page describes how to jointly exploit EGI and EUDAT services.

Interconnect EGI Federated Cloud VMs with EUDAT B2STAGE and B2SAFE services


Create a VM in the EGI Federated Cloud

This section describes how to create a VM in the EGI Federated Cloud with pre-configured on board all the software needed to interact with B2STAGE and B2SAFE services.

Add block storage to the VM

Access to B2STAGE/B2SAFE from your EGI Federated Cloud VM

docker run --rm --volumes-from occi-voms-proxy -it \ 
-v $PWD:/data:rw -v ~/.ssh_egi:/ssh:ro \
egifedcloud/fedcloud-userinterface \
/bin/bash -c "(apt-get install -y openssh-client && scp -i /ssh/fedcloud ${X509_USER_PROXY} egieudat@< IP-address >:)"

Upload and download files to/from B2STAGE instance with globus-url-copy

globus-url-copy -vb -cred <X509_USER_PROXY on VM> file:///<local filename> gsiftp://<B2STAGEinstance>/<path>/<filename>
globus-url-copy -vb -cred <X509_USER_PROXY on VM> gsiftp://<B2STAGEinstance>/<path>/<filename> file:///<local filename>
globus-url-copy -vb -cred <X509_USER_PROXY on VM> -list gsiftp://<B2STAGEinstance>/<path>/
globus-url-copy -vb -cred <X509_USER_PROXY on VM> -list gsiftp://<B2STAGEinstance>/~/
where ~ is the home directory

Install a GridFTP client in the EGI Federated Cloud VM

Other GridFTP clients, e.g. UberFTP, allow also other file manipulations like deleting files on B2STAGE/B2SAFE. In the following, you can find the instruction to install and use UberFTP:

sudo apt-get install software-properties-common
sudo add-apt-repository ppa:maarten-kooyman-6/ppa
sudo apt-get update
sudo apt-get install uberftp
cp <X509_USER_PROXY on VM> /tmp/x509up_u1000
uberftp <B2STAGEinstance>

EGI DataHub - Stage-In/Stage-Out data to B2STAGE/B2SAFE

In this section is explained how to connect storage managed via the EGI Data Hub with the EUDAT B2STAGE/B2SAFE services. This setup allows to have a distributed file-system shared by many VMs, that could be located also in different resource providers, connected to the EUDAT preservation services.

Personal tools