Jointly exploit EGI and EUDAT services

From EGIWiki
Jump to: navigation, search
Overview For users For resource providers Infrastructure status Site-specific configuration Architecture



Contents


EGI and EUDAT interoperability

This page describes how to jointly exploit EGI and EUDAT services.

Interconnect EGI Federated Cloud VMs with EUDAT B2STAGE and B2SAFE services

Prerequisites

Create a VM in the EGI Federated Cloud

This section describes how to create a VM in the EGI Federated Cloud with pre-configured on board all the software needed to interact with B2STAGE and B2SAFE services.

Add block storage to the VM

Access to B2STAGE/B2SAFE from your EGI Federated Cloud VM

docker run --rm --volumes-from occi-voms-proxy -it \ 
-v $PWD:/data:rw -v ~/.ssh_egi:/ssh:ro \
egifedcloud/fedcloud-userinterface \
/bin/bash -c "(apt-get install -y openssh-client && scp -i /ssh/fedcloud ${X509_USER_PROXY} egieudat@< IP-address >:)"

Upload and download files to/from B2STAGE instance with globus-url-copy

globus-url-copy -vb -cred <X509_USER_PROXY on VM> file:///<local filename> gsiftp://<B2STAGEinstance>/<path>/<filename>
globus-url-copy -vb -cred <X509_USER_PROXY on VM> gsiftp://<B2STAGEinstance>/<path>/<filename> file:///<local filename>
globus-url-copy -vb -cred <X509_USER_PROXY on VM> -list gsiftp://<B2STAGEinstance>/<path>/
globus-url-copy -vb -cred <X509_USER_PROXY on VM> -list gsiftp://<B2STAGEinstance>/~/
where ~ is the home directory

Install a GridFTP client in the EGI Federated Cloud VM

Other GridFTP clients, e.g. UberFTP, allow also other file manipulations like deleting files on B2STAGE/B2SAFE. In the following, you can find the instruction to install and use UberFTP:

sudo apt-get install software-properties-common
sudo add-apt-repository ppa:maarten-kooyman-6/ppa
sudo apt-get update
sudo apt-get install uberftp
cp <X509_USER_PROXY on VM> /tmp/x509up_u1000
uberftp <B2STAGEinstance>

EGI DataHub - Stage-In/Stage-Out data to B2STAGE/B2SAFE

In this section is explained how to connect storage managed via the EGI Data Hub with the EUDAT B2STAGE/B2SAFE services. This setup allows to have a distributed file-system shared by many VMs, that could be located also in different resource providers, connected to the EUDAT preservation services.

Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox
Print/export