Federated Cloud Communities

Overview

For users

For resource providers

Infrastructure status

Site-specific configuration

Architecture

Federated Cloud Communities menu:

Home •

Production use cases •

Under development use cases •

Closed use cases •

High level tools use cases

Technical support is available via the EGI.eu Support Team

Introduction

This wiki page provides information about the user communities and use cases who are exploiting the EGI Federated Cloud infrastructure and its services. These use cases and communities collaborated (or collaborate in the past) with the EGI Federated Cloud to enable scientific applications, simulations or tools in virtualised environments. The evolution of the Federated Cloud infrastructure is driven by the requirements of these use cases and the needs of the broader scientific community and industry in the European Research Area.

The EGI Federated Cloud User Support (FCUS) team during the porting and integration work of the use cases into the Federated Cloud, follows a well defined process described bellow. The various phases are described as well, and will be used in the next coming tables to list the ongoing, production and closed use cases.

Use cases in a pre-assessment phase are not listed in this page.

Status	Description
Pre-assessment	FCUS members identified a potential use case that can profit from the EGI Federated Cloud services
Assessed	The use case requirements are assessed with relevant information added to a dedicated wiki page, to manage the full porting & integration process
Preparatory	The user & FCUS team setup the environment to execute tests on the FedCloud (configuration of client environment, identify resource providers, upload vm images, ...)
Test & Integration	Users are accessing the FedCloud through the fedcloud.egi.eu VO to execute tests while integrate their applications to the infrastructure
Pre-production	Test & integration phases were successfully completed. Create a production Virtual Organization (VO) or join an already existing VO
Production	VO negotiate and agree on VO SLA with EGI. Use case is being used in production. The use case completed all tests and is regularly making use of the Federated Cloud using a production level VO
Closed	Test & integration successfully completed. Use case does not foresee moving into production.
Cancelled	Test & integration did not successfully completed. User cancelled the use case.

Production Use Cases

The following table shows the use cases in production status phase that are regularly making use of the EGI Federated Cloud using a production level VO.

Community	Description	Scientific discipline	VO	Sites	Further information
BioVeL	BioVeL Portal: it is a browser-based interface that contains everything necessary to run users' workflow without user having to install anything on their own computer.	Natural sciences Biological sciences Biodiversity conservation	biomed	BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI	Wiki page
BioVeL	OpenRefine: it is a powerful tool for working with messy data, cleaning it, transforming it from one format into another, extending it with web services, and linking it to databases.	Natural sciences Biological sciences Biodiversity conservation	biomed	BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI	Wiki page
BioVeL	OpenModeller: The Ecological Niche Modelling (ENM) Workflow takes as input a file containing species occurrence points to create a model with the openModeller Web Service.	Natural sciences Biological sciences Biodiversity conservation	biomed	CESNET-MetaCloud	Wiki page
BioVeL	BioSTIF: it is a web map application designed for the interactive visualisation of spatio-temporal data.	Natural sciences Biological sciences Biodiversity conservation	biomed	BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI	Wiki page
Catania Science Gateway Framework	It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time	N/A	N/A	N/A	Wiki page
CHAIN-REDS	R: it is a free software environment for statistical computing and graphics. visualisation of spatio-temporal data.	Natural sciences Mathematics Statistics and probability	vo.chain-project.eu	CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI	Wiki page
CHAIN-REDS	Octave: it is a high-level interpreted language, primarily intended for numerical computations. It provides capabilities for the numerical solution of linear and nonlinear problems, and for performing other numerical experiments. It also provides extensive graphics capabilities for data visualization and manipulation.	Natural sciences Mathematics Statistics and probability	vo.chain-project.eu	CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI	Wiki page
CHAIN-REDS	tthreader	Natural sciences Biological sciences Bioinformatics	vo.chain-project.eu	CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI	Wiki page
CUSM, Würzburg University	READemption: RNA-seq. analysis of data to understand different biological features and behaviour.	Natural sciences Biological sciences Bioinformatics	highthroughputseq.egi.eu	GoeGrid, IFCA	Wiki page
CSC / ELIXIR	Chipster: it is a user-friendly analysis software for high-throughput data. It contains over 300 analysis tools for next generation sequencing (NGS), microarray, proteomics and sequence data	Natural sciences Biological sciences Bioinformatics	chipster.csc.fi	PRISMA-INFN-BARI	Wiki page
DIRAC	VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user.	N/A	N/A	N/A	Wiki page
DRIHM	Run Hydrology and Hydraulic models on the cloud	Natural sciences Earth sciences Hydrology	drihm.eu	PRISMA-INFN-BARI	Wiki page
ELIXIR	Access to EGI Cloud Marketplace via EBI IdP	Natural sciences Biological sciences Bioinformatics	N/A	N/A	Wiki page
IFCA	CMS Open Data Portal: it is a virtual environment that allows the execution for educational purposes of CMS 2010 software to analyze the Open Data available at CERN Open Data portal.	Natural sciences Physical sciences High energy physics	cms	IFCA	Wiki page
Peachnote	OCR analysis in music scores	Humanities Arts Musicology	peachnote.com	CESNET-MetaCloud, FZJ	Wiki page

Use Cases under development

The following table shows the use cases from assessed to pre-production status phases.

Community	Description	Registration date	Scientific discipline	Status	Further information
Aix Marseille Universite	RSAT (Regulatory Sequence Analysis Tools): it provides a series of modular computer programs specifically designed for the detection of regulatory signals in non-coding sequences.	2014.10.08	Natural sciences Biological sciences Other	Preparatory	Wiki page
BILS	BILS portal: front-end to biological tools for not IT skilled users.	2014.10.31	Natural sciences Biological sciences	Preparatory	Wiki page
BILS	PConsC2: tools for protein structure prediction.	2014.10.31	Natural sciences Biological sciences Bioinformatics	Test & Integration	Wiki page
BILS	Genome Annotation service: genome brower to run genome annotation pipeline.	2014.10.31	Natural sciences Biological sciences Bioinformatics	Preparatory	Wiki page
BILS	TOPCons2: Membrane topology prediction web-server.	2014.10.31	Natural sciences Biological sciences Bioinformatics	Test & Integration	Wiki page
BioVeL	EDIT: it is a portal to access/visualize Catalogue of Life taxonomy data	2013	Natural sciences Biological sciences Biodiversity conservation	Assessed	Wiki page
BSIM2	Proof of Concept and optimization of data workflow	2014.04.12	Natural sciences Biological sciences	Assessed	Wiki page
CERN ATLAS	Run a cluster on-demand on the cloud to absorb peaks from ATLAS grid.	2013	Natural sciences Phisical sciences High energy physics	Test & Integration	Wiki page
CERN ATLAS	Run ATLAS jobs on the EGI FedCloud through Vac/Vcycle	2014.10.15	Natural sciences Phisical sciences High energy physics	Pre-production	Wiki page
CERN CMS	Run CMS jobs on the EGI FedCloud through Vac/Vcycle	2014.12.17	Natural sciences Phisical sciences High energy physics	Pre-production	Wiki page
CERN LHCb	Run LHCb jobs on the EGI FedCloud through Vac/Vcycle	2014.11.19	Natural sciences Phisical sciences High energy physics	Pre-production	Wiki page
CERN@School	CERN@school is a programme that brings CERN into the classroom. The cernatschool.org VO would use the EGI Federated Cloud to give users in facilities without access to a research-grade IT infrastructure access to the tools they need for analysing and storing data collected by CERN@school projects using the Timepix hyrbid silicon pixel detectors.	2014.04.20	Natural sciences Phisical sciences High energy physics	Pre-production	Wiki page
CHAIN-REDS	WRF (weather research forecast): it is a next-generation mesoscale numerical weather prediction system designed to serve both atmospheric research and operational forecasting needs.	2013	Natural sciences Earth sciences Atmospheric science	Test & Integration	Wiki page
CHAIN-REDS	ALEPH: it was a particle physics experiment installed on the Large Electron-Positron collider (LEP) at the CERN laboratory in Geneva/Switzerland.	2014.11.17	Natural sciences Phisical sciences High energy physics	Test & Integration	Wiki page
Charles University in Prague - First Faculty of Medicine	Physiome project: Project of web application to compute, store and provide values of parameters of physiological models via lightweight API.	2014.05.29	Medical and Health Sciences Basic medicine Physiology	Assessed	Wiki page
CLARIN ERIC	Virtual Language Observatory.	2015.02.01	Humanities Languages and literature Linguistics	Assessed	Wiki page
CNR	Satellite Data.	2015.02.01	Natural Sciences Earth Sciences Physical geography	Assessed	Wiki page
CNR / Engineering	D4Science/i-Marine.	2015.03.01	Natural Sciences Biological Sciences Ecology	Assessed	Wiki page
Curoverse	Arvados: integrate Arvados platform in the EGI Federated Cloud	2014.08.01	Natural sciences Biological sciences Bioinformatics	Test & Integration	Wiki page
DCH-RP / Engineering	Deploy SCIDIP-ES HAPPI Toolkit in the EGI Federated Cloud for the DCH-RP community. The HAPPI toolkit supports the archive manager and curator to capture and manage part of the Preservation Descriptive Information (PDI).	2014.07.08	Support activities Digital archives	Pre-production	Wiki page
DCH-RP	Long term preservation in the cloud	2014.03.12	Support activities Digital archivies	Preparatory	Wiki page
Departamento de física teórica y del cosmos, Universidad de Granada	Auger: running CORSIKA and OFFLINE in the EGI Federated Cloud.	2015.03.03	Natural sciences Physical sciences Astroparticle physics	Pre-production	Wiki page
EPOS	Download datasets from TCSs through ICS.	2015.03.01	Natural Sciences Earth Sciences	Assessed	Wiki page
EPOS	MISFIT/VERCE application.	2015.03.01	Natural Sciences Earth Sciences Volcanology	Assessed	Wiki page
ESA	Stimulus Project.	2015.04.27	Natural Sciences Physical Sciences Space Sciences	Assessed	Wiki page
HARNESS	The HARNESS project is developing a new generation of cloud computing platforms that integrate heterogeneous hardware resources to provide vastly increased performance with reduced energy consumption and lower cost. HARNESS would like to organise training events using FedCloud resources	2014.10.06	Natural sciences Computer sciences Distributed Computing	Assessed	Wiki page
HARNESS	The HARNESS project developed a PaaS to better exploit cloud resources. Aim of this use case is deploying the HARNESS PaaS on the EGI Federated Cloud to make it available for EGI users.	2014.10.06	Natural sciences Computer sciences Distributed Computing	Assessed	Wiki page
IFCA	Hydrodynamic modeling using EGI FedCloud	2014.09.25	Natural sciences Earth sciences Hydrology	Test & Integration	Wiki page
IFCA	Water Quality modeling using EGI FedCloud	2014.11.06	Natural sciences Biological sciences Ecology	Test & Integration	Wiki page
IFCA	TRUFA (Transcriptomes User-Friendly Analysis): it is a free webserver designed to perform RNA-seq analysis.	2014.08.01	Natural sciences Biological sciences Evolutionary biology	Assessed	Wiki page
INERTIA / Engineering	The INERTIA project addresses the "structural inertia" of existing Distribution Grids by introducing more active elements combined with the necessary control and distributed coordination mechanisms. To this end INERTIA will adopt the Internet of Things/Services principles to the Distribution Grid Control Operations.	2014.09.01	Engineering and technology Environmental engineering Energy and fuels	Pre-production	Wiki page
Instituto de Astrofísica de Andalucía	Calibration, Analysis and Modelling of Radio-Astronomy Data: Data Development of a calibration pipeline for LOFAR data	2014.10.06	Natural sciences Phisical sciences Astronomy	Test & Integration	Wiki page
Instituto de Astrofísica de Andalucía	Calibration, Analysis and Modelling of Radio-Astronomy Data: Modelling of the kinematic of galaxies (GIPSY)	2014.10.06	Natural sciences Phisical sciences Astronomy	Test & Integration	Wiki page
KNMI	CLIPCE.	2015.02.01	Natural sciences Earth sciences Climate research	Preparatory	Wiki page
VERCE	Deploy a service that utilizes Cloud resources to offer simplified execution of data pre- and post-processing scripts. It offers users access to the ObsPy seismological toolbox for processing data with the Python programming language, executed on virtual Cloud resources in a secured sandbox.	2013	Natural sciences Earth sciences Seismology	Preparatory	Wiki page

Closed Use Cases

The following table shows the use cases in Closed status phase. These use cases are related to the communities that tested the EGI Federated Cloud but that are not decided yet to use it for production aims. Use cases related to the adoption of EGI Federated Cloud services by other communities are also inserted in this table. An outcome for each use case is available.

Community	Description	Scientific discipline	Outcome	Further information
ELIXIR	Access to EGI Cloud Marketplace via EBI IdP	Natural sciences Biological sciences Bioinformatics	The EGI AppDB authentication system has been extended to support the Elixir/EBI’s Identity Provider.	Wiki page
ENVRI	Data access, catalog and dissemination (EISCAT 3D)	Natural sciences Phisical sciences Space science	In this proof-of-concept the OSGC software was deployed on the EGI Federated Cloud. OSGC is an Open Source implementation of an OpenSearch GeoSpatial Catalogue compliant to OGC 10-32r3 specification, developed by EGI.eu (http://www.egi.eu/) under the ENVRI (http://envri.eu/) project.	Wiki page
ESA	SSEP Data processing	Natural sciences	In the context of the Helix Nebula initiative, the European Space Agency organized a Proof of Concept using EGI Federated Cloud resources. The pilot proved the possibility to support the SuperSites Exploitation Platform flagship using academic resources, such as the one provided by the EGI federated cloud. An instance of the SSEP processing cluster has been instantiated into the EGI Federated cloud, on several EGI sites, connected with the SSEP processing platform and used to run test earthquakes monitoring related processing (such as SBAS and Gamma IPTA processing). SlipStream was adopted as Infrastructure broker.	Wiki page
Jena University	JAMS (Jena Adaptable Modelling System): run JAMS in the FedCloud	Natural sciences Earth sciences Hydrology	Aim of this proof-of-concept was the evaluation of the EGI Federated Cloud as alternative to the community computing resources to execute JAMS computation. The community already owns enough computing resources for their current needs but its workload should increase in a near future. The community was able to execute standard JAMS simulation in the EGI Federated Cloud without major issue.	Wiki page
WeNMR	Validating and improving biomolecular NMR structures	Natural sciences Biological sciences Structural biology	Proof of concept demonstrating the validation and improvement of biomolecular NMR structures using VirtualCing, a Virtual Machine equipped with a complex suite of ~25 programs. It was demonstrated at the Cloudscape V Workshop held in February 2013 and at the EGI CF 2013 held in April (see demostrations of VCing over the EGI Federated Cloud)	Wiki page

High level tools use cases

This table lists the high-level tools integrated in the EGI Federated Cloud that have been supported as use cases.

Community	Description	Status	Further information
Catania Science Gateway Framework	It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time	Production	CSGF App. Broker HowTo
DIRAC	VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user.	Production	FedCloudDIRAC
SCI-BUS	Test/debug new releases of WS-PGRADE	Test & Integration	FedCloudWSPGRADE