Federated Cloud Communities

From EGIWiki
Jump to: navigation, search
Overview For users For resource providers Infrastructure status Site-specific configuration Architecture



Federated Cloud Communities menu: Home Production use cases Under development use cases Closed use cases High level tools use cases


Contents


Technical support is available via the EGI.eu Support Team

Introduction

This wiki page provides information about the user communities and use cases who are exploiting the EGI Federated Cloud infrastructure and its services. These use cases and communities collaborated (or collaborate in the past) with the EGI Federated Cloud to enable scientific applications, simulations or tools in virtualised environments. The evolution of the Federated Cloud infrastructure is driven by the requirements of these use cases and the needs of the broader scientific community and industry in the European Research Area.

The EGI Federated Cloud User Support (FCUS) team during the porting and integration work of the use cases into the Federated Cloud, follows a well defined process described bellow. The various phases are described as well, and will be used in the next coming tables to list the ongoing, production and closed use cases.

Use cases in a pre-assessment phase are not listed in this page.

Cloud.Use.Cases.StatusV2.PNG
Status Description
Pre-assessment FCUS members identified a potential use case that can profit from the EGI Federated Cloud services
Assessed The use case requirements are assessed with relevant information added to a dedicated wiki page, to manage the full porting & integration process
Preparatory The user & FCUS team setup the environment to execute tests on the FedCloud (configuration of client environment, identify resource providers, upload vm images, ...)
Test & Integration Users are accessing the FedCloud through the fedcloud.egi.eu VO to execute tests while integrate their applications to the infrastructure
Pre-production Test & integration phases were successfully completed. Create a production Virtual Organization (VO) or join an already existing VO
Production VO negotiate and agree on VO SLA with EGI. Use case is being used in production. The use case completed all tests and is regularly making use of the Federated Cloud using a production level VO
Closed Test & integration successfully completed. Use case does not foresee moving into production.
Cancelled Test & integration did not successfully completed. User cancelled the use case.

Production Use Cases

The following table shows the use cases in production status phase that are regularly making use of the EGI Federated Cloud using a production level VO.

Community Description Scientific discipline VO Sites Further information
BioVeL BioVeL Portal: it is a browser-based interface that contains everything necessary to run users' workflow without user having to install anything on their own computer. Natural sciences

Biological sciences Biodiversity conservation

biomed BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI Wiki page
BioVeL OpenRefine: it is a powerful tool for working with messy data, cleaning it, transforming it from one format into another, extending it with web services, and linking it to databases. Natural sciences

Biological sciences Biodiversity conservation

biomed BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI Wiki page
BioVeL OpenModeller: The Ecological Niche Modelling (ENM) Workflow takes as input a file containing species occurrence points to create a model with the openModeller Web Service. Natural sciences

Biological sciences Biodiversity conservation

biomed CESNET-MetaCloud Wiki page
BioVeL BioSTIF: it is a web map application designed for the interactive visualisation of spatio-temporal data. Natural sciences

Biological sciences Biodiversity conservation

biomed BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI Wiki page
Catania Science Gateway Framework It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time N/A N/A N/A Wiki page
CHAIN-REDS R: it is a free software environment for statistical computing and graphics. visualisation of spatio-temporal data. Natural sciences

Mathematics Statistics and probability

vo.chain-project.eu CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI Wiki page
CHAIN-REDS Octave: it is a high-level interpreted language, primarily intended for numerical computations. It provides capabilities for the numerical solution of linear and nonlinear problems, and for performing other numerical experiments. It also provides extensive graphics capabilities for data visualization and manipulation. Natural sciences

Mathematics Statistics and probability

vo.chain-project.eu CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI Wiki page
CHAIN-REDS tthreader Natural sciences

Biological sciences
Bioinformatics

vo.chain-project.eu CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI Wiki page
CUSM, Würzburg University READemption: RNA-seq. analysis of data to understand different biological features and behaviour. Natural sciences

Biological sciences Bioinformatics

highthroughputseq.egi.eu GoeGrid, IFCA Wiki page
CSC / ELIXIR Chipster: it is a user-friendly analysis software for high-throughput data. It contains over 300 analysis tools for next generation sequencing (NGS), microarray, proteomics and sequence data Natural sciences

Biological sciences Bioinformatics

chipster.csc.fi PRISMA-INFN-BARI Wiki page
DIRAC VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user. N/A N/A N/A Wiki page
DRIHM Run Hydrology and Hydraulic models on the cloud Natural sciences

Earth sciences Hydrology

drihm.eu PRISMA-INFN-BARI Wiki page
ELIXIR Access to EGI Cloud Marketplace via EBI IdP Natural sciences

Biological sciences Bioinformatics

N/A N/A Wiki page
IFCA CMS Open Data Portal: it is a virtual environment that allows the execution for educational purposes of CMS 2010 software to analyze the Open Data available at CERN Open Data portal. Natural sciences

Physical sciences High energy physics

cms IFCA Wiki page
Peachnote OCR analysis in music scores Humanities

Arts Musicology

peachnote.com CESNET-MetaCloud, FZJ Wiki page

Use Cases under development

The following table shows the use cases from assessed to pre-production status phases.

Community Description Registration date Scientific discipline Status Further information
Aix Marseille Universite RSAT (Regulatory Sequence Analysis Tools): it provides a series of modular computer programs specifically designed for the detection of regulatory signals in non-coding sequences. 2014.10.08 Natural sciences

Biological sciences Other

Preparatory Wiki page
BILS BILS portal: front-end to biological tools for not IT skilled users. 2014.10.31 Natural sciences

Biological sciences

Preparatory Wiki page
BILS PConsC2: tools for protein structure prediction. 2014.10.31 Natural sciences

Biological sciences Bioinformatics

Test & Integration Wiki page
BILS Genome Annotation service: genome brower to run genome annotation pipeline. 2014.10.31 Natural sciences

Biological sciences Bioinformatics

Preparatory Wiki page
BILS TOPCons2: Membrane topology prediction web-server. 2014.10.31 Natural sciences

Biological sciences Bioinformatics

Test & Integration Wiki page
BioVeL EDIT: it is a portal to access/visualize Catalogue of Life taxonomy data 2013 Natural sciences

Biological sciences Biodiversity conservation

Assessed Wiki page
BSIM2 Proof of Concept and optimization of data workflow 2014.04.12 Natural sciences

Biological sciences

Assessed Wiki page
CERN ATLAS Run a cluster on-demand on the cloud to absorb peaks from ATLAS grid. 2013 Natural sciences

Phisical sciences High energy physics

Test & Integration Wiki page
CERN ATLAS Run ATLAS jobs on the EGI FedCloud through Vac/Vcycle 2014.10.15 Natural sciences

Phisical sciences
High energy physics

Pre-production Wiki page
CERN CMS Run CMS jobs on the EGI FedCloud through Vac/Vcycle 2014.12.17 Natural sciences

Phisical sciences
High energy physics

Pre-production Wiki page
CERN LHCb Run LHCb jobs on the EGI FedCloud through Vac/Vcycle 2014.11.19 Natural sciences

Phisical sciences
High energy physics

Pre-production Wiki page
CERN@School CERN@school is a programme that brings CERN into the classroom. The cernatschool.org VO would use the EGI Federated Cloud to give users in facilities without access to a research-grade IT infrastructure access to the tools they need for analysing and storing data collected by CERN@school projects using the Timepix hyrbid silicon pixel detectors. 2014.04.20 Natural sciences

Phisical sciences
High energy physics

Pre-production Wiki page
CHAIN-REDS WRF (weather research forecast): it is a next-generation mesoscale numerical weather prediction system designed to serve both atmospheric research and operational forecasting needs. 2013 Natural sciences

Earth sciences Atmospheric science

Test & Integration Wiki page
CHAIN-REDS ALEPH: it was a particle physics experiment installed on the Large Electron-Positron collider (LEP) at the CERN laboratory in Geneva/Switzerland. 2014.11.17 Natural sciences

Phisical sciences
High energy physics

Test & Integration Wiki page
Charles University in Prague - First Faculty of Medicine Physiome project: Project of web application to compute, store and provide values of parameters of physiological models via lightweight API. 2014.05.29 Medical and Health Sciences

Basic medicine Physiology

Assessed Wiki page
CLARIN ERIC Virtual Language Observatory. 2015.02.01 Humanities

Languages and literature Linguistics

Assessed Wiki page
CNR Satellite Data. 2015.02.01 Natural Sciences

Earth Sciences Physical geography

Assessed Wiki page
CNR / Engineering D4Science/i-Marine. 2015.03.01 Natural Sciences

Biological Sciences Ecology

Assessed Wiki page
Curoverse Arvados: integrate Arvados platform in the EGI Federated Cloud 2014.08.01 Natural sciences

Biological sciences Bioinformatics

Test & Integration Wiki page
DCH-RP / Engineering Deploy SCIDIP-ES HAPPI Toolkit in the EGI Federated Cloud for the DCH-RP community. The HAPPI toolkit supports the archive manager and curator to capture and manage part of the Preservation Descriptive Information (PDI). 2014.07.08 Support activities

Digital archives

Pre-production Wiki page
DCH-RP Long term preservation in the cloud 2014.03.12 Support activities

Digital archivies

Preparatory Wiki page
Departamento de física teórica y del cosmos, Universidad de Granada Auger: running CORSIKA and OFFLINE in the EGI Federated Cloud. 2015.03.03 Natural sciences

Physical sciences Astroparticle physics

Pre-production Wiki page
EPOS Download datasets from TCSs through ICS. 2015.03.01 Natural Sciences

Earth Sciences

Assessed Wiki page
EPOS MISFIT/VERCE application. 2015.03.01 Natural Sciences

Earth Sciences Volcanology

Assessed Wiki page
ESA Stimulus Project. 2015.04.27 Natural Sciences

Physical Sciences Space Sciences

Assessed Wiki page
HARNESS The HARNESS project is developing a new generation of cloud computing platforms that integrate heterogeneous hardware resources to provide vastly increased performance with reduced energy consumption and lower cost. HARNESS would like to organise training events using FedCloud resources 2014.10.06 Natural sciences

Computer sciences Distributed Computing

Assessed Wiki page
HARNESS The HARNESS project developed a PaaS to better exploit cloud resources. Aim of this use case is deploying the HARNESS PaaS on the EGI Federated Cloud to make it available for EGI users. 2014.10.06 Natural sciences

Computer sciences Distributed Computing

Assessed Wiki page
IFCA Hydrodynamic modeling using EGI FedCloud 2014.09.25 Natural sciences

Earth sciences Hydrology

Test & Integration Wiki page
IFCA Water Quality modeling using EGI FedCloud 2014.11.06 Natural sciences

Biological sciences Ecology

Test & Integration Wiki page
IFCA TRUFA (Transcriptomes User-Friendly Analysis): it is a free webserver designed to perform RNA-seq analysis. 2014.08.01 Natural sciences

Biological sciences Evolutionary biology

Assessed Wiki page
INERTIA / Engineering The INERTIA project addresses the "structural inertia" of existing Distribution Grids by introducing more active elements combined with the necessary control and distributed coordination mechanisms. To this end INERTIA will adopt the Internet of Things/Services principles to the Distribution Grid Control Operations. 2014.09.01 Engineering and technology

Environmental engineering
Energy and fuels

Pre-production Wiki page
Instituto de Astrofísica de Andalucía Calibration, Analysis and Modelling of Radio-Astronomy Data: Data Development of a calibration pipeline for LOFAR data 2014.10.06 Natural sciences

Phisical sciences Astronomy

Test & Integration Wiki page
Instituto de Astrofísica de Andalucía Calibration, Analysis and Modelling of Radio-Astronomy Data: Modelling of the kinematic of galaxies (GIPSY) 2014.10.06 Natural sciences

Phisical sciences Astronomy

Test & Integration Wiki page
KNMI CLIPCE. 2015.02.01 Natural sciences

Earth sciences Climate research

Preparatory Wiki page
VERCE Deploy a service that utilizes Cloud resources to offer simplified execution of data pre- and post-processing scripts. It offers users access to the ObsPy seismological toolbox for processing data with the Python programming language, executed on virtual Cloud resources in a secured sandbox. 2013 Natural sciences

Earth sciences Seismology

Preparatory Wiki page


Closed Use Cases

The following table shows the use cases in Closed status phase. These use cases are related to the communities that tested the EGI Federated Cloud but that are not decided yet to use it for production aims. Use cases related to the adoption of EGI Federated Cloud services by other communities are also inserted in this table. An outcome for each use case is available.

Community Description Scientific discipline Outcome Further information
ELIXIR Access to EGI Cloud Marketplace via EBI IdP Natural sciences

Biological sciences Bioinformatics

The EGI AppDB authentication system has been extended to support the Elixir/EBI’s Identity Provider. Wiki page
ENVRI Data access, catalog and dissemination (EISCAT 3D) Natural sciences

Phisical sciences Space science

In this proof-of-concept the OSGC software was deployed on the EGI Federated Cloud. OSGC is an Open Source implementation of an OpenSearch GeoSpatial Catalogue compliant to OGC 10-32r3 specification, developed by EGI.eu (http://www.egi.eu/) under the ENVRI (http://envri.eu/) project. Wiki page
ESA SSEP Data processing Natural sciences In the context of the Helix Nebula initiative, the European Space Agency organized a Proof of Concept using EGI Federated Cloud resources. The pilot proved the possibility to support the SuperSites Exploitation Platform flagship using academic resources, such as the one provided by the EGI federated cloud. An instance of the SSEP processing cluster has been instantiated into the EGI Federated cloud, on several EGI sites, connected with the SSEP processing platform and used to run test earthquakes monitoring related processing (such as SBAS and Gamma IPTA processing). SlipStream was adopted as Infrastructure broker. Wiki page
Jena University JAMS (Jena Adaptable Modelling System): run JAMS in the FedCloud Natural sciences

Earth sciences Hydrology

Aim of this proof-of-concept was the evaluation of the EGI Federated Cloud as alternative to the community computing resources to execute JAMS computation. The community already owns enough computing resources for their current needs but its workload should increase in a near future. The community was able to execute standard JAMS simulation in the EGI Federated Cloud without major issue. Wiki page
WeNMR Validating and improving biomolecular NMR structures Natural sciences

Biological sciences Structural biology

Proof of concept demonstrating the validation and improvement of biomolecular NMR structures using VirtualCing, a Virtual Machine equipped with a complex suite of ~25 programs. It was demonstrated at the Cloudscape V Workshop held in February 2013 and at the EGI CF 2013 held in April (see demostrations of VCing over the EGI Federated Cloud) Wiki page

High level tools use cases

This table lists the high-level tools integrated in the EGI Federated Cloud that have been supported as use cases.

Community Description Status Further information
Catania Science Gateway Framework It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time Production CSGF App. Broker HowTo
DIRAC VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user. Production FedCloudDIRAC
SCI-BUS Test/debug new releases of WS-PGRADE Test & Integration FedCloudWSPGRADE
Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox
Print/export