Difference between revisions of "Federated Cloud Communities"
(266 intermediate revisions by 7 users not shown) | |||
Line 1: | Line 1: | ||
{{ | {{Fedcloud_Menu}} | ||
{{FCloudCom_menubar}} | |||
{{TOC_right}} | |||
< | <big>Technical support is available via the [mailto:support@egi.eu EGI.eu Support Team]</big> | ||
== | == Introduction == | ||
This | This wiki page provides information about the user communities and use cases who are exploiting the EGI Federated Cloud infrastructure and its services. These use cases and communities collaborated (or collaborate in the past) with the EGI Federated Cloud to enable scientific applications, simulations or tools in virtualised environments. The evolution of the Federated Cloud infrastructure is driven by the requirements of these use cases and the needs of the broader scientific community and industry in the European Research Area. | ||
{|{{ | The EGI Federated Cloud User Support (FCUS) team during the porting and integration work of the use cases into the Federated Cloud, follows a well defined process described bellow. The various phases are described as well, and will be used in the next coming tables to list the [[Federated Cloud Communities#Ongoing_Use_Cases|ongoing]], [[Federated Cloud Communities#Production_Use_Cases|production]] and [[Federated Cloud Communities#Closed_Use_Cases|closed]] use cases. | ||
Use cases in a pre-assessment phase are not listed in this page. | |||
[[Image:Cloud.Use.Cases.StatusV2.PNG|center|800px|Cloud.Use.Cases.StatusV2.PNG]] | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | |||
|- | |||
! Status | |||
! class="unsortable" | Description | |||
|- | |||
| Pre-assessment | |||
| FCUS members identified a potential use case that can profit from the EGI Federated Cloud services | |||
|- | |||
| Assessed | |||
| The use case requirements are assessed with relevant information added to a dedicated wiki page, to manage the full porting & integration process | |||
|- | |||
| Preparatory | |||
| The user & FCUS team setup the environment to execute tests on the FedCloud (configuration of client environment, identify resource providers, upload vm images, ...) | |||
|- | |||
| Test & Integration | |||
| Users are accessing the FedCloud through the fedcloud.egi.eu VO to execute tests while integrate their applications to the infrastructure | |||
|- | |||
| Pre-production | |||
| Test & integration phases were successfully completed. Create a production Virtual Organization (VO) or join an already existing VO | |||
|- | |||
| Production | |||
| VO negotiate and agree on VO SLA with EGI. Use case is being used in production. The use case completed all tests and is regularly making use of the Federated Cloud using a production level VO | |||
|- | |||
| Closed | |||
| Test & integration successfully completed. Use case does not foresee moving into production. | |||
|- | |||
| Cancelled | |||
| Test & integration did not successfully completed. User cancelled the use case. | |||
|} | |||
== Production Use Cases == | |||
The following table shows the use cases in production status phase that are regularly making use of the EGI Federated Cloud using a production level VO. | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | |||
|- | |||
! Community | |||
! class="unsortable" | Description | |||
! [http://wiki.egi.eu/wiki/VT_Scientific_Discipline_Classification Scientific discipline] | |||
! VO | |||
! class="unsortable" | Sites | |||
! class="unsortable" | Further information | |||
|- | |||
| [http://www.biovel.eu/ BioVeL] | |||
| [http://portal.biovel.eu/ BioVeL Portal]: it is a browser-based interface that contains everything necessary to run users' workflow without user having to install anything on their own computer. | |||
| Natural sciences | |||
Biological sciences Biodiversity conservation | |||
| [http://operations-portal.egi.eu/vo/view/voname/biomed biomed] | |||
| [https://appdb.egi.eu/store/site/bifi BIFI], [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudBiovelPortal|Wiki page]] | |||
|- | |||
| [http://www.biovel.eu/ BioVeL] | |||
| [http://openrefine.org/ OpenRefine]: it is a powerful tool for working with messy data, cleaning it, transforming it from one format into another, extending it with web services, and linking it to databases. | |||
| Natural sciences | |||
Biological sciences Biodiversity conservation | |||
| [http://operations-portal.egi.eu/vo/view/voname/biomed biomed] | |||
| [https://appdb.egi.eu/store/site/bifi BIFI], [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudOpenRefine|Wiki page]] | |||
|- | |||
| [http://www.biovel.eu/ BioVeL] | |||
| [http://openmodeller.sourceforge.net/ OpenModeller]: The Ecological Niche Modelling (ENM) Workflow takes as input a file containing species occurrence points to create a model with the openModeller Web Service. | |||
| Natural sciences | |||
Biological sciences Biodiversity conservation | |||
| [http://operations-portal.egi.eu/vo/view/voname/biomed biomed] | |||
| [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud] | |||
| [[FedCloudOPENMODELLER|Wiki page]] | |||
|- | |||
| [http://www.biovel.eu/ BioVeL] | |||
| [https://wiki.biovel.eu/display/doc/BioVeL+Service+-+BioSTIF BioSTIF]: it is a web map application designed for the interactive visualisation of spatio-temporal data. | |||
| Natural sciences | |||
Biological sciences Biodiversity conservation | |||
| [http://operations-portal.egi.eu/vo/view/voname/biomed biomed] | |||
| [https://appdb.egi.eu/store/site/bifi BIFI], [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudBIOSTIF|Wiki page]] | |||
|- | |||
| [http://www.catania-science-gateways.it Catania Science Gateway Framework] | |||
| It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time | |||
| N/A | |||
| N/A | |||
| N/A | |||
| [[Fedcloud-tf:How to use the Catania Science Gateway Framework as Application Broker|Wiki page]] | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| [http://www.r-project.org/ R]: it is a free software environment for statistical computing and graphics. visualisation of spatio-temporal data. | |||
| Natural sciences | |||
Mathematics Statistics and probability | |||
| [http://operations-portal.egi.eu/vo/view/voname/vo.chain-project.eu vo.chain-project.eu] | |||
| [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/infn-catania-nebula INFN-CATANIA-NEBULA], [https://appdb.egi.eu/store/site/infn-catania-stack INFN-CATANIA-STACK], [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudChainR|Wiki page]] | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| [https://www.gnu.org/software/octave/ Octave]: it is a high-level interpreted language, primarily intended for numerical computations. It provides capabilities for the numerical solution of linear and nonlinear problems, and for performing other numerical experiments. It also provides extensive graphics capabilities for data visualization and manipulation. | |||
| Natural sciences | |||
Mathematics Statistics and probability | |||
| [http://operations-portal.egi.eu/vo/view/voname/vo.chain-project.eu vo.chain-project.eu] | |||
| [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/infn-catania-nebula INFN-CATANIA-NEBULA], [https://appdb.egi.eu/store/site/infn-catania-stack INFN-CATANIA-STACK], [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudChainOctave|Wiki page]] | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| tthreader | |||
| Natural sciences | |||
Biological sciences<br> Bioinformatics | |||
| [http://operations-portal.egi.eu/vo/view/voname/vo.chain-project.eu vo.chain-project.eu] | |||
| [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/infn-catania-nebula INFN-CATANIA-NEBULA], [https://appdb.egi.eu/store/site/infn-catania-stack INFN-CATANIA-STACK], [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudChainTTHREADER|Wiki page]] | |||
|- | |||
| [http://www.sysmed.uni-wuerzburg.de/ CUSM, Würzburg University] | |||
| [http://pythonhosted.org/READemption/ READemption]: RNA-seq. analysis of data to understand different biological features and behaviour. | |||
| Natural sciences | |||
Biological sciences Bioinformatics | |||
| [http://operations-portal.egi.eu/vo/view/voname/highthroughputseq.egi.eu highthroughputseq.egi.eu] | |||
| [https://appdb.egi.eu/store/site/goegrid GoeGrid], [https://appdb.egi.eu/store/site/ifca-lcg2 IFCA] | |||
| [[FedCloudRNASeq|Wiki page]] | |||
|- | |||
| [https://www.csc.fi/ CSC] / [http://www.elixir-europe.org/ ELIXIR] | |||
| [http://chipster.csc.fi/ Chipster]: it is a user-friendly analysis software for high-throughput data. It contains over 300 analysis tools for next generation sequencing (NGS), microarray, proteomics and sequence data | |||
| Natural sciences | |||
Biological sciences Bioinformatics | |||
| [http://operations-portal.egi.eu/vo/view/voname/chipster.csc.fi chipster.csc.fi] | |||
| [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudChipster|Wiki page]] | |||
|- | |||
| [http://diracgrid.org DIRAC] | |||
| VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user. | |||
| N/A | |||
| N/A | |||
| N/A | |||
| [[FedCloudDIRAC|Wiki page]] | |||
|- | |||
| [http://www.drihm.eu/ DRIHM] | |||
| Run Hydrology and Hydraulic models on the cloud | |||
| Natural sciences | |||
Earth sciences Hydrology | |||
| [http://operations-portal.egi.eu/vo/view/voname/drihm.eu drihm.eu] | |||
| [https://appdb.egi.eu/store/site/prisma-infn-bari PRISMA-INFN-BARI] | |||
| [[FedCloudDRIHM|Wiki page]] | |||
|- | |||
| [http://www.elixir-europe.org/ ELIXIR] | |||
| Access to EGI Cloud Marketplace via EBI IdP | |||
| Natural sciences | |||
Biological sciences Bioinformatics | |||
| N/A | |||
| N/A | |||
| [[FedCloudElixirAppDB|Wiki page]] | |||
|- | |||
| [http://www.ifca.es/ IFCA] | |||
| [http://cmsopendata.ifca.es/ CMS Open Data Portal]: it is a virtual environment that allows the execution for educational purposes of CMS 2010 software to analyze the Open Data available at CERN Open Data portal. | |||
| Natural sciences | |||
Physical sciences High energy physics | |||
| [http://operations-portal.egi.eu/vo/view/voname/cms cms] | |||
| [https://appdb.egi.eu/store/site/ifca-lcg2 IFCA] | |||
| [[FedCloudIFCACMSOpenDataPortal|Wiki page]] | |||
|- | |||
| [http://www.peachnote.com Peachnote] | |||
| OCR analysis in music scores | |||
| Humanities | |||
Arts Musicology | |||
| [http://operations-portal.egi.eu/vo/view/voname/peachnote.com peachnote.com] | |||
| [https://appdb.egi.eu/store/site/cesnet-metacloud CESNET-MetaCloud], [https://appdb.egi.eu/store/site/fzj FZJ] | |||
| [[FedCloudPeachnote|Wiki page]] | |||
|} | |||
== Use Cases under development == | |||
The following table shows the use cases from assessed to pre-production status phases. | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | |||
|- | |||
! Community | |||
! class="unsortable" | Description | |||
! Registration date | |||
! [http://wiki.egi.eu/wiki/VT_Scientific_Discipline_Classification Scientific discipline] | |||
! Status | |||
! class="unsortable" | Further information | |||
|- | |||
| [http://edu.univ-amu.fr/en Aix Marseille Universite] | |||
| [http://rsat.ulb.ac.be/ RSAT] (Regulatory Sequence Analysis Tools): it provides a series of modular computer programs specifically designed for the detection of regulatory signals in non-coding sequences. | |||
| 2014.10.08 | |||
| Natural sciences | |||
Biological sciences Other | |||
| Preparatory | |||
| [[FedCloudRSAT|Wiki page]] | |||
|- | |||
| [https://bils.se/ BILS] | |||
| [https://portal.bils.se/ BILS portal]: front-end to biological tools for not IT skilled users. | |||
| 2014.10.31 | |||
| Natural sciences | |||
Biological sciences | |||
| Preparatory | |||
| [[FedCloudBILSPortal|Wiki page]] | |||
|- | |||
| [https://bils.se/ BILS] | |||
| [http://c2.pcons.net/ PConsC2]: tools for protein structure prediction. | |||
| 2014.10.31 | |||
| Natural sciences | |||
Biological sciences | |||
Bioinformatics | |||
| Test & Integration | |||
| [[FedCloudBILSPConsC2|Wiki page]] | |||
|- | |||
| [https://bils.se/ BILS] | |||
| Genome Annotation service: genome brower to run genome annotation pipeline. | |||
| 2014.10.31 | |||
| Natural sciences | |||
Biological sciences | |||
Bioinformatics | |||
| Preparatory | |||
| [[FedCloudBILSGenomeAnnotation|Wiki page]] | |||
|- | |||
| [https://bils.se/ BILS] | |||
| TOPCons2: Membrane topology prediction web-server. | |||
| 2014.10.31 | |||
| Natural sciences | |||
Biological sciences | |||
Bioinformatics | |||
| Test & Integration | |||
| [[FedCloudBILSTOPCons2|Wiki page]] | |||
|- | |||
| [http://www.biovel.eu/ BioVeL] | |||
| [https://wiki.biovel.eu/display/doc/EDIT+Name+Catalogue EDIT]: it is a portal to access/visualize Catalogue of Life taxonomy data | |||
| 2013 | |||
| Natural sciences | |||
Biological sciences Biodiversity conservation | |||
| Assessed | |||
| [[FedCloudEdit|Wiki page]] | |||
|- | |||
| [http://www.bsimsquare.com/ BSIM2] | |||
| Proof of Concept and optimization of data workflow | |||
| 2014.04.12 | |||
| Natural sciences | |||
Biological sciences | |||
| Assessed | |||
| [[FedCloudBSIM2|Wiki page]] | |||
|- | |||
| [http://atlas.ch/ CERN ATLAS] | |||
| Run a cluster on-demand on the cloud to absorb peaks from ATLAS grid. | |||
| 2013 | |||
| Natural sciences | |||
Phisical sciences High energy physics | |||
| Test & Integration | |||
| [[FedCloudAtlasSlipstream|Wiki page]] | |||
|- | |||
| [http://atlas.ch/ CERN ATLAS] | |||
| Run ATLAS jobs on the EGI FedCloud through Vac/Vcycle | |||
| 2014.10.15 | |||
| Natural sciences | |||
Phisical sciences<br> High energy physics | |||
| Pre-production | |||
| [[FedCloudAtlasVCycle|Wiki page]] | |||
|- | |||
| [http://atlas.ch/ CERN CMS] | |||
| Run CMS jobs on the EGI FedCloud through Vac/Vcycle | |||
| 2014.12.17 | |||
| Natural sciences | |||
Phisical sciences<br> High energy physics | |||
| Pre-production | |||
| [[FedCloudCMSVCycle|Wiki page]] | |||
|- | |||
| [http://lhcb.web.cern.ch/lhcb/ CERN LHCb] | |||
| Run LHCb jobs on the EGI FedCloud through Vac/Vcycle | |||
| 2014.11.19 | |||
| Natural sciences | |||
Phisical sciences<br> High energy physics | |||
| Pre-production | |||
| [[FedCloudLHCbVCycle|Wiki page]] | |||
|- | |||
| [http://cernatschool.web.cern.ch/ CERN@School] | |||
| CERN@school is a programme that brings CERN into the classroom. The cernatschool.org VO would use the EGI Federated Cloud to give users in facilities without access to a research-grade IT infrastructure access to the tools they need for analysing and storing data collected by CERN@school projects using the Timepix hyrbid silicon pixel detectors. | |||
| 2014.04.20 | |||
| Natural sciences | |||
Phisical sciences<br> High energy physics | |||
| Pre-production | |||
| [[FedCloudCERNATSCHOOL|Wiki page]] | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| [http://www.wrf-model.org/index.php WRF] (weather research forecast): it is a next-generation mesoscale numerical weather prediction system designed to serve both atmospheric research and operational forecasting needs. | |||
| 2013 | |||
| Natural sciences | |||
Earth sciences Atmospheric science | |||
| Test & Integration | |||
| [[FedCloudChainWRF|Wiki page]] | |||
<!-- | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| [http://www.r-project.org/ R]: it is a free software environment for statistical computing and graphics. | |||
| 2013 | |||
| Natural sciences | |||
Mathematics Statistics and probability | |||
| Pre-production | |||
| [[FedCloudChainR|Wiki page]] | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| [https://www.gnu.org/software/octave/ Octave]: it is a high-level interpreted language, primarily intended for numerical computations. It provides capabilities for the numerical solution of linear and nonlinear problems, and for performing other numerical experiments. It also provides extensive graphics capabilities for data visualization and manipulation. | |||
| 2013 | |||
| Natural sciences | |||
Mathematics Applied mathematics | |||
| Pre-production | |||
| [[FedCloudChainOctave|Wiki page]] | |||
--> | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| [http://aleph.web.cern.ch/aleph/ ALEPH]: it was a particle physics experiment installed on the Large Electron-Positron collider (LEP) at the CERN laboratory in Geneva/Switzerland. | |||
| 2014.11.17 | |||
| Natural sciences | |||
Phisical sciences<br> High energy physics | |||
| Test & Integration | |||
| [[FedCloudChainALEPH|Wiki page]] | |||
<!-- | |||
|- | |||
| [http://www.chain-project.eu/ CHAIN-REDS] | |||
| tthreader | |||
| 2015.01.15 | |||
| Natural sciences | |||
Biological sciences<br> Bioinformatics | |||
| Pre-production | |||
| [[FedCloudChainTTHREADER|Wiki page]] | |||
--> | |||
|- | |||
| [http://www.lf1.cuni.cz/en Charles University in Prague - First Faculty of Medicine] | |||
| [http://www.physiovalues.org/ Physiome project]: Project of web application to compute, store and provide values of parameters of physiological models via lightweight API. | |||
| 2014.05.29 | |||
| Medical and Health Sciences | |||
Basic medicine Physiology | |||
| Assessed | |||
| [[FedCloudPhysiome|Wiki page]] | |||
|- | |||
| [http://www.clarin.eu CLARIN ERIC] | |||
| Virtual Language Observatory. | |||
| 2015.02.01 | |||
| Humanities | |||
Languages and literature | |||
Linguistics | |||
| Assessed | |||
| [[FedCloudCLARIN|Wiki page]] | |||
|- | |||
| [http://www.cnr.it CNR] | |||
| Satellite Data. | |||
| 2015.02.01 | |||
| Natural Sciences | |||
Earth Sciences | |||
Physical geography | |||
| Assessed | |||
| [[FedCloudCNR-SatelliteData|Wiki page]] | |||
|- | |||
| [http://www.cnr.it CNR] / [http://www.eng.it/home/home-eng.dot Engineering] | |||
| D4Science/i-Marine. | |||
| 2015.03.01 | |||
| Natural Sciences | |||
Biological Sciences | |||
Ecology | |||
| Assessed | |||
| [[FedCloudCNR-D4Science|Wiki page]] | |||
<!-- | |||
|- | |||
| [https://www.csc.fi/ CSC] / [http://www.elixir-europe.org/ ELIXIR] | |||
| [http://chipster.csc.fi/ Chipster]: it is a user-friendly analysis software for high-throughput data. It contains over 300 analysis tools for next generation sequencing (NGS), microarray, proteomics and sequence data | |||
| 2014.08.01 | |||
| Natural sciences | |||
Biological sciences Bioinformatics | |||
| Test & Integration | |||
| [[FedCloudChipster|Wiki page]] | |||
--> | |||
|- | |||
| [https://curoverse.com/ Curoverse] | |||
| [https://curoverse.com/technology Arvados]: integrate Arvados platform in the EGI Federated Cloud | |||
| 2014.08.01 | |||
| Natural sciences | |||
Biological sciences | |||
Bioinformatics | |||
| Test & Integration | |||
| [[FedCloudArvados|Wiki page]] | |||
|- | |||
| [http://www.dch-rp.eu/ DCH-RP] / [http://www.eng.it/home/home-eng.dot Engineering] | |||
| Deploy [http://int-platform.digitalpreserve.info/dashboard/happi-toolkit/ SCIDIP-ES HAPPI Toolkit] in the EGI Federated Cloud for the DCH-RP community. The HAPPI toolkit supports the archive manager and curator to capture and manage part of the Preservation Descriptive Information (PDI). | |||
| 2014.07.08 | |||
| Support activities | |||
Digital archives | |||
| Pre-production | |||
| [[FedCloudHAPPI|Wiki page]] | |||
|- | |||
| [http://www.dch-rp.eu/ DCH-RP] | |||
| Long term preservation in the cloud | |||
| 2014.03.12 | |||
| Support activities | |||
Digital archivies | |||
| Preparatory | |||
| [[FedCloudDCHRP|Wiki page]] | |||
|- | |||
| [http://www.ugr.es/~fteorica/ Departamento de física teórica y del cosmos, Universidad de Granada] | |||
| [https://www.auger.org/ Auger]: running CORSIKA and OFFLINE in the EGI Federated Cloud. | |||
| 2015.03.03 | |||
| Natural sciences | |||
Physical sciences | |||
Astroparticle physics | |||
| Pre-production | |||
| [[FedCloudAUGER|Wiki page]] | |||
<!-- | |||
|- | |||
| [http://www.drihm.eu/ DRIHM] | |||
| Run Hydrology and Hydraulic models on the cloud | |||
| 2014.06.18 | |||
| Natural sciences | |||
Earth sciences Hydrology | |||
| Test & Integration | |||
| [[FedCloudDRIHM|Wiki page]] | |||
--> | |||
|- | |||
| [http://www.epos-eu.org/ EPOS] | |||
| Download datasets from TCSs through ICS. | |||
| 2015.03.01 | |||
| Natural Sciences | |||
Earth Sciences | |||
| Assessed | |||
| [[FedCloudEPOS-AAI|Wiki page]] | |||
|- | |||
| [http://www.epos-eu.org/ EPOS] | |||
| MISFIT/VERCE application. | |||
| 2015.03.01 | |||
| Natural Sciences | |||
Earth Sciences | |||
Volcanology | |||
| Assessed | |||
| [[FedCloudEPOS-MISFIT|Wiki page]] | |||
|- | |||
| [http://www.esa.int/ESA ESA] | |||
| Stimulus Project. | |||
| 2015.04.27 | |||
| Natural Sciences | |||
Physical Sciences | |||
Space Sciences | |||
| Assessed | |||
| [[FedCloudESA-Stimulus|Wiki page]] | |||
|- | |||
| [http://www.harness-project.eu/ HARNESS] | |||
| The HARNESS project is developing a new generation of cloud computing platforms that integrate heterogeneous hardware resources to provide vastly increased performance with reduced energy consumption and lower cost. HARNESS would like to organise training events using FedCloud resources | |||
| 2014.10.06 | |||
| Natural sciences | |||
Computer sciences Distributed Computing | |||
| Assessed | |||
| [[FedCloudHarnessTraining|Wiki page]] | |||
|- | |||
| [http://www.harness-project.eu/ HARNESS] | |||
| The HARNESS project developed a PaaS to better exploit cloud resources. Aim of this use case is deploying the HARNESS PaaS on the EGI Federated Cloud to make it available for EGI users. | |||
| 2014.10.06 | |||
| Natural sciences | |||
Computer sciences Distributed Computing | |||
| Assessed | |||
| [[FedCloudHarnessPaaS|Wiki page]] | |||
|- | |||
| [http://www.ifca.es/ IFCA] | |||
| Hydrodynamic modeling using EGI FedCloud | |||
| 2014.09.25 | |||
| Natural sciences | |||
Earth sciences Hydrology | |||
| Test & Integration | |||
| [[FedCloudIFCAHydrodynamic|Wiki page]] | |||
|- | |||
| [http://www.ifca.es/ IFCA] | |||
| Water Quality modeling using EGI FedCloud | |||
| 2014.11.06 | |||
| Natural sciences | |||
Biological sciences Ecology | |||
| Test & Integration | |||
| [[FedCloudIFCAWaterQuality|Wiki page]] | |||
<!-- | |||
|- | |||
| [http://www.ifca.es/ IFCA] | |||
| [http://cmsopendata.ifca.es/ CMS Open Data Portal]: it is a virtual environment that allows the execution for educational purposes of CMS 2010 software to analyze the Open Data available at CERN Open Data portal. | |||
| 2014.11.20 | |||
| Natural sciences | |||
Physical sciences High energy physics | |||
| Test & Integration | |||
| [[FedCloudIFCACMSOpenDataPortal|Wiki page]] | |||
--> | |||
|- | |||
| [http://www.ifca.es/ IFCA] | |||
| [https://trufa.ifca.es/ TRUFA] (Transcriptomes User-Friendly Analysis): it is a free webserver designed to perform RNA-seq analysis. | |||
| 2014.08.01 | |||
| Natural sciences | |||
Biological sciences Evolutionary biology | |||
| Assessed | |||
| [[FedCloudTRUFA|Wiki page]] | |||
|- | |||
| [http://www.inertia-project.eu INERTIA] / [http://www.eng.it/home/home-eng.dot Engineering] | |||
| The [http://www.inertia-project.eu/inertia/ INERTIA project] addresses the "structural inertia" of existing Distribution Grids by introducing more active elements combined with the necessary control and distributed coordination mechanisms. To this end INERTIA will adopt the Internet of Things/Services principles to the Distribution Grid Control Operations. | |||
| 2014.09.01 | |||
| Engineering and technology | |||
Environmental engineering<BR> Energy and fuels | |||
| Pre-production | |||
| [[FedCloudINERTIA|Wiki page]] | |||
|- | |||
| [http://www.iaa.es/ Instituto de Astrofísica de Andalucía] | |||
| Calibration, Analysis and Modelling of Radio-Astronomy Data: Data Development of a calibration pipeline for LOFAR data | |||
| 2014.10.06 | |||
| Natural sciences | |||
Phisical sciences Astronomy | |||
| Test & Integration | |||
| [[FedCloudLOFAR|Wiki page]] | |||
|- | |||
| [http://www.iaa.es/ Instituto de Astrofísica de Andalucía] | |||
| Calibration, Analysis and Modelling of Radio-Astronomy Data: Modelling of the kinematic of galaxies (GIPSY) | |||
| 2014.10.06 | |||
| Natural sciences | |||
Phisical sciences Astronomy | |||
| Test & Integration | |||
| [[FedCloudGIPSY|Wiki page]] | |||
|- | |||
| [http://www.knmi.nl/index_en.html KNMI] | |||
| CLIPCE. | |||
| 2015.02.01 | |||
| Natural sciences | |||
Earth sciences | |||
Climate research | |||
| Preparatory | |||
| [[FedCloudCLIPCE|Wiki page]] | |||
|- | |- | ||
| [http://www.verce.eu/ VERCE] | |||
| Deploy a service that utilizes Cloud resources to offer simplified execution of data pre- and post-processing scripts. It offers users access to the [https://github.com/obspy/obspy/wiki ObsPy] seismological toolbox for processing data with the Python programming language, executed on virtual Cloud resources in a secured sandbox. | |||
| 2013 | |||
| Natural sciences | |||
! | Earth sciences Seismology | ||
| Preparatory | |||
| [[FedCloudVERCE|Wiki page]] | |||
|} | |||
<!-- Use cases in pre-assessment - not public yet | |||
|- | |- | ||
| [http:// | | [http://carelliance.com/ Carelliance] | ||
| | | Carelliance is offering a managed service using Arvados platform to healthcare and bioinformatics customers in the Netherlands. They wants to run this service in the FedCloud | ||
| 2014.07.28 | |||
| | |||
| | | | ||
| Pre-assessment | |||
| [[FedCloudCarelliance]] | |||
--> <!-- | |||
|- | |- | ||
| [http:// | | (initial suggestion made from Konrad (READemption), also ELIXIR mentioned it) | ||
| | | [http://cloudbiolinux.org/ CloudBioLinux] | ||
| | | | ||
| | |||
| Pre-assessment | |||
| | |||
| | | | ||
--> <!-- | |||
|- | |- | ||
| | | Ciops/Terradue | ||
| | | Analyse datasets on VM | ||
| | | | ||
| | |||
| | | Pre-assessment | ||
| | | | ||
--> <!-- | |||
|- | |- | ||
| [http:// | | [http://www.lifewatch.eu/ LifeWatch] | ||
| | | eLaboratory for Biodiversity based on VMI | ||
| | | | ||
| | | | ||
| Pre-assessment | |||
| | |||
| | | | ||
--> <!-- | |||
|- | |- | ||
| [http://verce.eu/ VERCE] | | [http://verce.eu/ VERCE] | ||
| | | Submitting VERCE Jobs through DCI-Bridge of gUse/SCI-BUS | ||
| | | | ||
| | | | ||
| Pre-assessment | |||
| [[FedCloudVERCE]] | |||
|- | --> <!-- | ||
| [ | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | {| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | ||
|- | |- | ||
Line 119: | Line 645: | ||
| [http://www.dch-rp.eu/ DCH-RP] | | [http://www.dch-rp.eu/ DCH-RP] | ||
| Digital Cultural Heritage Roadmap for Preservation (DCH-RP) coordination action aims to look at best practices for preservation standards. The use case wants to run a set of data preservation services at the EGI Federated Cloud. | | Digital Cultural Heritage Roadmap for Preservation (DCH-RP) coordination action aims to look at best practices for preservation standards. The use case wants to run a set of data preservation services at the EGI Federated Cloud. | ||
| | | | ||
|- | |- | ||
| [http://www.drihm.eu/ DRHIM] | | [http://www.drihm.eu/ DRHIM] | ||
Line 132: | Line 658: | ||
| INERTIA project addresses the "structural inertia" of existing Distribution Grids by introducing more active elements combined with the necessary control and distributed coordination mechanisms. To this end INERTIA will adopt the Internet of Things/Services principles to the Distribution Grid Control Operations. A set of use cases will be explored inside the Federated Cloud. | | INERTIA project addresses the "structural inertia" of existing Distribution Grids by introducing more active elements combined with the necessary control and distributed coordination mechanisms. To this end INERTIA will adopt the Internet of Things/Services principles to the Distribution Grid Control Operations. A set of use cases will be explored inside the Federated Cloud. | ||
| [[FedCloudINERTIA]] | | [[FedCloudINERTIA]] | ||
|- | |||
| [http://www.peachnote.com Peachnote] | |||
| Peachnote.com is a music score search engine and analysis platform. The system is the first of its kind and can be thought as an analog of Google Books Ngram Viewer and Google Books search for music scores. | |||
| [[FedCloudPeachnote]] | |||
|- | |||
| [http://www.physiovalues.org Physiome] | |||
| Project of web application to compute, store and provide values of parameters of physiological models via lightweight API. The goal is to run on the EGI Federated Cloud a system to support modelling of physiological systems in the phase of calibrating model parameters and in the phase of simulating different scenarios. | |||
| [[FedCloudPhysiome]] | |||
|- | |||
| [https://trufa.ifca.es/web TRUFA] | |||
| TRUFA (Transcriptomes User-Friendly Analysis) is a webserver designed to help researchers in genomics to perform de novo RNA-seq analysis. The goal is to exploit Cloud Federation resources from the TRUFA portal. | |||
| [[FedCloudTRUFA]] | |||
|- | |||
| [http://verce.eu/ VERCE] | |||
| VERCE supports earthquake and seismology research, which ultimately addresses fundamental problems in understanding the Earth's internal wave sources and properties, thereby aiding society in the management of natural hazards, energy resources, environmental changes, and national security. VERCE wants to evaluate the EGI Federated Cloud capabilities for data analysis and post-processing. | |||
| [[FedCloudVERCE]] | |||
|} | |} | ||
--> | |||
== Closed Use Cases == | |||
The following table shows the use cases in Closed status phase. These use cases are related to the communities that tested the EGI Federated Cloud but that are not decided yet to use it for production aims. Use cases related to the adoption of EGI Federated Cloud services by other communities are also inserted in this table. An outcome for each use case is available. | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | |||
|- | |||
! Community | |||
! class="unsortable" | Description | |||
! class="unsortable" | [http://wiki.egi.eu/wiki/VT_Scientific_Discipline_Classification Scientific discipline] | |||
! class="unsortable" | Outcome | |||
! class="unsortable" | Further information <!-- | |||
|- | |||
| [http://clarin.eu/ CLARIN] | |||
| BNCWeb: scalable ‘British National Corpus’ service | |||
| Humanities | |||
Languages and literature | |||
Linguistics | |||
| | |||
| [[FedCloudBNCweb| Wiki page]] | |||
|- | |||
| [http://www.cranfield.ac.uk/ Cranfield University] | |||
| Exploit the FedCloud capabilities to study resource allocation and scheduling algorithms for federated cloud systems | |||
| Natural sciences | |||
Computer sciences | |||
Distributed computing | |||
| | |||
| [[FedCloudCranfield| Wiki page]] | |||
--> | |||
|- | |||
| [http://www.elixir-europe.org/ ELIXIR] | |||
| Access to EGI Cloud Marketplace via EBI IdP | |||
| Natural sciences | |||
Biological sciences Bioinformatics | |||
| The [https://appdb.egi.eu/ EGI AppDB] authentication system has been extended to support the [https://idp.ebi.ac.uk/idp/Authn/UserPassword Elixir/EBI’s Identity Provider]. | |||
| [[FedCloudElixirAppDB|Wiki page]] | |||
|- | |||
| [http://envri.eu/ ENVRI] | |||
| Data access, catalog and dissemination (EISCAT 3D) | |||
| Natural sciences | |||
Phisical sciences Space science | |||
| In this proof-of-concept the [http://sourceforge.net/projects/osgcat/ OSGC] software was deployed on the EGI Federated Cloud. OSGC is an Open Source implementation of an OpenSearch GeoSpatial Catalogue compliant to OGC 10-32r3 specification, developed by EGI.eu (http://www.egi.eu/) under the ENVRI (http://envri.eu/) project. | |||
| [[EGI ENVRI|Wiki page]] | |||
|- | |||
| [http://www.esa.int/ ESA] | |||
| SSEP Data processing | |||
| Natural sciences | |||
| In the context of the [http://www.helix-nebula.eu/ Helix Nebula] initiative, the European Space Agency organized a Proof of Concept using EGI Federated Cloud resources. The pilot proved the possibility to support the [https://wiki.services.eoportal.org/tiki-index.php?page=SSEP SuperSites Exploitation Platform] flagship using academic resources, such as the one provided by the EGI federated cloud. An instance of the SSEP processing cluster has been instantiated into the EGI Federated cloud, on several EGI sites, connected with the SSEP processing platform and used to run test earthquakes monitoring related processing (such as [http://www.irea.cnr.it/index.php?option=com_k2&view=item&id=97:sbas&Itemid=127 SBAS] and [http://www.gamma-rs.ch/software/ipta-interferometric-point-target-analysis Gamma IPTA] processing). [http://sixsq.com/products/slipstream.html SlipStream] was adopted as Infrastructure broker. | |||
| [[FedCloudESAPoC|Wiki page]] | |||
|- | |||
| [http://www.uni-jena.de Jena University] | |||
| JAMS (Jena Adaptable Modelling System): run JAMS in the FedCloud | |||
| Natural sciences | |||
Earth sciences Hydrology | |||
| Aim of this proof-of-concept was the evaluation of the EGI Federated Cloud as alternative to the community computing resources to execute JAMS computation. The community already owns enough computing resources for their current needs but its workload should increase in a near future. The community was able to execute standard JAMS simulation in the EGI Federated Cloud without major issue. | |||
| [[FedCloudJAMSPoC|Wiki page]] | |||
|- | |||
| [http://wenmr.eu/ WeNMR] | |||
| Validating and improving biomolecular NMR structures | |||
| Natural sciences | |||
Biological sciences Structural biology | |||
| Proof of concept demonstrating the validation and improvement of biomolecular NMR structures using VirtualCing, a Virtual Machine equipped with a complex suite of ~25 programs. It was demonstrated at the Cloudscape V Workshop held in February 2013 and at the EGI CF 2013 held in April (see [https://documents.egi.eu/public/ShowDocument?docid=1593 demostrations of VCing over the EGI Federated Cloud]) | |||
| [[FedCloudWeNMR|Wiki page]] | |||
|} | |||
<!-- | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | {| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | ||
|- | |- | ||
Line 159: | Line 758: | ||
| BNCWeb is an interface to the British National Corpus, being a key reference work in English studies, linguistics and language teaching and is widely used in a wide variety of computational linguistic applications. The use case aims to offer BNCWeb services via EGI FedCloud. | | BNCWeb is an interface to the British National Corpus, being a key reference work in English studies, linguistics and language teaching and is widely used in a wide variety of computational linguistic applications. The use case aims to offer BNCWeb services via EGI FedCloud. | ||
| [[FedCloudBNCweb]] | | [[FedCloudBNCweb]] | ||
|- | |- | ||
| [https://www.wenmr.eu WeNMR] | | [https://www.wenmr.eu WeNMR] | ||
| | | WeNMR community provides the user community with a platform integrating and streamlining the computational approaches necessary for NMR/SAXS data analysis and structural modelling. A set of use cases aim to explore cloud resources to run molecular dynamics simulations for educational purpose, and to port VirtualCing suite of program to the cloud. | ||
| [[FedCloudWeNMR]] | | [[FedCloudWeNMR]] | ||
|- | |- | ||
| [http://www.cranfield.ac.uk/ Cranfield University] | | [http://www.cranfield.ac.uk/ Cranfield University] | ||
Line 187: | Line 778: | ||
| FTK – Research Institute for Telecommunication and Cooperation – consists of a team with broad and profound expertise in various fields such as consulting, research, information, innovation- and project management, event organisation and web development. FTK would like to evaluate the EGI Federated Cloud capabilities. | | FTK – Research Institute for Telecommunication and Cooperation – consists of a team with broad and profound expertise in various fields such as consulting, research, information, innovation- and project management, event organisation and web development. FTK would like to evaluate the EGI Federated Cloud capabilities. | ||
| [[FedCloudFTK]] | | [[FedCloudFTK]] | ||
|- | |||
| [http://jams.uni-jena.de/ JAMS] | |||
| Jena Adaptable Modelling System (JAMS) is an java-based, open-source software platform that has been especially designed to address the demands of a process-based hydrological model development and various aspects of model application. The use case was to run JAMS on the EGI Federated Cloud. | |||
| [[FedCloudJAMSPoC]] | |||
|- | |||
| [http://pythonhosted.org/READemption/ READemption] | |||
| READemption is a pipeline for the computational evaluation of RNA-Seq data. The use case consists in running the analysis workflow on the EGI Cloud Federation. | |||
| [[FedCloudRNASeq]] | |||
|- | |||
| [https://guse.sztaki.hu/liferay-portal-6.0.5/ WS-PGRADE] | |||
| WS-PGRADE is a portal environment for the development, execution and monitoring of workflows and workflow based parameter studies on different Distributed Computing Infrastructures (DCI). WS-PGRADE wants to exploit the cloud for software testing and debugging. | |||
| [[FedCloudWSPGRADE]] | |||
|} | |} | ||
--> <!-- | |||
<!-- | |||
These entries are already included in one of the tables above: on going, or completed! | These entries are already included in one of the tables above: on going, or completed! | ||
{|{{Egi-table}} | |||
|- | |||
! Project or Application | |||
! Description | |||
! Use Cases | |||
! Further information | |||
! Contacts | |||
|} | |||
|- | |- | ||
| [http://www.catania-science-gateways.it Catania Science Gateway Framework] | | [http://www.catania-science-gateways.it Catania Science Gateway Framework] | ||
Line 361: | Line 964: | ||
* EGI: Diego Scardaci (diego.scardaci@egi.eu) | * EGI: Diego Scardaci (diego.scardaci@egi.eu) | ||
* Engineering: Giampaolo Fiorentino (giampaolo.fiorentino@eng.it), Luigi Briguglio (luigi.briguglio@eng.it) | * Engineering: Giampaolo Fiorentino (giampaolo.fiorentino@eng.it), Luigi Briguglio (luigi.briguglio@eng.it) | ||
--> | |||
|- | |||
| [http://jams.uni-jena.de/ Jena Adaptable Modelling System (JAMS)] | |||
| JAMS is an java-based, open-source software platform that has been especially designed to address the demands of a process-based hydrological model development and various aspects of model application (https://appdb.egi.eu/store/software/jams). | |||
JAMS is a framework to build up complex models out of simple components. Several hydrological models were implemented within JAMS (e.g. J2000, J2000g). Usually those models are applied to simulate hydrological dynamics in catchments with a size of 1km² to 100,000 km² in a temporal time step of hours to months. Typically, the computing time of a single model run is in the range from minutes to hours (on a single workstation). However, those models have many parameters, which must be estimated indirectly during a calibration process. For model calibration an evolutionary optimization algorithms was adopted, which evaulate the model several thousand times. Therefore this calibration process takes days to weeks on a single workstation. To speed up this process, we implemented a thread-based parallelization in JAMS. This thread-based parallelization is used for example to evaluated several parameter combinations in parallel during optimization. The model calibration is carried out frequently. Sometimes more than 10 times a week. | |||
| | |||
* Use Case: run JAMS on the EGI Federated Cloud | |||
| [[FedCloudJAMSPoC]] | |||
| | |||
* JAMS: Christian Fischer (christian.fischer.2@uni-jena.de) - Department of Geoinformatics, Hydrology and Modelling of Friedrich Schiller University Jena | |||
* EGI: Diego Scardaci (diego.scardaci@egi.eu) | |||
|- | |||
| [http://www.peachnote.com Peachnote] | |||
| Peachnote.com is a music score search engine and analysis platform. The system is the first of its kind and can be thought as an analog of Google Books Ngram Viewer and Google Books search for music scores. Peachnote provides visitors and researchers access to a massive amount of symbolic music data. | |||
| | |||
* Use Case 1: the ability to upload and start a prepared VMware VM. The VM has only to be able to make outbound connections: to Amazon's SQS for job information, to HBase cluster to retrieve and store data, and to the peachnote server to regularly update the workflow code. No inbound connections are needed, which hopefully means less administrative and security concerns. | |||
* Use Case 2: the ability to run a small Hadoop and HBase cluster in the cloud. | |||
| [[FedCloudPeachnote]] | |||
| | |||
* EGI: Gergely Sipos (gergely.sipos@egi.eu), Salvatore Pinto (salvatore.pinto@egi.eu) | |||
* Peachnote: Vladimir Viro (vladimir@viro.name) | |||
|- | |||
| [http://www.physiovalues.org Physiome project] | |||
| Project of web application to compute, store and provide values of parameters of physiological models via lightweight API. The current version support model calibration. Further development will focus on storing the calibrated model parameters along with the data of real experiments and simulations and metadata of models. See [https://indico.egi.eu/indico/contributionDisplay.py?sessionId=10&contribId=51&confId=1994 slides] presented at the EGI CF 2014 for more info. | |||
| | |||
* Use Case: Run on the EGI Federated Cloud a system to support modeling of physiological systems in the phase of calibrating model parameters and in the phase of simulating different scenarios. The loosely coupled part of the system is deployed in a remote distributed computational capacity. The system capabilities is accessible via a web application and allows user to focus on experimental data, names of parameters, visual control of the calibration computation and hide unnecessary complexity of the remote subsystems computation. The data of real experiments and simulations are stored and provided for further research. | |||
| [[FedCloudPhysiome]] | |||
| | |||
* EGI: Diego Scardaci (diego.scardaci@egi.eu), Nuno Ferreira (nuno.ferreira@egi.eu) | |||
* Physiome: Tomas Kulhanek (tomas.kulhanek@lf1.cuni.cz) | |||
|- | |||
| [http://pythonhosted.org/READemption/ READemption - A RNA-Seq Analysis Pipeline] | |||
| RNA-sequencing analysis of data has performed to understand different biological features and behaviour. The research team generated a workflow based on a pipeline built to satisfy many experiments using Python 3.4, third party-libraries (numpy, pysam, matplotlib) and some external tools as segemehl and R. The running time heavily depends on the size and type of data. Usually takes some hour to some day. The workflow will be published as open source tool soon. Indeed, it’s a very common approach. | |||
| | |||
* Use Case: the use case consist to run this workflow on the EGI Federated Cloud. | |||
| [[FedCloudRNASeq]] | |||
| | |||
* EGI: Diego Scardaci (diego.scardaci@egi.eu), Salvatore Pinto (salvatore.pinto@egi.eu) | |||
* Core Unit Systems Medicine - University of Wurzburg: Konrad Foster | |||
|- | |||
| [https://trufa.ifca.es/web TRUFA - Transcriptomes User-Friendly Analysis] | |||
| TRUFA (Transcriptomes User-Friendly Analysis) is a free webserver designed to help researchers in genomics to perform de novo RNA-seq analysis. TRUFA aims to be a public service targeting a broad audience, namely comparative biology, biomedicine, bioinformatics and others. Sequencing methods are becoming cheaper and thus it is foreseeable that researchers studying models as well as non-models organisms could make use of this service. Having such pipeline ready for use will allow any biologist to perform RNA-seq analysis in a user-friendly way. | |||
| | |||
* Use Case: Exploiting FedCloud resources from the TRUFA Portal | |||
| [[FedCloudTRUFA]] | |||
| | |||
* EGI: Diego Scardaci (diego.scardaci@egi.eu), Nuno Ferreira (nuno.ferreira@egi.eu) | |||
* IFCA: Jesus Marco de Lucas (marco@ifca.unican.es) | |||
* Department of Biodiversity and Evolutionary Biology at MNCN (Museo Nacional de Ciencias Naturales, Madrid): Etienne Kornobise (ekornobis@gmail.com) | |||
|- | |||
| [http://verce.eu/ VERCE] | |||
| Earthquake and seismology research addresses fundamental problems in understanding the Earth's internal wave sources and properties, thereby aiding society in the management of natural hazards, energy resources, environmental changes, and national security. VERCE is supporting this effort by developing a data-intensive e-science environment to enable innovative data analysis and data modelling methods that fully exploit the increasing wealth of open data generated by the observational and monitoring systems of the global seismology community. | |||
| | |||
* Use Case : evaluate EGI Federated Cloud capabilities for data analysis and post-processing. | |||
| [[FedCloudVERCE]] | |||
| | |||
* EGI: Gergely Sipos (gergely.sipos@egi.eu) | |||
* VERCE: andre.gemuend@scai.fraunhofer.de | |||
|- | |||
| [https://www.wenmr.eu WeNMR] | |||
| The objective of WeNMR is to optimize and extend the use of the NMR and SAXS research infrastructures through the implementation of an e-infrastructure in order to provide the user community with a platform integrating and streamlining the computational approaches necessary for NMR and SAXS data analysis and structural modelling. | |||
| | |||
* Use Case 1: using VMs prepared with Gromacs and some other software to run MD simulations for educational purpose, possibly on multi-core VMs. | |||
* Use Case 2: validating and improving biomolecular NMR structures using VirtualCing (http://code.google.com/p/cing/wiki/VirtualCing), a VM equipped with a complex suite of ~25 programs. The cloud usage framework is based on a pilot job mechanism making use of the ToPoS (https://grid.sara.nl/wiki/index.php/Using_the_Grid/ToPoS) tool. Therefore, such a framework would naturally allow for execution of VirtualCing tasks across multiple cloud providers. Do notice that the framework is independent on the cloud access interface: it would work also with simple grid jobs, as far as the user-defined (or VO manager defined) VirtualCing VM is available at the grid site e.g. in a SE (or in the VO software area mounted by the WNs) and the grid job is allowed to start the VM. Technical details about its current implementation are available at http://code.google.com/p/cing/w/list. A live demonstration about the deployment and use of VirtualCing on the WNoDeS testbed of the INFN-CNAF computing centre has been shown at the EGI TF 2012 held in September: http://prezi.com/hrzwekguwfkx/virtualcing-cloud-demo-on-wnodes. | |||
| [[FedCloudWeNMR]] | |||
| | |||
* EGI: Nuno Ferreira (nuno.ferreira@egi.eu) | |||
* WeNRR: Marco Verlato (marco.verlato@pd.infn.it), Alexandre Bonvin (a.m.j.j.bonvin@uu.nl) | |||
|- | |||
| [https://guse.sztaki.hu/liferay-portal-6.0.5/ WS-PGRADE] | |||
| WS-PGRADE is a portal environment for the development, execution and monitoring of workflows and workflow based parameter studies on different Distributed Computing Infrastructures (DCI). | |||
| | |||
* Use Case 1: biologists, chemists simulating molecular docking by the autodock software tool are potential users of this use case. This use case gives the ability to run a small BOINC based desktop grid infrastructure as a DCI and to submit a pre-defined application (called autodock) to this DCI through the WS-PGRADE/gUSE portal as a (predefined) workflow. | |||
* Use Case 2: any scientists requiring an on-demand, scalable computing infrastructure are potential users of this use case. This use case gives the ability to run a small BOINC based desktop grid infrastructure providing virtualisation support (GBAC) on the computational resource (BOINC client). The job submission interface in this scenario is the WS-PGRADE/gUSE system where compound applications (i.e. workflows) can be easily built and executed on the BOINC based desktop grid DCI. The submitted jobs of the workflow are executed on minimal linux OS used as the virtualised environment. Scalability can be improved by attaching external (non-cloud) resources to the desktop grid server. | |||
| [[FedCloudWSPGRADE]] | |||
| | |||
* EGI: Gergely Sipos (gergely.sipos@egi.eu) | |||
* WS-PGRADE: Peter Kotcauer (peter.kotcauer@sztaki.mta.hu) | |||
--> | |||
== High level tools use cases == | |||
This table lists the high-level tools integrated in the EGI Federated Cloud that have been supported as use cases. | |||
{| cellspacing="0" cellpadding="10" border="1" class="wikitable sortable" | |||
|- | |||
! Community | |||
! class="unsortable" | Description | |||
! class="unsortable" | Status | |||
! class="unsortable" | Further information | |||
|- | |||
| [http://www.catania-science-gateways.it Catania Science Gateway Framework] | |||
| It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time | |||
| Production | |||
| [[Fedcloud-tf:How to use the Catania Science Gateway Framework as Application Broker|CSGF App. Broker HowTo]] | |||
|- | |||
| [http://diracgrid.org DIRAC] | |||
| VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user. | |||
| Production | |||
| [[FedCloudDIRAC]] | |||
|- | |||
| [http://www.sci-bus.eu/ SCI-BUS] | |||
| Test/debug new releases of WS-PGRADE | |||
| Test & Integration | |||
| [[FedCloudWSPGRADE]] | |||
|} |
Latest revision as of 17:04, 25 May 2015
Overview | For users | For resource providers | Infrastructure status | Site-specific configuration | Architecture |
Federated Cloud Communities menu: | Home • | Production use cases • | Under development use cases • | Closed use cases • | High level tools use cases |
Technical support is available via the EGI.eu Support Team
Introduction
This wiki page provides information about the user communities and use cases who are exploiting the EGI Federated Cloud infrastructure and its services. These use cases and communities collaborated (or collaborate in the past) with the EGI Federated Cloud to enable scientific applications, simulations or tools in virtualised environments. The evolution of the Federated Cloud infrastructure is driven by the requirements of these use cases and the needs of the broader scientific community and industry in the European Research Area.
The EGI Federated Cloud User Support (FCUS) team during the porting and integration work of the use cases into the Federated Cloud, follows a well defined process described bellow. The various phases are described as well, and will be used in the next coming tables to list the ongoing, production and closed use cases.
Use cases in a pre-assessment phase are not listed in this page.
Status | Description |
---|---|
Pre-assessment | FCUS members identified a potential use case that can profit from the EGI Federated Cloud services |
Assessed | The use case requirements are assessed with relevant information added to a dedicated wiki page, to manage the full porting & integration process |
Preparatory | The user & FCUS team setup the environment to execute tests on the FedCloud (configuration of client environment, identify resource providers, upload vm images, ...) |
Test & Integration | Users are accessing the FedCloud through the fedcloud.egi.eu VO to execute tests while integrate their applications to the infrastructure |
Pre-production | Test & integration phases were successfully completed. Create a production Virtual Organization (VO) or join an already existing VO |
Production | VO negotiate and agree on VO SLA with EGI. Use case is being used in production. The use case completed all tests and is regularly making use of the Federated Cloud using a production level VO |
Closed | Test & integration successfully completed. Use case does not foresee moving into production. |
Cancelled | Test & integration did not successfully completed. User cancelled the use case. |
Production Use Cases
The following table shows the use cases in production status phase that are regularly making use of the EGI Federated Cloud using a production level VO.
Community | Description | Scientific discipline | VO | Sites | Further information |
---|---|---|---|---|---|
BioVeL | BioVeL Portal: it is a browser-based interface that contains everything necessary to run users' workflow without user having to install anything on their own computer. | Natural sciences
Biological sciences Biodiversity conservation |
biomed | BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI | Wiki page |
BioVeL | OpenRefine: it is a powerful tool for working with messy data, cleaning it, transforming it from one format into another, extending it with web services, and linking it to databases. | Natural sciences
Biological sciences Biodiversity conservation |
biomed | BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI | Wiki page |
BioVeL | OpenModeller: The Ecological Niche Modelling (ENM) Workflow takes as input a file containing species occurrence points to create a model with the openModeller Web Service. | Natural sciences
Biological sciences Biodiversity conservation |
biomed | CESNET-MetaCloud | Wiki page |
BioVeL | BioSTIF: it is a web map application designed for the interactive visualisation of spatio-temporal data. | Natural sciences
Biological sciences Biodiversity conservation |
biomed | BIFI, CESNET-MetaCloud, PRISMA-INFN-BARI | Wiki page |
Catania Science Gateway Framework | It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time | N/A | N/A | N/A | Wiki page |
CHAIN-REDS | R: it is a free software environment for statistical computing and graphics. visualisation of spatio-temporal data. | Natural sciences
Mathematics Statistics and probability |
vo.chain-project.eu | CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI | Wiki page |
CHAIN-REDS | Octave: it is a high-level interpreted language, primarily intended for numerical computations. It provides capabilities for the numerical solution of linear and nonlinear problems, and for performing other numerical experiments. It also provides extensive graphics capabilities for data visualization and manipulation. | Natural sciences
Mathematics Statistics and probability |
vo.chain-project.eu | CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI | Wiki page |
CHAIN-REDS | tthreader | Natural sciences
Biological sciences |
vo.chain-project.eu | CESNET-MetaCloud, INFN-CATANIA-NEBULA, INFN-CATANIA-STACK, PRISMA-INFN-BARI | Wiki page |
CUSM, Würzburg University | READemption: RNA-seq. analysis of data to understand different biological features and behaviour. | Natural sciences
Biological sciences Bioinformatics |
highthroughputseq.egi.eu | GoeGrid, IFCA | Wiki page |
CSC / ELIXIR | Chipster: it is a user-friendly analysis software for high-throughput data. It contains over 300 analysis tools for next generation sequencing (NGS), microarray, proteomics and sequence data | Natural sciences
Biological sciences Bioinformatics |
chipster.csc.fi | PRISMA-INFN-BARI | Wiki page |
DIRAC | VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user. | N/A | N/A | N/A | Wiki page |
DRIHM | Run Hydrology and Hydraulic models on the cloud | Natural sciences
Earth sciences Hydrology |
drihm.eu | PRISMA-INFN-BARI | Wiki page |
ELIXIR | Access to EGI Cloud Marketplace via EBI IdP | Natural sciences
Biological sciences Bioinformatics |
N/A | N/A | Wiki page |
IFCA | CMS Open Data Portal: it is a virtual environment that allows the execution for educational purposes of CMS 2010 software to analyze the Open Data available at CERN Open Data portal. | Natural sciences
Physical sciences High energy physics |
cms | IFCA | Wiki page |
Peachnote | OCR analysis in music scores | Humanities
Arts Musicology |
peachnote.com | CESNET-MetaCloud, FZJ | Wiki page |
Use Cases under development
The following table shows the use cases from assessed to pre-production status phases.
Community | Description | Registration date | Scientific discipline | Status | Further information |
---|---|---|---|---|---|
Aix Marseille Universite | RSAT (Regulatory Sequence Analysis Tools): it provides a series of modular computer programs specifically designed for the detection of regulatory signals in non-coding sequences. | 2014.10.08 | Natural sciences
Biological sciences Other |
Preparatory | Wiki page |
BILS | BILS portal: front-end to biological tools for not IT skilled users. | 2014.10.31 | Natural sciences
Biological sciences |
Preparatory | Wiki page |
BILS | PConsC2: tools for protein structure prediction. | 2014.10.31 | Natural sciences
Biological sciences Bioinformatics |
Test & Integration | Wiki page |
BILS | Genome Annotation service: genome brower to run genome annotation pipeline. | 2014.10.31 | Natural sciences
Biological sciences Bioinformatics |
Preparatory | Wiki page |
BILS | TOPCons2: Membrane topology prediction web-server. | 2014.10.31 | Natural sciences
Biological sciences Bioinformatics |
Test & Integration | Wiki page |
BioVeL | EDIT: it is a portal to access/visualize Catalogue of Life taxonomy data | 2013 | Natural sciences
Biological sciences Biodiversity conservation |
Assessed | Wiki page |
BSIM2 | Proof of Concept and optimization of data workflow | 2014.04.12 | Natural sciences
Biological sciences |
Assessed | Wiki page |
CERN ATLAS | Run a cluster on-demand on the cloud to absorb peaks from ATLAS grid. | 2013 | Natural sciences
Phisical sciences High energy physics |
Test & Integration | Wiki page |
CERN ATLAS | Run ATLAS jobs on the EGI FedCloud through Vac/Vcycle | 2014.10.15 | Natural sciences
Phisical sciences |
Pre-production | Wiki page |
CERN CMS | Run CMS jobs on the EGI FedCloud through Vac/Vcycle | 2014.12.17 | Natural sciences
Phisical sciences |
Pre-production | Wiki page |
CERN LHCb | Run LHCb jobs on the EGI FedCloud through Vac/Vcycle | 2014.11.19 | Natural sciences
Phisical sciences |
Pre-production | Wiki page |
CERN@School | CERN@school is a programme that brings CERN into the classroom. The cernatschool.org VO would use the EGI Federated Cloud to give users in facilities without access to a research-grade IT infrastructure access to the tools they need for analysing and storing data collected by CERN@school projects using the Timepix hyrbid silicon pixel detectors. | 2014.04.20 | Natural sciences
Phisical sciences |
Pre-production | Wiki page |
CHAIN-REDS | WRF (weather research forecast): it is a next-generation mesoscale numerical weather prediction system designed to serve both atmospheric research and operational forecasting needs. | 2013 | Natural sciences
Earth sciences Atmospheric science |
Test & Integration | Wiki page |
CHAIN-REDS | ALEPH: it was a particle physics experiment installed on the Large Electron-Positron collider (LEP) at the CERN laboratory in Geneva/Switzerland. | 2014.11.17 | Natural sciences
Phisical sciences |
Test & Integration | Wiki page |
Charles University in Prague - First Faculty of Medicine | Physiome project: Project of web application to compute, store and provide values of parameters of physiological models via lightweight API. | 2014.05.29 | Medical and Health Sciences
Basic medicine Physiology |
Assessed | Wiki page |
CLARIN ERIC | Virtual Language Observatory. | 2015.02.01 | Humanities
Languages and literature Linguistics |
Assessed | Wiki page |
CNR | Satellite Data. | 2015.02.01 | Natural Sciences
Earth Sciences Physical geography |
Assessed | Wiki page |
CNR / Engineering | D4Science/i-Marine. | 2015.03.01 | Natural Sciences
Biological Sciences Ecology |
Assessed | Wiki page |
Curoverse | Arvados: integrate Arvados platform in the EGI Federated Cloud | 2014.08.01 | Natural sciences
Biological sciences Bioinformatics |
Test & Integration | Wiki page |
DCH-RP / Engineering | Deploy SCIDIP-ES HAPPI Toolkit in the EGI Federated Cloud for the DCH-RP community. The HAPPI toolkit supports the archive manager and curator to capture and manage part of the Preservation Descriptive Information (PDI). | 2014.07.08 | Support activities
Digital archives |
Pre-production | Wiki page |
DCH-RP | Long term preservation in the cloud | 2014.03.12 | Support activities
Digital archivies |
Preparatory | Wiki page |
Departamento de física teórica y del cosmos, Universidad de Granada | Auger: running CORSIKA and OFFLINE in the EGI Federated Cloud. | 2015.03.03 | Natural sciences
Physical sciences Astroparticle physics |
Pre-production | Wiki page |
EPOS | Download datasets from TCSs through ICS. | 2015.03.01 | Natural Sciences
Earth Sciences |
Assessed | Wiki page |
EPOS | MISFIT/VERCE application. | 2015.03.01 | Natural Sciences
Earth Sciences Volcanology |
Assessed | Wiki page |
ESA | Stimulus Project. | 2015.04.27 | Natural Sciences
Physical Sciences Space Sciences |
Assessed | Wiki page |
HARNESS | The HARNESS project is developing a new generation of cloud computing platforms that integrate heterogeneous hardware resources to provide vastly increased performance with reduced energy consumption and lower cost. HARNESS would like to organise training events using FedCloud resources | 2014.10.06 | Natural sciences
Computer sciences Distributed Computing |
Assessed | Wiki page |
HARNESS | The HARNESS project developed a PaaS to better exploit cloud resources. Aim of this use case is deploying the HARNESS PaaS on the EGI Federated Cloud to make it available for EGI users. | 2014.10.06 | Natural sciences
Computer sciences Distributed Computing |
Assessed | Wiki page |
IFCA | Hydrodynamic modeling using EGI FedCloud | 2014.09.25 | Natural sciences
Earth sciences Hydrology |
Test & Integration | Wiki page |
IFCA | Water Quality modeling using EGI FedCloud | 2014.11.06 | Natural sciences
Biological sciences Ecology |
Test & Integration | Wiki page |
IFCA | TRUFA (Transcriptomes User-Friendly Analysis): it is a free webserver designed to perform RNA-seq analysis. | 2014.08.01 | Natural sciences
Biological sciences Evolutionary biology |
Assessed | Wiki page |
INERTIA / Engineering | The INERTIA project addresses the "structural inertia" of existing Distribution Grids by introducing more active elements combined with the necessary control and distributed coordination mechanisms. To this end INERTIA will adopt the Internet of Things/Services principles to the Distribution Grid Control Operations. | 2014.09.01 | Engineering and technology
Environmental engineering |
Pre-production | Wiki page |
Instituto de Astrofísica de Andalucía | Calibration, Analysis and Modelling of Radio-Astronomy Data: Data Development of a calibration pipeline for LOFAR data | 2014.10.06 | Natural sciences
Phisical sciences Astronomy |
Test & Integration | Wiki page |
Instituto de Astrofísica de Andalucía | Calibration, Analysis and Modelling of Radio-Astronomy Data: Modelling of the kinematic of galaxies (GIPSY) | 2014.10.06 | Natural sciences
Phisical sciences Astronomy |
Test & Integration | Wiki page |
KNMI | CLIPCE. | 2015.02.01 | Natural sciences
Earth sciences Climate research |
Preparatory | Wiki page |
VERCE | Deploy a service that utilizes Cloud resources to offer simplified execution of data pre- and post-processing scripts. It offers users access to the ObsPy seismological toolbox for processing data with the Python programming language, executed on virtual Cloud resources in a secured sandbox. | 2013 | Natural sciences
Earth sciences Seismology |
Preparatory | Wiki page |
Closed Use Cases
The following table shows the use cases in Closed status phase. These use cases are related to the communities that tested the EGI Federated Cloud but that are not decided yet to use it for production aims. Use cases related to the adoption of EGI Federated Cloud services by other communities are also inserted in this table. An outcome for each use case is available.
Community | Description | Scientific discipline | Outcome | Further information |
---|---|---|---|---|
ELIXIR | Access to EGI Cloud Marketplace via EBI IdP | Natural sciences
Biological sciences Bioinformatics |
The EGI AppDB authentication system has been extended to support the Elixir/EBI’s Identity Provider. | Wiki page |
ENVRI | Data access, catalog and dissemination (EISCAT 3D) | Natural sciences
Phisical sciences Space science |
In this proof-of-concept the OSGC software was deployed on the EGI Federated Cloud. OSGC is an Open Source implementation of an OpenSearch GeoSpatial Catalogue compliant to OGC 10-32r3 specification, developed by EGI.eu (http://www.egi.eu/) under the ENVRI (http://envri.eu/) project. | Wiki page |
ESA | SSEP Data processing | Natural sciences | In the context of the Helix Nebula initiative, the European Space Agency organized a Proof of Concept using EGI Federated Cloud resources. The pilot proved the possibility to support the SuperSites Exploitation Platform flagship using academic resources, such as the one provided by the EGI federated cloud. An instance of the SSEP processing cluster has been instantiated into the EGI Federated cloud, on several EGI sites, connected with the SSEP processing platform and used to run test earthquakes monitoring related processing (such as SBAS and Gamma IPTA processing). SlipStream was adopted as Infrastructure broker. | Wiki page |
Jena University | JAMS (Jena Adaptable Modelling System): run JAMS in the FedCloud | Natural sciences
Earth sciences Hydrology |
Aim of this proof-of-concept was the evaluation of the EGI Federated Cloud as alternative to the community computing resources to execute JAMS computation. The community already owns enough computing resources for their current needs but its workload should increase in a near future. The community was able to execute standard JAMS simulation in the EGI Federated Cloud without major issue. | Wiki page |
WeNMR | Validating and improving biomolecular NMR structures | Natural sciences
Biological sciences Structural biology |
Proof of concept demonstrating the validation and improvement of biomolecular NMR structures using VirtualCing, a Virtual Machine equipped with a complex suite of ~25 programs. It was demonstrated at the Cloudscape V Workshop held in February 2013 and at the EGI CF 2013 held in April (see demostrations of VCing over the EGI Federated Cloud) | Wiki page |
High level tools use cases
This table lists the high-level tools integrated in the EGI Federated Cloud that have been supported as use cases.
Community | Description | Status | Further information |
---|---|---|---|
Catania Science Gateway Framework | It is an high-level tool (SaaS model) providing application developers with a tool to create Science Gateways (SGs) in short time | Production | CSGF App. Broker HowTo |
DIRAC | VMDIRAC is a DIRAC extension to integrate Federated Clouds in a transparent manner to the user. | Production | FedCloudDIRAC |
SCI-BUS | Test/debug new releases of WS-PGRADE | Test & Integration | FedCloudWSPGRADE |