Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:WP6 Services for the Heavy User Community"

From EGIWiki
Jump to navigation Jump to search
Line 42: Line 42:
this work.
this work.


==TSA3.2 Activity Management (3yr) (Jamie Shiers, CERN)==
==TSA3.2 Shared Services and Tools (3yr) (Jamie Shiers, CERN)==
 
The services and tools within this task are already being used by multiple communities, and have been identified
as having benefit to other specific communities or the general user community. It is expected that by the end of
the project many of these services and tools will have been migrated into UMD (i.e. be supported independently
of the EGI project by an external software provider) and deployed within EGI as part of the core, supported
infrastructure. This migration will be justified by the continued adoption and use of these tools and services by
HUCs and the broader EGI user community.
 
Subtasks:
 
• TSA3.2.1 Dashboards: Dashboards provide a generic framework to monitor sites and their services within a VO
using tests specific to that community. Dashboards have emerged from within the HEP community, and are now
being adopted by the LS community, to monitor their resources.
 
• TSA3.2.2 Applications: The GANGA and DIANE tools are both part of the EGEE RESPECT programme which
recognises software that builds on top of the gLite platform. Although initially developed for the HEP community
these tools have now gained traction in other communities, as they provide simple environments to manage
large collections of tasks. The requirements of these tools will be integrated into the workplan.
 
• TSA3.2.3 Services: HYDRA and GReIC are services that have emerged from a single community that show
potential for adoption in others. HYRDA allows an encryption key to be securely stored on distributed servers
in order that storage elements can be used to store confidential data which is critical for the medical community
securely. The GReIC service provides uniform relational and non-relational access to heterogeneous data
sources and is currently being used to support bioinformatics and Earth Observation Systems.
 
• TSA3.2.4 Workflow and Schedulers: These tools are critical in integrating complex processes, generally
involving multiple data sources and different computational resources, as needed within many disciplines.
SOMA2 is a web-based workflow tool used for computational drug design and general molecular modelling.
TAVERNA is used extensively by the bioinformatics community. The combination of the Kepler workflow engine
and the Migrating Desktop platform are used by the Fusion community to run workflows requiring visualisation
and interactive access on gLite and UNICORE-enabled resources. For simpler workflows and metascheduling
scenarios the GridWay system is used by the Fusion community. Effort is provided to maintain the integration of
these tools with the different systems.
 
• TSA3.2.5 MPI: Support for parallel computing (MPI) applications are critical for many user communities but
the integration of this capability into the general infrastructure has been difficult. This task will focus on the
improvement of the core services and software needed to support MPI, while engaging with two representative
user communities (CCMST & Fusion) to ensure that the offered support meets their requirements.


==TSA3.3 Services for HEP (3yr) (Maria Girone, CERN)==
==TSA3.3 Services for HEP (3yr) (Maria Girone, CERN)==

Revision as of 12:22, 26 May 2010

Wiki page for EGI InSPIRE SA3 activities

WP6-SA3

This activity provides continued support for activities previously supported by EGEE while they transition to a sustainable support model within their own community or within the production infrastructure by: Supporting the tools, services and capabilities required by different heavy user communities (HUCs)

  • Identifying the tools, services and capabilities currently used by the HUCs that can benefit all user communities and to promote their adoption
  • Migrating the tools, services and capabilities that could benefit all user communities into a sustainable support model as part of the core EGI infrastructure
  • Establishing e a sustainable support model for the tools, services and capabilities that will remain relevant to single HUCs

Involved partners

Germany - KIT-G,
Spain - CSIC,
Finland - CSC,
France - CNRS,
Italy - INFN,
Ireland - TCD,
Poland - CYFRONET,
Slovenia - ARNES
Slovakia - UI SAV
UK - EMBL
CERN

TSA3.1 Activity Management (3yr) (Jamie Shiers, CERN)

The SA3 management is the responsibility of the Activity Manager, who reports to the UCO for the running of this activity and coordinates the work across the different tasks within the activity to meet the stated objectives. This activity will be represented in the USAG by the Activity Manager and the task leaders for the sub tasks in TSA3.2 to ensure that the services being offered to the general EGI community are meeting their needs. The domain specific activities will have their community specific mechanisms for supervision. The Activity Manager will pay particular attention to the provision of the shared services and tools task (TSA3.2) to ensure that all requests from all communities are correctly evaluated and prioritised into the work plan even if the work is being undertaken by a single community. All tasks will establish outreach and sustainability plans, and mechanisms for monitoring and gathering feedback on the delivery of their services. The work in SA3 has many benefits to other HUCs (e.g. EIRO and ESFRI) and more broadly the general DCI community. Some of the potential results from this activity include: dashboards customised to specific VOs, workflows and schedulers bridging different DCIs (e.g. DEISA, PRACE, EGI), support of MPI, frameworks for managing collections of jobs on DCIs, services for accessing relational data resources, secure data storage, visualisations tools, etc. Technical dissemination material will be generated by SA3 to inform all communities of this work.

TSA3.2 Shared Services and Tools (3yr) (Jamie Shiers, CERN)

The services and tools within this task are already being used by multiple communities, and have been identified as having benefit to other specific communities or the general user community. It is expected that by the end of the project many of these services and tools will have been migrated into UMD (i.e. be supported independently of the EGI project by an external software provider) and deployed within EGI as part of the core, supported infrastructure. This migration will be justified by the continued adoption and use of these tools and services by HUCs and the broader EGI user community.

Subtasks:

• TSA3.2.1 Dashboards: Dashboards provide a generic framework to monitor sites and their services within a VO using tests specific to that community. Dashboards have emerged from within the HEP community, and are now being adopted by the LS community, to monitor their resources.

• TSA3.2.2 Applications: The GANGA and DIANE tools are both part of the EGEE RESPECT programme which recognises software that builds on top of the gLite platform. Although initially developed for the HEP community these tools have now gained traction in other communities, as they provide simple environments to manage large collections of tasks. The requirements of these tools will be integrated into the workplan.

• TSA3.2.3 Services: HYDRA and GReIC are services that have emerged from a single community that show potential for adoption in others. HYRDA allows an encryption key to be securely stored on distributed servers in order that storage elements can be used to store confidential data which is critical for the medical community securely. The GReIC service provides uniform relational and non-relational access to heterogeneous data sources and is currently being used to support bioinformatics and Earth Observation Systems.

• TSA3.2.4 Workflow and Schedulers: These tools are critical in integrating complex processes, generally involving multiple data sources and different computational resources, as needed within many disciplines. SOMA2 is a web-based workflow tool used for computational drug design and general molecular modelling. TAVERNA is used extensively by the bioinformatics community. The combination of the Kepler workflow engine and the Migrating Desktop platform are used by the Fusion community to run workflows requiring visualisation and interactive access on gLite and UNICORE-enabled resources. For simpler workflows and metascheduling scenarios the GridWay system is used by the Fusion community. Effort is provided to maintain the integration of these tools with the different systems.

• TSA3.2.5 MPI: Support for parallel computing (MPI) applications are critical for many user communities but the integration of this capability into the general infrastructure has been difficult. This task will focus on the improvement of the core services and software needed to support MPI, while engaging with two representative user communities (CCMST & Fusion) to ensure that the offered support meets their requirements.

TSA3.3 Services for HEP (3yr) (Maria Girone, CERN)

TSA3.4 Services for LS (3yr) (Johan Montagnat, CNRS)

TSA3.5 Services for A&A (3yr) (Claudio Vuerli, INAF)

TSA3.6 Services for ES (3yr) (Horst Schwichtenberg, SCAI)