Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "VO Services"

From EGIWiki
Jump to navigation Jump to search
(Created page with '_TOC__ = Goals = The EGI-InSPIRE project aims at supporting both “Heavy user communities” (HUC) and new emerging communities. HUC are directly supported through specific ta…')
 
 
(259 intermediate revisions by 4 users not shown)
Line 1: Line 1:
_TOC__
{{Template:Op menubar}}
{{Template:Doc_menubar}}
[[Category:Operations Documentation]]
<br />
[[File:Vo_services_logo.png|right|600px]]
{{TOC_right}}


= Goals =
= Introduction =


The EGI-InSPIRE project aims at supporting both “Heavy user communities” (HUC) and new emerging communities. HUC are directly supported through specific tasks in the SA3 activity. New emerging communities are lacking from this organization and resources, and take-off can fail if assistance is not provided. The VO Services subtask in NA3 aims at providing documentation and services to these emerging communities.  
Users of the European Grid Infrastructure are organised into Virtual Organisations (VO). A VO is a group of people who share similar interests, have similar goals, and need to work collaboratively sharing resources (e.g. data, software, expertise, CPU, storage space) regardless of their geographical location. There are already more than [http://operations-portal.egi.eu/vo <big>'''200 VOs hosted on EGI'''</big>]. Users are invited to join these VOs, or establish new ones for their own communities.  


= Documents and Protocols =
This page contains links to documents that will guide new emerging communities on selecting the services and tools they would need in the daily operation of the VO.


* Documentation and procedures
<br />
** [[Media:Setting_up_VO_Services_in_EGI_v2.pdf|Core VO services evaluation]]
= Main activities =
** [[Media:Monitoring_tools_V5.pdf|Survey on monitoring tools]]


* Operation protocols
[[File:VOServicesWikiFig1_2.png|right|400px]]
The VO services activities are summarized in four main points:
* '''Evaluation of VO and VRC support services and tools''': To identify and evaluate tools / services which could be considered valuable by VOs
* '''Provision of services and tools for VOs and VRCS''': To provide or help setting up tools / services for VOs aiming to foster production quality by VO users and VO infrastructure providers
* '''Consultancy for VO managers''': To provide consultancy services to VO managers, clarifying procedures and gathering documentation aiming to optimize the VO managers daily work.
* '''Helpdesk for VO managers''': To provide a first line support to VO managers.


= Services =
<br />
In this frame, one of the needs that new communities have is the support of core services. Among those core services, we can identify:
1. EGI central VO services. As those services already in place by the infrastructure, hold centrally and which will be automatically supported. Examples are the new VO monitoring database (evolution of CIC), accounting portals or information systems.
2. EGI distributed VO core services. Those services are set-up at the NGI level by previous agreements with users. Those services require dedicated hardware resources and continuous monitoring. Among those services we can list VOMS, WMS, LFC, PxServer, UI.
3. VO local services. Those services require lower hardware resources and are less critical and can be operated at the VO-side from the very beginning. Among them we can cite thematic Wikis, monitoring visualization portals, etc.
Resources at point 1 are provided by default by EGI-InSPIRE. Resources at point 3 are provided by the user communities. Resources at point 2 are quite critical and cannot be easily provided by the VO community.


* Catch-all services (in progress)
= Evaluation of support tools for VOs and VRCs =
** VOMS.
** WMS.
** LFC.
** PxServer.
** UI.


* Test services (in progress)
Members of VRCs and VOs should be able to assess how reliable their production infrastructure is. In order to achieve this VRCs and VO members must make use of tools that run VO specific tests on their infrastructure on a regular basis, and at same time make the results visible to all VO and/or VRC members. Such tools typically consist of multiple modules:
** VO nagios
* '''An infrastructure testing framework:''' A component that can host VO/VRC specific tests and run these tests on a regular basis on the infrastructure
* '''A monitor system:''' A system that collects test results and makes them visible for VO/VRC members
* '''An alarm system:''' A component that can raise alarms whenever a site/service/resource fails a VO-specific test. 


* Support services. The introduction of the VO Services Support Unit in GGUS will guied VO managers during the VO registration and unregistration, deploying technical services and to communicate requests in terms of service requirements.
<br />
** [https://gus.fzk.de/pages/ggus-docs/PDF/18000_FAQ_for_vo_services.pdf GGUS VO Services Support Unit FAQ]
 
The VO Service team has investigated tools and services available within the EGI community that could be adapted to multi-VO environments. The investigated tools cover areas from job management to resource monitoring. The final goal is to easy the access to those applications aiming to foster production quality by the users of a VO.
 
<br />
 
'''All communities (VRCs, VOs, NGIs, ...) are invited to recommend new tools for evaluation or share their own evaluation / experience with the VO Services team. The obvious advantage is that those surveys become available to the whole EGI community. Please contact the VO Service team via its GGUS support unit, or directly via  <big>vo-services@mailman.egi.eu</big>'''.
<br />
 
== Provision of services and tools for VOs and VRCs ==
 
There are two different kinds of tools which can be considered useful for VOs:
# global tools supported under the EGI project (operations portal, accounting portal, gocdb, ...)
# specific tools developed and supported by communities (VO, VRCs or NGIs).
<br />
 
=== Tools developed and supported by communities ===
 
<br />
 
The VO Services team already evaluated a high number of services and tools. Making use of that information the VO Services compiled a list of services and tools useful to VO and/or VRC's members. which can be consulted at:  [[VO_Services_and_Tools_Portfolio |<big>'''Services and Tools portfolio wiki page'''</big>]]
 
 
Before taking the decision of installing them under a production environment VOs should take into account the effort needed for the operation and maintenance of those tools. Three different scenarios are foreseen:
* The VO installs and operate those tools using their own resources
* The VO uses a service instance installed elsewhere during a temporary period while it gains expertise to deploy and operate the service.
* The VO makes permanent use of the tools operated elsewhere and offered as a service to the VO or VO users
<br />
 
= Consultancy for VO Managers =
 
[[File:VOServicesWikiFig2.png|right]]
 
The [[GGUS:VO_Services_FAQ |<big>'''GGUS VO Services Support Unit'''</big>]] is the official communication channel between VO managers and VO Services staff. One of its main objectives is to provide a direct link to VO managers so that they can ask for consultancy services on VO management issues, like:
 
* '''ask for help on operations through different scenarios'''
* '''provide feedback regarding specific tools and services'''
* '''discuss and assess requests and enhancements'''
 
While interacting with the VO managers, VO Services staff can involve different experts in the discussions, and bridge VO managers requests with the appropriate support units. Through the interactions with the VO managers, different requirements can also emerge. In this case, it is the VO Services Support Unit responsibility to summarize the discussion into a requirement, and insert it in [https://rt.egi.eu EGI Request Tracker]. USCT is then responsible for the requirement follow up.
 
Also, through this subtask, the VO Service staff is responsible for evaluating and gathering documentation found relevant for VO managers daily activities. All communities (VRCs, VOs, NGIs, ...) are invited to recommend topics about which new materials should be prepared (manuals, presentations, etc...) or even to share their own materials about VO management related topics. Please contact the VO Service team via its GGUS support unit, or directly via  <big>'''vo-services@mailman.egi.eu'''</big>'''.
 
<br />
 
== Documentation ==
The <big>[[User_Documentation|'''Relevant documentation for VO activities''']]</big> wiki page presents a snapshot of the current aggregated material.
 
<br />
 
= Helpdesk for VO managers =
A first line service to support VO managers is consolidated through the [https://gus.fzk.de/pages/ggus-docs/PDF/18000_FAQ_for_vo_services.pdf <big>'''GGUS VO Services Support Unit'''</big>]. Through this service, the VO managers can:
* '''ask for support while operating their VO'''
* '''ask for clarification of procedures'''
*''' ask for documentation improvements'''
The VO Service team seats behind the [https://gus.fzk.de/pages/ggus-docs/PDF/18000_FAQ_for_vo_services.pdf <big>'''GGUS VO Services Support Unit'''</big>] and is responsible for evaluating VO managers requests and treat them in a timely manner. Because this support unit is fully integrated in GGUS user support workflows, it is possible to reassign requests to other support units and/or involved other experts in the evaluation of a given request. For the previous reasons, the [https://gus.fzk.de/pages/ggus-docs/PDF/18000_FAQ_for_vo_services.pdf <big>'''GGUS VO Services Support Unit'''</big>] represents the primordial point of contact for VO managers support. Nevertheless, the VO Services mailing list is also available through <big>'''vo-services@mailman.egi.eu'''</big>'''
 
<br />
 
= Contacts =
* <big>GGUS: '''VO Services Support Unit'''</big>
* <big>Mailing list: '''vo-services@mailman.egi.eu'''</big>'''

Latest revision as of 11:41, 23 November 2012

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Documentation menu: Home • Manuals • Procedures • Training • Other • Contact ► For: VO managers • Administrators


Vo services logo.png


Introduction

Users of the European Grid Infrastructure are organised into Virtual Organisations (VO). A VO is a group of people who share similar interests, have similar goals, and need to work collaboratively sharing resources (e.g. data, software, expertise, CPU, storage space) regardless of their geographical location. There are already more than 200 VOs hosted on EGI. Users are invited to join these VOs, or establish new ones for their own communities.



Main activities

VOServicesWikiFig1 2.png

The VO services activities are summarized in four main points:

  • Evaluation of VO and VRC support services and tools: To identify and evaluate tools / services which could be considered valuable by VOs
  • Provision of services and tools for VOs and VRCS: To provide or help setting up tools / services for VOs aiming to foster production quality by VO users and VO infrastructure providers
  • Consultancy for VO managers: To provide consultancy services to VO managers, clarifying procedures and gathering documentation aiming to optimize the VO managers daily work.
  • Helpdesk for VO managers: To provide a first line support to VO managers.


Evaluation of support tools for VOs and VRCs

Members of VRCs and VOs should be able to assess how reliable their production infrastructure is. In order to achieve this VRCs and VO members must make use of tools that run VO specific tests on their infrastructure on a regular basis, and at same time make the results visible to all VO and/or VRC members. Such tools typically consist of multiple modules:

  • An infrastructure testing framework: A component that can host VO/VRC specific tests and run these tests on a regular basis on the infrastructure
  • A monitor system: A system that collects test results and makes them visible for VO/VRC members
  • An alarm system: A component that can raise alarms whenever a site/service/resource fails a VO-specific test.


The VO Service team has investigated tools and services available within the EGI community that could be adapted to multi-VO environments. The investigated tools cover areas from job management to resource monitoring. The final goal is to easy the access to those applications aiming to foster production quality by the users of a VO.


All communities (VRCs, VOs, NGIs, ...) are invited to recommend new tools for evaluation or share their own evaluation / experience with the VO Services team. The obvious advantage is that those surveys become available to the whole EGI community. Please contact the VO Service team via its GGUS support unit, or directly via vo-services@mailman.egi.eu.

Provision of services and tools for VOs and VRCs

There are two different kinds of tools which can be considered useful for VOs:

  1. global tools supported under the EGI project (operations portal, accounting portal, gocdb, ...)
  2. specific tools developed and supported by communities (VO, VRCs or NGIs).


Tools developed and supported by communities


The VO Services team already evaluated a high number of services and tools. Making use of that information the VO Services compiled a list of services and tools useful to VO and/or VRC's members. which can be consulted at: Services and Tools portfolio wiki page


Before taking the decision of installing them under a production environment VOs should take into account the effort needed for the operation and maintenance of those tools. Three different scenarios are foreseen:

  • The VO installs and operate those tools using their own resources
  • The VO uses a service instance installed elsewhere during a temporary period while it gains expertise to deploy and operate the service.
  • The VO makes permanent use of the tools operated elsewhere and offered as a service to the VO or VO users


Consultancy for VO Managers

VOServicesWikiFig2.png

The GGUS VO Services Support Unit is the official communication channel between VO managers and VO Services staff. One of its main objectives is to provide a direct link to VO managers so that they can ask for consultancy services on VO management issues, like:

  • ask for help on operations through different scenarios
  • provide feedback regarding specific tools and services
  • discuss and assess requests and enhancements

While interacting with the VO managers, VO Services staff can involve different experts in the discussions, and bridge VO managers requests with the appropriate support units. Through the interactions with the VO managers, different requirements can also emerge. In this case, it is the VO Services Support Unit responsibility to summarize the discussion into a requirement, and insert it in EGI Request Tracker. USCT is then responsible for the requirement follow up.

Also, through this subtask, the VO Service staff is responsible for evaluating and gathering documentation found relevant for VO managers daily activities. All communities (VRCs, VOs, NGIs, ...) are invited to recommend topics about which new materials should be prepared (manuals, presentations, etc...) or even to share their own materials about VO management related topics. Please contact the VO Service team via its GGUS support unit, or directly via vo-services@mailman.egi.eu.


Documentation

The Relevant documentation for VO activities wiki page presents a snapshot of the current aggregated material.


Helpdesk for VO managers

A first line service to support VO managers is consolidated through the GGUS VO Services Support Unit. Through this service, the VO managers can:

  • ask for support while operating their VO
  • ask for clarification of procedures
  • ask for documentation improvements

The VO Service team seats behind the GGUS VO Services Support Unit and is responsible for evaluating VO managers requests and treat them in a timely manner. Because this support unit is fully integrated in GGUS user support workflows, it is possible to reassign requests to other support units and/or involved other experts in the evaluation of a given request. For the previous reasons, the GGUS VO Services Support Unit represents the primordial point of contact for VO managers support. Nevertheless, the VO Services mailing list is also available through vo-services@mailman.egi.eu


Contacts

  • GGUS: VO Services Support Unit
  • Mailing list: vo-services@mailman.egi.eu
Retrieved from "https://wiki.egi.eu/w/index.php?title=VO_Services&oldid=46093"