Resource Allocation Task Force

From EGIWiki
Revision as of 22:17, 7 April 2013 by Magda (talk | contribs)
Jump to: navigation, search
Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security



Coordinator: T. Ferrari/EGI.eu

Meetings page: https://indico.egi.eu/indico/categoryDisplay.py?categId=86

Mailing list: resource-allocation@mailman.egi.eu

Mailing list page: https://www.egi.eu/sso/groupView/resource-allocation

Action list: http://go.egi.eu/Resource_Allocation_Actions_RT

Members:

  • NGIs: NGI_PL, NGI_France, NGI_IberGrid, NGI_IT, NGI_AEGIS, NGI_CZ
  • VOs: WeNMR, BIOMED, (DCH-RP)?, COMPCHEM VO


Resource Allocation Task Force brainstorming page - page with ideas, issues for discussion and ideas

Resource Allocation Process - page with draft proposal for RA process

Resource Allocation Procedure Draft - page with a draft version of RA procedure

Introduction

EGI needs to develop a model and the related processes for allocation of resources as a service to international collaborations. Offering resources as a services is relevant to all communities that do not contribute own resources to the infrastructure.

Policies, a service model and the related processes are needed to:

  • provide resources in a streamlined fashion making it procurement easy for users, while taking into account the different Resource Centre-level and NGI-level resource allocation policies
  • provide resources as a service through service level agreements in order to give some structure to resource offering for VOs relying on opportunistic usage of resources
  • ensure mechanisms are in place to acknowledge usage of resources by VOs that rely on opportunistic usage of the infrastructure. This can happen through acknowledgement of infrastructure usage in published research work and it is important for Resource Centres and NGIs to provide evidence of their contribution to national and international science
  • develop processes to express resource demand, and resource offer.

In Nov 2012 the EGI Council approved the start of experimental activities around the development of policies and processes for the application, scientific review and pooled resource allocation of NGI resources. More information

This task force aims at focusing on the processes and the operational aspects of resource application and allocation. The process for assessment is out of scope and will be dwelt with by other groups.

Mandate

  • Collect information about best practices and processes that are already in place at a national level
  • Propose processes around central management of demand and offer of pooled NGI resources, through the establishment of
    • SLAs to express user demand (involved parties: customers, EGI.eu)
    • OLAs to express resource offer (involved parties: EGI.eu, Resource Providers)
  • Identify the needs of development in the existing operational tools for the automation of the identified processes
  • Coordinate the implementation of a testbed with the involvement of VOs and Resource Providers

Actions

See the task force actions on the resource-allocation queue of RT (access restricted to the members of the task force)

How to participate

For NGIs

  • Participate to the task force to contribute to the definition of application and allocation processes
  • Deadline: 11-01-2013
  • Send mail to resource-allocation at mailman.egi.eu

For NGIs and Resource Centres

  • Contribute to the pool of shared resources for the implementation of a testbed. Purpose of the testbed is try processes in a production environment. Minimum requirements to participate to the testbed:
    • Compute: 10 cores available at any time with HIGH PRIORITY. Jobs arriving to that site will enter in execution at the earliest possibility the cluster occupation permits.
    • Storage: 1 TB
  • Deadline: 22 Jan 2013
  • Send mail to resource-allocation at mailman.egi.eu

Milestones

  • (DONE) 11-01-2013: setup the task force with the participation of users and NGIs
  • (DONE) 22-01-2013: collect expressions of interest from resource providers to participate to a testbed.
  • (DONE) 29-01-2013 (Evolving EGI workshop): propose processes around application and offering for discussion
  • (IN PROGRESS)15-02-2013: setup a testbed with the participation of resource providers and VOs
  • 10-04-2013: at CF13 finalize models and procedures

Resources

NGI proposals