Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Resource Allocation Task Force"

From EGIWiki
Jump to navigation Jump to search
Line 1: Line 1:
{{Template:Op menubar}}  
{{Template:Op menubar}} {{TOC_right}} '''Coordinator''': T. Ferrari/EGI.eu<br>  
{{TOC_right}}  
[[Category: Task forces]]
'''Coordinator''': T. Ferrari/EGI.eu<br>


'''Meetings page''': https://indico.egi.eu/indico/categoryDisplay.py?categId=86
'''Meetings page''': https://indico.egi.eu/indico/categoryDisplay.py?categId=86  


'''Mailing list''': resource-allocation@mailman.egi.eu  
'''Mailing list''': resource-allocation@mailman.egi.eu  


'''Mailing list page''': https://www.egi.eu/sso/groupView/resource-allocation<br>
'''Mailing list page''': https://www.egi.eu/sso/groupView/resource-allocation


= Introduction =
'''Members:'''
EGI needs to develop a model and the related processes for allocation of resources as a service to international collaborations. Offering resources as a services is relevant to all communities that do not contribute own resources to the infrastructure.


Policies, a service model and the related processes are needed to:
*'''NGIs''': <span style="font-size:16px;font-family:'Liberation Serif';color:#000000;background-color:transparent;font-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;"><span id="internal-source-marker_0.7566157448089824" style="font-size:16px;font-family:'Liberation Serif';color:#000000;background-color:transparent;font-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;">Poland,</span></span><span style="font-size:16px;font-family:'Liberation Serif';color:#000000;background-color:transparent;font-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;"><span id="internal-source-marker_0.7566157448089824" style="font-size:16px;font-family:'Liberation Serif';color:#000000;background-color:transparent;font-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;"><span style="font-size:16px;font-family:'Liberation Serif';color:#000000;background-color:transparent;font-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;"> France</span>, </span>IberGrid, Italy, Serbia</span>
* provide resources in a streamlined fashion making it procurement easy for users, while taking into account the different Resource Centre-level and NGI-level resource allocation policies
*'''VOs''': <span style="font-size:16px;font-family:'Liberation Serif';color:#000000;background-color:transparent;font-weight:normal;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;">WeNMR, BIOMED, (DCH-RP)?</span><br>
* provide resources as a service through service level agreements in order to give some structure to resource offering for VOs relying on opportunistic usage of resources
* ensure mechanisms are in place to acknowledge usage of resources by VOs that rely on opportunistic usage of the infrastructure. This can happen through acknowledgement of infrastructure usage in published research work and it is important for Resource Centres and NGIs to provide evidence of their contribution to national and international science
* develop processes to express resource demand, and resource offer.


In Nov 2012 the EGI Council approved the start of experimental activities around the development of policies and processes for the application, scientific review and pooled resource allocation of NGI resources. [http://documents.egi.eu/document/1415 More information]
= Introduction  =


This task force aims at focusing on the processes and the operational aspects of resource application and allocation. The process for assessment is out of scope and will be dwelt with by other groups.
EGI needs to develop a model and the related processes for allocation of resources as a service to international collaborations. Offering resources as a services is relevant to all communities that do not contribute own resources to the infrastructure.  


= Mandate =
Policies, a service model and the related processes are needed to:  
* Collect information about best practices and processes that are already in place at a national level
* Propose processes around central management of demand and offer of pooled NGI resources, through the establishment of
** SLAs to express user demand (involved parties: customers, EGI.eu)
** OLAs to express resource offer (involved parties: EGI.eu, Resource Providers)
* Identify the needs of development in the existing operational tools for the automation of the identified processes
* Coordinate the implementation of a testbed with the involvement of VOs and Resource Providers


= How to participate =
*provide resources in a streamlined fashion making it procurement easy for users, while taking into account the different Resource Centre-level and NGI-level resource allocation policies
== For NGIs ==
*provide resources as a service through service level agreements in order to give some structure to resource offering for VOs relying on opportunistic usage of resources
* Participate to the task force to contribute to the definition of application and allocation processes
*ensure mechanisms are in place to acknowledge usage of resources by VOs that rely on opportunistic usage of the infrastructure. This can happen through acknowledgement of infrastructure usage in published research work and it is important for Resource Centres and NGIs to provide evidence of their contribution to national and international science
* Deadline: 11-01-2013
*develop processes to express resource demand, and resource offer.
* Send mail to resource-allocation at mailman.egi.eu


== For NGIs and Resource Centres ==
In Nov 2012 the EGI Council approved the start of experimental activities around the development of policies and processes for the application, scientific review and pooled resource allocation of NGI resources. [http://documents.egi.eu/document/1415 More information]
* Contribute to the pool of shared resources for the implementation of a testbed. Purpose of the testbed is try processes in a production environment. Minimum requirements to participate to the testbed:
** Compute: 10 cores available at any time with HIGH PRIORITY. Jobs arriving to that site will enter in execution at the earliest possibility the cluster occupation permits.
** Storage: 1 TB
* Deadline: 22 Jan 2013
* Send mail to resource-allocation at mailman.egi.eu


= Milestones =
This task force aims at focusing on the processes and the operational aspects of resource application and allocation. The process for assessment is out of scope and will be dwelt with by other groups.
* 11-01-2013: setup the task force with the participation of users and NGIs
* 22-02-2013: collect expressions of interest from resource providers to participate to a testbed.
* 29-01-2013 (Evolving EGI workshop): propose processes around application and offering for discussion
* 15-02-2013: setup a testbed with the participation of resource providers and VOs


= Resources =
= Mandate  =
* [http://documents.egi.eu/document/1415 Demonstrating Excellent European Science on EGI's shared resources], Nov 2012
 
* [https://indico.egi.eu/indico/materialDisplay.py?contribId=3&materialId=0&confId=1100 Draft processes]: initial draft document for discussion
*Collect information about best practices and processes that are already in place at a national level
*Propose processes around central management of demand and offer of pooled NGI resources, through the establishment of
**SLAs to express user demand (involved parties: customers, EGI.eu)
**OLAs to express resource offer (involved parties: EGI.eu, Resource Providers)
*Identify the needs of development in the existing operational tools for the automation of the identified processes
*Coordinate the implementation of a testbed with the involvement of VOs and Resource Providers
 
= How to participate  =
 
== For NGIs  ==
 
*Participate to the task force to contribute to the definition of application and allocation processes
*Deadline: 11-01-2013
*Send mail to resource-allocation at mailman.egi.eu
 
== For NGIs and Resource Centres  ==
 
*Contribute to the pool of shared resources for the implementation of a testbed. Purpose of the testbed is try processes in a production environment. Minimum requirements to participate to the testbed:
**Compute: 10 cores available at any time with HIGH PRIORITY. Jobs arriving to that site will enter in execution at the earliest possibility the cluster occupation permits.
**Storage: 1 TB
*Deadline: 22 Jan 2013
*Send mail to resource-allocation at mailman.egi.eu
 
= Milestones  =
 
*11-01-2013: setup the task force with the participation of users and NGIs
*22-02-2013: collect expressions of interest from resource providers to participate to a testbed.
*29-01-2013 (Evolving EGI workshop): propose processes around application and offering for discussion
*15-02-2013: setup a testbed with the participation of resource providers and VOs
 
= Resources =
 
*[http://documents.egi.eu/document/1415 Demonstrating Excellent European Science on EGI's shared resources], Nov 2012  
*[https://indico.egi.eu/indico/materialDisplay.py?contribId=3&materialId=0&confId=1100 Draft processes]: initial draft document for discussion
 
[[Category:Task_forces]]

Revision as of 17:39, 11 January 2013

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Coordinator: T. Ferrari/EGI.eu

Meetings page: https://indico.egi.eu/indico/categoryDisplay.py?categId=86

Mailing list: resource-allocation@mailman.egi.eu

Mailing list page: https://www.egi.eu/sso/groupView/resource-allocation

Members:

  • NGIs: Poland, France, IberGrid, Italy, Serbia
  • VOs: WeNMR, BIOMED, (DCH-RP)?

Introduction

EGI needs to develop a model and the related processes for allocation of resources as a service to international collaborations. Offering resources as a services is relevant to all communities that do not contribute own resources to the infrastructure.

Policies, a service model and the related processes are needed to:

  • provide resources in a streamlined fashion making it procurement easy for users, while taking into account the different Resource Centre-level and NGI-level resource allocation policies
  • provide resources as a service through service level agreements in order to give some structure to resource offering for VOs relying on opportunistic usage of resources
  • ensure mechanisms are in place to acknowledge usage of resources by VOs that rely on opportunistic usage of the infrastructure. This can happen through acknowledgement of infrastructure usage in published research work and it is important for Resource Centres and NGIs to provide evidence of their contribution to national and international science
  • develop processes to express resource demand, and resource offer.

In Nov 2012 the EGI Council approved the start of experimental activities around the development of policies and processes for the application, scientific review and pooled resource allocation of NGI resources. More information

This task force aims at focusing on the processes and the operational aspects of resource application and allocation. The process for assessment is out of scope and will be dwelt with by other groups.

Mandate

  • Collect information about best practices and processes that are already in place at a national level
  • Propose processes around central management of demand and offer of pooled NGI resources, through the establishment of
    • SLAs to express user demand (involved parties: customers, EGI.eu)
    • OLAs to express resource offer (involved parties: EGI.eu, Resource Providers)
  • Identify the needs of development in the existing operational tools for the automation of the identified processes
  • Coordinate the implementation of a testbed with the involvement of VOs and Resource Providers

How to participate

For NGIs

  • Participate to the task force to contribute to the definition of application and allocation processes
  • Deadline: 11-01-2013
  • Send mail to resource-allocation at mailman.egi.eu

For NGIs and Resource Centres

  • Contribute to the pool of shared resources for the implementation of a testbed. Purpose of the testbed is try processes in a production environment. Minimum requirements to participate to the testbed:
    • Compute: 10 cores available at any time with HIGH PRIORITY. Jobs arriving to that site will enter in execution at the earliest possibility the cluster occupation permits.
    • Storage: 1 TB
  • Deadline: 22 Jan 2013
  • Send mail to resource-allocation at mailman.egi.eu

Milestones

  • 11-01-2013: setup the task force with the participation of users and NGIs
  • 22-02-2013: collect expressions of interest from resource providers to participate to a testbed.
  • 29-01-2013 (Evolving EGI workshop): propose processes around application and offering for discussion
  • 15-02-2013: setup a testbed with the participation of resource providers and VOs

Resources