Difference between revisions of "Resource Pool"

From EGIWiki
Jump to: navigation, search
(Introduction)
 
(21 intermediate revisions by one other user not shown)
Line 1: Line 1:
 
{{Template:Op menubar}} {{TOC_right}}  
 
{{Template:Op menubar}} {{TOC_right}}  
[[Category:Operations]]
+
[[Category:ResourceAllocation]]
= Introduction =
+
In June 2013 the EGI Council approved the implementation of a EGI Resource Allocation Pool to support resource needs of user communities whose request is scientifically peer reviewed. Resource requests from user communities will be reviewed by a Scientific Review Committee (see the [https://documents.egi.eu/document/1472 Terms of Reference]).  
This page provides information about resource allocation in EGI and instructions on how to contribute resources to the EGI Pool.
 
  
= Submit a resource offer =
+
This page provides information to partners interested in contributing resources to the EGI federated pool about resource allocation in EGI.
 +
 
 +
Through this page you can submit your resource offer to contribute to the federated pool.
 +
 
 +
= How can I contribute to the federated EGI resource pool? =
 
== CALL 1. 2013 QR3 ==
 
== CALL 1. 2013 QR3 ==
If you are an NGI or Resource Centre and you are interested in contribute resources to the EGI Pool, please submit your offer by filling in the following survey.
+
The call for contributions of resource to the EGI federated resource pool CALL1.2013.QR3 is now open to Resource Providers (NGIs and Resource Centres).
  
DEADLINE for submission: 30 September 2013
+
<big>
 +
'''Click [https://www.surveymonkey.com/s/2GPHMTK here]''' to submit your resource offer to contribute to the EGI Resource Pool (see the [https://documents.egi.eu/document/1943 pdf] version of the on-line offer form) .
  
Submit your offer.
+
'''DEADLINE for submission: 30 September 2013'''
 +
</big>
  
 
= [[Resource_Allocation_Terminology|Terminology]] =
 
= [[Resource_Allocation_Terminology|Terminology]] =
  
 
= Computing: QoS levels  =
 
= Computing: QoS levels  =
For computing resources a Resource Provider can provide different types of access to resources according to its local policies and the user requests:
+
For computing resources a Resource Provider can offer different types of access to resources according to its local policies and the user requirements:
 
* [[Resource_Allocation_Terminology#Level_C1:_Opportunistic | Level C1: Opportunistic]]. Resources are not guaranteed and are subject to local availability.
 
* [[Resource_Allocation_Terminology#Level_C1:_Opportunistic | Level C1: Opportunistic]]. Resources are not guaranteed and are subject to local availability.
 
* [[Resource_Allocation_Terminology#Level_C2:_Time_allocation| Level C2: Time allocation]]. Resources are available in fair share-like mode for a fixed time period.  
 
* [[Resource_Allocation_Terminology#Level_C2:_Time_allocation| Level C2: Time allocation]]. Resources are available in fair share-like mode for a fixed time period.  
* [[Resource_Allocation_Terminology#Level_C3:_Reserved_allocation | Level C3: Reserved allocation]]. Resources are exclusively reserved to the VO and the job will be executed immediately after submission.  
+
* [[Resource_Allocation_Terminology#Level_C3:_Reserved_allocation | Level C3: Reserved allocation]]. Resources are exclusively reserved to the VO and the job will be executed immediately after submission.
 +
 
 +
= Storage: QoS levels =
 +
For storage resources a Resource Provider can offer different types of access to resources according to its local policies and the user requirements:
 +
* [[Resource_Allocation_Terminology#Level_S1:_Opportunistic | Level S1. Opportunistic]]. Storage space is provided depending on availability of local resources at a time without any guarantees in terms of quota and duration of the allocation.
 +
* [[Resource_Allocation_Terminology#Level_S2:_Guaranteed | Level S2. Guaranteed]]. Storage space is reserved.
  
 
= Resource allocation policies =
 
= Resource allocation policies =
 
For the resources offered to the EGI Pool, the Resource Provider can play different roles in the resource brokerage process according to its local requirements.
 
For the resources offered to the EGI Pool, the Resource Provider can play different roles in the resource brokerage process according to its local requirements.
  
* Free hands: the broker, responsible of matching demand and offer, is free to allocate the resources from one RP Pool according to local criteria which aim to optimize usage of available resources and user demand. The Resource Provider delegates the responsibility of accepting a proposed resource allocation to the Broker.  
+
* '''Free hands''': the broker, responsible of matching demand and offer, is free to allocate the resources from one RP Pool according to local criteria which aim to optimize usage of available resources and user demand. The Resource Provider delegates the responsibility of accepting a proposed resource allocation to the Broker.  
* Right to revoke: the broker matches demand and offer and defines a resource allocation proposal. The RP Pool Manager is responsible of accepting or rejecting the resource allocation proposal of the Broker (EGI.eu)
+
* '''Right to revoke''': the broker matches demand and offer and defines a resource allocation proposal. The RP Pool Manager is responsible of accepting or rejecting the resource allocation proposal of the Broker (EGI.eu), in case of no reply to a Broker's proposal after a default time, the resource allocation proposal is considered to be accepted.
* Negotiated: the Resource Provider offers resources to the EGI Pool in a on-demand fashion, depending on the user demands that are approved.  
+
* '''Negotiated''': the broker matches demand and offer and defines a resource allocation proposal. The RP Pool Manager is responsible of accepting or rejecting the resource allocation proposal of the Broker (EGI.eu) and to '''explicitly''' accept or reject.  
  
The table below illustrates the role of the Broker and of the Resource Provider in the resource allocation process according to the resource allocation policy of choice.  
+
The table below illustrates the role of the Broker and of the Resource Provider in the resource allocation process according to the resource allocation policy of choice (one of the options above).  
  
 
{| class="wikitable"
 
{| class="wikitable"
Line 39: Line 49:
 
! scope="col" | Actions/steps<br>
 
! scope="col" | Actions/steps<br>
 
|-
 
|-
| in free hand<br>  
+
| Free hands<br>  
 
| address requests below a defined threshold  
 
| address requests below a defined threshold  
 
| central collector for requests; set up and coordinate the usage of the pool; investigate all the operational aspects; allocate resources;&nbsp; monitor the effectiveness of the pool resources usage<br>  
 
| central collector for requests; set up and coordinate the usage of the pool; investigate all the operational aspects; allocate resources;&nbsp; monitor the effectiveness of the pool resources usage<br>  
Line 47: Line 57:
 
| After the pool has been set up, EGI collects requests, defines the required operational steps to support the requests; RPs configure their resources that are part of the pool accordingly
 
| After the pool has been set up, EGI collects requests, defines the required operational steps to support the requests; RPs configure their resources that are part of the pool accordingly
 
|-
 
|-
| right to revoke<br>  
+
| Right to revoke<br>  
 
| address request above the threshold  
 
| address request above the threshold  
 
| central collector for requests; set up and coordinate the usage of the pool; investigate all the operational aspects; allocate resources;&nbsp; monitor the effectiveness of the pool resources usage<br>  
 
| central collector for requests; set up and coordinate the usage of the pool; investigate all the operational aspects; allocate resources;&nbsp; monitor the effectiveness of the pool resources usage<br>  
Line 55: Line 65:
 
| After the pool has been set up, EGI collects requests, defines the required operational steps to support the requests; RPs configure their resources that are part of the pool accordingly
 
| After the pool has been set up, EGI collects requests, defines the required operational steps to support the requests; RPs configure their resources that are part of the pool accordingly
 
|-
 
|-
| negotiated (elastic pools)<br>
+
| Negotiated 
 
| address 'heavy' requests  
 
| address 'heavy' requests  
| central collector for requests; broker for the RPs resources; define all the technical aspects of the requests; open calls to RPs in order to set up the pool&nbsp; through the NGIs<br>  
+
| central collector for requests; broker for the RPs resources; define all the technical aspects of the requests<br>  
 
| broker for the RCs resources; provide support to RCs in order to ease the creation of a pool; monitor the effectiveness of the pool resources usage by the requester<br>  
 
| broker for the RCs resources; provide support to RCs in order to ease the creation of a pool; monitor the effectiveness of the pool resources usage by the requester<br>  
| not at all; it is up to the different RPs (NGIs and/or RCs) to decide how many resources (if any) they want to provide to that specific request/user community<br>  
+
| it is up to the different RPs (NGIs and/or RCs) to agree on how many resources (if any) they want to provide to that specific request/user community. A broker's proposal is implemented only if explicitly acknowledged by the Resource Providers<br>  
 
| the call shall look for resources whose allocation could be guaranteed; in addition opportunistic usage is an added value  
 
| the call shall look for resources whose allocation could be guaranteed; in addition opportunistic usage is an added value  
| for each request EGI investigates all the operational aspects, providing a technical descritption of the request (and recipes if necessary) and sets up a call to RPs (throug NGIs) to provide resources for the temporary (elastic) pool dedicated to that request. Then coordinates the setting up of the pools and informs the requester about the conditions for accessing and using the resources
+
| for each request EGI investigates all the operational aspects, providing a technical description of the request (and recipes if necessary). Then the broker coordinates the setting up of the pools and informs the requester about the conditions for accessing and using the resources
 
|}
 
|}
  
 
<br>
 
<br>
 +
 +
= Contact information =
 +
For more information about the EGI Pool please contact: operations (at) egi.eu

Latest revision as of 17:33, 23 October 2014

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


In June 2013 the EGI Council approved the implementation of a EGI Resource Allocation Pool to support resource needs of user communities whose request is scientifically peer reviewed. Resource requests from user communities will be reviewed by a Scientific Review Committee (see the Terms of Reference).

This page provides information to partners interested in contributing resources to the EGI federated pool about resource allocation in EGI.

Through this page you can submit your resource offer to contribute to the federated pool.

How can I contribute to the federated EGI resource pool?

CALL 1. 2013 QR3

The call for contributions of resource to the EGI federated resource pool CALL1.2013.QR3 is now open to Resource Providers (NGIs and Resource Centres).

Click here to submit your resource offer to contribute to the EGI Resource Pool (see the pdf version of the on-line offer form) .

DEADLINE for submission: 30 September 2013

Terminology

Computing: QoS levels

For computing resources a Resource Provider can offer different types of access to resources according to its local policies and the user requirements:

Storage: QoS levels

For storage resources a Resource Provider can offer different types of access to resources according to its local policies and the user requirements:

  • Level S1. Opportunistic. Storage space is provided depending on availability of local resources at a time without any guarantees in terms of quota and duration of the allocation.
  • Level S2. Guaranteed. Storage space is reserved.

Resource allocation policies

For the resources offered to the EGI Pool, the Resource Provider can play different roles in the resource brokerage process according to its local requirements.

  • Free hands: the broker, responsible of matching demand and offer, is free to allocate the resources from one RP Pool according to local criteria which aim to optimize usage of available resources and user demand. The Resource Provider delegates the responsibility of accepting a proposed resource allocation to the Broker.
  • Right to revoke: the broker matches demand and offer and defines a resource allocation proposal. The RP Pool Manager is responsible of accepting or rejecting the resource allocation proposal of the Broker (EGI.eu), in case of no reply to a Broker's proposal after a default time, the resource allocation proposal is considered to be accepted.
  • Negotiated: the broker matches demand and offer and defines a resource allocation proposal. The RP Pool Manager is responsible of accepting or rejecting the resource allocation proposal of the Broker (EGI.eu) and to explicitly accept or reject.

The table below illustrates the role of the Broker and of the Resource Provider in the resource allocation process according to the resource allocation policy of choice (one of the options above).

Scenario
Scope
EGI role
NGIs role
Review
Usage (guaranteed allocation/opportunistic)
Actions/steps
Free hands
address requests below a defined threshold central collector for requests; set up and coordinate the usage of the pool; investigate all the operational aspects; allocate resources;  monitor the effectiveness of the pool resources usage
provide resources directly; act as broker towards the Resource Centers
no review as long as the pool's resources are enough to satisfy all requests. If a review is needed it is up to EGI.eu only to decide
guaranteed allocation for a subset of the pool's resources; opportunistic for the rest After the pool has been set up, EGI collects requests, defines the required operational steps to support the requests; RPs configure their resources that are part of the pool accordingly
Right to revoke
address request above the threshold central collector for requests; set up and coordinate the usage of the pool; investigate all the operational aspects; allocate resources;  monitor the effectiveness of the pool resources usage
provide resources directly; act as broker towards the Resource Centers + option to withdraw if national/local policies are conflicting
same as above, but  if a review is needed a very lightweight procedure should be defined, involving EGI.eu and representatives of the RPs contributing to the pool
guaranteed allocation for a subset of the pool's resources; opportunistic for the rest After the pool has been set up, EGI collects requests, defines the required operational steps to support the requests; RPs configure their resources that are part of the pool accordingly
Negotiated address 'heavy' requests central collector for requests; broker for the RPs resources; define all the technical aspects of the requests
broker for the RCs resources; provide support to RCs in order to ease the creation of a pool; monitor the effectiveness of the pool resources usage by the requester
it is up to the different RPs (NGIs and/or RCs) to agree on how many resources (if any) they want to provide to that specific request/user community. A broker's proposal is implemented only if explicitly acknowledged by the Resource Providers
the call shall look for resources whose allocation could be guaranteed; in addition opportunistic usage is an added value for each request EGI investigates all the operational aspects, providing a technical description of the request (and recipes if necessary). Then the broker coordinates the setting up of the pools and informs the requester about the conditions for accessing and using the resources


Contact information

For more information about the EGI Pool please contact: operations (at) egi.eu