Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Resource Allocation"

From EGIWiki
Jump to navigation Jump to search
 
(24 intermediate revisions by 4 users not shown)
Line 1: Line 1:
{{Template:Op menubar}} {{Template:EGI RA menubar}}<br>  
{{Template:Op menubar}} {{Template:EGI RA menubar}}<br>  
{| width="100%" style="background: none repeat scroll 0% 0% rgb(255, 255, 255); margin: 1.2em 0px 6px; border: 1px solid rgb(221, 221, 221);"
|-
| style="width:50%; color:#000;" | <!--            -->
{| style="width:230px; border:none; background:none;"
|-
| style="width:230px; text-align:center; white-space:nowrap; color:#000;" | <div style="font-size:162%; border:none; margin:0; padding:.1em; color:#000;">Welcome to EGI&nbsp;Resource Allocation Page. </div>
|}
| style="width:60%; font-size:95%;" |
This page is developed for Resource Providers.<br> It describes Resource Allocation Process supported by [http://e-grant.egi.eu/ e-GRANT] tool.
|}


<br> {{TOC_right}}  
<br> {{TOC_right}}  


= '''Introduction to Resource Allocation'''<br>  =
= '''Introduction to Resource Allocation in EGI'''<br>  =


The '''goal''' of the Resource Allocation (RA) process is to reach an agreement between
The '''goal''' of the Resource Allocation (RA) process is to reach an agreement between Customer and Provider concerning the parameters and conditions of use of resources.<br>  
Customer and Provider concerning the parameters and conditions of use of resources.<br>


The RA process is advantageous for the Customers (VO representatives, individual users) because in a multi-provider  
The RA process is useful for the Customers (VO representatives, individual users) because in a multi-provider EGI environment they have a single point of contact to ask for a share on resources. RA is also beneficial for Providers (Site Manager, NGI Manager) as it allows more effectively plan the use of resources and closer communication with Customers. <br>  
EGI environment they have a single point of contact to get a share on resources. RA is also beneficial
for Providers (Site Manager, NGI Manager) as it allows more effectively plan the use of resources and closer communication with Customers.
<br>


The basic parameters of a RA contact are: duration and the amount of computing resources and / or storage.
The basic parameters of a RA contact are: '''duration''' and the '''amount of computing and /or storage resources'''.  


The EGI offer is expressed in a form of Resource Pools declared by Providers. Resource Pools are defined in common [[Resource Allocation Metrics Description|metrics]]. The Customers use the same metrics while describing their needs (resource request).
The EGI offer is expressed in a form of '''Resource Pools''' which are declared by Providers using common [[Resource Allocation Metrics Description|metrics]]. The Customers use the same metrics while describing their needs (resource request).  


<br>


= '''Basics'''<br>  =


== '''RA basics'''<br>  ==
In this section basic elements of Resource Allocation Process are introduced. Please have a look at the [https://wiki.egi.eu/wiki/Resource_Allocation_Terminology RA terminology] to facilitate further reading.


In this section the most important elements of Resource Allocation Process can be found. <br><br>  
== Parties involved<br> ==


=== Terminology  ===
In RA&nbsp;process there are three parties involved:<br>


[https://wiki.egi.eu/wiki/Resource_Allocation_Terminology https://wiki.egi.eu/wiki/Resource_Allocation_Terminology]
*'''Broker (B)''' - matchmaker and coordinator of RA process<br>
*'''Resource Provider (P)''' - Site Manager or NGI Manager responsible for resource allocation on sites in their scope<br>
*'''Customer (C)''' - scientist involved in a science project requesting storage or computing resources in EGI, person signing SLA with Resource Provider<br><br>


=== Parties involved<br> ===
<br>  


In RA&nbsp;process there are three parties involved:<br>
== Documents  ==


*'''Broker (B)'''- coordinator of RA process<br>
The RA process operates on the following documents:
*'''Resource Provider (P)''' - Site Administrator or NGI manager responsible for resource allocation in involved sites<br>
*'''Customer (C) '''– scientist involved in a science project requesting storage or computing resources in EGI, person signing SLA with Resource Provider<br><br>


=== Activities<br> ===
{| cellspacing="1" cellpadding="1" border="1" width="291"
|-
| '''No.'''
| '''Document Name'''
| '''Involved'''
|-
| 1.
| Customer Request
| C
|-
| 2.
| Service Level Agreement
| C, B
|-
| 3.
| SLA Section
| C, B
|-
| 4.
| Operations Level Agreement<br>  
| P, B
|}


As mentioned Resource Allocation Process main goal is to reach a point at which both engaged sides: Customer and Resource Provider, reach an understanding about resources allocated for Customer and sign SLA.
<br>


There are 9 activities leading to this goal:<br><br>


<u>Activities beyond RA&nbsp;Procedure</u>:<br>


#Pool creation - party(-ies) involved: P &nbsp;
=== Customer Request ===
#User Request creation -&nbsp; party(-ies) involved: C


<u>Activities directly involved in RA&nbsp;Procedure</u>:<br><br>
A document created by Customer describing their resource requirements. In a reply to a Customer Request the Broker creates an SLA containing one or more SLA Sections. There is one SLA Sections for each Resource Pool selected to satisfy a Request.


#User Request validation - party(-ies) involved: C and B
=== Service Level Agreement (SLA) ===
#OLA creation based on pool matching - party(-ies) involved: B
#OLA (re)negotiation - party(-ies) involved: P and B
#OLA confirmation/rejection - party(-ies)) involved: P
#SLA creation/updating &nbsp;- party(-ies) involved: B
#SLA negotiation step - party(-ies) involved: B and C
#SLA confirmation/signing - party(-ies) involved: C


All RA&nbsp;connected activities are being conducted in [https://e-grant.egi.eu/slaneg/auth e-GRANT].<br>
Document created on the basis (in fact it is exact copy) of Customer Request. Parties involved in SLA handling are Broker and Customer. An SLA must contain at least one SLA Section. Each SLA Section is linked to an underpinning OLA. SLA may contain metrics defined on federated level (there are direct obligations of EGI towards the User).  


=== Related documents  ===
<u>SLA states:</u>


While participating in RA&nbsp;process parties can deal with following documents:
*IN-NEGOTIATION – state indicates that a proposal was sent by one party to another and a negotiation step is expected.
*BINDING-IN-PART – at least one SLA section is binding (also related underpinned OLA must be binding); this state is used in case some of the Site representatives agreed on their OLAs, but negotiations with others are still in progress.
*BINDING – this is terminal state for the SLA; this state indicates that RA process was completed (even in case that the request is not satisfied fully)<br>
*REJECTED – this state indicates that SLA was rejected and is neither binding nor a subject of negotiation.<br>


==== Customer Request ====
=== SLA Section<br> ===


Initial request specified by Customer, describing their resource requirements.  
The document exchanged between Broker and Customer along with SLA. Created as an exact copy of a corresponding OLA, can be modified in the negotiation process. If changed, OLA should be modified accordingly. At the end of negotiations metrics values in SLA Section must be equal to those in OLA. SLA Section cannot be handled separately from SLA.<br>


After Request validation, a reply to this document is an SLA with SLA Sections (underpinning OLAs). It contains all parameters about Customer’s resource allocation request (VO, description of activity, specified metrics etc.)
<u>SLA Sections states:</u>


==== Operations Level Agreement (OLA)  ====
*DRAFT – in this state SLA Sections is visible only to its author
*PROPOSAL – state indicates that a proposal was sent by one party to another and a negotiation step is expected.
*BINDING – this state indicates that resource allocation must be performed based on details described in the OLA  
*REJECTED – this state indicates that OLA was rejected and is neither binding nor a subject of negotiation.<br><br>


Stand alone document describing a specific Resource Provider allocation associated with user request (SLA).
=== Operations Level Agreement (OLA) ===


It is created on the basis of SLA parameters and as a result of pool matching. Every created OLA is connected with some specific SLA, but can be handled parallel with or independently from SLA.  
The document created by the Broker as a result of selecting a Resource Provider to satisfy a given Customer Request. There may be a number of OLAs linked with an SLA. Stand alone document describing a specific Resource Provider allocation associated with some SLA. OLA is created on the basis of SLA parameters and as a result of pool matching. Each created OLA is connected with some specific SLA, but can be handled in parallel with or independently from SLA.  


Parties engaged in OLA negotiation are EGI Broker and Resource Provider (e.g. Site or NGI manager).<br><br>  
Parties engaged in OLA negotiation are Broker and Resource Provider (e.g. Site or NGI manager).<br><br>  


<u>OLA states:</u>  
<u>OLA states:</u>  
Line 99: Line 102:
*REJECTED – this state indicates that OLA was rejected and is neither binding nor a subject of negotiation.<br>
*REJECTED – this state indicates that OLA was rejected and is neither binding nor a subject of negotiation.<br>


==== Service Level Agreement (SLA)  ====
[[File:EGI-RA-SLA2.png]]


Document created on the basis (is exact copy) of Users Request after succesful pool matching (at least one OLA must be created/agreed). Parties involved in SLA handling are Broker and Customer. Every SLA contains underpinned OLAs (visible to Broker and Site Representatives) and corresponding to OLAs SLA sections (visible to Broker and Customer).
<br>


SLA must contain at least one SLA section (each section reflects a single underpinned OLA); SLA may contain metrics defined on federated level (there are direct obligations of EGI towards the User).
== Activities<br>  ==


SLA is created as a response to the RA User Request.<br>
As mentioned Resource Allocation Process main goal is to reach a point at which Customer and Resource Provider reach an understanding about resources allocated for Customer and sign the SLA.  


<u>SLA states:</u>  
There are 9 activities leading to this goal:<br><br>  


*IN-NEGOTIATION – state indicates that a proposal was sent by one party to another and a negotiation step is expected.
<u>Activities directly involved in RA&nbsp;Procedure</u>:<br><br>  
*BINDING-IN-PART – at least one SLA section is binding (also related underpinned OLA must be binding); this state is used in case some of the Site representatives agreed on their OLAs, but negotiations with others are still in progress.
*BINDING – this is terminal state for the SLA; this state indicates that RA process was completed (even in case that the request is not satisfied fully)<br>  
*REJECTED – this state indicates that SLA was rejected and is neither binding nor a subject of negotiation.<br>


==== SLA Section<br>  ====
{| class="wikitable"
|-
! No.
! Activity Name
! Involved
|-
| 1
| User Request validation
| C,B
|-
| 2
| OLA creation based on pool matching
| B
|-
| 3
| OLA (re)negotiation
| P, B
|-
| 4
| OLA confirmation/rejection
| P
|-
| 5
| SLA creation/updating
| B
|-
| 6
| SLA negotiation step
| B, C
|-
| 7
| SLA confirmation, signing
| C
|}


The document corresponding to OLA but exchanged between Broker and Customer along with SLA. Created as an exact copy of appropriate OLA, can be modified in the negotiation process. If changed, OLA should be modified accordingly. At the end of negotiations metrics values in SLA Section must be equal to those in OLA. SLA Section cannot be handled separately from SLA.<br>  
<br> <u>Activities beyond RA&nbsp;Procedure</u>:<br>  


<u>SLA Sections states:</u>
{| class="wikitable"
|-
! No.
! Activity Name
! Involved
|-
| 1
| Resource Pool creation
| P
|-
| 2
| User Request creation
| C
|}


*DRAFT – in this state SLA Sections is visible only to its author
All activities are being conducted in [https://e-grant.egi.eu/slaneg/auth e-GRANT] tool.<br>  
*PROPOSAL – state indicates that a proposal was sent by one party to another and a negotiation step is expected.  
*BINDING – this state indicates that resource allocation must be performed based on details described in the OLA
*REJECTED – this state indicates that OLA was rejected and is neither binding nor a subject of negotiation.<br><br>


=== Example of RA implementation in E-grant  ===
<br>


TBD<br>


More about Resource allocation Procedure can be found [[Resource Allocation Procedure and Work Instruction|here]].<br><br>  
More about Resource allocation Procedure can be found [[Resource Allocation Procedure and Work Instruction|here]].<br><br>  


== '''Customer - related activities'''  ==
TBD<br>
== '''Provider - related activities'''  ==
[https://wiki.egi.eu/wiki/Resource_Allocation_Provider_Activities Provider activities]<br>
== '''Operations of Resource Allocation Process'''  ==
[[Resource Allocation Operations internals|Internal space for Resource Allocation Operations]]


[[Category:ResourceAllocation]]
[[Category:ResourceAllocation]]

Latest revision as of 14:38, 19 January 2015

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


EGI Resource Allocation menu:




Introduction to Resource Allocation in EGI

The goal of the Resource Allocation (RA) process is to reach an agreement between Customer and Provider concerning the parameters and conditions of use of resources.

The RA process is useful for the Customers (VO representatives, individual users) because in a multi-provider EGI environment they have a single point of contact to ask for a share on resources. RA is also beneficial for Providers (Site Manager, NGI Manager) as it allows more effectively plan the use of resources and closer communication with Customers.

The basic parameters of a RA contact are: duration and the amount of computing and /or storage resources.

The EGI offer is expressed in a form of Resource Pools which are declared by Providers using common metrics. The Customers use the same metrics while describing their needs (resource request).


Basics

In this section basic elements of Resource Allocation Process are introduced. Please have a look at the RA terminology to facilitate further reading.

Parties involved

In RA process there are three parties involved:

  • Broker (B) - matchmaker and coordinator of RA process
  • Resource Provider (P) - Site Manager or NGI Manager responsible for resource allocation on sites in their scope
  • Customer (C) - scientist involved in a science project requesting storage or computing resources in EGI, person signing SLA with Resource Provider


Documents

The RA process operates on the following documents:

No. Document Name Involved
1. Customer Request C
2. Service Level Agreement C, B
3. SLA Section C, B
4. Operations Level Agreement
P, B



Customer Request

A document created by Customer describing their resource requirements. In a reply to a Customer Request the Broker creates an SLA containing one or more SLA Sections. There is one SLA Sections for each Resource Pool selected to satisfy a Request.

Service Level Agreement (SLA)

Document created on the basis (in fact it is exact copy) of Customer Request. Parties involved in SLA handling are Broker and Customer. An SLA must contain at least one SLA Section. Each SLA Section is linked to an underpinning OLA. SLA may contain metrics defined on federated level (there are direct obligations of EGI towards the User).

SLA states:

  • IN-NEGOTIATION – state indicates that a proposal was sent by one party to another and a negotiation step is expected.
  • BINDING-IN-PART – at least one SLA section is binding (also related underpinned OLA must be binding); this state is used in case some of the Site representatives agreed on their OLAs, but negotiations with others are still in progress.
  • BINDING – this is terminal state for the SLA; this state indicates that RA process was completed (even in case that the request is not satisfied fully)
  • REJECTED – this state indicates that SLA was rejected and is neither binding nor a subject of negotiation.

SLA Section

The document exchanged between Broker and Customer along with SLA. Created as an exact copy of a corresponding OLA, can be modified in the negotiation process. If changed, OLA should be modified accordingly. At the end of negotiations metrics values in SLA Section must be equal to those in OLA. SLA Section cannot be handled separately from SLA.

SLA Sections states:

  • DRAFT – in this state SLA Sections is visible only to its author
  • PROPOSAL – state indicates that a proposal was sent by one party to another and a negotiation step is expected.
  • BINDING – this state indicates that resource allocation must be performed based on details described in the OLA
  • REJECTED – this state indicates that OLA was rejected and is neither binding nor a subject of negotiation.

Operations Level Agreement (OLA)

The document created by the Broker as a result of selecting a Resource Provider to satisfy a given Customer Request. There may be a number of OLAs linked with an SLA. Stand alone document describing a specific Resource Provider allocation associated with some SLA. OLA is created on the basis of SLA parameters and as a result of pool matching. Each created OLA is connected with some specific SLA, but can be handled in parallel with or independently from SLA.

Parties engaged in OLA negotiation are Broker and Resource Provider (e.g. Site or NGI manager).

OLA states:

  • DRAFT – in this state OLA is visible only to its author
  • INVALIDATED - document (OLA) cancelled by its author before sending to another party
  • PROPOSAL – state indicates that a proposal was sent by one party to another and a negotiation step is expected.
  • AGREED-REVOKABLE – state indicates that OLA was created based on right-to-revoke scenario and it is in a period when it can be revoked.
  • AGREED – state indicates that both parties agreed on the OLA, however it is not linked to any binding SLA; OLA in this state can be invalidated only in case the association with underpinned SLA is deleted both based on Broker or User decision).
  • BINDING – this state indicates that resource allocation must be performed based on details described in the OLA
  • REJECTED – this state indicates that OLA was rejected and is neither binding nor a subject of negotiation.

EGI-RA-SLA2.png


Activities

As mentioned Resource Allocation Process main goal is to reach a point at which Customer and Resource Provider reach an understanding about resources allocated for Customer and sign the SLA.

There are 9 activities leading to this goal:

Activities directly involved in RA Procedure:

No. Activity Name Involved
1 User Request validation C,B
2 OLA creation based on pool matching B
3 OLA (re)negotiation P, B
4 OLA confirmation/rejection P
5 SLA creation/updating B
6 SLA negotiation step B, C
7 SLA confirmation, signing C


Activities beyond RA Procedure:

No. Activity Name Involved
1 Resource Pool creation P
2 User Request creation C

All activities are being conducted in e-GRANT tool.



More about Resource allocation Procedure can be found here.