Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "VT EGI Pay-for-Use PoC"

From EGIWiki
Jump to navigation Jump to search
 
(35 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{EGI_Activity_groups_menubar}}
{{Menubar_VT}}
{{Template:EGI-PayForUse-PoC_menubar}}
{{TOC_right}} 
[[Category:Virtual_Teams]]
This page is dedicated to the EGI Pay-for-Use Proof of Concept and Activities.  
This page is dedicated to the EGI Pay-for-Use Proof of Concept and Activities.  


Line 5: Line 12:
== Motivation  ==
== Motivation  ==


Sustainability has been an issue explored by EGI in various ways over the last couple years. There are also messages from the European Commission that keeping the status quo is not an option for e-Infrastructures and EGI should therefore explore options around a more market driven e-Infrastructure for supporting the ERA. However, EGI operates within a publicly funded research and academic environment providing services free at point of delivery with resources bought from grants dedicated to certain groups or disciplines either by direct allocation or by peer review. With the advent of cloud computing, business models and user expectations are shifting towards on-demand and pay-per-use service provision increasing flexibility and agility. This new paradigm provides another motivation for EGI to explore new service definitions by enabling the possibility to provide ICT services that can be paid for the use, along with the more traditional procurement of resources to be managed and offered for free to the owners.<br>
EGI currently operates within a publicly funded research and academic environment providing services free at point of delivery with resources bought from grants dedicated to certain groups or disciplines either by direct allocation or by peer review. With the advent of cloud computing, business models and user expectations are shifting towards on-demand and pay-per-use service provision increasing flexibility and agility. This new paradigm provides motivation for EGI to explore new service definitions by enabling the possibility to provide ICT services that can be paid for the use, along with the more traditional procurement of resources to be managed and offered for free to the owners.<br> This approach also allows researchers and resource providers to better understand costs to access individual services and would enable the creation of innovative business models and pricing schemes (e.g. pay-per-use).


== Mandate  ==
== Mandate  ==


In early 2013, the EGI Council approved a policy to explore business models for pay-for-use service delivery to couple together with the traditional method of free-at-point-of-use. The goal of this activity is to support the implementation of this policy in collaboration with NGIs through the definition and execution of proof of concepts.
In early 2013, the EGI Council approved a policy to explore business models for pay-for-use service delivery to couple together with the traditional method of free-at-point-of-use. The goal of this activity is to support the implementation of this policy in collaboration with NGIs through the definition and execution of proof of concepts. The mandate of the group is to create a proof of concept pay-for-use prototype.
The mandate of the group is to create a proof of concept pay-for-use prototype.
In 2014, activities have continued in order to move the prototype into production, which is expected for the end of 2016.


== Objectives  ==
== Objectives  ==


The objectives are the group are to:  
The objectives are the group are to:  
#Articulate appropriate business and responsibility models
#Define prices for services from the participating sites
#Define agreements and service management processes and procedures
#Introduce a billing function
#Analyse the changes needed to support services and roll out the new functionalities in the production environment
#Evaluate legal, policy, and organisational issues around the full implementation of the pay-for-use model
#Submit a report covering the overall activities and final output as part of the final EGI-InSPIRE periodic report.
This activity will be closely linked to TNA5.1 Strategy, Policy and Business Development; SA5.2: Federated Cloud and JRA2.2 Accounting.


= Milestones/Timeline (12 months) =
#Articulate appropriate business and responsibility models through defined business cases
*January 2014: Kick-off of the activity
#Define prices for services from the participating sites (both compute and storage)  
*April 2014: First phase implementation of all technical specifications, list of required agreements and refinements to policy issues documented in the EGI Sustainability Plan (M48)
#Define agreements and service management processes and procedures
*May 2014: Pay-for-Use aspects included in Federated Cloud release (even in Beta/pre-production)
#Identify the tools required and necessary development to faciliate pay-for-use service provisioning (e.g. billing function)
*June 2014: First presentation of activities and feedback from EGI-InSPIRE EC Review
#Analyse the changes within a pre-production environment that would be needed to support and roll out the new functionalities in the production environment
*October 2014: Conclusion of phase 2 activities: updates from feedback and overall refinements
#Evaluate legal, policy, and organisational issues around the full implementation of the pay-for-use model
*December 2014: Circulation/Publication of Final Proof of Concept Report
#Develop a full production service.


= Group Members  =
= Group Members  =
<div style="width: 60%"><div style="column-count:2;-moz-column-count:2;-webkit-column-count:2">
<div style="width: 60%"><div style="column-count:2;-moz-column-count:2;-webkit-column-count:2">
*Sergio Andreozzi, EGI.eu  
*Sy Holsinger, EGI.eu (Chair)
*Sergio Andreozzi, EGI.eu
*Luis Alves, CSC
*Owen Appleton, EGI.eu
*Emanouil Atanassov, IICT-BAS  
*Emanouil Atanassov, IICT-BAS  
*Bruce Becker, CSIR  
*Bruce Becker, CSIR  
*David Blundell, 100 Percent IT Ltd.
*Wilhelm Buehler, KIT-G  
*Wilhelm Buehler, KIT-G  
*Isabel Campos, CSIC  
*Isabel Campos, CSIC  
*Daniele Cesini, INFN-CNAF  
*Daniele Cesini, INFN-CNAF  
*Alessandro Costantini, INFN/Master-Up  
*Alessandro Costantini, INFN/Master-Up  
*Ivan Diaz, CESGA
*Miroslav Dobrucky, IISAS
*Feyza Eryol, TUBITAK ULAKBIM  
*Feyza Eryol, TUBITAK ULAKBIM  
*Carlos Fernandez Sanchez, CESGA  
*Carlos Fernandez Sanchez, CESGA  
*Enol Fernández del Castillo, EGI.eu
*Tiziana Ferrari, EGI.eu  
*Tiziana Ferrari, EGI.eu  
*Luciano Gaido, INFN  
*Luciano Gaido, INFN  
*André Gemünd, Fraunhofer SCAI  
*André Gemünd, Fraunhofer SCAI  
*Vaidas Giedrimas, Šiauliai University
*John Gordon, STFC  
*John Gordon, STFC  
*Todor Gurov, IICT-BAS  
*Todor Gurov, IICT-BAS  
Line 51: Line 58:
*Helmut Heller, BADW  
*Helmut Heller, BADW  
*Ladislav Hluchý, IISAS  
*Ladislav Hluchý, IISAS  
*Sy Holsinger, EGI.eu  
*Janne Ignatius, CSC
*Javier Jimenez, EGI.eu  
*Kostas Koumantaros, GRNET  
*Kostas Koumantaros, GRNET  
*Kaspars Krampis, IMCS UL  
*Kaspars Krampis, IMCS UL  
Line 58: Line 66:
*Giorgio Maggi, INFN-Bari  
*Giorgio Maggi, INFN-Bari  
*Jesus Marco, IFCA/CSIC  
*Jesus Marco, IFCA/CSIC  
*Stuart Pullinger, STFC  
*Per Öster, CSC
*Stuart Pullinger, STFC
*Roksana Różańska, CYFRONET
*François Ruty, Luna Technologies
*Serge Salamanka, UIIP NASB  
*Serge Salamanka, UIIP NASB  
*Diego Scardaci, INFN  
*Diego Scardaci, INFN  
*Horst Schwichtenberg, Fraunhofer SCAI
*Alvaro Simon, CESGA  
*Alvaro Simon, CESGA  
*Vincenzo Spinoso, INFN-Bari  
*Vincenzo Spinoso, INFN-Bari
*Mariusz Sterzel, CYFRONET  
*Mariusz Sterzel, CYFRONET
*Achim Streit, KIT-G
*Tomasz Szepieniec, CYFRONET
*Jelena Tamulienė, VU  
*Jelena Tamulienė, VU
*Onur Temizsoylu, TUBITAK ULAKBIM
*Onur Temizsoylu, TUBITAK ULAKBIM  
*Viet Tran, IISAS
</div></div>
</div></div>


= <span style="font-size: 25px; line-height: 1.5em;">Technical Details</span> =
= Technical Details  =
 
The following table provides an overview of the technical details of the resource and technology providers for the PoC.
 
{| class="wikitable"
|-
! scope="col" | NGI/RC
! scope="col" | GOCDB Name
! scope="col" | Service Type
! scope="col" | Services and Resources
! scope="col" | Preferred Payment Direct/Indirect
! scope="col" | Price
|-
! scope="row" | Albert Einstein Center, Univ. of Bern
| UNIBE-LHEP
| Batch via CENTOS 5/6 ARC CE <br>
|
*500 cores (approx. 2 months in 2013) on highest priority;
*Consumption preferably in one go, but distributed in time also possible
*10-20 TB disk on local SE for consumption period via DPM SRM interface plus two weeks
 
| Both
| €0.03/hr; Storage free
|-
! scope="row" | Bulgaria Grid Portal
| BG08-Madara
| TBC
|
*TBC
 
| TBC
| TBC
|-
! scope="row" | Institute of Informatics of the Slovak Academy of Sciences
| IISAS-FedCloud
| Cloud
|
*TBC
 
| TBC
| TBC
|-
! scope="row" | Latvian Grid
| IMCSUL
| TBC
|
*TBC
 
| TBC
| TBC
|-
! scope="row" | Leibniz SC Centre
| LRZ
| Globus
|
*Linux Cluster through Globus: GRAM5, GridFTP, Gsissh
 
| Indirect
| Price and capacity to be detailed later
|-
! scope="row" | MASTER-UP Srl
| TBC
| EMI1/2, CEs, WNs, SE
|
*EMI1 middleware (phasing to EMI2) - CE's, WN's and SE.
*10 nodes to start (intel 4core, ethernet connection)
*Long experience in Molecular Science and Comp Chem, can provide support for such innovative applications and in the field of R&amp;D for combustion, energy and material science.
*Managing a computer farm of 200 cores and 4TB of storage part of those resources are supporting EGI.
 
| Direct
| To be evaluated
|-
! scope="row" | NGI-DE
| TBC
| UNICORE
|
*Cluster via UNICORE
*Others can be offered (TBD)
 
| Both
| €0.06/hr + 19% VAT
|-
! scope="row" | NGI_GRNET
| All HG-*
| Cloud and Grid
|
*TBC
 
| TBC
| TBC
|-
! scope="row" | NGI-IT
| TBC
| EMI
|
*gLite MW stack: Cream CE, LFC, Storm SE, WMS+LB, BDII.
*Cloud: WNodes and OpenSTACK
 
| TBD
| €0.07/hr + 21% VAT
|-
! scope="row" | PL-Grid
| TBC
| Cloud + Batch via Cream / EMI
|
*Computing power, storage, and human support
*Batch processing via Cream CE/EMI
*Cloud access
*Non-grid, local access to queue system
 
| Both
| Capacity and price are a subject to negotiation
|-
! scope="row" | TUBITAK ULAKBIM
| TR-10-ULAKBIM
| Cloud + Batch
|
*Batch processing via Cream CE
*VM Management using OpenNebula/OCCI
*Infiniband connected Linux computing resources
 
| Both
| €0.15/hour 8 core 24 GB instance
|-
! scope="row" | UIIP NASB
| BY-UIIP
| Cloud + Batch
|
*Batch processing via UNICORE or Cream CE
*Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs
*400 virtual CPUs
*400 Gb memory
*8TB Disk storage – 9-12TB Storage servers
*Infiniband DDR 20Gbit/sec]


| Indirect
The following [https://wiki.egi.eu/wiki/EGI_Pay-for-Use_PoC_Technical_Details link] provides an overview of the [https://wiki.egi.eu/wiki/EGI_Pay-for-Use_PoC_Technical_Details technical details] of the resource and technology providers for the PoC.
| $0.077/hr (TBD) 1 Core
|}


= How to Join =
= How to Join =


If you would like to participate in the Proof of Concept, contact policy@egi.eu
If you would like to participate in the Proof of Concept, contact policy@egi.eu  


= References  =
= References  =

Latest revision as of 10:53, 3 June 2016

EGI Activity groups Special Interest groups Policy groups Virtual teams Distributed Competence Centres


EGI Virtual teams: Main Active Projects Closed Projects Guidelines
Pay-For-Use menu: Home Processes/Instructions Service/Price Overview Service Management Legal/Policy Actions Meetings



This page is dedicated to the EGI Pay-for-Use Proof of Concept and Activities.

Overview

Motivation

EGI currently operates within a publicly funded research and academic environment providing services free at point of delivery with resources bought from grants dedicated to certain groups or disciplines either by direct allocation or by peer review. With the advent of cloud computing, business models and user expectations are shifting towards on-demand and pay-per-use service provision increasing flexibility and agility. This new paradigm provides motivation for EGI to explore new service definitions by enabling the possibility to provide ICT services that can be paid for the use, along with the more traditional procurement of resources to be managed and offered for free to the owners.
This approach also allows researchers and resource providers to better understand costs to access individual services and would enable the creation of innovative business models and pricing schemes (e.g. pay-per-use).

Mandate

In early 2013, the EGI Council approved a policy to explore business models for pay-for-use service delivery to couple together with the traditional method of free-at-point-of-use. The goal of this activity is to support the implementation of this policy in collaboration with NGIs through the definition and execution of proof of concepts. The mandate of the group is to create a proof of concept pay-for-use prototype. In 2014, activities have continued in order to move the prototype into production, which is expected for the end of 2016.

Objectives

The objectives are the group are to:

  1. Articulate appropriate business and responsibility models through defined business cases
  2. Define prices for services from the participating sites (both compute and storage)
  3. Define agreements and service management processes and procedures
  4. Identify the tools required and necessary development to faciliate pay-for-use service provisioning (e.g. billing function)
  5. Analyse the changes within a pre-production environment that would be needed to support and roll out the new functionalities in the production environment
  6. Evaluate legal, policy, and organisational issues around the full implementation of the pay-for-use model
  7. Develop a full production service.

Group Members

  • Sy Holsinger, EGI.eu (Chair)
  • Sergio Andreozzi, EGI.eu
  • Luis Alves, CSC
  • Owen Appleton, EGI.eu
  • Emanouil Atanassov, IICT-BAS
  • Bruce Becker, CSIR
  • David Blundell, 100 Percent IT Ltd.
  • Wilhelm Buehler, KIT-G
  • Isabel Campos, CSIC
  • Daniele Cesini, INFN-CNAF
  • Alessandro Costantini, INFN/Master-Up
  • Ivan Diaz, CESGA
  • Miroslav Dobrucky, IISAS
  • Feyza Eryol, TUBITAK ULAKBIM
  • Carlos Fernandez Sanchez, CESGA
  • Enol Fernández del Castillo, EGI.eu
  • Tiziana Ferrari, EGI.eu
  • Luciano Gaido, INFN
  • André Gemünd, Fraunhofer SCAI
  • Vaidas Giedrimas, Šiauliai University
  • John Gordon, STFC
  • Todor Gurov, IICT-BAS
  • Sigve Haug, ETH ZURICH
  • Helmut Heller, BADW
  • Ladislav Hluchý, IISAS
  • Janne Ignatius, CSC
  • Javier Jimenez, EGI.eu
  • Kostas Koumantaros, GRNET
  • Kaspars Krampis, IMCS UL
  • Antonio Lagana, UNIPG/Master-Up
  • Panos Louridas, GRNET
  • Giorgio Maggi, INFN-Bari
  • Jesus Marco, IFCA/CSIC
  • Per Öster, CSC
  • Stuart Pullinger, STFC
  • Roksana Różańska, CYFRONET
  • François Ruty, Luna Technologies
  • Serge Salamanka, UIIP NASB
  • Diego Scardaci, INFN
  • Horst Schwichtenberg, Fraunhofer SCAI
  • Alvaro Simon, CESGA
  • Vincenzo Spinoso, INFN-Bari
  • Mariusz Sterzel, CYFRONET
  • Tomasz Szepieniec, CYFRONET
  • Jelena Tamulienė, VU
  • Onur Temizsoylu, TUBITAK ULAKBIM
  • Viet Tran, IISAS

Technical Details

The following link provides an overview of the technical details of the resource and technology providers for the PoC.

How to Join

If you would like to participate in the Proof of Concept, contact policy@egi.eu

References