Difference between revisions of "VT EGI Pay-for-Use Technical Details"
(67 intermediate revisions by 15 users not shown) | |||
Line 1: | Line 1: | ||
{{Template:EGI-PayForUse-PoC_menubar}} {{ | {{EGI_Activity_groups_menubar}} | ||
{{Menubar_VT}} | |||
{{Template:EGI-PayForUse-PoC_menubar}} | |||
{{TOC_right}} | |||
[[Category:Virtual_Teams]] | |||
The following table provides an overview of the technical details of the resource and technology providers for the PoC. | The following table provides an overview of the technical details of the resource and technology providers for the PoC. | ||
Line 16: | Line 21: | ||
! scope="col" | Preferred Payment Direct/Indirect | ! scope="col" | Preferred Payment Direct/Indirect | ||
! scope="col" | Grid Compute Price<br>[HEPSPEC06/hr] | ! scope="col" | Grid Compute Price<br>[HEPSPEC06/hr] | ||
! scope="col" | Cloud Compute Price<br>[ | ! scope="col" | Cloud Compute Price<br>[wallclock/hr] | ||
! scope="col" | Storage Price<br>[€/GB] | ! scope="col" | Grid Storage Price<br>[€/GB/Month] | ||
! scope="col" | Cloud Storage Price<br>[€/GB/Month] | |||
! scope="col" | VAT<br>[%] | |||
|- | |- | ||
! scope="row" | Albert Einstein Center, Univ. of Bern | ! scope="row" | Albert Einstein Center, Univ. of Bern | ||
Line 29: | Line 36: | ||
| Both | | Both | ||
| €0.03/hr | | €0.03/hr | ||
| N/A | |||
| No long-tem storage offered. Disk up to 20 TB for CPU usage period plus to weeks for free. | |||
| | | | ||
| 8% | |||
|- | |- | ||
! scope="row" | NGI_BG | ! scope="row" | NGI_BG | ||
| BG01-IPP; | | BG01-IPP; BG03-NGCC | ||
| Todor Gurov<br>Emanouil Atanassov | | Todor Gurov<br>Emanouil Atanassov | ||
| | | | ||
Line 41: | Line 51: | ||
*16 NVIDIA Tesla M2090 6 GB + 48 core Intel Xeon E5679 @ 2.53GHz with 4 GB of RAM per core | *16 NVIDIA Tesla M2090 6 GB + 48 core Intel Xeon E5679 @ 2.53GHz with 4 GB of RAM per core | ||
*576 cores Intel Xeon X5560 @ 2.8GHz with 1.5 GB of RAM per core | *576 cores Intel Xeon X5560 @ 2.8GHz with 1.5 GB of RAM per core | ||
* | *200 cores Intel Xeon E5430 @ 2.66GHz with 2 GB of RAM per core | ||
*MPI jobs | *MPI jobs | ||
*Non-blocking InfiniBand interconnect | *Non-blocking InfiniBand interconnect | ||
* | *140 TB of storage provisioned through Lustre FS (/home and /scratch systems), EMI dCache, EMI DPM, OpenStack Swift and OpenStack Cinder | ||
| Both | | Both | ||
| | | | ||
€1.00/GPU/hour + | *€1.00/GPU/hour + VAT (GPU-enabled servers) | ||
*€0.07/core/hour + VAT (CPU only Intel Xeon X5560-based cluster) | |||
*€0.05/core/hour + VAT (CPU only Intel Xeon E5430-based cluster) | |||
| N/A | |||
| €0.04/GB/month (+VAT) via dCache. Maximal capacity 30TB. | |||
| | | | ||
| 20% | |||
|- | |- | ||
! scope="row" | CESGA-IBERGRID | ! scope="row" | CESGA-IBERGRID | ||
| CESGA | | CESGA | ||
| | | Ivan Diaz <br> Ruben Diez | ||
| Batch + Cloud | | Batch + Cloud | ||
| | | | ||
Line 60: | Line 75: | ||
*240 cores (Cloud) Intel(R) Xeon(R) CPU E5520 2.27GHz | *240 cores (Cloud) Intel(R) Xeon(R) CPU E5520 2.27GHz | ||
*MPI jobs | *MPI jobs | ||
*RAM from | *RAM from 1GB to 32GB per core | ||
| Direct | | Direct | ||
Line 66: | Line 81: | ||
€0.02/core/HEPSPEC06 hour | €0.02/core/HEPSPEC06 hour | ||
| | | €0.04/core+2GB RAM/hour (+VAT) Example: | ||
*small: 1 core & 2GB €0.04/hour | |||
*medium: 2 cores & 4GB €0.08/hour | |||
*large: 4 cores & 8GB €0.16/hour | |||
| €0.055/GB/month (+VAT) | |||
| €0.055/GB/month (+VAT) | |||
| 21% | |||
|- | |- | ||
! scope="row" | IFCA-IBERGRID | ! scope="row" | IFCA-IBERGRID | ||
Line 81: | Line 103: | ||
| Both, Direct preferred | | Both, Direct preferred | ||
| | | | ||
€0.05/core/hour for usual instances , <0.01/core/HS06 hour (+ VAT) €0.04/core/hour for multicore use (>128 cores) | *€0.05/core/hour for usual instances, <0.01/core/HS06 hour (+ VAT) | ||
*€0.04/core/hour for multicore use (>128 cores) | |||
| €0.03 | |||
| Minimal storage free, requests up to 100 TB high performance storage possible | |||
| | | | ||
| 21% | |||
|- | |- | ||
! scope="row" | Institute of Informatics of the Slovak Academy of Sciences (II SAS) | ! scope="row" | Institute of Informatics of the Slovak Academy of Sciences (II SAS) | ||
Line 90: | Line 116: | ||
Ladislav Hluchý<br> Viet Tran | Ladislav Hluchý<br> Viet Tran | ||
| Cloud | | Cloud (Openstack) | ||
| | | | ||
*120 cores (Cloud) Intel(R) Xeon(R) CPU | *120 cores (Cloud) Intel(R) Xeon(R) CPU E5570 2.93GHz | ||
*1, 2, 4, 8 cores VMs | *1, 2, 4, 8 cores VMs | ||
*RAM up to 4GB per core | *RAM up to 4GB per core | ||
| Both | | Both | ||
| | | N/A | ||
| €0.06/core/h +VAT | |||
| TBD | |||
| | | | ||
| 20% | |||
|- | |- | ||
! scope="row" | Latvian Grid | ! scope="row" | Latvian Grid | ||
| IMCSUL | | IMCSUL | ||
| Kaspars Krampis | | Kaspars Krampis | ||
| | | Cloud: OpenStack, GRID: ARC + SLURM | ||
| | | | ||
* | *CPU: Up to 256 cores, RAM up to 4GB per core | ||
| TBC | | TBC | ||
| | | €0.07/core/hr + VAT | ||
| | | N/A | ||
| | | TBD | ||
| | | | ||
| 21% | |||
|- | |- | ||
! scope="row" | MASTER-UP Srl | ! scope="row" | MASTER-UP Srl | ||
| | | UNI-PERUGIA | ||
| | | | ||
Alessandro Costantini<br>Antonio Lagana | Alessandro Costantini<br>Antonio Lagana | ||
Line 135: | Line 156: | ||
| Direct | | Direct | ||
| | | €0.05 | ||
| | | N/A | ||
| €0.01/GB per month | |||
| €0. | |||
| | | | ||
| 22% | |||
|- | |- | ||
! scope="row" | NGI_GRNET | ! scope="row" | NGI_GRNET | ||
Line 158: | Line 170: | ||
| TBC | | TBC | ||
| €0.05/hr + | | €0.05/hr + VAT | ||
| €0.05 + VAT | |||
| TBD | |||
| | | | ||
| 23% | |||
|- | |- | ||
! scope="row" | NGI-IT | ! scope="row" | NGI-IT | ||
Line 173: | Line 188: | ||
*Cloud: OpenSTACK | *Cloud: OpenSTACK | ||
| | | Both | ||
| €0.07/hr + VAT | |||
| €0.05 + VAT | |||
| €0.02 + VAT | |||
| | |||
| 22% | |||
|- | |||
! scope="row" | 100 Percent IT | |||
| 100IT | |||
| David Blundell | |||
| Cloud (Openstack) | |||
| | | | ||
*Intel Xeon X5670 @ 2.93GHz | |||
*Cloud via OpenStack | |||
| Both | |||
| N/A | |||
| €0.07 + VAT | |||
| TBD | |||
| | | | ||
| 20% | |||
|- | |- | ||
! scope="row" | PL-Grid | ! scope="row" | PL-Grid | ||
| | | CYFRONET-LCG2 | ||
| Mariusz Sterzel | | Mariusz Sterzel | ||
| Cloud + Batch via Cream / EMI | | Cloud + Batch via Cream / EMI | ||
Line 190: | Line 221: | ||
| Both | | Both | ||
| | | €0.03 + VAT | ||
| €0.04 + VAT | |||
| TBD | |||
| | | | ||
| 23% | |||
|- | |- | ||
! scope="row" | TUBITAK ULAKBIM | ! scope="row" | TUBITAK ULAKBIM | ||
Line 204: | Line 238: | ||
| Both | | Both | ||
| €0.15/hour 8 core 24 GB instance | | €0.15/hour 8 core 24 GB instance | ||
| TBC | |||
| TBD | |||
| | | | ||
| 18% | |||
|- | |- | ||
! scope="row" | UIIP NASB | ! scope="row" | UIIP NASB | ||
Line 211: | Line 248: | ||
| Cloud + Batch | | Cloud + Batch | ||
| | | | ||
*Batch processing via UNICORE or | *Batch processing via UNICORE or QCG-Computing | ||
*Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs | *Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs | ||
*400 virtual CPUs | *400 virtual CPUs | ||
Line 219: | Line 256: | ||
| Indirect | | Indirect | ||
| $0.077/hr | | $0.077/hr 1 Core | ||
| | | $0.015/hr | ||
| $0.055/GB/month | |||
| $0.055/GB/month | |||
| 20% | |||
|- | |- | ||
! scope="row" | Fraunhofer SCAI | ! scope="row" | Fraunhofer SCAI | ||
| SCAI | | SCAI | ||
| Horst Schwichtenberg | | Horst Schwichtenberg | ||
| Cloud (Openstack) + | | Cloud (Openstack) + Grid (gLite) | ||
| | | | ||
Cloud: | |||
*Intel Xeon X5570 @ 2.93GHz | *Intel Xeon X5570 @ 2.93GHz | ||
*Non-blocking QDR InfiniBand interconnect (40GBps) | *Non-blocking QDR InfiniBand interconnect (40GBps) | ||
Grid: | |||
*AMD Opteron | |||
*DDR Infiniband | |||
| TBC | | TBC | ||
| €0.02 | |||
| TBC | | TBC | ||
| TBD | |||
| | |||
| 19% | |||
|- | |||
! scope="row" | CSC, IT Center for Science, Ltd. | |||
| CSC-cloud | |||
| Janne Ignatius, Luís Alves | |||
| Cloud (Openstack) | |||
| | | | ||
*Intel Xeon E5-2670 @ 2.6 GHz<br> | |||
| Direct | |||
| N/A | |||
| € 0.04 | |||
| N/A | |||
| N/A | |||
| 24% | |||
|} | |} | ||
Line 241: | Line 305: | ||
== Overview == | == Overview == | ||
To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot | To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot the numbers are not legally binding but obviously a ballpark figure would be good as it would give more realistic pilot reports. | ||
To define the charging rate the plan is to use a new feature of GOCDB which is known as | To define the charging rate the plan is to use a new feature of GOCDB which is known as 'A Key-Value Pair Property Bag Extensiblity Mechanism'. This allows the definition of arbitrary key-value pairs for a site or any service. If a community agrees a naming scheme for the keys and semantics for the values then they have a flexible and low overhead method of adding more information about anything defined in GOCDB. For anyone interested about more details this is documented https://wiki.egi.eu/wiki/GOCDB/Release4/Development/ExtensibilityMechanism | ||
== Instructions == | == Instructions == | ||
If you do not have access rights to change features of your site please ask the site manager or a site admin to do it for you. | |||
#Go to | #Go to GOCDB https://goc.egi.eu; | ||
#Navigate to your site. (My Sites) at the top of the left hand sidebar. | #Navigate to your site. (My Sites) at the top of the left hand sidebar. | ||
#Just above the list of Services you should see a new box called 'Site Extension Properties' | #Just above the list of Services you should see a new box called 'Site Extension Properties' | ||
#At the bottom of this box there is a big green plus titled 'Add Properties' – click on it | #At the bottom of this box there is a big green plus titled 'Add Properties' – click on it | ||
#This should show a window with two fields 'Property Name' and 'Property Value' | #This should show a window with two fields 'Property Name' and 'Property Value' | ||
#For 'Property Name' insert | #For 'Property Name' insert the 'Key Name' according to your desired 'Charge Type' (see table below) e.g. P4U_Pilot_Grid_CPU | ||
#For 'Property Value' insert a real number which will be interpreted as | #For 'Property Value' insert a real number which will be interpreted as shown in the Price Calculation column in the table below. e.g. Euros per HEPSPEC06 Hour. | ||
#Click the button 'Add Site Property' | #Click the button 'Add Site Property' | ||
#If you go back to the site view you will see | #If you go back to the site view you will see the 'Key Name' listed. You can edit or delete it. | ||
#Then add other properties from the table below as appropriate for your site. | |||
Once you have done this we will query GOCDB to pull the values for the pilot sites and the accounting portal will join them with usage data to produce a charging report. | |||
=== Charge Types / Properties === | |||
{| class="wikitable" | |||
|- | |||
! scope="col" | Charge Type | |||
! scope="col" | Key Name | |||
! scope="col" | Pricing | |||
|- | |||
! scope="row" | Grid CPU | |||
| P4U_Pilot_Grid_CPU | |||
| Euros/HEPSPEC06 Hour | |||
|- | |||
! scope="row" | Cloud CPU | |||
| P4U_Pilot_Cloud_Wall | |||
| Euros/Hour | |||
|- | |||
! scope="row" | Storage | |||
| P4U_Pilot_Storage_Use | |||
| Euros/GB*month | |||
|- | |||
! scope="row" | Cloud Storage | |||
| P4U_Pilot_Storage_Use_Cloud | |||
| Euros/GB*month | |||
|- | |||
! scope="row" | VAT | |||
| P4U_Pilot_VAT | |||
| Optional VAT rate to be applied to above | |||
|} | |||
<br> |
Latest revision as of 13:44, 19 June 2015
EGI Activity groups | Special Interest groups | Policy groups | Virtual teams | Distributed Competence Centres |
EGI Virtual teams: | Main • | Active Projects • | Closed Projects • | Guidelines |
Pay-For-Use menu: | Home • | Processes/Instructions • | Service/Price Overview • | Service Management • | Legal/Policy • | Actions • | Meetings • |
The following table provides an overview of the technical details of the resource and technology providers for the PoC.
Further below are instructions for adding pricing into the accounting mechanisms.
Resource Providers, Services and Prices
NGI/RC | GOCDB Name | Contact | Service Type | Services and Resources | Preferred Payment Direct/Indirect | Grid Compute Price [HEPSPEC06/hr] |
Cloud Compute Price [wallclock/hr] |
Grid Storage Price [€/GB/Month] |
Cloud Storage Price [€/GB/Month] |
VAT [%] |
---|---|---|---|---|---|---|---|---|---|---|
Albert Einstein Center, Univ. of Bern | UNIBE-LHEP | Sigve Haug | Batch via CENTOS 5/6 ARC CE |
|
Both | €0.03/hr | N/A | No long-tem storage offered. Disk up to 20 TB for CPU usage period plus to weeks for free. | 8% | |
NGI_BG | BG01-IPP; BG03-NGCC | Todor Gurov Emanouil Atanassov |
Batch & Grid: EMI-2/EMI-3 |
|
Both |
|
N/A | €0.04/GB/month (+VAT) via dCache. Maximal capacity 30TB. | 20% | |
CESGA-IBERGRID | CESGA | Ivan Diaz Ruben Diez |
Batch + Cloud |
|
Direct |
€0.02/core/HEPSPEC06 hour |
€0.04/core+2GB RAM/hour (+VAT) Example:
|
€0.055/GB/month (+VAT) | €0.055/GB/month (+VAT) | 21% |
IFCA-IBERGRID | IFCA-LCG2 | Jesus Marco | Batch (SLURM, SGE) + Cloud |
|
Both, Direct preferred |
|
€0.03 | Minimal storage free, requests up to 100 TB high performance storage possible | 21% | |
Institute of Informatics of the Slovak Academy of Sciences (II SAS) | IISAS-FedCloud |
Ladislav Hluchý |
Cloud (Openstack) |
|
Both | N/A | €0.06/core/h +VAT | TBD | 20% | |
Latvian Grid | IMCSUL | Kaspars Krampis | Cloud: OpenStack, GRID: ARC + SLURM |
|
TBC | €0.07/core/hr + VAT | N/A | TBD | 21% | |
MASTER-UP Srl | UNI-PERUGIA |
Alessandro Costantini |
EMI1/2, CEs, WNs, SE |
|
Direct | €0.05 | N/A | €0.01/GB per month | 22% | |
NGI_GRNET | All HG-* | Kostas Koumantaros | Cloud and Grid |
|
TBC | €0.05/hr + VAT | €0.05 + VAT | TBD | 23% | |
NGI-IT |
INFN-BARI PRISMA-INFN-BARI (cloud) INFN-XX |
Vincenzo Spinoso | EMI, OpenStack |
|
Both | €0.07/hr + VAT | €0.05 + VAT | €0.02 + VAT | 22% | |
100 Percent IT | 100IT | David Blundell | Cloud (Openstack) |
|
Both | N/A | €0.07 + VAT | TBD | 20% | |
PL-Grid | CYFRONET-LCG2 | Mariusz Sterzel | Cloud + Batch via Cream / EMI |
|
Both | €0.03 + VAT | €0.04 + VAT | TBD | 23% | |
TUBITAK ULAKBIM | TR-10-ULAKBIM | Onur Temizsoylu Feyza Eryol |
Cloud + Batch |
|
Both | €0.15/hour 8 core 24 GB instance | TBC | TBD | 18% | |
UIIP NASB | BY-UIIP | Serge Salamanka | Cloud + Batch |
|
Indirect | $0.077/hr 1 Core | $0.015/hr | $0.055/GB/month | $0.055/GB/month | 20% |
Fraunhofer SCAI | SCAI | Horst Schwichtenberg | Cloud (Openstack) + Grid (gLite) |
Cloud:
Grid:
|
TBC | €0.02 | TBC | TBD | 19% | |
CSC, IT Center for Science, Ltd. | CSC-cloud | Janne Ignatius, Luís Alves | Cloud (Openstack) |
|
Direct | N/A | € 0.04 | N/A | N/A | 24% |
Price in Accounting
Overview
To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot the numbers are not legally binding but obviously a ballpark figure would be good as it would give more realistic pilot reports.
To define the charging rate the plan is to use a new feature of GOCDB which is known as 'A Key-Value Pair Property Bag Extensiblity Mechanism'. This allows the definition of arbitrary key-value pairs for a site or any service. If a community agrees a naming scheme for the keys and semantics for the values then they have a flexible and low overhead method of adding more information about anything defined in GOCDB. For anyone interested about more details this is documented https://wiki.egi.eu/wiki/GOCDB/Release4/Development/ExtensibilityMechanism
Instructions
If you do not have access rights to change features of your site please ask the site manager or a site admin to do it for you.
- Go to GOCDB https://goc.egi.eu;
- Navigate to your site. (My Sites) at the top of the left hand sidebar.
- Just above the list of Services you should see a new box called 'Site Extension Properties'
- At the bottom of this box there is a big green plus titled 'Add Properties' – click on it
- This should show a window with two fields 'Property Name' and 'Property Value'
- For 'Property Name' insert the 'Key Name' according to your desired 'Charge Type' (see table below) e.g. P4U_Pilot_Grid_CPU
- For 'Property Value' insert a real number which will be interpreted as shown in the Price Calculation column in the table below. e.g. Euros per HEPSPEC06 Hour.
- Click the button 'Add Site Property'
- If you go back to the site view you will see the 'Key Name' listed. You can edit or delete it.
- Then add other properties from the table below as appropriate for your site.
Once you have done this we will query GOCDB to pull the values for the pilot sites and the accounting portal will join them with usage data to produce a charging report.
Charge Types / Properties
Charge Type | Key Name | Pricing |
---|---|---|
Grid CPU | P4U_Pilot_Grid_CPU | Euros/HEPSPEC06 Hour |
Cloud CPU | P4U_Pilot_Cloud_Wall | Euros/Hour |
Storage | P4U_Pilot_Storage_Use | Euros/GB*month |
Cloud Storage | P4U_Pilot_Storage_Use_Cloud | Euros/GB*month |
VAT | P4U_Pilot_VAT | Optional VAT rate to be applied to above |