Difference between revisions of "VT EGI Pay-for-Use Technical Details"
(99 intermediate revisions by 21 users not shown) | |||
Line 1: | Line 1: | ||
{{Template:EGI-PayForUse-PoC_menubar}} {{ | {{EGI_Activity_groups_menubar}} | ||
{{Menubar_VT}} | |||
{{Template:EGI-PayForUse-PoC_menubar}} | |||
{{TOC_right}} | |||
[[Category:Virtual_Teams]] | |||
The following table provides an overview of the technical details of the resource and technology providers for the PoC. | The following table provides an overview of the technical details of the resource and technology providers for the PoC. | ||
Line 5: | Line 10: | ||
Further below are instructions for adding pricing into the accounting mechanisms. | Further below are instructions for adding pricing into the accounting mechanisms. | ||
= | = Resource Providers, Services and Prices = | ||
{| class="wikitable" | {| class="wikitable" | ||
Line 11: | Line 16: | ||
! scope="col" | NGI/RC | ! scope="col" | NGI/RC | ||
! scope="col" | GOCDB Name | ! scope="col" | GOCDB Name | ||
! scope="col" | Contact | |||
! scope="col" | Service Type | ! scope="col" | Service Type | ||
! scope="col" | Services and Resources | ! scope="col" | Services and Resources | ||
! scope="col" | Preferred Payment Direct/Indirect | ! scope="col" | Preferred Payment Direct/Indirect | ||
! scope="col" | Price | ! scope="col" | Grid Compute Price<br>[HEPSPEC06/hr] | ||
! scope="col" | Cloud Compute Price<br>[wallclock/hr] | |||
! scope="col" | Grid Storage Price<br>[€/GB/Month] | |||
! scope="col" | Cloud Storage Price<br>[€/GB/Month] | |||
! scope="col" | VAT<br>[%] | |||
|- | |- | ||
! scope="row" | Albert Einstein Center, Univ. of Bern | ! scope="row" | Albert Einstein Center, Univ. of Bern | ||
| UNIBE-LHEP | | UNIBE-LHEP | ||
| Sigve Haug | |||
| Batch via CENTOS 5/6 ARC CE <br> | | Batch via CENTOS 5/6 ARC CE <br> | ||
| | | | ||
Line 25: | Line 36: | ||
| Both | | Both | ||
| €0.03/hr; | | €0.03/hr | ||
| N/A | |||
| No long-tem storage offered. Disk up to 20 TB for CPU usage period plus to weeks for free. | |||
| | |||
| 8% | |||
|- | |||
! scope="row" | NGI_BG | |||
| BG01-IPP; BG03-NGCC | |||
| Todor Gurov<br>Emanouil Atanassov | |||
| | |||
Batch & Grid: EMI-2/EMI-3 <br> Cloud: OpenStack - FedCloud | |||
| | |||
*16 NVIDIA Tesla M2090 6 GB + 48 core Intel Xeon E5679 @ 2.53GHz with 4 GB of RAM per core | |||
*576 cores Intel Xeon X5560 @ 2.8GHz with 1.5 GB of RAM per core | |||
*200 cores Intel Xeon E5430 @ 2.66GHz with 2 GB of RAM per core | |||
*MPI jobs | |||
*Non-blocking InfiniBand interconnect | |||
*140 TB of storage provisioned through Lustre FS (/home and /scratch systems), EMI dCache, EMI DPM, OpenStack Swift and OpenStack Cinder | |||
| Both | |||
| | |||
*€1.00/GPU/hour + VAT (GPU-enabled servers) | |||
*€0.07/core/hour + VAT (CPU only Intel Xeon X5560-based cluster) | |||
*€0.05/core/hour + VAT (CPU only Intel Xeon E5430-based cluster) | |||
| N/A | |||
| €0.04/GB/month (+VAT) via dCache. Maximal capacity 30TB. | |||
| | |||
| 20% | |||
|- | |- | ||
! scope="row" | | ! scope="row" | CESGA-IBERGRID | ||
| | | CESGA | ||
| | | Ivan Diaz <br> Ruben Diez | ||
| Batch + Cloud | |||
| | |||
*720 cores (Batch) AMD Opteron(tm) Processor 6174 2.2Ghz | |||
*240 cores (Cloud) Intel(R) Xeon(R) CPU E5520 2.27GHz | |||
*MPI jobs | |||
*RAM from 1GB to 32GB per core | |||
| Direct | |||
| | | | ||
* | €0.02/core/HEPSPEC06 hour | ||
| €0.04/core+2GB RAM/hour (+VAT) Example: | |||
*small: 1 core & 2GB €0.04/hour | |||
*medium: 2 cores & 4GB €0.08/hour | |||
*large: 4 cores & 8GB €0.16/hour | |||
| | | €0.055/GB/month (+VAT) | ||
| | | €0.055/GB/month (+VAT) | ||
| 21% | |||
|- | |- | ||
! scope="row" | IFCA-IBERGRID | ! scope="row" | IFCA-IBERGRID | ||
| | | IFCA-LCG2 | ||
| Batch (SLURM, SGE) | | Jesus Marco | ||
| Batch (SLURM, SGE) + Cloud | |||
| | | | ||
*Batch via CREAM CE | |||
*Cloud via OpenStack | |||
*Up to 2500 cores in servers with 4, 8, 16, 40 physical cores | *Up to 2500 cores in servers with 4, 8, 16, 40 physical cores | ||
*Infiniband access to other nodes and storage possible for MPI jobs | *Infiniband access to other nodes and storage possible for MPI jobs | ||
*RAM from 4GB to 256GB per core (max 1TB) | *RAM from 4GB to 256GB per core (max 1TB) | ||
| Direct | | Both, Direct preferred | ||
| | | | ||
€0.05/core/hour for usual instances | *€0.05/core/hour for usual instances, <0.01/core/HS06 hour (+ VAT) | ||
*€0.04/core/hour for multicore use (>128 cores) | |||
| €0.03 | |||
| Minimal storage free, requests up to 100 TB high performance storage possible | |||
| | |||
| 21% | |||
|- | |- | ||
! scope="row" | Institute of Informatics of the Slovak Academy of Sciences | ! scope="row" | Institute of Informatics of the Slovak Academy of Sciences (II SAS) | ||
| IISAS-FedCloud | | IISAS-FedCloud | ||
| | | | ||
* | Ladislav Hluchý<br> Viet Tran | ||
| Cloud (Openstack) | |||
| | |||
*120 cores (Cloud) Intel(R) Xeon(R) CPU E5570 2.93GHz | |||
*1, 2, 4, 8 cores VMs | |||
*RAM up to 4GB per core | |||
| | | Both | ||
| | | N/A | ||
| €0.06/core/h +VAT | |||
| TBD | |||
| | |||
| 20% | |||
|- | |- | ||
! scope="row" | Latvian Grid | ! scope="row" | Latvian Grid | ||
| IMCSUL | | IMCSUL | ||
| | | Kaspars Krampis | ||
| Cloud: OpenStack, GRID: ARC + SLURM | |||
| | | | ||
* | *CPU: Up to 256 cores, RAM up to 4GB per core | ||
| TBC | | TBC | ||
| | | €0.07/core/hr + VAT | ||
| N/A | |||
| TBD | |||
| | |||
| 21% | |||
|- | |- | ||
! scope="row" | | ! scope="row" | MASTER-UP Srl | ||
| | | UNI-PERUGIA | ||
| | | | ||
Alessandro Costantini<br>Antonio Lagana | |||
| EMI1/2, CEs, WNs, SE | | EMI1/2, CEs, WNs, SE | ||
| | | | ||
Line 90: | Line 156: | ||
| Direct | | Direct | ||
| | | €0.05 | ||
| | | N/A | ||
| €0.01/GB per month | |||
| | | | ||
| 22% | |||
| | |||
|- | |- | ||
! scope="row" | NGI_GRNET | ! scope="row" | NGI_GRNET | ||
| All HG-* | | All HG-* | ||
| Kostas Koumantaros | |||
| Cloud and Grid | | Cloud and Grid | ||
| | | | ||
Line 109: | Line 170: | ||
| TBC | | TBC | ||
| €0.05/hr | | €0.05/hr + VAT | ||
| €0.05 + VAT | |||
| TBD | |||
| | |||
| 23% | |||
|- | |- | ||
! scope="row" | NGI-IT | ! scope="row" | NGI-IT | ||
| | | | ||
| EMI | INFN-BARI PRISMA-INFN-BARI (cloud) | ||
INFN-XX | |||
| Vincenzo Spinoso | |||
| EMI, OpenStack | |||
| | | | ||
*gLite MW stack: Cream CE, LFC, Storm SE, WMS+LB, BDII. | *gLite MW stack: Cream CE, LFC, Storm SE, WMS+LB, BDII. | ||
*Cloud: | *Cloud: OpenSTACK | ||
| Both | |||
| €0.07/hr + VAT | |||
| €0.05 + VAT | |||
| €0.02 + VAT | |||
| | |||
| 22% | |||
|- | |||
! scope="row" | 100 Percent IT | |||
| 100IT | |||
| David Blundell | |||
| Cloud (Openstack) | |||
| | |||
*Intel Xeon X5670 @ 2.93GHz | |||
*Cloud via OpenStack | |||
| Both | |||
| N/A | |||
| €0.07 + VAT | |||
| TBD | | TBD | ||
| | | | ||
| 20% | |||
|- | |- | ||
! scope="row" | PL-Grid | ! scope="row" | PL-Grid | ||
| | | CYFRONET-LCG2 | ||
| Mariusz Sterzel | |||
| Cloud + Batch via Cream / EMI | | Cloud + Batch via Cream / EMI | ||
| | | | ||
Line 131: | Line 221: | ||
| Both | | Both | ||
| | | €0.03 + VAT | ||
| €0.04 + VAT | |||
| TBD | |||
| | |||
| 23% | |||
|- | |- | ||
! scope="row" | TUBITAK ULAKBIM | ! scope="row" | TUBITAK ULAKBIM | ||
| TR-10-ULAKBIM | | TR-10-ULAKBIM | ||
| Onur Temizsoylu<br>Feyza Eryol | |||
| Cloud + Batch | | Cloud + Batch | ||
| | | | ||
Line 142: | Line 237: | ||
| Both | | Both | ||
| €0.15/hour 8 core 24 GB instance | | €0.15/hour 8 core 24 GB instance | ||
| TBC | |||
| TBD | |||
| | |||
| 18% | |||
|- | |- | ||
! scope="row" | UIIP NASB | ! scope="row" | UIIP NASB | ||
| BY-UIIP | | BY-UIIP | ||
| Serge Salamanka | |||
| Cloud + Batch | | Cloud + Batch | ||
| | | | ||
*Batch processing via UNICORE or | *Batch processing via UNICORE or QCG-Computing | ||
*Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs | *Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs | ||
*400 virtual CPUs | *400 virtual CPUs | ||
Line 156: | Line 256: | ||
| Indirect | | Indirect | ||
| $0.077/hr (TBD) | | $0.077/hr 1 Core | ||
| $0.015/hr | |||
| $0.055/GB/month | |||
| $0.055/GB/month | |||
| 20% | |||
|- | |||
! scope="row" | Fraunhofer SCAI | |||
| SCAI | |||
| Horst Schwichtenberg | |||
| Cloud (Openstack) + Grid (gLite) | |||
| | |||
Cloud: | |||
*Intel Xeon X5570 @ 2.93GHz | |||
*Non-blocking QDR InfiniBand interconnect (40GBps) | |||
Grid: | |||
*AMD Opteron | |||
*DDR Infiniband | |||
| TBC | |||
| €0.02 | |||
| TBC | |||
| TBD | |||
| | |||
| 19% | |||
|- | |||
! scope="row" | CSC, IT Center for Science, Ltd. | |||
| CSC-cloud | |||
| Janne Ignatius, Luís Alves | |||
| Cloud (Openstack) | |||
| | |||
*Intel Xeon E5-2670 @ 2.6 GHz<br> | |||
| Direct | |||
| N/A | |||
| € 0.04 | |||
| N/A | |||
| N/A | |||
| 24% | |||
|} | |} | ||
<br> | <br> | ||
= Price in Accounting<br> = | |||
= | == Overview == | ||
To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot | To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot the numbers are not legally binding but obviously a ballpark figure would be good as it would give more realistic pilot reports. | ||
To define the charging rate the plan is to use a new feature of GOCDB which is known as | To define the charging rate the plan is to use a new feature of GOCDB which is known as 'A Key-Value Pair Property Bag Extensiblity Mechanism'. This allows the definition of arbitrary key-value pairs for a site or any service. If a community agrees a naming scheme for the keys and semantics for the values then they have a flexible and low overhead method of adding more information about anything defined in GOCDB. For anyone interested about more details this is documented https://wiki.egi.eu/wiki/GOCDB/Release4/Development/ExtensibilityMechanism | ||
== Instructions | == Instructions == | ||
If you do not have access rights to change features of your site please ask the site manager or a site admin to do it for you. | |||
#Go to | #Go to GOCDB https://goc.egi.eu; | ||
#Navigate to your site. (My Sites) at the top of the left hand sidebar. | #Navigate to your site. (My Sites) at the top of the left hand sidebar. | ||
#Just above the list of Services you should see a new box called | #Just above the list of Services you should see a new box called 'Site Extension Properties' | ||
#At the bottom of this box there is a big green plus titled | #At the bottom of this box there is a big green plus titled 'Add Properties' – click on it | ||
#This should show a window with two fields Property Name and Property Value | #This should show a window with two fields 'Property Name' and 'Property Value' | ||
#For Property Name insert | #For 'Property Name' insert the 'Key Name' according to your desired 'Charge Type' (see table below) e.g. P4U_Pilot_Grid_CPU | ||
#For Property Value insert a real number which will be interpreted as | #For 'Property Value' insert a real number which will be interpreted as shown in the Price Calculation column in the table below. e.g. Euros per HEPSPEC06 Hour. | ||
#Click the button | #Click the button 'Add Site Property' | ||
#If you go back to the site view you will see | #If you go back to the site view you will see the 'Key Name' listed. You can edit or delete it. | ||
#Then add other properties from the table below as appropriate for your site. | |||
Once you have done this we will query GOCDB to pull the values for the pilot sites and the accounting portal will join them with usage data to produce a charging report. | |||
=== Charge Types / Properties === | |||
{| class="wikitable" | |||
|- | |||
! scope="col" | Charge Type | |||
! scope="col" | Key Name | |||
! scope="col" | Pricing | |||
|- | |||
! scope="row" | Grid CPU | |||
| P4U_Pilot_Grid_CPU | |||
| Euros/HEPSPEC06 Hour | |||
|- | |||
! scope="row" | Cloud CPU | |||
| P4U_Pilot_Cloud_Wall | |||
| Euros/Hour | |||
|- | |||
! scope="row" | Storage | |||
| P4U_Pilot_Storage_Use | |||
| Euros/GB*month | |||
|- | |||
! scope="row" | Cloud Storage | |||
| P4U_Pilot_Storage_Use_Cloud | |||
| Euros/GB*month | |||
|- | |||
! scope="row" | VAT | |||
| P4U_Pilot_VAT | |||
| Optional VAT rate to be applied to above | |||
|} | |||
<br> |
Latest revision as of 13:44, 19 June 2015
EGI Activity groups | Special Interest groups | Policy groups | Virtual teams | Distributed Competence Centres |
EGI Virtual teams: | Main • | Active Projects • | Closed Projects • | Guidelines |
Pay-For-Use menu: | Home • | Processes/Instructions • | Service/Price Overview • | Service Management • | Legal/Policy • | Actions • | Meetings • |
The following table provides an overview of the technical details of the resource and technology providers for the PoC.
Further below are instructions for adding pricing into the accounting mechanisms.
Resource Providers, Services and Prices
NGI/RC | GOCDB Name | Contact | Service Type | Services and Resources | Preferred Payment Direct/Indirect | Grid Compute Price [HEPSPEC06/hr] |
Cloud Compute Price [wallclock/hr] |
Grid Storage Price [€/GB/Month] |
Cloud Storage Price [€/GB/Month] |
VAT [%] |
---|---|---|---|---|---|---|---|---|---|---|
Albert Einstein Center, Univ. of Bern | UNIBE-LHEP | Sigve Haug | Batch via CENTOS 5/6 ARC CE |
|
Both | €0.03/hr | N/A | No long-tem storage offered. Disk up to 20 TB for CPU usage period plus to weeks for free. | 8% | |
NGI_BG | BG01-IPP; BG03-NGCC | Todor Gurov Emanouil Atanassov |
Batch & Grid: EMI-2/EMI-3 |
|
Both |
|
N/A | €0.04/GB/month (+VAT) via dCache. Maximal capacity 30TB. | 20% | |
CESGA-IBERGRID | CESGA | Ivan Diaz Ruben Diez |
Batch + Cloud |
|
Direct |
€0.02/core/HEPSPEC06 hour |
€0.04/core+2GB RAM/hour (+VAT) Example:
|
€0.055/GB/month (+VAT) | €0.055/GB/month (+VAT) | 21% |
IFCA-IBERGRID | IFCA-LCG2 | Jesus Marco | Batch (SLURM, SGE) + Cloud |
|
Both, Direct preferred |
|
€0.03 | Minimal storage free, requests up to 100 TB high performance storage possible | 21% | |
Institute of Informatics of the Slovak Academy of Sciences (II SAS) | IISAS-FedCloud |
Ladislav Hluchý |
Cloud (Openstack) |
|
Both | N/A | €0.06/core/h +VAT | TBD | 20% | |
Latvian Grid | IMCSUL | Kaspars Krampis | Cloud: OpenStack, GRID: ARC + SLURM |
|
TBC | €0.07/core/hr + VAT | N/A | TBD | 21% | |
MASTER-UP Srl | UNI-PERUGIA |
Alessandro Costantini |
EMI1/2, CEs, WNs, SE |
|
Direct | €0.05 | N/A | €0.01/GB per month | 22% | |
NGI_GRNET | All HG-* | Kostas Koumantaros | Cloud and Grid |
|
TBC | €0.05/hr + VAT | €0.05 + VAT | TBD | 23% | |
NGI-IT |
INFN-BARI PRISMA-INFN-BARI (cloud) INFN-XX |
Vincenzo Spinoso | EMI, OpenStack |
|
Both | €0.07/hr + VAT | €0.05 + VAT | €0.02 + VAT | 22% | |
100 Percent IT | 100IT | David Blundell | Cloud (Openstack) |
|
Both | N/A | €0.07 + VAT | TBD | 20% | |
PL-Grid | CYFRONET-LCG2 | Mariusz Sterzel | Cloud + Batch via Cream / EMI |
|
Both | €0.03 + VAT | €0.04 + VAT | TBD | 23% | |
TUBITAK ULAKBIM | TR-10-ULAKBIM | Onur Temizsoylu Feyza Eryol |
Cloud + Batch |
|
Both | €0.15/hour 8 core 24 GB instance | TBC | TBD | 18% | |
UIIP NASB | BY-UIIP | Serge Salamanka | Cloud + Batch |
|
Indirect | $0.077/hr 1 Core | $0.015/hr | $0.055/GB/month | $0.055/GB/month | 20% |
Fraunhofer SCAI | SCAI | Horst Schwichtenberg | Cloud (Openstack) + Grid (gLite) |
Cloud:
Grid:
|
TBC | €0.02 | TBC | TBD | 19% | |
CSC, IT Center for Science, Ltd. | CSC-cloud | Janne Ignatius, Luís Alves | Cloud (Openstack) |
|
Direct | N/A | € 0.04 | N/A | N/A | 24% |
Price in Accounting
Overview
To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot the numbers are not legally binding but obviously a ballpark figure would be good as it would give more realistic pilot reports.
To define the charging rate the plan is to use a new feature of GOCDB which is known as 'A Key-Value Pair Property Bag Extensiblity Mechanism'. This allows the definition of arbitrary key-value pairs for a site or any service. If a community agrees a naming scheme for the keys and semantics for the values then they have a flexible and low overhead method of adding more information about anything defined in GOCDB. For anyone interested about more details this is documented https://wiki.egi.eu/wiki/GOCDB/Release4/Development/ExtensibilityMechanism
Instructions
If you do not have access rights to change features of your site please ask the site manager or a site admin to do it for you.
- Go to GOCDB https://goc.egi.eu;
- Navigate to your site. (My Sites) at the top of the left hand sidebar.
- Just above the list of Services you should see a new box called 'Site Extension Properties'
- At the bottom of this box there is a big green plus titled 'Add Properties' – click on it
- This should show a window with two fields 'Property Name' and 'Property Value'
- For 'Property Name' insert the 'Key Name' according to your desired 'Charge Type' (see table below) e.g. P4U_Pilot_Grid_CPU
- For 'Property Value' insert a real number which will be interpreted as shown in the Price Calculation column in the table below. e.g. Euros per HEPSPEC06 Hour.
- Click the button 'Add Site Property'
- If you go back to the site view you will see the 'Key Name' listed. You can edit or delete it.
- Then add other properties from the table below as appropriate for your site.
Once you have done this we will query GOCDB to pull the values for the pilot sites and the accounting portal will join them with usage data to produce a charging report.
Charge Types / Properties
Charge Type | Key Name | Pricing |
---|---|---|
Grid CPU | P4U_Pilot_Grid_CPU | Euros/HEPSPEC06 Hour |
Cloud CPU | P4U_Pilot_Cloud_Wall | Euros/Hour |
Storage | P4U_Pilot_Storage_Use | Euros/GB*month |
Cloud Storage | P4U_Pilot_Storage_Use_Cloud | Euros/GB*month |
VAT | P4U_Pilot_VAT | Optional VAT rate to be applied to above |