VT EGI Pay-for-Use Technical Details

From EGIWiki
Jump to: navigation, search
EGI Activity groups Special Interest groups Policy groups Virtual teams Distributed Competence Centres


EGI Virtual teams: Main Active Projects Closed Projects Guidelines
Pay-For-Use menu: Home Processes/Instructions Service/Price Overview Service Management Legal/Policy Actions Meetings



The following table provides an overview of the technical details of the resource and technology providers for the PoC.

Further below are instructions for adding pricing into the accounting mechanisms.

Resource Providers, Services and Prices

NGI/RC GOCDB Name Contact Service Type Services and Resources Preferred Payment Direct/Indirect Grid Compute Price
[HEPSPEC06/hr]
Cloud Compute Price
[wallclock/hr]
Grid Storage Price
[€/GB/Month]
Cloud Storage Price
[€/GB/Month]
VAT
[%]
Albert Einstein Center, Univ. of Bern UNIBE-LHEP Sigve Haug Batch via CENTOS 5/6 ARC CE
  • 500 cores (approx. 2 months in 2013) on highest priority;
  • Consumption preferably in one go, but distributed in time also possible
  • 10-20 TB disk on local SE for consumption period via DPM SRM interface plus two weeks
Both €0.03/hr N/A No long-tem storage offered. Disk up to 20 TB for CPU usage period plus to weeks for free. 8%
NGI_BG BG01-IPP; BG03-NGCC Todor Gurov
Emanouil Atanassov

Batch & Grid: EMI-2/EMI-3
Cloud: OpenStack - FedCloud

  • 16 NVIDIA Tesla M2090 6 GB + 48 core Intel Xeon E5679 @ 2.53GHz with 4 GB of RAM per core
  • 576 cores Intel Xeon X5560 @ 2.8GHz with 1.5 GB of RAM per core
  • 200 cores Intel Xeon E5430 @ 2.66GHz with 2 GB of RAM per core
  • MPI jobs
  • Non-blocking InfiniBand interconnect
  • 140 TB of storage provisioned through Lustre FS (/home and /scratch systems), EMI dCache, EMI DPM, OpenStack Swift and OpenStack Cinder
Both
  • €1.00/GPU/hour + VAT (GPU-enabled servers)
  • €0.07/core/hour + VAT (CPU only Intel Xeon X5560-based cluster)
  • €0.05/core/hour + VAT (CPU only Intel Xeon E5430-based cluster)
N/A €0.04/GB/month (+VAT) via dCache. Maximal capacity 30TB. 20%
CESGA-IBERGRID CESGA Ivan Diaz
Ruben Diez
Batch + Cloud
  • 720 cores (Batch) AMD Opteron(tm) Processor 6174 2.2Ghz
  • 240 cores (Cloud) Intel(R) Xeon(R) CPU E5520 2.27GHz
  • MPI jobs
  • RAM from 1GB to 32GB per core
Direct

€0.02/core/HEPSPEC06 hour

€0.04/core+2GB RAM/hour (+VAT) Example:
  • small: 1 core & 2GB €0.04/hour
  • medium: 2 cores & 4GB €0.08/hour
  • large: 4 cores & 8GB €0.16/hour
€0.055/GB/month (+VAT) €0.055/GB/month (+VAT) 21%
IFCA-IBERGRID IFCA-LCG2 Jesus Marco Batch (SLURM, SGE) + Cloud
  • Batch via CREAM CE
  • Cloud via OpenStack
  • Up to 2500 cores in servers with 4, 8, 16, 40 physical cores
  • Infiniband access to other nodes and storage possible for MPI jobs
  • RAM from 4GB to 256GB per core (max 1TB)
Both, Direct preferred
  • €0.05/core/hour for usual instances, <0.01/core/HS06 hour (+ VAT)
  • €0.04/core/hour for multicore use (>128 cores)
€0.03 Minimal storage free, requests up to 100 TB high performance storage possible 21%
Institute of Informatics of the Slovak Academy of Sciences (II SAS) IISAS-FedCloud

Ladislav Hluchý
Viet Tran

Cloud (Openstack)
  • 120 cores (Cloud) Intel(R) Xeon(R) CPU E5570 2.93GHz
  • 1, 2, 4, 8 cores VMs
  • RAM up to 4GB per core
Both N/A €0.06/core/h +VAT TBD 20%
Latvian Grid IMCSUL Kaspars Krampis Cloud: OpenStack, GRID: ARC + SLURM
  • CPU: Up to 256 cores, RAM up to 4GB per core
TBC €0.07/core/hr + VAT N/A TBD 21%
MASTER-UP Srl UNI-PERUGIA

Alessandro Costantini
Antonio Lagana

EMI1/2, CEs, WNs, SE
  • EMI1 middleware (phasing to EMI2) - CE's, WN's and SE.
  • 10 nodes to start (intel 4core, ethernet connection)
  • Long experience in Molecular Science and Comp Chem, can provide support for such innovative applications and in the field of R&D for combustion, energy and material science.
  • Managing a computer farm of 200 cores and 4TB of storage part of those resources are supporting EGI.
Direct €0.05 N/A €0.01/GB per month 22%
NGI_GRNET All HG-* Kostas Koumantaros Cloud and Grid
  • TBC
TBC €0.05/hr + VAT €0.05 + VAT TBD 23%
NGI-IT

INFN-BARI PRISMA-INFN-BARI (cloud)

INFN-XX

Vincenzo Spinoso EMI, OpenStack
  • gLite MW stack: Cream CE, LFC, Storm SE, WMS+LB, BDII.
  • Cloud: OpenSTACK
Both €0.07/hr + VAT €0.05 + VAT €0.02 + VAT 22%
100 Percent IT 100IT David Blundell Cloud (Openstack)
  • Intel Xeon X5670 @ 2.93GHz
  • Cloud via OpenStack
Both N/A €0.07 + VAT TBD 20%
PL-Grid CYFRONET-LCG2 Mariusz Sterzel Cloud + Batch via Cream / EMI
  • Computing power, storage, and human support
  • Batch processing via Cream CE/EMI
  • Cloud access
  • Non-grid, local access to queue system
Both €0.03 + VAT €0.04 + VAT TBD 23%
TUBITAK ULAKBIM TR-10-ULAKBIM Onur Temizsoylu
Feyza Eryol
Cloud + Batch
  • Batch processing via Cream CE
  • VM Management using OpenNebula/OCCI
  • Infiniband connected Linux computing resources
Both €0.15/hour 8 core 24 GB instance TBC TBD 18%
UIIP NASB BY-UIIP Serge Salamanka Cloud + Batch
  • Batch processing via UNICORE or QCG-Computing
  • Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs
  • 400 virtual CPUs
  • 400 Gb memory
  • 8TB Disk storage – 9-12TB Storage servers
  • Infiniband DDR 20Gbit/sec]
Indirect $0.077/hr 1 Core $0.015/hr $0.055/GB/month $0.055/GB/month 20%
Fraunhofer SCAI SCAI Horst Schwichtenberg Cloud (Openstack) + Grid (gLite)

Cloud:

  • Intel Xeon X5570 @ 2.93GHz
  • Non-blocking QDR InfiniBand interconnect (40GBps)

Grid:

  • AMD Opteron
  • DDR Infiniband
TBC €0.02 TBC TBD 19%
CSC, IT Center for Science, Ltd. CSC-cloud Janne Ignatius, Luís Alves Cloud (Openstack)
  • Intel Xeon E5-2670 @ 2.6 GHz
Direct N/A € 0.04 N/A N/A 24%


Price in Accounting

Overview

To test the mechanism for turning your accounting into a monetary charge charging rate needs to be defined. During the pilot the numbers are not legally binding but obviously a ballpark figure would be good as it would give more realistic pilot reports.

To define the charging rate the plan is to use a new feature of GOCDB which is known as 'A Key-Value Pair Property Bag Extensiblity Mechanism'. This allows the definition of arbitrary key-value pairs for a site or any service. If a community agrees a naming scheme for the keys and semantics for the values then they have a flexible and low overhead method of adding more information about anything defined in GOCDB. For anyone interested about more details this is documented https://wiki.egi.eu/wiki/GOCDB/Release4/Development/ExtensibilityMechanism

Instructions

If you do not have access rights to change features of your site please ask the site manager or a site admin to do it for you.

  1. Go to GOCDB https://goc.egi.eu;
  2. Navigate to your site. (My Sites) at the top of the left hand sidebar.
  3. Just above the list of Services you should see a new box called 'Site Extension Properties'
  4. At the bottom of this box there is a big green plus titled 'Add Properties' – click on it
  5. This should show a window with two fields 'Property Name' and 'Property Value'
  6. For 'Property Name' insert the 'Key Name' according to your desired 'Charge Type' (see table below) e.g. P4U_Pilot_Grid_CPU
  7. For 'Property Value' insert a real number which will be interpreted as shown in the Price Calculation column in the table below. e.g. Euros per HEPSPEC06 Hour.
  8. Click the button 'Add Site Property'
  9. If you go back to the site view you will see the 'Key Name' listed. You can edit or delete it.
  10. Then add other properties from the table below as appropriate for your site.

Once you have done this we will query GOCDB to pull the values for the pilot sites and the accounting portal will join them with usage data to produce a charging report.

Charge Types / Properties

Charge Type Key Name Pricing
Grid CPU P4U_Pilot_Grid_CPU Euros/HEPSPEC06 Hour
Cloud CPU P4U_Pilot_Cloud_Wall Euros/Hour
Storage P4U_Pilot_Storage_Use Euros/GB*month
Cloud Storage P4U_Pilot_Storage_Use_Cloud Euros/GB*month
VAT P4U_Pilot_VAT Optional VAT rate to be applied to above