Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

EGI Pay-for-Use PoC:Business Cases/Workplan

From EGIWiki
Revision as of 14:40, 7 March 2014 by Syh (talk | contribs) (→‎By Roles)
Jump to navigation Jump to search
Pay-For-Use menu: Home Processes/Instructions Service/Price Overview Service Management Legal/Policy Actions Meetings



List of selected business cases and overall workplan of agreed activities.

(To be developed)

Business Cases

Roles

  • Consumer (User): The person actually using the service (user).
  • Customer: The person or entity that negotiates the level of services and commissions the service provider or broker and may pay, doing so on behalf of a number of consumers (users).
  • Resource Provider: An organisation offering access to ICT resources through service abstractions (e.g., computing power, storage).
  • Broker: An organisation facilitating or arranging transactions and agreements between a customer and one or more resource providers.
  • Technology Provider: A person or entity providing the required technology to support service delivery.

User Stories

A list of potential questions that each role may ask or scenarios that will lead to the developments required:

See wikipedia page

General

Define, at least, the "first level" or "base" service we are going to provide for each class of services.

By Roles

Role Question Contact Service Type Services and Resources Preferred Payment Direct/Indirect Grid Compute Price
[HEPSPEC06/hr]
Cloud Compute Price
[TBD]
Storage Price
[€/GB]
VAT
[%]
Albert Einstein Center, Univ. of Bern UNIBE-LHEP Sigve Haug Batch via CENTOS 5/6 ARC CE
  • 500 cores (approx. 2 months in 2013) on highest priority;
  • Consumption preferably in one go, but distributed in time also possible
  • 10-20 TB disk on local SE for consumption period via DPM SRM interface plus two weeks
Both €0.03/hr
  • Free for PoC
  • Other TBD
NGI_BG BG01-IPP; BG03-NGCC Todor Gurov
Emanouil Atanassov

Batch & Grid: EMI-2/EMI-3
Cloud: OpenStack - FedCloud

  • 16 NVIDIA Tesla M2090 6 GB + 48 core Intel Xeon E5679 @ 2.53GHz with 4 GB of RAM per core
  • 576 cores Intel Xeon X5560 @ 2.8GHz with 1.5 GB of RAM per core
  • 200 cores Intel Xeon E5430 @ 2.66GHz with 2 GB of RAM per core
  • MPI jobs
  • Non-blocking InfiniBand interconnect
  • 140 TB of storage provisioned through Lustre FS (/home and /scratch systems), EMI dCache, EMI DPM, OpenStack Swift and OpenStack Cinder
Both
  • €1.00/GPU/hour + VAT (GPU-enabled servers)
  • €0.07/core/hour + VAT (CPU only Intel Xeon X5560-based cluster)
  • €0.05/core/hour + VAT (CPU only Intel Xeon E5430-based cluster)
20%
CESGA-IBERGRID CESGA Alvaro Simon
Ivan Diaz
Batch + Cloud
  • 720 cores (Batch) AMD Opteron(tm) Processor 6174 2.2Ghz
  • 240 cores (Cloud) Intel(R) Xeon(R) CPU E5520 2.27GHz
  • MPI jobs
  • RAM from 4GB to 32GB per core
Direct

€0.02/core/HEPSPEC06 hour

IFCA-IBERGRID IFCA-LCG2 Jesus Marco Batch (SLURM, SGE) + Cloud
  • Batch via CREAM CE
  • Cloud via OpenStack
  • Up to 2500 cores in servers with 4, 8, 16, 40 physical cores
  • Infiniband access to other nodes and storage possible for MPI jobs
  • RAM from 4GB to 256GB per core (max 1TB)
Both, Direct preferred
  • €0.05/core/hour for usual instances, <0.01/core/HS06 hour (+ VAT)
  • €0.04/core/hour for multicore use (>128 cores)
Minimal storage free, requests up to 100 TB high performance storage possible
Institute of Informatics of the Slovak Academy of Sciences (II SAS) IISAS-FedCloud

Ladislav Hluchý
Viet Tran

Cloud (Openstack)
  • 120 cores (Cloud) Intel(R) Xeon(R) CPU E5570 2.93GHz
  • 1, 2, 4, 8 cores VMs
  • RAM up to 4GB per core
Both €0.06/core/hr
Latvian Grid IMCSUL Kaspars Krampis Cloud: OpenStack, GRID: ARC + SLURM
  • CPU: Up to 256 cores, RAM up to 4GB per core
TBC ~€0.07/core/hr + VAT (TBC) 21%
MASTER-UP Srl TBC

Alessandro Costantini
Antonio Lagana

EMI1/2, CEs, WNs, SE
  • EMI1 middleware (phasing to EMI2) - CE's, WN's and SE.
  • 10 nodes to start (intel 4core, ethernet connection)
  • Long experience in Molecular Science and Comp Chem, can provide support for such innovative applications and in the field of R&D for combustion, energy and material science.
  • Managing a computer farm of 200 cores and 4TB of storage part of those resources are supporting EGI.
Direct To be evaluated
NGI_GRNET All HG-* Kostas Koumantaros Cloud and Grid
  • TBC
TBC €0.05/hr + VAT 23%
NGI-IT

INFN-BARI PRISMA-INFN-BARI (cloud)

INFN-XX

Vincenzo Spinoso EMI, OpenStack
  • gLite MW stack: Cream CE, LFC, Storm SE, WMS+LB, BDII.
  • Cloud: OpenSTACK
TBD €0.07/hr + VAT TBD 22%
100 Percent IT 100IT David Blundell Cloud (Openstack)
  • Intel Xeon X5670 @ 2.93GHz
  • Cloud via OpenStack
Both €0.07 + VAT 20%
PL-Grid TBC Mariusz Sterzel Cloud + Batch via Cream / EMI
  • Computing power, storage, and human support
  • Batch processing via Cream CE/EMI
  • Cloud access
  • Non-grid, local access to queue system
Both Capacity and price are a subject to negotiation
TUBITAK ULAKBIM TR-10-ULAKBIM Onur Temizsoylu
Feyza Eryol
Cloud + Batch
  • Batch processing via Cream CE
  • VM Management using OpenNebula/OCCI
  • Infiniband connected Linux computing resources
Both €0.15/hour 8 core 24 GB instance
UIIP NASB BY-UIIP Serge Salamanka Cloud + Batch
  • Batch processing via UNICORE or Cream CE
  • Intel Xeon E5472 (3,0 GHz, 4 Cores) 50 nodes / 100 physical CPUs
  • 400 virtual CPUs
  • 400 Gb memory
  • 8TB Disk storage – 9-12TB Storage servers
  • Infiniband DDR 20Gbit/sec]
Indirect $0.077/hr (TBD) 1 Core
Fraunhofer SCAI SCAI Horst Schwichtenberg Cloud (Openstack) + Grid (gLite)

Cloud:

  • Intel Xeon X5570 @ 2.93GHz
  • Non-blocking QDR InfiniBand interconnect (40GBps)

Grid:

  • AMD Opteron
  • DDR Infiniband
TBC €0.02 TBC



  • Consumer: I want a list of the available services and their price
  • Consumer: Who helps me when issues arise ? Is this help cost and how much?
  • Consumer: Where do I get information about your services?
  • Consumer: How can I access your services? Do you have a portal or something similar?
  • Consumer: What is the price? Is it cheaper than the commercial cloud?
  • Consumer: If not, what is the difference with commercial clouds? What are the advantages or using yours?
  • Consumer: How can I pay for the services? Credit Card?
  • Consumer: Can I receive a formal invoice with my requirements to put it into my budget?
  • Consumer: How can I be sure the price is equal to the quality of resource?
  • Consumer: Are any other communities paying for resources?
  • Consumer: Do you have Windows?
  • Consumer: Do you support products with licensing (like ANSYS, that only allows licenses for a given customer, not shared) even if the license machine is at my site behind a firewall? how?
  • Consumer: Do I get a contact to phone/mail who will be reliable? what time can I call?
  • Consumer: Will the service be there for next 12 months?
  • Consumer: Can I test for free? (only next 12 months or so)
  • Consumer: Is your firewall open for what I need?
  • Consumer: I can't ftp, do you support dropbox?
  • Consumer: Do I need a certificate? who gives it?
  • Consumer: Do I get a machine/service for me immediately at any time? will the machine be too busy? is the data transfer too slow? can I use Teamviewer?
  • Consumer: Is there a Service Level Agreement?
  • Resource Provider: I want to set a price for the Grid Compute service on a HEPSPEC-hour (or hour?)
  • Resource Provider: I want to set a price for the Cloud Compute service based on ....
  • Resource Provider: I want to set a price for the Grid/Cloud Storage service based on GB per month
  • Resource Provider: How much extra effort & on how many people does this require, and at what level?
  • Resource Provider: Can I pay such extra effort to those people?
  • Resource Provider: If I give a contact name, how many mails/calls will she/he receive?
  • Resource Provider: When do I get the extra fund and under what constraints?
  • Resource Provider: Can I reject potential users that will create more problems than benefits? On what basis?
  • Resource Provider: What are the legal issues if the customer is not in my country? will digital certificates be used?
  • Resource Provider: Do I know these users? (example, bitcoin "researchers") Does it make sense to work with them even if they say they work on research or innovation?
  • Resource Provider: Can parts of administration be outsourced? If so, what are the service costs? What are the benefits?
  • Resource Provider: What agreements do I have to make and with whom?
  • Resource Provider: Does VAT apply? If so, when?
  • Resource Provider: We are a publicly funded institution, are there any known restrictions for selling services?
  • Technology Provider: What technologies are you lacking that we could offer or develop? Can I develop pay-per-use tools and deploy them? Can I charge for that?
  • Technology Provider: How do I get paid? who pays me? when?
  • Technology Provider: Who is our interface for e.g. agreements/contracts, requirements, improvement, support?
  • Technology Provider: Can I deploy a contextualized solution? (may need to explain this)
  • Technology Provider: Do you run on Windows?
  • Technology Provider: Does it make sense to prepare something for mobile phones? (guessing no)
  • Broker: What agreements do I have to make and with whom?
  • Broker: How do I get paid? who pays me? when?
  • Broker: Do customers prefer a % and/or flat rate for broker services? Will it depend?
  • Broker: How is revenue shared in federated service provision? (e.g. GOCDB, Acct Portal)
  • Multi: Do I have to get involved in the communication between provider and user after an agreement/contract is signed? If yes, how do I get a percent or a contract for support?
  • Multi: How can I teach this to the users?
  • All: How can I learn what is this about?

Workplan Overview

January 2014: Kick-off of the activity

  • Hold first call - 23 Feb 2014 @ 12:00 CET (TBC)
  • Establish fixed day and time for semi-monthly calls

April 2014: First phase implementation of all technical specifications, list of required agreements and refinements to policy issues documented in the EGI Sustainability Plan (M48)

  • Technical
    • Review technical detail table and complete with relevant information
    • Associate prices within GOCDB according to instructions provided here
    • Accounting Portal to make required extraction from GOCDB and accounting for usage
      • Pull the site data and create a table for use in displaying charging. This table should be directly viewable, at least for the pilot.
      • Create test cpu view like the cloud one. Best to base it on the Custom_View so that we can select particular VOs relevant to the pilot.
    • Investigate and implement a billing function (initially a virtual bill)
    • Perform a gap analysis of supporting services (either new or extensions to the current tools) that would enable the increased automation of the process once it has been manually established and subsequent development required for missing functionality.
    • Report back on identified issues and overall progress
  • Policy/Legal
    • Identify and evaluate legal, policy, and organisational issues around the full implementation of the pay-for-use model (review initial information from first survey)
    • Articulate appropriate business and responsibility models (review initial broker models developed)
    • Request potential consultation from FedSM regarding service management processes and agreements.
    • Collate information to be presented within Sustainability Plan that is easily digestible (Lead: EGI.eu)

May 2014: Pay-for-Use aspects included in Federated Cloud release (even in Beta/pre-production)

  • Identify members involved in the EGI Federated Cloud to serve as pay-for-use representatives
  • Gather requirements from the EGI FedCloud for its inclusion

June 2014: First presentation of activities and feedback from EGI-InSPIRE EC Review

  • PoC to decide what information to be presented and ultimate goal

October 2014: Conclusion of phase 2 activities: updates from feedback and overall refinements

  • TBD based on activities carried out. Dedicated F2F to be discussed either following EC review or other date TBD (e.g. Sept 2014).

December 2014: Circulation/Publication of Final Proof of Concept Report

  • To be included in final EGI-InSPIRE Periodic Report (Lead: EGI.eu with requested contributions from PoC members)