Difference between revisions of "Fedcloud-tf:WorkGroups:Scenario4"

From EGIWiki
Jump to: navigation, search
(Cloud Accounting Draft Usage Record)
(Previous version:)
Line 38: Line 38:
To help define what we will account for the existing [https://twiki.cern.ch/twiki/pub/EMI/ComputeAccounting/CAR-EMI-tech-doc-0.8.doc Compute Accounting Record] could be extended.   
To help define what we will account for the existing [https://twiki.cern.ch/twiki/pub/EMI/ComputeAccounting/CAR-EMI-tech-doc-0.8.doc Compute Accounting Record] could be extended.   
==== Previous version: ====
==== Previous versions: ====
[https://oerc.basecamphq.com/projects/7732005/file/105129409/Draft-CloudAccountingUsageRecord-v1.pdf Previous Draft - Cloud Accounting Usage Record]).
[https://oerc.basecamphq.com/projects/7732005/file/115129730/CloudAccountingUR-v2.pdf - Version 2 - Cloud Accounting Usage Record]
[https://oerc.basecamphq.com/projects/7732005/file/105129409/Draft-CloudAccountingUsageRecord-v1.pdf Version 1 - Cloud Accounting Usage Record]).
== Publishing Accounting Data ==
== Publishing Accounting Data ==

Revision as of 21:22, 12 March 2012

Main Roadmap and Innovation Technology For Users For Resource Providers Media

Workbenches: Open issues
Scenario 1
VM Management
Scenario 2
Data Management
Scenario 3
Information Systems
Scenario 4
Scenario 5
Scenario 6
Scenario 7
Federated AAI
Scenario 8
VM Image Management
Scenario 9
Scenario 10
Scenario 11

Scenario 4: Accounting across Resource Providers

Leader: Alison Packer and John Gordon, STFC

Scenario collaborators

Role Institution Name
Scenario leader STFC Alison Packer
Collaborator OeRC Matteo Turilli
Collaborator BSC Daniele Lezzi


To account for resource usage across multiple resource providers we need to define:

  1. the elements to be accounted for and how accounting data may be gathered. (This relates to the statement “Resource providers agree and follow the same rules for accounting the resource usage”.)
  2. how accounting data will be published
  3. what is required from this data (for VM users, Resource Providers, VO Managers, others?)

Cloud Accounting Draft Usage Record

The latest draft schema attempts to map the Cloud Accounting Usage Record fields to fields used by Venus-C and OpenNebula. Draft - Cloud Accounting Usage Record

Compute Accounting Record

To help define what we will account for the existing Compute Accounting Record could be extended.

Previous versions:

- Version 2 - Cloud Accounting Usage Record Version 1 - Cloud Accounting Usage Record).

Publishing Accounting Data

Cloud Accounting System

The software and technology choices for the new APEL system (which receives compute accounting records) will be used to provide a ‘testbed’ so that the resource providers can send records to a Cloud Accounting System at STFC. The software is written in Python and the data is stored in a MySQL database, the component parts of the system are:

  1. SSM
  2. Record loader
  3. MySQL Database

More detail available in the Cloud Accounting System document here: Cloud Accounting System

Work on providing OpenNebula Accounting Records

Contact made with "VENUS" project developers who have developed a system for extracting accounting data. Detail on the Cloud Accounting System (above) provided to them, requested more detail on their implementation.

Feedback from Resource Providers

VM What is measured
Oxford/Eucalyptus (no longer running) Number of VM instantiated - Type of VM - Amount of time each VM has been running - Number of Elastic Block Storage volumes created - Amount of time the EBS volumes have been owned - Times the EBS volumes have been mounted - Binding between EBS volumes and VMs - Number of OS images loaded in the S3 repository - Amount of time the OS images have been loaded into the S3 repository
OpenNebula (Have reviewed UR)