EGI-InSPIRE:Plan 2014 SA1.5

From EGIWiki
(Redirected from Plan 2014 SA1.5)
Jump to navigation Jump to search
EGI Inspire Main page


Inspire reports menu: Home SA1 weekly Reports SA1 Task QR Reports NGI QR Reports NGI QR User support Reports



Assessment of progress in 2013

Completed Activities and Milestones

  • A new EMI-APEL client was released as part of EMI 3. It uses SSM 2.0 for communication between clients and the APEL Accounting Repository and includes support for local jobs and MPI accounting. Data from the new EMI-APEL client is stored in the new APEL Accounting Repository which uses the EGI Message Brokers to receive data and to send summaries on to the Accounting Portal. The two APEL Accounting systems have successfully run in parallel with one merged set of daily summaries retrieved by the Accounting Portal.
  • A regional version of the APEL Accounting Repository has been released. It is in production with NGI-ZA.
  • Federated Cloud Accounting - new version using SSM 2.0 implemented and in use. Summary data is sent to Accounting Portal daily.
  • Storage Accounting - new test database in place. Implemented using SSM 2.0. Now contains data from over 50 sites. Accounting portal have a dump of this data and have produced a prototype view.
  • Worked with APEL client sites to migrate them to running EMI APEL 3. There are now 50 sites sending data to the new repository.
  • Worked with sites and developers running alternative accounting clients to use SSM to send their records to the Accounting Repository. There are now sites in production sending accounting data from ARC, QCG and EDGI Desktop Grid. Globus and Unicore have successfully tested but have not started publishing in production.

Milestones not accomplished

  • Work with sites running SSM 1.2 for CPU Accounting to migrate them to SSM 2.0
  • Application Accounting repository installed for testing.
  • Implement publishing summaries from Accounting Repository to other sites (OSG, DGAS).

Plans for 2014

Q1

  • Work with Hanover to develop a prototype application accounting system to present at the EGI CF
  • Work with developers and sites to finalise the cloud data schema and start the work for production
  • Continue to work with sites to migrate their CPU accounting systems from EMI2 to EMI3
  • Work with sites running SSM 1.2 for CPU Accounting to migrate them to SSM 2.0
  • Ensure storage accounting data received from the different storage clients is comparable across sites.

Q2

  • Work with sites in testing and the message broker team to move our test infrastructure to use the production message broker network
  • Install, configure and monitor the necessary systems for the cloud accounting in production
  • Continue work to define the summaries of storage accounting data. Work with accounting portal team to visualise these

Q3

  • Send MPI data from the new repository to the accounting portal. This requires extensive work to re-route the data flow of the existing repository backend.
  • Configure database replication to improve reliability/availability of the service
  • Application Accounting repository installed for testing.
  • Implement publishing summaries from Accounting Repository to other sites (OSG, DGAS).

Q4

  • Begin receiving storage accounting data in production.