Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:Plan 2013 SA1.5"

From EGIWiki
Jump to navigation Jump to search
Line 19: Line 19:
===Milestones not accomplished===
===Milestones not accomplished===
<!-- list here milestones that were not completed according to the envisaged schedule, saying why they were not completed, and the new schedule is -->
<!-- list here milestones that were not completed according to the envisaged schedule, saying why they were not completed, and the new schedule is -->
* Regional APEL Server work was delayed while the SSM protocol was revised.  It will be release in 2013.
* Regional APEL Server work was delayed while the SSM protocol was revised (Regional APEL sevrer will use the new version of SSM).  It will be release in 2013.


== Plans for 2013 ==
== Plans for 2013 ==

Revision as of 11:54, 4 February 2013

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Inspire reports menu: Home SA1 weekly Reports SA1 Task QR Reports NGI QR Reports NGI QR User support Reports


Assessment of progress in 2012

Completed Activities and Milestones

  • The APEL Accounting Repository and Portal were kept working reliably throughout 2012. The APEL Accounting Repository was taken out of service in February when the servers were all upgraded to Scientific Linux 5.
  • The new SSM-based APEL Accounting Repository was brought into service in June, 2012 and there are currently two sites (CERN and NIKHEF) which now send Job Records to this repository. There are also four other publishers (OSG/Gratia, INFN/DGAS, NDGF/SGAS and Switzerland/SGAS) which have migrated to sending Summary Records (for 97 sites) to the new APEL Accounting Repository. These records are integrated with the summaries from the old Accounting Repository which are updated daily and retrieved by The Accounting Portal. This has established a stable method for other accounting implementations to interface their different solutions with central accounting.
  • Other sites producing accounting data requested a change to the messaging protocol used in SSM 1.2 and a new accounting protocol was produced in collaboration with these teams which has been implemented as SSM 2.0.
  • The SSM and associated record loading/unloading methods created for publishing CPU accounting records were modified to collect new types of accounting record, including storage and cloud accounting records. Eight resource providers participating in the EGI Federated Cloud Task now publish cloud accounting records using this method. The storage accounting database has been installed and initial testing carried out to receive storage records. A new Application Accounting package is also under development in Hannover and the same method will be used to send/receive application accounting records.

Milestones not accomplished

  • Regional APEL Server work was delayed while the SSM protocol was revised (Regional APEL sevrer will use the new version of SSM). It will be release in 2013.

Plans for 2013

Q1

  • A new EMI-APEL client will be released as part of EMI 3. This will use SSM 2.0 for communication between clients and the APEL Accounting Repository and includes support for local jobs and MPI accounting. Data from the new EMI-APEL client will be stored in the new APEL Accounting Repository which uses the EGI Message Brokers to receive data and to send summaries on to the Accounting Portal. The two APEL Accounting systems will run in parallel with one set of daily summaries retrieved by the Accounting Portal.
  • Final external APEL client migrated to the new SSM based accounting repository.
  • A regional version of the APEL Accounting Repository will be released for testing.
  • Federated Cloud Accounting - new version using SSM 2.0 implemented and summary data sent to Accounting Portal.
  • Storage Accounting - new test version implemented using SSM 2.0.

Q2

  • Work with sites running SSM 1.2 for CPU Accounting to migrate them to SSM 2.0
  • Release Regional APEL server

Q3

  • Historical external APEL data migrated to new repository.
  • Application Accounting repository installed for testing.

Q4

  • Implement publishing summaries from Accounting Repository to other sites (OSG, DGAS).

Throughout 2013:

  • Work with APEL client sites to migrate them to running EMI APEL 3.
  • Work will continue with sites running alternative accounting clients who will use SSM to send their records to the Accounting Repositories.