Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

EGI-InSPIRE:SA1.5-QR15

From EGIWiki
(Redirected from SA1.5-QR15)
Jump to navigation Jump to search
EGI Inspire Main page


Inspire reports menu: Home SA1 weekly Reports SA1 Task QR Reports NGI QR Reports NGI QR User support Reports



1. Task Meetings

Date (dd/mm/yyyy) Url Indico Agenda Title Outcome
4-6th December EGI Horizon 2020 Workshop, Amsterdam
13th January Federated Cloud Taskforce Face to Face, Oxford
14-15th January preGDB/GDB, CERN

2. Main Achievements

CPU Accounting

  • New release of Apel and SSM software with bug fixes
    • Fixed crash on dropped connection
    • Fixed crashes on badly formatted XML message
    • Fixed crashes when joiner is disabled
    • Improved performance of database queries
    • Improvements to SLURM parser

MPI Accounting

  • Begun planning for backend changes to enable combined MPI and non-MPI accounting
  • Portal has static data, working on visualisation. A sample is available.

Cloud Accounting

  • New sites added
  • Schema conformance assessment proceeding

Storage Accounting

  • New sites added

Application Accounting

  • Code in repository

Test Message Brokers

  • Planning has begun to migrate our test services which use the test message broker network to the production network

Pay for Use Accounting

  • GOCDB have added the key=value support
  • A group of sites are now publishing a cost in Euros per HEPSPEC06 hour
  • The portal has created a view of this data

3. Issues and Mitigation

Issue Description Mitigation Description
SSM2 Receiver problem A problem with the software which receives accounting data from EMI3 Apel clients and other external clients was discovered on 8th January. This had prevented the daemon from receiving any new messages since 31st December. The problem was fixed later the same day. No data was lost and all sites sent the backlog of data. Improvements will be made to monitoring and software to prevent this problem reoccurring.
Migration script issues Still working with sites who have experienced duplicated data problems when migrating from EMI2 to EMI3.

4. Plans for the next period

CPU Accounting

  • Release more improvements to the SLURM parser

MPI Accounting

  • Work with portal team to send regular updates of MPI accounting data

Cloud Accounting

  • Work with developers to complete work to comply with cloud accounting schema
  • Work with sites to upgrade their software and configuration to conform to the cloud accounting schema
  • Install and configure the necessary software and services to enable sites to publish production accounting records.

Storage Accounting

  • Confirm the storage accounting schema
  • Send storage accounting summaries to the portal

Application Accounting

  • Create a working prototype from the test code to show to potential collaborators

Test Message Brokers

  • Assist sites moving from the test message broker network which ends in April. This affects:
    • CPU Accounting in test
    • Cloud Accounting in test
    • Storage Accounting

EMI2 to EMI3 migration

  • Begin planning of extensive work to re-route the data flow of the existing repository backend. This will enable us to send combined MPI and non-MPI accounting data to the portal. Further work will be to set up database replication to improve the reliability and availability of the service.