EGI-InSPIRE:SA1.5-QR15
Jump to navigation
Jump to search
EGI Inspire Main page |
Inspire reports menu: | Home • | SA1 weekly Reports • | SA1 Task QR Reports • | NGI QR Reports • | NGI QR User support Reports |
1. Task Meetings
Date (dd/mm/yyyy) | Url Indico Agenda | Title | Outcome |
---|---|---|---|
4-6th December | EGI Horizon 2020 Workshop, Amsterdam | ||
13th January | Federated Cloud Taskforce Face to Face, Oxford | ||
14-15th January | preGDB/GDB, CERN |
2. Main Achievements
CPU Accounting
- New release of Apel and SSM software with bug fixes
- Fixed crash on dropped connection
- Fixed crashes on badly formatted XML message
- Fixed crashes when joiner is disabled
- Improved performance of database queries
- Improvements to SLURM parser
MPI Accounting
- Begun planning for backend changes to enable combined MPI and non-MPI accounting
- Portal has static data, working on visualisation. A sample is available.
Cloud Accounting
- New sites added
- Schema conformance assessment proceeding
Storage Accounting
- New sites added
Application Accounting
- Code in repository
Test Message Brokers
- Planning has begun to migrate our test services which use the test message broker network to the production network
Pay for Use Accounting
- GOCDB have added the key=value support
- A group of sites are now publishing a cost in Euros per HEPSPEC06 hour
- The portal has created a view of this data
3. Issues and Mitigation
Issue Description | Mitigation Description |
---|---|
SSM2 Receiver problem | A problem with the software which receives accounting data from EMI3 Apel clients and other external clients was discovered on 8th January. This had prevented the daemon from receiving any new messages since 31st December. The problem was fixed later the same day. No data was lost and all sites sent the backlog of data. Improvements will be made to monitoring and software to prevent this problem reoccurring. |
Migration script issues | Still working with sites who have experienced duplicated data problems when migrating from EMI2 to EMI3. |
4. Plans for the next period
CPU Accounting
- Release more improvements to the SLURM parser
MPI Accounting
- Work with portal team to send regular updates of MPI accounting data
Cloud Accounting
- Work with developers to complete work to comply with cloud accounting schema
- Work with sites to upgrade their software and configuration to conform to the cloud accounting schema
- Install and configure the necessary software and services to enable sites to publish production accounting records.
Storage Accounting
- Confirm the storage accounting schema
- Send storage accounting summaries to the portal
Application Accounting
- Create a working prototype from the test code to show to potential collaborators
Test Message Brokers
- Assist sites moving from the test message broker network which ends in April. This affects:
- CPU Accounting in test
- Cloud Accounting in test
- Storage Accounting
EMI2 to EMI3 migration
- Begin planning of extensive work to re-route the data flow of the existing repository backend. This will enable us to send combined MPI and non-MPI accounting data to the portal. Further work will be to set up database replication to improve the reliability and availability of the service.