The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.
Difference between revisions of "EGI-InSPIRE:SA1 Quality Metrics"
Jump to navigation
Jump to search
| Line 59: | Line 59: | ||
| | | | ||
|- | |- | ||
| M.SA1.Size.4, Installed Disk Capacity (PB) | | M.SA1.Size.4, Installed Disk Capacity (PB) in EGI - P | ||
| TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR | | TSA1.1, Tool: gstat. The overall installed capacity of EGI is derived from the sum of the capacity reported by NGIs. NGI can amend results reported by tools, and report correct values in its own QR | ||
| | | | ||
| | | | ||
| Line 67: | Line 67: | ||
| | | | ||
|- | |- | ||
| M.SA1.Size.5, Installed Tape Capacity (PB) | | M.SA1.Size.5, Installed Tape Capacity (PB) in EGI - P | ||
| TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR | | TSA1.1, Tool: gstat. The overall installed capacity of EGI is derived from the sum of the capacity reported by NGIs. NGI can amend results reported by tools, and report correct values in its own QR | ||
| | | | ||
| | | | ||
| Line 108: | Line 108: | ||
|- | |- | ||
| M.SA1.Integration.2, Number of production sites supporting MPI - I | | M.SA1.Integration.2, Number of production sites supporting MPI - I | ||
| TSA1.3, | | TSA1.3, only sites passing MPI Nagios tests are considered. Tool: query to the information system Manual metric (NGI QR) | ||
| NA | | NA | ||
| 73 | | 73 | ||
| Line 131: | Line 131: | ||
| | | | ||
|- | |- | ||
| M.SA1.ServiceValidation.1, Total number of staged rollout components operated | | M.SA1.ServiceValidation.1, Total number of staged rollout components operated in EGI - I | ||
| TSA1.3, Record the number of components participating in each release of a component. Manual metric (TSA1.3 QR) | | TSA1.3, Record the number of components participating in each release of a component. Manual metric (TSA1.3 QR) | ||
| 27 (34 comp) | | 27 (34 comp) | ||
| Line 155: | Line 155: | ||
| | | | ||
|- | |- | ||
| M.SA1.Support.1, | | M.SA1.Support.1, overall average number of operations tickets in EGI per month CREATED /SOLVED - P | ||
| TSA1.7, Tool: GGUS reporting tool | | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | ||
| | | | ||
| | | | ||
| Line 163: | Line 163: | ||
| | | | ||
|- | |- | ||
| M.SA1.Support.2, Average/Median Solution Time ticket solution time (business days) | | M.SA1.Support.2, Average/Median Solution Time ticket solution time (business days) per month - P | ||
| TSA1.7, Tool: GGUS reporting tool | | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | ||
| | | | ||
| | | | ||
| Line 171: | Line 171: | ||
| | | | ||
|- | |- | ||
| M.SA1.Support.3, Number of monthly tickets opened | | M.SA1.Support.3, Number of monthly tickets opened in EGI - P | ||
| TSA1.7, Tool: GGUS reporting tool | | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | ||
| | | | ||
| | | | ||
| Line 179: | Line 179: | ||
| | | | ||
|- | |- | ||
| M.SA1.Support.4, Assigned ticket Average/Median RESPONSE TIME/SOLUTION TIME | | M.SA1.Support.4, Assigned ticket Average/Median RESPONSE TIME/SOLUTION TIME per month - P | ||
| TSA1.7, Tool: GGUS reporting tool | | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | ||
| | | | ||
| | | | ||
| Line 187: | Line 187: | ||
| | | | ||
|- | |- | ||
| M.SA1.Support.5, Number of tickets SOLVED by TPM (1st line support) - I | | M.SA1.Support.5, Number of tickets SOLVED by TPM (1st line support) per month - I | ||
| TSA1.7, Tool: GGUS reporting tool | | TSA1.7, Tool: GGUS reporting tool | ||
| | | | ||
| Line 195: | Line 195: | ||
| | | | ||
|- | |- | ||
| M.SA1.Support.6, | | M.SA1.Support.6, Average ticket assignment time to Support Units by TPM (1st line support) per month - I | ||
| TSA1.7, Tool: operations dashboard | | TSA1.7, Tool: operations dashboard | ||
| | | | ||
| Line 227: | Line 227: | ||
| | | | ||
|- | |- | ||
| M.SA1.Operation.1, | | M.SA1.Operation.1, EGI monthly availability and reliability - P | ||
| TSA1.8, Tool: availability report generator | | TSA1.8, Tool: availability report generator | ||
| | | | ||
| Line 243: | Line 243: | ||
| | | | ||
|- | |- | ||
| M.SA1.Operation.3, | | M.SA1.Operation.3, EGI monthly availability and reliability of core operations tools - P | ||
| TSA1.8, Development needed | | TSA1.8, Development needed | ||
| | | | ||
| Line 251: | Line 251: | ||
| | | | ||
|- | |- | ||
| M.SA1.Operation.4, | | M.SA1.Operation.4, EGI Monthly availability and reliability of core middleware services - P | ||
| TSA1.8, Development needed | | TSA1.8, Development needed | ||
| | | | ||
Revision as of 12:40, 22 February 2011
| Main | EGI.eu operations services | Support | Documentation | Tools | Activities | Performance | Technology | Catch-all Services | Resource Allocation | Security |
Note: P=Public, I=Internal, QR=Quarterly Report, x/y/z=Month1/Month2/Month3
| Metric ID, Description | Comment | QR1 | QR2 | QR3 | QR4 | QR5 |
|---|---|---|---|---|---|---|
| M.SA1.Usage.1, Average number of jobs "done" per day for all VOs - P | Excluding OPS and DTEAM. Tool: accounting portal | 834,746 | 871,073 | 75,357,279 | ||
| M.SA1.Usage.2, Normalised consumed computing capacity - P | Normalized elapsed time to a reference value of hepspec06 (hours), excluding DTEAM and OPS. Tool: accounting portal | |||||
| M.SA1.Usage.3, Normalised Computing power consumed outside of a user’s home country - P | Requires tool development | |||||
| M.SA1.Size.1, Total number of production resource centers that are part of the EGI - P | TSA1.1, Tool: gstat. TSA1.1 QR . Local Sites that are part of a local grid, not integrated with EGI, do not need to be included in the count. | 341 | 337 | |||
| M.SA1.Size.2, Total number of job slots available in EGI per NGI - P | TSA1.1, Job slots equals logical cpus. Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR. non-InSPIRE means excluding logical CPUs from USA | 184,844 | 189,596 (Dec 2010: Inspire: 197977, non-InSPIRE: 98611, TOT: 296588) | |||
| M.SA1.Size.3, Installed Capacity in HEP SPEC in EGI - P | TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR. The total HEPSPEC06 are derived by the capacity reported by each NGI (by summing NGI values) | |||||
| M.SA1.Size.4, Installed Disk Capacity (PB) in EGI - P | TSA1.1, Tool: gstat. The overall installed capacity of EGI is derived from the sum of the capacity reported by NGIs. NGI can amend results reported by tools, and report correct values in its own QR | |||||
| M.SA1.Size.5, Installed Tape Capacity (PB) in EGI - P | TSA1.1, Tool: gstat. The overall installed capacity of EGI is derived from the sum of the capacity reported by NGIs. NGI can amend results reported by tools, and report correct values in its own QR | |||||
| M.SA1.OperationalSecurity.1, Number of Site Security challenge (SSC) made - I | TSA1.2, Manual metric (from TSA1.2 QR) | - | 13 | |||
| M.SA1.OperationalSecurity.2, Number of Sites passing one Security Challenge - I | TSA1.2, Target: 50% (to be reviewed in the coming months). Manual metric (from TSA1.2 QR) | - | 100% | |||
| M.SA1.OperationalSecurity.3, Number of suspended sites for security issues - I | TSA1.2, Manual metric (in TSA1.2 QR) | 0 | 0 | |||
| M.SA1.Integration.1, Number of production HPC clusters per NGI - I | TSA1.3, HPC clusters is a site with a dedicated high-speed low-latency communications network. Manual metric (NGI QR) | NA | 55 | |||
| M.SA1.Integration.2, Number of production sites supporting MPI - I | TSA1.3, only sites passing MPI Nagios tests are considered. Tool: query to the information system Manual metric (NGI QR) | NA | 73 | |||
| M.SA1.Integration.3, Amount of integrated desktop resources - I | TSA1.3, Placeholder: Need to define desktop resources and how to integrate them. Manual metric (NGI QR) | NA | 0 | |||
| M.SA1.Integration.4, Amount of virtualised installed capacity accessible to EGI users - I | TSA1.3, Placeholder: Need to define virtualised resources and how to integrate them. Manual metric (NGI QR) | NA | 246,200 | |||
| M.SA1.ServiceValidation.1, Total number of staged rollout components operated in EGI - I | TSA1.3, Record the number of components participating in each release of a component. Manual metric (TSA1.3 QR) | 27 (34 comp) | 30 (34 comp) | |||
| M.SA1.ServiceValidation.2, Number of staged rollout releases undertaken & rejected - I | TSA1.3, Manual metric (TSA1.3 QR) | 0 | 3 | |||
| M.SA1.Accounting.1, Number of sites adopting AMQ messaging for Usage Record publication - P | TSA1.5, Manual metric (TSA1.5 QR) | - | 62 | |||
| M.SA1.Support.1, overall average number of operations tickets in EGI per month CREATED /SOLVED - P | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | |||||
| M.SA1.Support.2, Average/Median Solution Time ticket solution time (business days) per month - P | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | |||||
| M.SA1.Support.3, Number of monthly tickets opened in EGI - P | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | |||||
| M.SA1.Support.4, Assigned ticket Average/Median RESPONSE TIME/SOLUTION TIME per month - P | TSA1.7, Tool: GGUS reporting tool. Only Operations SUs are considered. | |||||
| M.SA1.Support.5, Number of tickets SOLVED by TPM (1st line support) per month - I | TSA1.7, Tool: GGUS reporting tool | |||||
| M.SA1.Support.6, Average ticket assignment time to Support Units by TPM (1st line support) per month - I | TSA1.7, Tool: operations dashboard | |||||
| M.SA1.Support.7,COD Workload per month - I | TSA1.7, Tool: operations dashboard. TSA1.7 report | 886/188/1742 | 652/591/487 | |||
| M.SA1.Support.8, ROD Workload per month per region/NGI - I | TSA1.7, Tool: operations dashboard. TSA1.7 report | 4535/1532/4277 | 2622/2733/1944 | |||
| MSA1.Support.9, ROD Quality Metrics per month per region/NGI - I | TSA1.7, Tool: operations dashboard. TSA1.7 report | 0.84/0.81/0.89 | 0.86/0.89/0.90 | |||
| M.SA1.Operation.1, EGI monthly availability and reliability - P | TSA1.8, Tool: availability report generator | |||||
| M.SA1.Operation.2, Number of sites suspended - I | TSA1.7, Manual metric. TSA1.7 report | 0/0/0 | 3/1/2 | |||
| M.SA1.Operation.3, EGI monthly availability and reliability of core operations tools - P | TSA1.8, Development needed | |||||
| M.SA1.Operation.4, EGI Monthly availability and reliability of core middleware services - P | TSA1.8, Development needed | |||||
| M.SA1.Operation.5, EGI monthly availability and reliability of site middleware services - P | TSA1.8, Development needed | |||||
| M.SA1.Operation.6, EGI monthly availability and reliability of central operations tools - P | TSA1.8, Development needed |