Difference between revisions of "EGI-InSPIRE:SA1 Quality Metrics"
Jump to navigation
Jump to search
(Created page with '{| border="1" cellspacing="0" cellpadding="5" align="center" ! MetricID (scope) ! Metric ! Public/Internal ! Task ! Comments and explanation |- | M.SA1.Size.1 (A, N) | Total nu…') |
|||
Line 1: | Line 1: | ||
{| border="1" cellspacing="0" cellpadding="5" align="center" | {| border="1" cellspacing="0" cellpadding="5" align="center" | ||
! | ! Metric ID (scope) | ||
! Metric | ! Metric | ||
! Public/Internal | ! Public/Internal | ||
Line 121: | Line 121: | ||
|- | |- | ||
| M.SA1.Usage.1 | | M.SA1.Usage.1 | ||
| Number of jobs done, per VO (mean daily/monthly number | | Number of jobs done, per VO (mean daily/monthly number) | ||
| P | | P | ||
| TSA1.5 | | TSA1.5 | ||
Line 127: | Line 127: | ||
|- | |- | ||
| M.SA1.Usage.2 | | M.SA1.Usage.2 | ||
| Normalized consumed computing capacity (A, V, N) | | Normalized consumed computing capacity | ||
| P | |||
| TSA1.5 | |||
| HepSpec-day | |||
|- | |||
| M.SA1.Usage.3 | |||
| Number of active VOs | |||
| P | |||
| | |||
| | |||
|- | |||
| M.SA1.Usage.4 | |||
| Monthly job efficiency per VO | |||
| P | |||
| TSA1.5 | |||
| | |||
|- | |||
| M.SA1.Usage.5 | |||
| Monthly data throughput per VO | |||
| P | |||
| TSA1.5 | |||
| | |||
|- | |||
| M.SA1.Usage.6 (A, V, N) | |||
| Normalised Computing power consumed outside of a user’s home country | |||
| P | | P | ||
| TSA1.5 | | TSA1.5 | ||
| | | | ||
|- | |||
| M.SA1.Operation.1 (A, V, N) | |||
| Availability and reliability per resource centre in EGI. | |||
| P | |||
| TSA1.8 | |||
| Minimum targets specified for ops and critical top-ten VOs | |||
|- | |||
| M.SA1.Operation.4 (A, N) | |||
| Number of sites suspended | |||
| I | |||
| TSA1.8 | |||
| | |||
|- | |||
| M.SA1.Operation.5 (A, N) | |||
| Monthly availability and reliability of core and regional operational tools | |||
| P | |||
| TSA1.8 | |||
| | |||
|- | |||
| M.SA1.Operation.6 (A, N) | |||
| Monthly availability and reliability of core middleware services | |||
| P | |||
| TSA1.8 | |||
| | |||
|- | |||
| M.SA1.Operation.7 (A,N) | |||
| Number of operational tickets escalated | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Operation.8 (A, N) | |||
| Number of operational procedures, documents and best practices | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Operation.9 (A, N) | |||
| Number of sites not publishing accounting data | |||
| I | |||
| TSA1.5 | |||
| | |||
|- | |||
| M.SA1.Operation.10 (A) | |||
! Monthly availability and reliability of central accounting repository and portal | |||
! P | |||
| TSA1.5 | |||
| | |||
|- | |||
| M.SA1.Support.1 (A) | |||
| Overall number of tickets (operational and user) opened and solved | |||
| P | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Support.2 (A, N) | |||
| Mean ticket solution time (business days) and median | |||
| P | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Support.3 (A) | |||
| Submitted tickets per month per VO | |||
| P | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Support.4 | |||
| Number of monthly tickets per NGI | |||
| P | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Support.5 (A) | |||
| Number of tickets closed by TPM (1st line support) | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Support.6 (A) | |||
| Ticket assignment time to Support Units by TPM (1st line support) | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| M.SA1.Support.7 (N) | |||
| Assigned ticket response time | |||
| I | |||
| TSA1.7 | |||
| | |||
| | |||
|- | |||
| M.SA1.Support.8 (N) | |||
| Assigned ticket solution time | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| MSA1.Support.9 COD | |||
| Workload per month | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| MSA1.Support.10 | |||
| ROD Workload per month per region/NGI | |||
| I | |||
| TSA1.7 | |||
| | |||
|- | |||
| MSA1.Support.11 | |||
| ROD Quality Metrics per month per region/NGI | |||
| I | |||
| TSA1.7 | |||
| | |||
|- |
Revision as of 15:07, 26 August 2010
Metric ID (scope) | Metric | Public/Internal | Task | Comments and explanation | |
---|---|---|---|---|---|
M.SA1.Size.1 (A, N) | Total number of production resource centers that are part of the EGI. | P | TSA1.1 | ||
M.SA1.Size.2 (A, N, V) | Total number of job slots available in EGI. | P | TSA1.1 | ||
M.SA1.Size.3 (A, N, V) | Installed Capacity in HEP SPEC in EGI. | P | TSA1.1 | Replaces EGEE metric "Total available computing power" | |
M.SA1.Size.4 (A, N, V) | Installed Disk Capacity (PB) | P | TSA1.1 | ||
M.SA1.Size.5 (A, N, V) | Installed Tape Capacity (PB) | P | TSA1.1 | ||
M.SA1.Size.6 (A, N, V) | Number of new/decommissioned/international VOs | P | TSA1.1 | ||
M.SA1.Size.7 (A, N, V) | Number of users | P | TSA1.1 | ||
M.SA1.OperationalSecurity.1 | Number of Site Security challenge (SSC) organized | I | TSA1.2 | ||
M.SA1.OperationalSecurity.2 | Security Service Challenge assessment scores | I | TSA1.2 | ||
M.SA1.OperationalSecurity.3 | Incident handling assesment scores | I | TSA1.2 | ||
M.SA1.OperationalSecurity.4 | Number of suspended sites for security issues | I | TSA1.2 | ||
M.SA1.OperationalSecurity.5 | Vulnerability issue handling timeliness (operational and middleware) | I | TSA1.2 | ||
M.SA1.OperationalSecurity.4 | Number of suspended sites for security issues | I | TSA1.2 | ||
M.SA1.Integration.1 | Number of production HPC resources | I | TSA1.3 | HPC resource is a site with a dedicated high-speed low-latency communications network for applications | |
M.SA1.Integration.2 | Number of production sites supporting MPI | I | TSA1.3 | Passing MPI Nagios tests | |
M.SA1.Integration.3 | Number of desktop resources | I | TSA1.3 | Placeholder: Need to define desktop resources and how to integrate them | |
M.SA1.Integration.4 | Number of accessible virtualised resources | I | TSA1.3 | Placeholder: Need to define virtualised resources and how to integrate them | |
M.SA1.ServiceValidation.1 | Total number of sites who participating in a staged rollout release | I | TSA1.3 | Record the number of sites participating in each release. | |
M.SA1.ServiceValidation.2 | Number of staged rollout releases undertaken & rejected | I | TSA1.3 | ||
M.SA1.Usage.1 | Number of jobs done, per VO (mean daily/monthly number) | P | TSA1.5 | ||
M.SA1.Usage.2 | Normalized consumed computing capacity | P | TSA1.5 | HepSpec-day | |
M.SA1.Usage.3 | Number of active VOs | P | |||
M.SA1.Usage.4 | Monthly job efficiency per VO | P | TSA1.5 | ||
M.SA1.Usage.5 | Monthly data throughput per VO | P | TSA1.5 | ||
M.SA1.Usage.6 (A, V, N) | Normalised Computing power consumed outside of a user’s home country | P | TSA1.5 | ||
M.SA1.Operation.1 (A, V, N) | Availability and reliability per resource centre in EGI. | P | TSA1.8 | Minimum targets specified for ops and critical top-ten VOs | |
M.SA1.Operation.4 (A, N) | Number of sites suspended | I | TSA1.8 | ||
M.SA1.Operation.5 (A, N) | Monthly availability and reliability of core and regional operational tools | P | TSA1.8 | ||
M.SA1.Operation.6 (A, N) | Monthly availability and reliability of core middleware services | P | TSA1.8 | ||
M.SA1.Operation.7 (A,N) | Number of operational tickets escalated | I | TSA1.7 | ||
M.SA1.Operation.8 (A, N) | Number of operational procedures, documents and best practices | I | TSA1.7 | ||
M.SA1.Operation.9 (A, N) | Number of sites not publishing accounting data | I | TSA1.5 | ||
M.SA1.Operation.10 (A) | Monthly availability and reliability of central accounting repository and portal | P | TSA1.5 | ||
M.SA1.Support.1 (A) | Overall number of tickets (operational and user) opened and solved | P | TSA1.7 | ||
M.SA1.Support.2 (A, N) | Mean ticket solution time (business days) and median | P | TSA1.7 | ||
M.SA1.Support.3 (A) | Submitted tickets per month per VO | P | TSA1.7 | ||
M.SA1.Support.4 | Number of monthly tickets per NGI | P | TSA1.7 | ||
M.SA1.Support.5 (A) | Number of tickets closed by TPM (1st line support) | I | TSA1.7 | ||
M.SA1.Support.6 (A) | Ticket assignment time to Support Units by TPM (1st line support) | I | TSA1.7 | ||
M.SA1.Support.7 (N) | Assigned ticket response time | I | TSA1.7 | ||
M.SA1.Support.8 (N) | Assigned ticket solution time | I | TSA1.7 | ||
MSA1.Support.9 COD | Workload per month | I | TSA1.7 | ||
MSA1.Support.10 | ROD Workload per month per region/NGI | I | TSA1.7 | ||
MSA1.Support.11 | ROD Quality Metrics per month per region/NGI | I | TSA1.7 |