Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:SA1 Quality Metrics"

From EGIWiki
Jump to navigation Jump to search
Line 1: Line 1:
Note: P=Public, I=Internal
Note: P=Public, I=Internal, QR=Quarterly Report, x/y/z=Month1/Month2/Month3


{|  border="1" cellspacing="0" cellpadding="5" align="center"
{|  border="1" cellspacing="0" cellpadding="5" align="center"
Line 7: Line 7:
! QR2
! QR2
! QR3
! QR3
! QR4
! QR5
|-
|-
| M.SA1.Usage.1, Number of jobs done, per VO and discipline (mean daily/monthly number) - P
| M.SA1.Usage.1, Number of jobs done, per VO and discipline (mean daily/monthly number) - P
Line 13: Line 15:
|  
|  
|  
|  
|
|
|-
|-
| M.SA1.Usage.2, Normalised consumed computing capacity - P
| M.SA1.Usage.2, Normalised consumed computing capacity - P
Line 19: Line 23:
|  
|  
|  
|  
|
|
|-
|-
| M.SA1.Usage.3, Normalised Computing power consumed outside of a user’s home country - P
| M.SA1.Usage.3, Normalised Computing power consumed outside of a user’s home country - P
Line 25: Line 31:
|  
|  
|  
|  
|
|
|-  
|-  
| M.SA1.Size.1, Total number of production resource centers that are part of the EGI - P  
| M.SA1.Size.1, Total number of production resource centers that are part of the EGI - P  
Line 31: Line 39:
| 337
| 337
|  
|  
|
|
|-
|-
| M.SA1.Size.2, Total number of job slots available in EGI per NGI - P  
| M.SA1.Size.2, Total number of job slots available in EGI per NGI - P  
Line 36: Line 46:
|  
|  
|  
|  
|
|
|  
|  
|-
|-
Line 42: Line 54:
|  
|  
|  
|  
|
|
|  
|  
|-
|-
Line 48: Line 62:
|  
|  
|  
|  
|
|
|  
|  
|-
|-
Line 54: Line 70:
|  
|  
|  
|  
|
|
|  
|  
|-
|-
Line 61: Line 79:
| 13
| 13
|  
|  
|
|
|-
|-
| M.SA1.OperationalSecurity.2, Number of Sites passing one Security Challenge - I
| M.SA1.OperationalSecurity.2, Number of Sites passing one Security Challenge - I
Line 67: Line 87:
| 100%
| 100%
|  
|  
|
|
|-
|-
| M.SA1.OperationalSecurity.3, Number of suspended sites for security issues - I  
| M.SA1.OperationalSecurity.3, Number of suspended sites for security issues - I  
Line 73: Line 95:
| 0
| 0
|  
|  
|
|
|-
|-
| M.SA1.Integration.1, Number of production HPC clusters per NGI - I
| M.SA1.Integration.1, Number of production HPC clusters per NGI - I
| TSA1.3, HPC clusters is a site with a dedicated high-speed low-latency communications network. Manual metric (NGI QR)  
| TSA1.3, HPC clusters is a site with a dedicated high-speed low-latency communications network. Manual metric (NGI QR)  
|
|
|  
|  
|
|
Line 84: Line 110:
|  
|  
|  
|  
|
|
|  
|  
|-
|-
Line 89: Line 117:
| TSA1.3, Placeholder: Need to define desktop resources and how to integrate them. Manual metric (NGI QR)
| TSA1.3, Placeholder: Need to define desktop resources and how to integrate them. Manual metric (NGI QR)
|  
|  
|
|
|  
|  
|  
|  
Line 97: Line 127:
|  
|  
|  
|  
|
|
|-
|-
| M.SA1.ServiceValidation.1, Total number of staged rollout components operated per NGI - I  
| M.SA1.ServiceValidation.1, Total number of staged rollout components operated per NGI - I  
Line 103: Line 135:
| 30 (34 comp)
| 30 (34 comp)
|  
|  
|
|
|-
|-
| M.SA1.ServiceValidation.2, Number of staged rollout releases undertaken & rejected - I
| M.SA1.ServiceValidation.2, Number of staged rollout releases undertaken & rejected - I
Line 109: Line 143:
| 3
| 3
|  
|  
|
|
|-
|-
| M.SA1.Accounting.1, Number of sites adopting AMQ messaging for Usage Record publication - P  
| M.SA1.Accounting.1, Number of sites adopting AMQ messaging for Usage Record publication - P  
Line 115: Line 151:
| 62
| 62
|  
|  
|
|
|-
|-
| M.SA1.Support.1, Number of operational tickets (operational and user) CREATED /SOLVED per Support Unit per month - P  
| M.SA1.Support.1, Number of operational tickets (operational and user) CREATED /SOLVED per Support Unit per month - P  
Line 120: Line 158:
|
|
|  
|  
|
|
|  
|  
|-
|-
Line 126: Line 166:
|
|
|  
|  
|
|
|  
|  
|-
|-
Line 131: Line 173:
| TSA1.7, Tool: GGUS reporting tool
| TSA1.7, Tool: GGUS reporting tool
|
|
|
|
|
|
|  
|  
Line 139: Line 183:
|  
|  
|  
|  
|
|
|-
|-
| M.SA1.Support.5, Number of tickets SOLVED by TPM (1st line support) - I  
| M.SA1.Support.5, Number of tickets SOLVED by TPM (1st line support) - I  
Line 144: Line 190:
|  
|  
|  
|  
|
|
|  
|  
|-
|-
Line 150: Line 198:
|
|
|  
|  
|
|
|  
|  
|-
|-
Line 157: Line 207:
| 652/591/487
| 652/591/487
|  
|  
|
|
|-
|-
| M.SA1.Support.8, ROD Workload per month per region/NGI - I  
| M.SA1.Support.8, ROD Workload per month per region/NGI - I  
Line 163: Line 215:
| 2622/2733/1944
| 2622/2733/1944
|  
|  
|
|
|-
|-
| MSA1.Support.9, ROD Quality Metrics per month per region/NGI - I  
| MSA1.Support.9, ROD Quality Metrics per month per region/NGI - I  
Line 169: Line 223:
| 0.86/0.89/0.90
| 0.86/0.89/0.90
|  
|  
|
|
|-
|-
| M.SA1.Operation.1, NGI monthly availability and reliability - P
| M.SA1.Operation.1, NGI monthly availability and reliability - P
Line 174: Line 230:
|  
|  
|
|
|
|
|  
|  
|-
|-
Line 181: Line 239:
| 3/1/2
| 3/1/2
|  
|  
|
|
|-
|-
| M.SA1.Operation.3, NGI monthly availability and reliability of core operations tools - P  
| M.SA1.Operation.3, NGI monthly availability and reliability of core operations tools - P  
Line 187: Line 247:
|
|
|  
|  
|
|
|-
|-
| M.SA1.Operation.4, NGI Monthly availability and reliability of core middleware services - P
| M.SA1.Operation.4, NGI Monthly availability and reliability of core middleware services - P
Line 192: Line 254:
|
|
|  
|  
|
|
|  
|  
|-
|-
Line 198: Line 262:
|
|
|  
|  
|
|
|  
|  
|-
|-
Line 204: Line 270:
|
|
|
|
|
|
|  
|  
|}
|}

Revision as of 12:30, 10 December 2010

Note: P=Public, I=Internal, QR=Quarterly Report, x/y/z=Month1/Month2/Month3

Metric ID, Description Comment QR1 QR2 QR3 QR4 QR5
M.SA1.Usage.1, Number of jobs done, per VO and discipline (mean daily/monthly number) - P Tool: accounting portal
M.SA1.Usage.2, Normalised consumed computing capacity - P Measured in HEP SPEC. Tool: accounting portal
M.SA1.Usage.3, Normalised Computing power consumed outside of a user’s home country - P Requires tool development
M.SA1.Size.1, Total number of production resource centers that are part of the EGI - P TSA1.1, Tool: gstat. TSA1.1 QR 341 337
M.SA1.Size.2, Total number of job slots available in EGI per NGI - P TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR
M.SA1.Size.3, Installed Capacity in HEP SPEC in EGI per NGI - P TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR
M.SA1.Size.4, Installed Disk Capacity (PB) per NGI - P TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR
M.SA1.Size.5, Installed Tape Capacity (PB) per NGI - P TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR
M.SA1.OperationalSecurity.1, Number of Site Security challenge (SSC) made - I TSA1.2, Manual metric (from TSA1.2 QR) - 13
M.SA1.OperationalSecurity.2, Number of Sites passing one Security Challenge - I TSA1.2, Target: 50% (to be reviewed in the coming months). Manual metric (from TSA1.2 QR) - 100%
M.SA1.OperationalSecurity.3, Number of suspended sites for security issues - I TSA1.2, Manual metric (in TSA1.2 QR) 0 0
M.SA1.Integration.1, Number of production HPC clusters per NGI - I TSA1.3, HPC clusters is a site with a dedicated high-speed low-latency communications network. Manual metric (NGI QR)
M.SA1.Integration.2, Number of production sites supporting MPI - I TSA1.3, Passing MPI Nagios tests. Tool: query to the information system Manual metric (NGI QR)
M.SA1.Integration.3, Amount of integrated desktop resources - I TSA1.3, Placeholder: Need to define desktop resources and how to integrate them. Manual metric (NGI QR)
M.SA1.Integration.4, Amount of virtualised installed capacity accessible to EGI users - I TSA1.3, Placeholder: Need to define virtualised resources and how to integrate them. Manual metric (NGI QR)
M.SA1.ServiceValidation.1, Total number of staged rollout components operated per NGI - I TSA1.3, Record the number of components participating in each release of a component. Manual metric (TSA1.3 QR) 27 (34 comp) 30 (34 comp)
M.SA1.ServiceValidation.2, Number of staged rollout releases undertaken & rejected - I TSA1.3, Manual metric (TSA1.3 QR) 0 3
M.SA1.Accounting.1, Number of sites adopting AMQ messaging for Usage Record publication - P TSA1.5, Manual metric (TSA1.5 QR) - 62
M.SA1.Support.1, Number of operational tickets (operational and user) CREATED /SOLVED per Support Unit per month - P TSA1.7, Tool: GGUS reporting tool
M.SA1.Support.2, Average/Median Solution Time ticket solution time (business days) per Support Unit per month - P TSA1.7, Tool: GGUS reporting tool
M.SA1.Support.3, Number of monthly tickets opened per NGI - P TSA1.7, Tool: GGUS reporting tool
M.SA1.Support.4, Assigned ticket Average/Median RESPONSE TIME/SOLUTION TIME per Support Unit per month - P TSA1.7, Tool: GGUS reporting tool
M.SA1.Support.5, Number of tickets SOLVED by TPM (1st line support) - I TSA1.7, Tool: GGUS reporting tool
M.SA1.Support.6, Ticket assignment time to Support Units by TPM (1st line support) - I TSA1.7, Tool: operations dashboard
M.SA1.Support.7,COD Workload per month - I TSA1.7, Tool: operations dashboard. TSA1.7 report 886/188/1742 652/591/487
M.SA1.Support.8, ROD Workload per month per region/NGI - I TSA1.7, Tool: operations dashboard. TSA1.7 report 4535/1532/4277 2622/2733/1944
MSA1.Support.9, ROD Quality Metrics per month per region/NGI - I TSA1.7, Tool: operations dashboard. TSA1.7 report 0.84/0.81/0.89 0.86/0.89/0.90
M.SA1.Operation.1, NGI monthly availability and reliability - P TSA1.8, Tool: availability report generator
M.SA1.Operation.2, Number of sites suspended - I TSA1.7, Manual metric. TSA1.7 report 0/0/0 3/1/2
M.SA1.Operation.3, NGI monthly availability and reliability of core operations tools - P TSA1.8, Development needed
M.SA1.Operation.4, NGI Monthly availability and reliability of core middleware services - P TSA1.8, Development needed
M.SA1.Operation.5, EGI monthly availability and reliability of core middleware services - P TSA1.8, Development needed
M.SA1.Operation.6, EGI monthly availability and reliability of central operations tools - P TSA1.8, Development needed