Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

EGI-InSPIRE:SA1 Quality Metrics

From EGIWiki
Revision as of 18:53, 23 February 2011 by Tferrari (talk | contribs)
Jump to navigation Jump to search
Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Note: P=Public, I=Internal, QR=Quarterly Report, x/y/z=Month1/Month2/Month3

Metric ID, Description Comment QR1 QR2 QR3 QR4 QR5
M.SA1.Usage.1, Average number of jobs "done" per day for all VOs - P Excluding OPS and DTEAM. Tool: accounting portal 834,746 871,073 819,100
M.SA1.Usage.2, Normalised consumed computing capacity - P Normalized elapsed time to a reference value of hepspec06 (hours), excluding DTEAM and OPS. Tool: accounting portal 916,910,352 1,415,191,460 1,617,306,040
M.SA1.Usage.3, Normalised Computing power consumed outside of a user’s home country - P Requires tool development NA NA NA
M.SA1.Size.1, Total number of production resource centers that are part of the EGI - P TSA1.1, Tool: gstat. TSA1.1 QR . Local Sites that are part of a local grid, not integrated with EGI, do not need to be included in the count. 341 337 340
M.SA1.Size.2, Total number of job slots available in EGI per NGI - P TSA1.1, Job slots equals logical cpus. Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR. non-InSPIRE means excluding logical CPUs from USA 184,844 189,596 (Dec 2010: Inspire: 197977, non-InSPIRE: 98611, TOT: 296588) 226,226 (non InSPIRE 82,357, tot 308,583)
M.SA1.Size.3, Installed Capacity in HEP SPEC in EGI - P TSA1.1, Tool: gstat. NGI can amend results reported by tools, and report correct values in its own QR. The total HEPSPEC06 are derived by the capacity reported by each NGI (by summing NGI values) 45,471,329
M.SA1.Size.4, Installed Disk Capacity (PB) in EGI - P TSA1.1, Tool: gstat. The overall installed capacity of EGI is derived from the sum of the capacity reported by NGIs. NGI can amend results reported by tools, and report correct values in its own QR 72.962
M.SA1.Size.5, Installed Tape Capacity (PB) in EGI - P TSA1.1, Tool: gstat. The overall installed capacity of EGI is derived from the sum of the capacity reported by NGIs. NGI can amend results reported by tools, and report correct values in its own QR 56.647
M.SA1.OperationalSecurity.1, Number of Site Security challenge (SSC) made - I TSA1.2, Manual metric (from TSA1.2 QR) - 13 0
M.SA1.OperationalSecurity.2, Number of Sites passing one Security Challenge - I TSA1.2, Target: 50% (to be reviewed in the coming months). Manual metric (from TSA1.2 QR) - 100% -
M.SA1.OperationalSecurity.3, Number of suspended sites for security issues - I TSA1.2, Manual metric (in TSA1.2 QR) 0 0 0
M.SA1.Integration.1, Number of production HPC clusters per NGI - I TSA1.3, HPC clusters is a site with a dedicated high-speed low-latency communications network. Manual metric (NGI QR) NA 55 52
M.SA1.Integration.2, Number of production sites supporting MPI - I TSA1.3, only sites passing MPI Nagios tests are considered. Tool: query to the information system Manual metric (NGI QR) NA 73 90
M.SA1.Integration.3, Amount of integrated desktop resources - I TSA1.3, Placeholder: Need to define desktop resources and how to integrate them. Manual metric (NGI QR) NA 0 1562
M.SA1.Integration.4, Amount of virtualised installed capacity accessible to EGI users - I TSA1.3, Placeholder: Need to define virtualised resources and how to integrate them. Manual metric (NGI QR) NA 246,200 16,109
M.SA1.ServiceValidation.1, Total number of staged rollout components operated in EGI - I TSA1.3, Record the number of components participating in each release of a component. Manual metric (TSA1.3 QR) 27 (34 comp) 30 (34 comp) 15 (19 comp)
M.SA1.ServiceValidation.2, Number of staged rollout releases undertaken & rejected - I TSA1.3, Manual metric (TSA1.3 QR) 0 3 3
M.SA1.Accounting.1, Number of sites adopting AMQ messaging for Usage Record publication - P TSA1.5, Manual metric (TSA1.5 QR) - 62 149 (90 RGMA, 62 direct insertion, 56% infrastructure ok)
M.SA1.Support.1, overall average number of GGUS tickets in EGI per month CREATED - P TSA1.7, Tool: GGUS reporting tool. All SUs - including CIC portal. 766/879/1079 931/901/954 1137/962/1014
M.SA1.Support.2, Average/Median monthly ticket solution time (hours) - P TSA1.7, Tool: GGUS reporting tool. All SUs - including CIC portal (Average h-Median h) 172-28/108-24/91-39 missing/97-31/129-39 160-32/51-22/45-25
M.SA1.Support.4, Assigned ticket monthly Average RESPONSE TIME (hours) - P TSA1.7, Tool: GGUS monthly reports. Only Operations SUs are considered. 16/9/15 missing/10/15 15/12/11
[=TPM&type_of_problem=all%20problems&mouarea=&priority=all&rel_issue_search= M.SA1.Support.5], Number of tickets SOLVED by TPM (1st line support) per month - I TSA1.7, Tool: GGUS reporting tool 1/7/0 2/2/2 6/9/2
M.SA1.Support.6, Average-Median ticket assignment time by TPM (1st line support) per month hours - I TSA1.7, Tool: GGUS montly reports 4-0/2-0/1-0 missing/1-0/2-0 2-0/1-0/2-0
M.SA1.Support.7,COD Workload per month - I TSA1.7, Number of COD issues handled per month. Tool: operations dashboard. TSA1.7 report 886/188/1742 652/591/487 764/551/844
M.SA1.Support.8, EGI ROD Workload per month - I TSA1.7, The overall ROD workload per month adding up the workload of all NGIs. Tool: operations dashboard. TSA1.7 report 4535/1532/4277 2622/2733/1944 2943/1912/2090
MSA1.Support.9, EGI ROD Quality Metrics per month - I TSA1.7, Arithetic mean of all ROD quality metrics. Tool: operations dashboard. TSA1.7 report 0.84/0.81/0.89 0.86/0.89/0.90 0.90/0.81/0.76
M.SA1.Operation.1, EGI monthly availability and reliability - P TSA1.8, Tool: availability report generator 93.298 90.734 92.318
M.SA1.Operation.2, Number of sites suspended - I TSA1.7, Includes sites suspended for operational issues. Manual metric. TSA1.7 report 0/0/0 3/1/2 1/0/1
M.SA1.Operation.3, EGI monthly availability and reliability of core operations tools - P TSA1.8, Development needed NA NA NA
M.SA1.Operation.4, EGI Monthly availability and reliability of core middleware services - P TSA1.8, Development needed NA NA NA
M.SA1.Operation.5, EGI monthly availability and reliability of site middleware services - P TSA1.8, Development needed NA NA NA
M.SA1.Operation.6, EGI monthly availability and reliability of central operations tools - P TSA1.8, Development needed NA NA NA