Difference between revisions of "Service Level Target - ROD performance index"

From EGIWiki
Jump to: navigation, search
Line 1: Line 1:
{{Template:Op menubar}}  
+
{{Template:Op menubar}} {{Template:GO menubar}} {{TOC_right}}  
{{Template:GO menubar}} {{TOC_right}}  
 
  
[[Category:Grid Oversight]]
+
The ROD performance index (<span lang="en" id="result_box" class="short_text"><span class="hps">formerly known as ROD&nbsp;OLA metric</span></span>) was introcuded to track the level of Grid Oversight service delivered by Operations Centres according to [https://documents.egi.eu/secure/ShowDocument?docid=463 Resource Provider OLA].
[[Category:Service_Level_Management]]
 
  
The ROD performance index (<span lang="en" class="short_text" id="result_box"><span class="hps">formerly known as ROD&nbsp;OLA metric</span></span>) was introcuded to track the level of Grid Oversight service delivered by Operations Centres according to [https://documents.egi.eu/secure/ShowDocument?docid=463 Resource Provider OLA].  
+
The index was accepted during Technical Forum 2011 in Lyon and is available on [https://operations-portal.egi.eu/rodDashboard/ EGI&nbsp;Operations Portal].
 +
(choose Metrics tab).
  
The index was accepted during Technical Forum 2011 in Lyon and is available on [https://operations-portal.in2p3.fr/dashboard/rodOlaMetrics EGI&nbsp;Operations Portal].
+
= Definition  =
  
= Definition  =
+
'''ROD performance index''' is the sum of:  
'''ROD performance index''' is the sum of:
+
 
*No. of ticket expired<sup>*</sup> <span lang="en" id="result_box" class="short_text"><span class="hps"> in the operations dashboard daily</span></span>  
+
*No. of ticket expired<sup>*</sup> <span lang="en" class="short_text" id="result_box"><span class="hps"> in the operations dashboard daily</span></span>  
*No. alarms older than 72h <span lang="en" id="result_box" class="short_text"><span class="hps"> appearing</span></span><span lang="en" id="result_box" class="short_text"><span class="hps">in operations dashboard daily</span></span>
+
*No. alarms older than 72h <span lang="en" class="short_text" id="result_box"><span class="hps"> appearing</span></span><span lang="en" class="short_text" id="result_box"><span class="hps">in operations dashboard daily</span></span>
  
 
<span lang="en" class="short_text">
 
<span lang="en" class="short_text">
</span>  
+
</span> A ticket in counted as '''expired''' in the [https://operations-portal.egi.eu/dashboard Operations Portal dashboard] if the "Expiration date" is set at a time in the past. The "Expiration date" field is set according to [[PROC01|escalation procedure]], but can be freely changed by ROD. It refers to the date when the status of issue should be checked next time.  
A ticket in counted as '''expired''' in the [https://operations-portal.egi.eu/dashboard Operations Portal dashboard] if the "Expiration date" is set at a time in the past. The "Expiration date" field is set according to [[PROC01 |escalation procedure]], but can be freely changed by ROD. It refers to the date when the status of issue should be checked next time.
 
  
The ROD performance index is calculated monthly from the data gathered by EGI Operations Portal. It does not take into account weekends.
+
The ROD performance index is calculated monthly from the data gathered by EGI Operations Portal. It does not take into account weekends.  
  
= Threshold =
+
= Threshold =
The maximum value of the index must be 10. Above this value ROD teams has to provide explanation and provide a plan of improvement of the oversight service.
+
 
 +
The maximum value of the index must be 10. Above this value ROD teams has to provide explanation and provide a plan of improvement of the oversight service.  
  
 
= <span class="mw-headline">Performance reports</span><br>  =
 
= <span class="mw-headline">Performance reports</span><br>  =
Line 151: Line 150:
  
 
#When an Operations Centre get a ticket from COD about ROD performance, the Operations Centre should provide GGUS ticket or a link to SAM or the oeprations dashboard downtime page in GOC DB.  
 
#When an Operations Centre get a ticket from COD about ROD performance, the Operations Centre should provide GGUS ticket or a link to SAM or the oeprations dashboard downtime page in GOC DB.  
#*If ROD performance index is below 10 items, NGI can create a GGUS ticket to COD asking for recalculation
+
#*If ROD performance index is below 10 items, NGI can create a GGUS ticket to COD asking for recalculation  
 
#Based on GGUS trouble tickets referenced in prerequisites, or on the GGUS ticket opened by the Operations Centre to MyEGI requesting for A/R recualculation, or GOC DB service downtime entry, COD, knowing when the problem occurred,<br>can remove the metrics items for given days from final report pdf.
 
#Based on GGUS trouble tickets referenced in prerequisites, or on the GGUS ticket opened by the Operations Centre to MyEGI requesting for A/R recualculation, or GOC DB service downtime entry, COD, knowing when the problem occurred,<br>can remove the metrics items for given days from final report pdf.
  
Line 164: Line 163:
 
*Automatic check if node is not in production while alarm is closing  
 
*Automatic check if node is not in production while alarm is closing  
 
*In case of SCHEDULED interventions, the monthly metrics calculation should automatically take the scheduled downtime into account. At the time the metrics are computed, the application which does such calculation should access the GOC PI to determine which regional nagios machines were in downtime, and include that restriction in the calculation.
 
*In case of SCHEDULED interventions, the monthly metrics calculation should automatically take the scheduled downtime into account. At the time the metrics are computed, the application which does such calculation should access the GOC PI to determine which regional nagios machines were in downtime, and include that restriction in the calculation.
 +
 +
[[Category:Grid_Oversight]] [[Category:Service_Level_Management]]

Revision as of 11:28, 6 October 2014

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


EGI Infrastructure Operations Oversight menu: Home EGI.eu Operations Team Regional Operators (ROD) 



The ROD performance index (formerly known as ROD OLA metric) was introcuded to track the level of Grid Oversight service delivered by Operations Centres according to Resource Provider OLA.

The index was accepted during Technical Forum 2011 in Lyon and is available on EGI Operations Portal. (choose Metrics tab).

Definition

ROD performance index is the sum of:

  • No. of ticket expired* in the operations dashboard daily
  • No. alarms older than 72h appearingin operations dashboard daily

A ticket in counted as expired in the Operations Portal dashboard if the "Expiration date" is set at a time in the past. The "Expiration date" field is set according to escalation procedure, but can be freely changed by ROD. It refers to the date when the status of issue should be checked next time.

The ROD performance index is calculated monthly from the data gathered by EGI Operations Portal. It does not take into account weekends.

Threshold

The maximum value of the index must be 10. Above this value ROD teams has to provide explanation and provide a plan of improvement of the oversight service.

Performance reports

Service Level:

ROD Performance Index ticket/Report

Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
2011 - - - - - - - - -

10/11

11/11

12/11

2012

01/12

02/12

03/12

04/12

05/12

06/12

07/12

08/12

09/12

10/12

11/12

 

12/12

2013

01/13

02/13

03/13

04/13

05/13

06/13 07/13 08/13 09/13 10/13 11/13 12/13
2014 01/14 02/14 ----
04/14 05/14 06/14 07/14 08/14



Recalculation procedure in case of intervention on the NGI SAM or the operations dashboard

Prerequisite:

  1. In case of problems with synchronization between regional operations dashboard the Resource infrastructure Provider should create a GGUS ticket to Operations Portal team.
  2. In case of problems with the regional SAM, Resource infrastructure Provider should create a GGUS ticket to SAM team.
  3. In case of work carried out on regional SAM or operations dashboard the Resource infrastructure Provider should declare downtime in GOC DB.

Procedure steps:

  1. When an Operations Centre get a ticket from COD about ROD performance, the Operations Centre should provide GGUS ticket or a link to SAM or the oeprations dashboard downtime page in GOC DB.
    • If ROD performance index is below 10 items, NGI can create a GGUS ticket to COD asking for recalculation
  2. Based on GGUS trouble tickets referenced in prerequisites, or on the GGUS ticket opened by the Operations Centre to MyEGI requesting for A/R recualculation, or GOC DB service downtime entry, COD, knowing when the problem occurred,
    can remove the metrics items for given days from final report pdf.

Future plans

In the future the metric will also include no. alarms closed in NON-OK status without explanation. This will need some implementation effort.

Issues to be implemented:

  • Taking into account holidays periods in alarms ageing
  • Automatic check if site/node is in downtime while alarm is closing
  • Automatic check if node is not in production while alarm is closing
  • In case of SCHEDULED interventions, the monthly metrics calculation should automatically take the scheduled downtime into account. At the time the metrics are computed, the application which does such calculation should access the GOC PI to determine which regional nagios machines were in downtime, and include that restriction in the calculation.