|
|
| (94 intermediate revisions by 13 users not shown) |
| Line 1: |
Line 1: |
| {{Template:Op menubar}} | | {{DeprecatedAndMovedTo|new_location=https://ims.egi.eu/display/EGIPP/EGI+Infrastructure+operations+oversight}} |
| {{TOC_right}}
| |
|
| |
|
| EGI Grid Operations oversight of the e-Infrastructure is a co-ordination task for ensuring that GRID monitoring across EGI runs smoothly.
| | {{Template:Op menubar}} {{Template:GO menubar}} |
| This team communicates among the 3 groups - Operations and e-Infrastructure Oversight (OE); Operational Documentation (OD);
| |
| and "Coordination of interoperations between NGIs and with other Grids".
| |
|
| |
|
| The Operations oversight team works with the Tool Developers (and particularly the [[OTAG]] group), NGIs and their Operations Teams (ROD).
| | [[Category:Infrastructure_Oversight|*]] |
| There are regular phone meetings for the co-ordinators and others working in the tasks. The OE co-ordinators also organise face to face meetings for the
| |
| ROD teams 3 to 4 times a year.
| |
| | |
| ;'''COD managers:''' : Ron Trompert (Chair), Marcin Radecki, Luuk Uljee, Malgorzata Krakowian
| |
| ;'''COD shifters:''' : Malgorzata Krakowian, Ron Trompert, Luuk Uljee, Maarten van Ingen, Ernst Pijper, Alexander Verkooijen
| |
| ;'''Contact:''' :
| |
| *There are 3 mailing lists used for different cases:
| |
| ** '''manager-central-operator-on-duty''' AT mailman.egi.eu - for COD managerial issues like suggesting changes in procedures, tools. COD managers are recipients of this list.
| |
| ** '''central-operator-on-duty''' AT mailman.egi.eu - for reporting COD day-to-day issues like problems with tools or Nagios tests. COD shifters are recipients of this list.
| |
| ** '''all-central-operator-on-duty''' AT mailman.egi.eu - for contacting all ROD teams in NGIs. Every ROD team is a recipient of this list.
| |
| | |
| | |
| ;'''Activities:''' :
| |
| * COD managers
| |
| ** '''representing RODs/COD in OTAG, OMB''' - collecting requirements and improvements proposals from RODs concerning operations tools and procedures
| |
| ** '''taking part in OLA task force'''
| |
| ** '''writing new procedures''' - in case of need COD is taking part in procedures creation process
| |
| ** '''preparing ROD newsletters''' - informing RODs about recent and upcoming developments related to Grid Oversight
| |
| ** '''preparing ROD metrics reports''' - providing an overview of operations support process in grid infrastructure.
| |
| * COD shifters.
| |
| ** '''escalation of operational problems with RODs'''
| |
| ** '''dealing with GGUS tickets assigned to COD'''
| |
| ** '''process coordination''' of:
| |
| *** creation and decommission of Operations Centre
| |
| *** setting a Nagios test to an operations test
| |
| *** getting explanations for low availability and reliability metrics
| |
| | |
| ----
| |
| == COD official web pages ==
| |
| * [[Operations:OperationsSupportMetrics | Operations Support Metrics]]
| |
| * [[Operations:Operations_tests| Operations tests list ]]
| |
| * [[Availability_and_reliability_tests| Availability and reliability tests list ]]
| |
| | |
| | |
| | |
| == Internal area ==
| |
| | |
| * [[Operations:Meetings|Phone conference Meetings, Agenda and Actions]]
| |
| | |
| * [https://documents.egi.eu/secure/ShowDocument?docid=298 ROD newsletter]
| |
| | |
| * [[Operations:List_of_typical_problems_with_RODs| List of typical problems with RODs]]
| |
| | |
| === COD shifters daily work instructions ===
| |
| In this section are collected all work instructions containing detailed information specifying exactly what steps are to be followed to carry out an activity.
| |
| | |
| {| border="1" cellspacing="0" cellpadding="5" align="center"
| |
| ! Action
| |
| ! Description
| |
| ! Related procedures
| |
| |-v
| |
| | '''GGUS tickets assigned to COD'''
| |
| |
| |
| COD shifter is obliged to check the current status of all '''GGUS tickets assigned to COD'''
| |
| * see [http://tinyurl.com/2ws735h Link to all GGUS tickets assigned to COD]
| |
| * If the ticket is waiting for COD action then he/she should perform the action
| |
| | |
| | |
| In case of a request for:
| |
| * '''ROD certification'''
| |
| ** see [[Procedure_to_handle_new_ROD_certification_GGUS_tickets | New ROD team certification work instructions]]
| |
| * '''Creation of a new NGI'''
| |
| ** see [[Operations_Centre_creation_process_coordination | Creation of a new Operations Centre process coordination]]
| |
| ** In case where COD is also the Integration Process Coordinator, COD is responsible for the whole procedure.
| |
| * '''Operations Centre decommission'''
| |
| ** see [[Operations:Operations_Centre_decommission|Operations Centre decommission process coordination]]
| |
| ** COD validates the request and removes ROD information from all-operators mailing list
| |
| * '''Setting a Nagios test to an operations test'''
| |
| ** see [[Operations:Procedure_for_setting_Nagios_test_an_operations_test| Procedure for setting a Nagios test to an operations test]]
| |
| ** COD is responsible for coordinating the whole process.
| |
| | |
| If the shifter doesn't know what kind of action should be taken, he/she should contact COD managers
| |
| |
| |
| * [[Operations_Centre_creation_process_coordination | Creation of a new Operations Centre process coordination]]
| |
| * [[Operations:Operations_Centre_decommission|Operations Centre decommission process coordination]]
| |
| * [[Operations:Procedure_for_setting_Nagios_test_an_operations_test| Procedure for setting Nagios test an operations test]]
| |
| |-
| |
| | '''Availability/reliability reports'''
| |
| |
| |
| * Handling availability/reliability reports: [[Availability_and_reliability_internal_procedure_for_COD | Availability and reliability work instruction]]
| |
| ** [[Availability_and_reliability_reports_metrics | AR reports metrics]]
| |
| |
| |
| * [[Operations:COD_Escalation_Procedure|COD escalation procedure]]
| |
| * [[Availability_and_reliability_monthly_statistics | Availability and reliability monthly statistics procedure]]
| |
| |-
| |
| | '''Operational portal dashboard issues'''
| |
| |
| |
| *[https://operations-portal.in2p3.fr/dashboard/ccodView COD dashboard link]
| |
| *[[Operations:Work_instruction_for_escalating_operational_problems_with_ROD | Escalation for operational problems with ROD - work instruction]]
| |
| |
| |
| * [[Operations:COD_Escalation_Procedure|COD escalation procedure]]
| |
| |-
| |
| | '''Handover'''
| |
| |
| |
| [https://operations-portal.in2p3.fr/dashboard/ccodView COD dashboard link]
| |
| * At the end of the shift a handover should be submitted (send to COD) via Handover tool in the Operational Portal
| |
| ** Problems on the dashboard which will pass to next week: the ggus id of the ticket and when next escalation step should be taken
| |
| ** GGUS tickets assigned to COD: for each ticket its last status and the action taken by the shifter should be provided
| |
| ** Other issues: problems with tools etc.
| |
| | | |
| |-
| |
| |}
| |
| | |
| | |
| ''NOTE: all procedures should contain the following template: https://wiki.egi.eu/wiki/PDT:Procedure_Template''
| |
| | |
| === Procedures ===
| |
| | |
| ==== To be approved by OMB ====
| |
| | |
| === OTAG topics ===
| |
| | |
| ==== Operational Portal: Dashboard ====
| |
| * [http://bit.ly/dZ3RWN RT tickets] | |
| * [[Operations:COD_interaction_with_Dashboard_team| COD interactions with Dashboard team (draft)]]
| |
| * [[Operations:COD_OTAG_topics| COD topics to be discussed on OTAG meeting]]
| |
| | |
| ==== GOC DB ====
| |
| * [[Operations:COD_GOCDB_requirements|Collection of GOC DB requirements regarding COD work (draft)]]
| |
| | |
| === Pages in draft state ===
| |
| | |
| * [[Operations:COD_Improvements_to_availability_procedure|Improvements to Availability Calculation Procedure (draft)]]
| |
| | |
| * [[Operations:A/R_fixing_procedure| A/R fixing procedure (draft)]]
| |
| | |
| | |
| | |
| | |
| [[Category:COD]]
| |
The wiki is deprecated and due to be decommissioned by the end of September 2022.