WI02 Operations centre creation

From EGIWiki
Jump to: navigation, search
Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


EGI Infrastructure Operations Oversight menu: Home EGI.eu Operations Team Regional Operators (ROD) 


Internal procedure for EGI Operations - Proc02

This page describes steps which should be taken to follow Operations Centre creation procedure.


When GGUS ticket is assigned to Operations:

  1.  Check if all the required information were provided: PROC02#Start_of_the_integration If not, ask to supplement the data. If all information are provided create tickets according following steps as new ticket. Add tickets should be assign as child tickets to the parent one.
  2. Do not split parent ticket to create new tickets. It is important to keep everything clear. Child tickets should have proper content and it should be clear from parent ticket which step when was taken.



Step Substep Action on Action
1
IPC

Put an information that request was validated:

The request was validated and the creation procedure will start. 
2
IPC Create child tickets in the order given as follows:

1 GOCDB Creation of a new Operations Centre entry in the GOCDB (with no site attached).

Include the following into the GOCDB ticket:

'''Subject''': NGI creation child ticket for GOCDB: NGI_XX

Please create entries in GOCDB for NGI_XX. 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process. 
The related master ticket is XXXX. 	

Operations Centre name: <Operations Centre name>

Operations Centre management mailing list: foo@bar.org

Operations Centre security mailing list:

Operations Centre ROD mailing list: 

Operations Centre Operations manager:

Operations Centre security officer: 

2 Operations Portal

Enter the new Operations Centre in the Operations dashboard (also add ROD mailing list)

'''Subject''': NGI creation child ticket for Operational Portal: NGI_XXX

Please enter NGI_XX in the Operations dashboard.
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.

3 GGUS

Create a new support unit in GGUS :

'''Subject''': NGI creation child ticket for GGUS: NGI_XXX

Please create entries in GGUS for NGI_XXX. 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.

NOTE:

NGI should fill in https://wiki.egi.eu/wiki/GGUS:NGI_XXX_FAQ

Instruction how to create GGUS wiki page https://wiki.egi.eu/wiki/GGUS:FAQ_Responsible_Units


4 Operations Support Certification of new ROD team –
'''Subject''': NGI creation child ticket for Operations Support: NGI_XXX

Please certify NGI_XXX ROD team (ROD mailing list). 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.
3
The newly created Operations Centre

Confirmation that NGI read, accept and agree to fulfill the RP OLA  https://documents.egi.eu/secure/ShowDocument?docid=463

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX, Could you please confirm that you read, accept and agree to fulfill the RP OLA  
[https://documents.egi.eu/secure/ShowDocument?docid=463] ?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.

How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field

This step is not blocking the process and can be done in parallel. It is required to finish this step before closing parent ticket.

4
Dteam VO manager

Create a branch/group for Operations Centre and assign DN of people who will be dteam VO representative for the Operations Centre, Operations Centre Group owner and Operations Centre Group manager.

'''Subject''': NGI creation child ticket for Dteam: NGI_XX

Dear Dteam Vo manager,

Please create branch for NGI_XX
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.

Dteam VO representative for NGI_XX will be

Operations Centre Group owner:

Operations Centre Group manager:

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.

How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field

This step is not blocking the process and can be done in parallel. It is required to finish this step before closing parent ticket.

5

The newly created Operations Centre Include the NAGIOS host in the GOCDB as a 'National-Nagios' service.

(This step only applies to Operations Centres running own Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XXX,

Could you please include your Nagios instance host in GOC DB as 'National-Nagios' service?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX
6


IPC

[If the Operations Centre was part of a OC]
Configure the Operations Centre in the OC Nagios instance

'''Subject''': NGI creation child ticket for _XX: NGI_XXX

Dear XXX,

Could you please configure your Nagios instance so that it will test sites from NGI_XXXX??

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
7

The newly created Operations Centre

Final confirmation that the new Operations Centre can start the operations

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XXX,

Could you please confirm you are ready to take responsibility for your sites and start operations??
With next step your site will be registered in GOC DB under your NGI and you will have to start
look after operations alarms on Operations Portal.  

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
8
GOCDB
  • [If the Operations Centre was part of a ROC]

GOCDB transfers related sites from the source ROC to the new Operations Centre structure.

NOTE: please indicate the sites moving across to the new NGI in the ticket.

'''Subject''': NGI creation child ticket for GOC DB: NGI_XX

Dear GOC DB,

Could you please transfer sites:
*
*
*
*
*
from the XXX to new Operations Centre NGI_XX?
  

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
The newly created Operations Centre
  • [If the Operations Centre wasn't part of a ROC]

Newly created Operations Centre can insert new sites

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please insert your sites in GOC DB?  

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
9

The newly created Operations Centre

[If the Operations Centre was part of a ROC]

Inform managers of regional VOs to change the VO scope of their VOs from ROC (regional) to the relevant Operations Centre (national). This action require only confirmation from Operations Centre manager that information was passed.

Information which should be pass to VO managers: "The Vo scope can be changes by creating a ticket to CIC portal SU in GGUS."

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please pass an information to your national VO managers to change the VO scope of their VOs from to the relevant 
Operations Centre (national). 

Additional information which should be pass to VO managers: "The Vo scope can be changes by creating a ticket to Operations portal SU in GGUS." 

This action require only confirmation from Operations Centre manager that information was passed.

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
10 OPTIONAL The newly created Operations Centre All sites should be reconfigured according to the instructions at:

MAN01 How to publish Site Information


 GlueSiteOtherInfo: EGI_NGI=<Operations Centre name>
GlueSiteOtherInfo: GRID=EGI

This step can be performed at any time from this point.

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please confirm that all your sites are configured according to the instruction at:
https://wiki.egi.eu/wiki/MAN1_How_to_publish_Site_Information 


GlueSiteOtherInfo: EGI_NGI=<Operations Centre name>
GlueSiteOtherInfo: GRID=EGI

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
11
The newly created Operations Centre

[If the Operations Centre was part of a OC]

Transfer all open operational tickets to the new Operations Centre in GGUS.

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please transfer all open operational tickets to the new Operations Centre in GGUS?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
12
Nagios team Include the Operations Centre level Nagios in the central ops-monitor Nagios instance.

(This step only applies to Operations Centres running an Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for Nagios: NGI_XX

Dear Nagios team,

Could you please include the NGI_XXX Operations Centre level Nagios in the central ops-monitor Nagios instance?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
13
IPC Validation process of the new Operations Centre Nagios, as described at the step 5.3 of:

https://wiki.egi.eu/wiki/PROC05

(This step only applies to Operations Centres running an Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for IPC: NGI_XX

Dear IPC,

Could you please validate the new Operations Centre Nagios for NGI_XX?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
14
Nagios team

Validation that sites/Operations Centre shown up correctly in Central DBs

'''Subject''': NGI creation child ticket for Nagios: NGI_XX

Dear Nagios team,

Could you please validate that sites and Operations Centre shown up correctly in Central DB?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
15

Nagios team

[If the Operations Centre was part of a OC]

Migrating alerts from OC to Operations Centre Nagios instance.

(This step only applies to Operations Centres running an Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for Nagios: NGI_XX

Dear Nagios team,

Could you please migrate alerts from NGI_XXX to NGI_XXX Operations Centre Nagios instance?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
16
IPC Final checks by the IPC.

(Were all steps taken and finished properly? Close the parent ticket.)

17
The newly created Operations Centre Final checks should be verified and then the information that the Operations Centre is ready is broadcast by Operations Centre officials.

(This broadcast should be sent to VO managers and NOC/ROC managers)

See the template below for an indication of the message content.

'''Subject''': <Operations Centre name> is operational

Dear All,

We would like to announce that <Operations Centre name> is now fully operational 
and that we have finished its integration procedure. All necessary operational 
teams and tools are established in our Operations Centre and we are ready for production. 
This Operations Centre is visible in all operational tools as <Operations Centre name> 
and is responsible for all <COUNTRY> sites.

Best regards,



Revision history

Version Authors Date Comments
Alessandro Paolini 2016-06-08 "EGI Operations Support" was decommissioned, changed all the references to "Operations"