Difference between revisions of "WI02 Operations centre creation"

From EGIWiki
Jump to: navigation, search
 
(15 intermediate revisions by 5 users not shown)
Line 1: Line 1:
= Internal procedure for COD - Proc02<br>  =
+
{{Template:Op menubar}} {{Template:GO menubar}}
  
This page describes steps which should be taken by COD shifter to follow Operations Centre creation procedure.
+
= Internal procedure for EGI Operations - Proc02<br>  =
  
<br> When GGUS ticket is assigned to COD:
+
This page describes steps which should be taken to follow Operations Centre creation procedure.
  
#&nbsp;Check if all the required information were provided: https://wiki.egi.eu/wiki/PROC02#Start_of_the_integration <span lang="en" class="short_text" id="result_box"><span class="hps" title="Kliknij, aby wyświetlić alternatywne tłumaczenia">If not</span><span title="Kliknij, aby wyświetlić alternatywne tłumaczenia">, ask </span>new OC <span class="hps" title="Kliknij, aby wyświetlić alternatywne tłumaczenia">to supplement the</span> <span class="hps" title="Kliknij, aby wyświetlić alternatywne tłumaczenia">data.</span></span>If all information are provided create tickets according following steps as new ti. Add tickets should be assign as child tickets to the parent one.<br>  
+
<br> When GGUS ticket is assigned to Operations:
#'''Do not split parent ticket to create new tickets.''' It is important to keep everyting clear. Child tickets should have proper content and it should be clear from parent ticket which step when was taken.<br>
+
 
 +
#&nbsp;Check if all the required information were provided: [[PROC02#Start_of_the_integration]] If not, ask to supplement the data. If all information are provided create tickets according following steps as new ticket. Add tickets should be assign as child tickets to the parent one.<br>  
 +
#'''Do not split parent ticket to create new tickets.''' It is important to keep everything clear. Child tickets should have proper content and it should be clear from parent ticket which step when was taken.<br>
  
 
<br>  
 
<br>  
Line 12: Line 14:
 
<br>  
 
<br>  
  
{| cellspacing="0" cellpadding="4" border="1" align="left"
+
{| align="left" cellspacing="0" cellpadding="4" border="1"
 
|-
 
|-
 
! Step  
 
! Step  
Line 48: Line 50:
  
 
Operations Centre security mailing list:
 
Operations Centre security mailing list:
 +
 +
Operations Centre ROD&nbsp;mailing list:&nbsp;
  
 
Operations Centre Operations manager:
 
Operations Centre Operations manager:
Line 84: Line 88:
 
| <br>  
 
| <br>  
 
| 4  
 
| 4  
| COD
+
| Operations Support
| Certification of new ROD team – <pre>'''Subject''': NGI creation child ticket for COD: NGI_XXX
+
| Certification of new ROD team – <pre>'''Subject''': NGI creation child ticket for Operations Support: NGI_XXX
  
 
Please certify NGI_XXX ROD team (ROD&nbsp;mailing list).  
 
Please certify NGI_XXX ROD team (ROD&nbsp;mailing list).  
Line 93: Line 97:
 
|-
 
|-
 
| 3  
 
| 3  
 +
| <br>
 +
| The newly created Operations Centre
 +
|
 +
Confirmation that NGI read, accept and agree to fulfill the RP OLA&nbsp; [https://documents.egi.eu/secure/ShowDocument?docid=463 https://documents.egi.eu/secure/ShowDocument?docid=463]
 +
<pre>'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX
 +
 +
Dear NGI_XX, Could you please confirm that you read, accept and agree to fulfill the RP OLA&nbsp;
 +
[https://documents.egi.eu/secure/ShowDocument?docid=463]&nbsp;?
 +
 +
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
 +
The related master ticket is XXX.
 +
</pre>
 +
How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field
 +
 +
This step is not blocking the process and can be done in parallel. It is required to finish this step before closing parent ticket.
 +
 +
|-
 +
| 4
 
| <br>  
 
| <br>  
 
| Dteam VO manager  
 
| Dteam VO manager  
Line 109: Line 131:
 
Operations Centre Group owner:
 
Operations Centre Group owner:
  
Operations Centre Group manager:</pre>  
+
Operations Centre Group manager:
 +
 
 +
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
 +
The related master ticket is XXX.</pre>  
 
How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field  
 
How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field  
  
Line 115: Line 140:
  
 
|-
 
|-
| 4
+
| 5<br>
 
| <br>  
 
| <br>  
 
| The newly created Operations Centre  
 
| The newly created Operations Centre  
Line 130: Line 155:
 
</pre>
 
</pre>
 
|-
 
|-
| 5
+
| 6<br>
 
| <br>  
 
| <br>  
 
| ''<br>''  
 
| ''<br>''  
Line 136: Line 161:
  
 
|  
 
|  
''[If the Operations Centre was part of a ROC]''<br>Configure the Operations Centre in the ROC Nagios instance  
+
''[If the Operations Centre was part of a OC]''<br>Configure the Operations Centre in the OC Nagios instance  
<pre>'''Subject''': NGI creation child ticket for ROC_XX: NGI_XXX
+
<pre>'''Subject''': NGI creation child ticket for _XX: NGI_XXX
  
Dear ROC_XXX,
+
Dear XXX,
  
 
Could you please configure your Nagios instance so that it will test sites from NGI_XXXX??
 
Could you please configure your Nagios instance so that it will test sites from NGI_XXXX??
Line 146: Line 171:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 6
+
| 7<br>
 
| <br>  
 
| <br>  
 
| The newly created Operations Centre  
 
| The newly created Operations Centre  
Line 162: Line 187:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| rowspan="2" | 7
+
| rowspan="2" | 8
 
| rowspan="2" | <br>  
 
| rowspan="2" | <br>  
 
| GOCDB  
 
| GOCDB  
Line 181: Line 206:
 
*
 
*
 
*
 
*
from the XXX to new O[perations Centre NGI_XX?
+
from the XXX to new Operations Centre NGI_XX?
 
    
 
    
  
Line 201: Line 226:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 8
+
| 9<br>
 
| <br>  
 
| <br>  
 
| The newly created Operations Centre  
 
| The newly created Operations Centre  
Line 214: Line 239:
 
Dear NGI_XX,
 
Dear NGI_XX,
  
Could you please pass an information to your regional VO&nbsp;managers to change the VO scope of their VOs from ROC (regional) to the relevant  
+
Could you please pass an information to your national VO&nbsp;managers to change the VO scope of their VOs from to the relevant  
 
Operations Centre (national).  
 
Operations Centre (national).  
  
Additional information which should be pass to VO managers: "The Vo scope can be changes by creating a ticket to CIC portal SU in GGUS."  
+
Additional information which should be pass to VO managers: "The Vo scope can be changes by creating a ticket to Operations portal SU in GGUS."  
  
 
This action require only confirmation from Operations Centre manager that information was passed.
 
This action require only confirmation from Operations Centre manager that information was passed.
Line 224: Line 249:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 9
+
| 10
 
| OPTIONAL  
 
| OPTIONAL  
 
| The newly created Operations Centre  
 
| The newly created Operations Centre  
 
| All sites should be reconfigured according to the instructions at:  
 
| All sites should be reconfigured according to the instructions at:  
https://wiki.egi.eu/wiki/MAN1_How_to_publish_Site_Information
+
[[MAN01 How to publish Site Information]]<br>
 
 
change the old information from:
 
  
  GlueSiteOtherInfo: EGEE_ROC=XXX
 
  GlueSiteOtherInfo: GRID=EGEE
 
  
to:
 
  
 
   GlueSiteOtherInfo: EGI_NGI=&lt;Operations Centre name&gt;
 
   GlueSiteOtherInfo: EGI_NGI=&lt;Operations Centre name&gt;
  GlueSiteOtherInfo: GRID=EGI
+
GlueSiteOtherInfo: GRID=EGI
  
 
This step can be performed at any time from this point.  
 
This step can be performed at any time from this point.  
Line 245: Line 265:
 
Dear NGI_XX,
 
Dear NGI_XX,
  
Could you please confirm that all your sites are configured accroding to the instruction at:
+
Could you please confirm that all your sites are configured according to the instruction at:
 
https://wiki.egi.eu/wiki/MAN1_How_to_publish_Site_Information  
 
https://wiki.egi.eu/wiki/MAN1_How_to_publish_Site_Information  
  
Line 255: Line 275:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 10
+
| 11
 
| <br>  
 
| <br>  
 
| The newly created Operations Centre  
 
| The newly created Operations Centre  
 
|  
 
|  
''[If the Operations Centre was part of a ROC]''  
+
''[If the Operations Centre was part of a OC]''  
  
 
Transfer all open operational tickets to the new Operations Centre in GGUS.  
 
Transfer all open operational tickets to the new Operations Centre in GGUS.  
Line 271: Line 291:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 11
+
| 12
 
| <br>  
 
| <br>  
 
| Nagios team  
 
| Nagios team  
Line 285: Line 305:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 12
+
| 13
 
| <br>  
 
| <br>  
 
| IPC  
 
| IPC  
 
| Validation process of the new Operations Centre Nagios, as described at the step 5.3 of:  
 
| Validation process of the new Operations Centre Nagios, as described at the step 5.3 of:  
https://twiki.cern.ch/twiki/bin/view/EGEE/ValidateROCNagios#Validation_Process.
+
https://wiki.egi.eu/wiki/PROC05 <br>
  
 
''(This step only applies to Operations Centres running an Operations Centre Nagios instance)''  
 
''(This step only applies to Operations Centres running an Operations Centre Nagios instance)''  
Line 301: Line 321:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 13
+
| 14
 
| <br>  
 
| <br>  
 
| Nagios team  
 
| Nagios team  
Line 315: Line 335:
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 14
+
| 15
 
| <br>  
 
| <br>  
 
| ''<br>''  
 
| ''<br>''  
Line 321: Line 341:
  
 
|  
 
|  
''[If the Operations Centre was part of a ROC]''  
+
''[If the Operations Centre was part of a OC]''  
  
Migrating alerts from ROC to Operations Centre Nagios instance.  
+
Migrating alerts from OC to Operations Centre Nagios instance.  
  
 
''(This step only applies to Operations Centres running an Operations Centre Nagios instance)''  
 
''(This step only applies to Operations Centres running an Operations Centre Nagios instance)''  
Line 330: Line 350:
 
Dear Nagios team,
 
Dear Nagios team,
  
Could you please migrate alerts from ROC_XXX to NGI_XXX Operations Centre Nagios instance?
+
Could you please migrate alerts from NGI_XXX to NGI_XXX Operations Centre Nagios instance?
  
 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
 
The related master ticket is XXX.</pre>
 
The related master ticket is XXX.</pre>
 
|-
 
|-
| 15
+
| 16
 
| <br>  
 
| <br>  
 
| IPC  
 
| IPC  
Line 342: Line 362:
  
 
|-
 
|-
| 16
+
| 17
 
| <br>  
 
| <br>  
 
| The newly created Operations Centre  
 
| The newly created Operations Centre  
Line 362: Line 382:
 
|}
 
|}
  
<br>
+
 
 +
 
 +
 
 +
= Revision history  =
 +
 
 +
{| class="wikitable"
 +
|-
 +
! Version
 +
! Authors
 +
! Date
 +
! Comments
 +
|-
 +
|
 +
| Alessandro Paolini
 +
| 2016-06-08
 +
| "EGI Operations Support" was decommissioned, changed all the references to "Operations"
 +
|-
 +
|
 +
|
 +
|
 +
|
 +
|}
 +
 
 +
[[Category:Infrastructure_Oversight]]

Latest revision as of 09:44, 8 June 2016

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


EGI Infrastructure Operations Oversight menu: Home EGI.eu Operations Team Regional Operators (ROD) 


Internal procedure for EGI Operations - Proc02

This page describes steps which should be taken to follow Operations Centre creation procedure.


When GGUS ticket is assigned to Operations:

  1.  Check if all the required information were provided: PROC02#Start_of_the_integration If not, ask to supplement the data. If all information are provided create tickets according following steps as new ticket. Add tickets should be assign as child tickets to the parent one.
  2. Do not split parent ticket to create new tickets. It is important to keep everything clear. Child tickets should have proper content and it should be clear from parent ticket which step when was taken.



Step Substep Action on Action
1
IPC

Put an information that request was validated:

The request was validated and the creation procedure will start. 
2
IPC Create child tickets in the order given as follows:

1 GOCDB Creation of a new Operations Centre entry in the GOCDB (with no site attached).

Include the following into the GOCDB ticket:

'''Subject''': NGI creation child ticket for GOCDB: NGI_XX

Please create entries in GOCDB for NGI_XX. 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process. 
The related master ticket is XXXX. 	

Operations Centre name: <Operations Centre name>

Operations Centre management mailing list: foo@bar.org

Operations Centre security mailing list:

Operations Centre ROD mailing list: 

Operations Centre Operations manager:

Operations Centre security officer: 

2 Operations Portal

Enter the new Operations Centre in the Operations dashboard (also add ROD mailing list)

'''Subject''': NGI creation child ticket for Operational Portal: NGI_XXX

Please enter NGI_XX in the Operations dashboard.
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.

3 GGUS

Create a new support unit in GGUS :

'''Subject''': NGI creation child ticket for GGUS: NGI_XXX

Please create entries in GGUS for NGI_XXX. 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.

NOTE:

NGI should fill in https://wiki.egi.eu/wiki/GGUS:NGI_XXX_FAQ

Instruction how to create GGUS wiki page https://wiki.egi.eu/wiki/GGUS:FAQ_Responsible_Units


4 Operations Support Certification of new ROD team –
'''Subject''': NGI creation child ticket for Operations Support: NGI_XXX

Please certify NGI_XXX ROD team (ROD mailing list). 
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.
3
The newly created Operations Centre

Confirmation that NGI read, accept and agree to fulfill the RP OLA  https://documents.egi.eu/secure/ShowDocument?docid=463

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX, Could you please confirm that you read, accept and agree to fulfill the RP OLA  
[https://documents.egi.eu/secure/ShowDocument?docid=463] ?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.

How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field

This step is not blocking the process and can be done in parallel. It is required to finish this step before closing parent ticket.

4
Dteam VO manager

Create a branch/group for Operations Centre and assign DN of people who will be dteam VO representative for the Operations Centre, Operations Centre Group owner and Operations Centre Group manager.

'''Subject''': NGI creation child ticket for Dteam: NGI_XX

Dear Dteam Vo manager,

Please create branch for NGI_XX
This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXXX.

Dteam VO representative for NGI_XX will be

Operations Centre Group owner:

Operations Centre Group manager:

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.

How to assign the child ticket: assign the ticket to "VO support" after the selection of "dteam" in the concerned VO field

This step is not blocking the process and can be done in parallel. It is required to finish this step before closing parent ticket.

5

The newly created Operations Centre Include the NAGIOS host in the GOCDB as a 'National-Nagios' service.

(This step only applies to Operations Centres running own Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XXX,

Could you please include your Nagios instance host in GOC DB as 'National-Nagios' service?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX
6


IPC

[If the Operations Centre was part of a OC]
Configure the Operations Centre in the OC Nagios instance

'''Subject''': NGI creation child ticket for _XX: NGI_XXX

Dear XXX,

Could you please configure your Nagios instance so that it will test sites from NGI_XXXX??

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
7

The newly created Operations Centre

Final confirmation that the new Operations Centre can start the operations

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XXX,

Could you please confirm you are ready to take responsibility for your sites and start operations??
With next step your site will be registered in GOC DB under your NGI and you will have to start
look after operations alarms on Operations Portal.  

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
8
GOCDB
  • [If the Operations Centre was part of a ROC]

GOCDB transfers related sites from the source ROC to the new Operations Centre structure.

NOTE: please indicate the sites moving across to the new NGI in the ticket.

'''Subject''': NGI creation child ticket for GOC DB: NGI_XX

Dear GOC DB,

Could you please transfer sites:
*
*
*
*
*
from the XXX to new Operations Centre NGI_XX?
  

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
The newly created Operations Centre
  • [If the Operations Centre wasn't part of a ROC]

Newly created Operations Centre can insert new sites

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please insert your sites in GOC DB?  

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
9

The newly created Operations Centre

[If the Operations Centre was part of a ROC]

Inform managers of regional VOs to change the VO scope of their VOs from ROC (regional) to the relevant Operations Centre (national). This action require only confirmation from Operations Centre manager that information was passed.

Information which should be pass to VO managers: "The Vo scope can be changes by creating a ticket to CIC portal SU in GGUS."

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please pass an information to your national VO managers to change the VO scope of their VOs from to the relevant 
Operations Centre (national). 

Additional information which should be pass to VO managers: "The Vo scope can be changes by creating a ticket to Operations portal SU in GGUS." 

This action require only confirmation from Operations Centre manager that information was passed.

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
10 OPTIONAL The newly created Operations Centre All sites should be reconfigured according to the instructions at:

MAN01 How to publish Site Information


 GlueSiteOtherInfo: EGI_NGI=<Operations Centre name>
GlueSiteOtherInfo: GRID=EGI

This step can be performed at any time from this point.

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please confirm that all your sites are configured according to the instruction at:
https://wiki.egi.eu/wiki/MAN1_How_to_publish_Site_Information 


GlueSiteOtherInfo: EGI_NGI=<Operations Centre name>
GlueSiteOtherInfo: GRID=EGI

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
11
The newly created Operations Centre

[If the Operations Centre was part of a OC]

Transfer all open operational tickets to the new Operations Centre in GGUS.

'''Subject''': NGI creation child ticket for NGI_XX: NGI_XX

Dear NGI_XX,

Could you please transfer all open operational tickets to the new Operations Centre in GGUS?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
12
Nagios team Include the Operations Centre level Nagios in the central ops-monitor Nagios instance.

(This step only applies to Operations Centres running an Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for Nagios: NGI_XX

Dear Nagios team,

Could you please include the NGI_XXX Operations Centre level Nagios in the central ops-monitor Nagios instance?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
13
IPC Validation process of the new Operations Centre Nagios, as described at the step 5.3 of:

https://wiki.egi.eu/wiki/PROC05

(This step only applies to Operations Centres running an Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for IPC: NGI_XX

Dear IPC,

Could you please validate the new Operations Centre Nagios for NGI_XX?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
14
Nagios team

Validation that sites/Operations Centre shown up correctly in Central DBs

'''Subject''': NGI creation child ticket for Nagios: NGI_XX

Dear Nagios team,

Could you please validate that sites and Operations Centre shown up correctly in Central DB?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
15

Nagios team

[If the Operations Centre was part of a OC]

Migrating alerts from OC to Operations Centre Nagios instance.

(This step only applies to Operations Centres running an Operations Centre Nagios instance)

'''Subject''': NGI creation child ticket for Nagios: NGI_XX

Dear Nagios team,

Could you please migrate alerts from NGI_XXX to NGI_XXX Operations Centre Nagios instance?

This ticket was created according to procedures: https://wiki.egi.eu/wiki/PROC02 in order to track process.
The related master ticket is XXX.
16
IPC Final checks by the IPC.

(Were all steps taken and finished properly? Close the parent ticket.)

17
The newly created Operations Centre Final checks should be verified and then the information that the Operations Centre is ready is broadcast by Operations Centre officials.

(This broadcast should be sent to VO managers and NOC/ROC managers)

See the template below for an indication of the message content.

'''Subject''': <Operations Centre name> is operational

Dear All,

We would like to announce that <Operations Centre name> is now fully operational 
and that we have finished its integration procedure. All necessary operational 
teams and tools are established in our Operations Centre and we are ready for production. 
This Operations Centre is visible in all operational tools as <Operations Centre name> 
and is responsible for all <COUNTRY> sites.

Best regards,



Revision history

Version Authors Date Comments
Alessandro Paolini 2016-06-08 "EGI Operations Support" was decommissioned, changed all the references to "Operations"