Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Operations"

From EGIWiki
Jump to navigation Jump to search
 
(279 intermediate revisions by 10 users not shown)
Line 1: Line 1:
'''EGI Operations'''
{{Template:Op menubar}}


== Contact information ==
{| width="100%" style="background: none repeat scroll 0% 0% rgb(249, 249, 249); margin: 1.2em 0px 6px; border: 1px solid rgb(221, 221, 221);"
You are welcome to get in contact with EGI Operations via e-mail!
|-
| style="width:61%; color:#000;" | <!--        "WELCOME TO EGI Operations"      -->
{| style="width:280px; border:none; background:none;"
|-
| style="width:280px; text-align:center; white-space:nowrap; color:#000;" | <div style="font-size:162%; border:none; margin:0; padding:.1em; color:#000;">Welcome to EGI Operations</div>
|}


'''Contact address''': operations at egi.eu
| style="width:40%; font-size:95%;" |
'''Contact information'''  


== Overview of EGI-InSPIRE SA1 ==
'''e-mail:''' send an e-mail to operations at mailman.egi.eu  
[https://wiki.egi.eu/wiki/Sa1_tasks Tasks, activities and coordinators] | [[SA1_Deliverables|Deliverables]] and [[SA1_Milestones|Milestones]] | [[EGI-InSPIRE SA1 Quality Metrics]]


== General information ==
'''Ticket:''' submit a ticket to the "Operations" Support Unit in the [http://helpdesk.egi.eu/ EGI Helpdesk]  
=== Infrastructure and Resource Providers===
* Full list '''[http://www.egi.eu/production-infrastructure/NGIs/ resource providers]''' who are contributing resources to the EGI infrastructure.
* '''[[Join]]''' the infrastructure. Step-by-step instructions for a Grid site to become part of the EGI infrastructure.


=== Operations boards and agendas===
|}
* '''Operations:''' [[OMB | Operations Management Board (OMB)]] | [https://www.egi.eu/indico/categoryDisplay.py?categId=32 Monday operations meetings] | [[SA1 Task leaders]]


* '''Operational Tools''': [[OTAG|Operational Tool Advisory Group (OTAG)]] | [https://www.egi.eu/indico/categoryDisplay.py?categId=33 Operations Automation Team (OAT)] | [[WP7:_Operational_Tools|EGI-InSPIRE JRA1]]
{| width="100%"
|-
| style="width:50%; border: 1px solid rgb(221, 221, 221);; background: none repeat scroll 0% 0% rgb(249, 249, 249); vertical-align:top; color:#000;" |
{| width="100%" style="vertical-align: top; background: none repeat scroll 0% 0% rgb(249, 249, 249);"
|-
! style="padding:2px;background-color: lightgray;" |  
<big>'''Infrastructure'''</big>


* '''Security''': [https://www.egi.eu/indico/categoryDisplay.py?categId=23 EGI CSIRT]
|-
| style="color:#000;" | <div style="padding:2px 5px" id="mp-tfa">
*List of EGI [http://www.egi.eu/infrastructure/resource-providers/index.html Resource infrastructure Providers]
*[http://www.egi.eu/infrastructure/operations/egi_in_numbers/ Installed capacity and figures] - a summary of the EGI infrastructure current resources pool capacity and their utilisation in the last year
*[[Core EGI Activities|EGI.eu operations services]]
*[http://www.egi.eu/how-to/join_resource_provider.html Join the infrastructure] - How to become a Resource Provider
*[[Operations centres|Mapping countries to Operations Centres]]


* '''EGI-InSPIRE SA1''': [https://www.egi.eu/indico/categoryDisplay.py?categId=11 EGI-InSPIRE SA1 meetings]
*[[Resource Allocation|Resource Allocation]]
*[[Federation of NGI services|Federation of NGI services]]
</div>
|}


=== Task forces ===
| style="border:1px solid transparent;" | <br>
* '''Operational Level Agreement''' (OLA) Task Force - October 2010. Purpose of the OLA task force is to propose a plan for an extension and further development of the current OLA framework of EGI. The plan, expected for end of November 2010, will be used as input for discussion at the OMB.
| style="width:50%; border: 1px solid rgb(221, 221, 221);; background: none repeat scroll 0% 0% rgb(249, 249, 249); vertical-align:top; color:#000;" |
{| width="100%" style="vertical-align: top; background: none repeat scroll 0% 0% rgb(249, 249, 249);"
|-
! style="padding:2px;background-color: lightgray;" |
<big>'''Boards and Groups''' </big>


:[https://www.egi.eu/indico/categoryDisplay.py?categId=29 Meetings] | Milestone [https://documents.egi.eu/document/65 MS404] (Operational Level Agreements (OLAs) within the EGI production infrastructure)
|-
| style="color:#000; padding:2px 5px;" | <div id="mp-itn">
List of EGI&nbsp;Operations boards and teams:  


* '''Network Support proposal''' (NS) Task Force - October 2010. Purpose of the NS task force is to propose a strategy and a set of tools and workflows to provide Network Support to EGI. The plan and proposed tools, expected for end of January 2011, will be used as input for discussion at the OMB.
*[[OMB|Operations Management Board (OMB)]]
*[[OTAG|Operational Tool Advisory Group (OTAG)]]
*[[EGI CSIRT:Main Page|EGI CSIRT]]
*[[EGI_DMSU|EGI&nbsp;DMSU]] - Deployed Middleware Support Unit
*[[Grid operations oversight|EGI Infrastructure Operations Oversight]] - Operations, Operations Support and ROD
*[[RC FORUM|Resource Centre Forum]]
*Operations [[Task forces]]
</div>
|}


:[https://wiki.egi.eu/wiki/NST NS Team and Task Force]
|}


== [[Interoperability of EGI operations]]==
<br>
* [[NGIs and other Grids]]
* [[UNICORE 6 Nagios sensors implementation]]
* [https://twiki.cern.ch/twiki/bin/view/EGEE/Interoperation EGEE-III WLCG Interoperations]


== Operational security ==
{| width="100%"
[[Security:Main Page]] | [[EGI CSIRT:Main Page|EGI Computer Security and Incident Response Team]] | [https://wiki.egi.eu/wiki/SVG EGI Software Vulnerability Group]
|-
| style="width:50%; border: 1px solid rgb(221, 221, 221);; background: none repeat scroll 0% 0% rgb(249, 249, 249); vertical-align:top; color:#000;" |
{| width="100%" style="vertical-align: top; background: none repeat scroll 0% 0% rgb(249, 249, 249);"
|-
! style="padding:2px;background-color: lightgray;" |  
<br>


== Middleware rollout to production infrastructure ==
|-
This section describes the process and procedures to deploy new versions of Grid middleware components into the EGI production infrastructure.
| style="color:#000;" |
|}


=== Distribution process ===
| style="border:1px solid transparent;" | <br>
* [[Middleware:Release_Process]]
| style="width:50%; border: 1px solid rgb(221, 221, 221);; background: none repeat scroll 0% 0% rgb(249, 249, 249); vertical-align:top; color:#000;" |
* [https://documents.egi.eu/document/53 Deploying Software into the EGI production infrastructure, Milestone MS402]
{| width="100%" style="vertical-align: top; background: none repeat scroll 0% 0% rgb(249, 249, 249);"
* [https://wiki.egi.eu/wiki/Staged-Rollout Staged Rollout]: Early Adopters and Components
|-
* [https://wiki.egi.eu/wiki/EGI_IGTF_Release_Process EGI IGTF Release Process]
! style="padding:2px;background-color: lightgray;" |
<big>'''Meetings''' </big>


=== Supported middleware ===
|-
* '''NEW!''' gLite 3.1 [http://glite.web.cern.ch/glite/packages/R3.1/ end of support schedule], OMB approved, 26 Nov 2010
| style="color:#000; padding:2px 5px;" |
* [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGBaselineVersions WLCG baseline clients and services]
'''Operations EGI Meetings '''[[Operations EGI Meetings|'''calendar''']]  


<!--* [https://twiki.cern.ch/twiki/bin/view/EGEE/SupportedClientVersions Supported versions of gLite Clients] (to be updated) -->
*Operations Management Board ([https://www.egi.eu/indico/categoryDisplay.py?categId=19 agendas],[[OMB|actions]])  
<!--* [https://twiki.cern.ch/twiki/bin/view/EGEE/SupportedServiceVersions Supported versions of gLite Services] (to be updated) -->
*User Community Board ([https://indico.egi.eu/indico/categoryDisplay.py?categId=21 agendas],[[UCB|actions]])  
* [https://edms.cern.ch/document/985325/1 Procedure for retiring middleware services] (to be updated)
*Operations Meetings ([[Operations Meeting|agendas and actions]])  
* [https://edms.cern.ch/document/1057955/1 Processes for Maintaining and Enforcing a List of Supported gLite Middleware Service]
*UMD Release Team ([[URT meetings agendas|agendas and actions]])


==[https://wiki.egi.eu/wiki/Availability_and_reliability_monthly_statistics#Performance Performance]==
<big>Other </big>


== Tools ==
*[https://www.egi.eu/indico/categoryDisplay.py?categId=11 All Operations meetings]&nbsp;
* '''Operational tools:''' [https://operations-portal.egi.eu/ operations dashboard] | [http://cic.gridops.org/index.php?section=home Operations portal] | [https://goc.egi.eu/ GOCDB] (Grid configuration repository) | [http://gstat.egi.eu/gstat/geo/openlayers Gstat 2.0] | [https://grid-monitoring.egi.eu/myegee/ MyEGI portal]


* '''Network monitoring:''' [[Network]] monitoring tools ([https://net.egi.eu/ temporary link])
|}


* '''Accounting:''' [http://accounting.egi.eu/ Accounting portal] | [http://accounting.egi.eu/acctenfor/nodata.php Accounting enforcement]
|}


* '''Reporting on availability:''' GridView [http://gridview.cern.ch/GRIDVIEW/same_index.php availability graphs] | Monthly availability: [https://wiki.egi.eu/wiki/Availability_and_reliability_monthly_statistics#Statistics historical reports] | [http://gvdev.cern.ch/GVPC/Excel/ Availability Excel Reports]
{| width="100%"
|-
| style="width:50%; border: 1px solid rgb(221, 221, 221);; background: none repeat scroll 0% 0% rgb(249, 249, 249); vertical-align:top; color:#000;" |
{| width="100%" style="vertical-align: top; background: none repeat scroll 0% 0% rgb(249, 249, 249);"
|-
! style="padding:2px;background-color: lightgray;" |
<big>'''Other Resources'''</big>


* '''Support:''' EGI [https://gus.fzk.de/pages/home.php Helpdesk]
|}


* '''Metrics:''' [http://metrics.egi.eu/ Metrics portal]
{| style="width:100%; border: 1px solid rgb(221, 221, 221);; background: none repeat scroll 0% 0% rgb(249, 249, 249); vertical-align:top; color:#000;"
|-
|
[https://www.youtube.com/channel/UCEhFH5H6dKAs5ITT-Bh3jlA '''Youtube channel''']  


* [[Operation tools|Operation tools - DRAFT]]
'''Surveys'''


== Tool documentation ==
See all open [[EGI Operations Surveys|operations surveys]]  
* [https://wiki.egi.eu/wiki/Operational_Tools_Documentation_links Documentation] on operational tools
* [https://wiki.egi.eu/wiki/SAM_Instances Status of ROC/NGI Nagios services]
* [https://twiki.cern.ch/twiki/bin/view/EGEE/OAT_EGEE_III EGEE-III OAT wiki]


== Daily Operations, Support and Documentation ==
'''EGI Operations'''  
* [[Accounting]]
* Monitoring infrastructure
** [https://wiki.egi.eu/w/index.php?title=Critical_SAM/Nagios_Probes Critical SAM/Nagios Probes]
** [https://tomtools.cern.ch/confluence/display/SAM/Probes SAM probes] (draft, will be release in Nov 2010, and replaces https://twiki.cern.ch/twiki/bin/view/LCG/SAMProbesMetrics)
** Monitoring [https://tomtools.cern.ch/confluence/display/SAM/Setting+Nagios+to+monitor+uncertified+sites uncertified sites] with Nagios
** [https://twiki.cern.ch/twiki/bin/view/LCG/ATP Aggregated Topology Provider] (ATP)
* [[EGI Helpdesk]]
** [https://gus.fzk.de/stat/ttt.php GGUS ticket timeline tool]
** [https://gus.fzk.de/stat/stat.php GGUS report generator]
** [https://gus.fzk.de/pages/metrics/download_escalation_reports.php GGUS escalation reports]
** [https://gus.fzk.de/pages/docu.php GGUS documentation] (including information on ''team'' and ''alarm'' tickets)
** [https://twiki.cern.ch/twiki/bin/view/EGEE/SA1_USAG EGEE-III User Support Advisory Group]
* [[Grid operations oversight]]
* [http://cic.in2p3.fr/index.php?section=home&page=newsarchives Operations news archive]


== Procedures and best practices ==
*[http://www.egi.eu/results/presentations#operations EGI Operations official Presentations]
* [[Operations:OD|Operational procedures and best practices]]
*[[EGI Operations in the press]]


== Documentation ==
*Operations broadcasts: [http://operations-portal.egi.eu/?limit=40 Archive]


=== ARC ===
| style="width:50%;" |
'''EGI-InSPIRE '''


=== gLite ===
*[https://documents.egi.eu/document/506 EGI-InSPIRE project presentation]  
* gLite [http://glite.web.cern.ch/glite/packages/latestRelease.asp latest release]
*[[EGI-InSPIRE-Tasks|EGI-Inspire Global and Local Tasks]]
* gLite [http://glite.web.cern.ch/glite/documentation/default.asp User guide and general docuementation]
** gLite [http://glite.web.cern.ch/glite/packages/R3.2/ 3.2]: User guide and general docuementation
** gLite [http://glite.web.cern.ch/glite/packages/R3.1/ 3.1]: User guide and general docuementation


* EGEE -III [http://grid.ie/mpi/wiki/WorkingGroup MPI WG Recommendations] and Improvements for the current MPI Implementation and Ideas for Extension, final version 1.0
<br> '''Other'''


=== UNICORE ===
*[[Glossary|Glossary]]<br>


* Download server & central services: [https://sourceforge.net/projects/unicore/files/1%20UNICORE%206%20Servers%20and%20Services/1.1%20Core%20Server/ Core Server] | [https://sourceforge.net/projects/unicore/files/1%20UNICORE%206%20Servers%20and%20Services/1.2%20Workflow%20System/ Workflow System] | [https://sourceforge.net/projects/unicore/files/1%20UNICORE%206%20Servers%20and%20Services/1.3%20Common%20Information%20Service/ Common Information Service]
*[https://www.egi.eu/indico/getFile.py/access?contribId=1&resId=0&materialId=0&confId=152 EGI Operations Requirement Gathering Process], OMB, 21 Dec 2010


* Download clients: [https://sourceforge.net/projects/unicore/files/2%20UNICORE%206%20Clients,%20Applications,%20and%20APIs/2.1%20UNICORE%20Rich%20Client%20(URC)/ Rich Client] | [https://sourceforge.net/projects/unicore/files/2%20UNICORE%206%20Clients,%20Applications,%20and%20APIs/2.3%20Commandline%20Client%20(UCC)/ Command Line Client] | [https://sourceforge.net/projects/unicore/files/2%20UNICORE%206%20Clients,%20Applications,%20and%20APIs/2.4%20HiLA%20Programming%20API/ HiLA API]
|}
* [http://unicore.eu/documentation/ Documentation]


=== Tools ===
|}
* [https://gus.fzk.de/pages/docu.php GGUS documentation and tutorials] (including information on ''alarm'' and ''team'' tickets)
* [https://wiki.egi.eu/wiki/Operational_Tools_Documentation_links Documentation] on EGI operational tools
* [https://tomtools.cern.ch/confluence/display/IS/DM_Troubleshooting Troubleshooting with GStat 2.0]


== Resources ==
<br> ''The EGI wiki is mirrored at [http://egi-wiki-mirror.twgrid.org/index.php/Main_Page TWGRID].''
EGI-InSPIRE [https://documents.egi.eu/document/44 presentation template] | EGI-InSPIRE [https://documents.egi.eu/document/26 document template] | EGI-InSPIRE [https://documents.egi.eu/document/45 quarterly report template]


== References ==
[[Category:Operations|*]]
* [https://twiki.cern.ch/twiki/bin/view/EGEE/SA1 EGEE SA1 wiki pages]

Latest revision as of 15:31, 4 September 2019

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security



Welcome to EGI Operations

Contact information

e-mail: send an e-mail to operations at mailman.egi.eu

Ticket: submit a ticket to the "Operations" Support Unit in the EGI Helpdesk

Infrastructure


Boards and Groups

List of EGI Operations boards and teams:




Meetings

Operations EGI Meetings calendar

Other

Other Resources

Youtube channel

Surveys

See all open operations surveys

EGI Operations

EGI-InSPIRE


Other


The EGI wiki is mirrored at TWGRID.