Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "GOCDB"

From EGIWiki
Jump to navigation Jump to search
(41 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{Template:Op menubar}}
{{Template:Op menubar}} {{Template:Tools menubar}} {{TOC_right}}  
{{Template:Tools menubar}}
{{TOC_right}}


[[Category:GOCDB]]
<br> Grid Configuration Database (GOCDB) contains general information about the sites participating to the production Grid. Accessed by all the project actors (end-users, sitemanagers, NGI mangers, support teams, VO managers), by other tools and by third party middleware in order to get Grid topology. The portal has a single central installation but interested NGIs can download and install their own instance.


Grid Configuration Database (GOCDB) contains general information about the sites participating to the production Grid. Accessed by all the project actors (end-users, sitemanagers, NGI mangers, support teams, VO managers), by other tools and by third party middleware in order to get Grid topology. The portal has a single central installation but interested NGIs can download and install their own instance.
<br>  
<br/>


= Entry points =
GOCDB is one of [[Core EGI Activities|EGI&nbsp;core services and]] part of [http://www.egi.eu/services/catalogue/fed-ops.html EGI&nbsp;Federated Operations service].  
* '''GOCDB Entry Point: https://goc.egi.eu'''
* '''Failover Instance: https://goc.dl.ac.uk/portal'''
<!--* '''Secondary Failover Instance: https://goc.itwm.fraunhofer.de/portal/''' -->
<!--*GOCDB4 Central Visualisation Portal (read only): https://goc.egi.eu/portal 
<!--*GOCDB4 Input System (read): https://gocdb4.esc.rl.ac.uk/portal-->
<!--* [https://savannah.cern.ch/projects/gocdb/ GOCDB project in Savannah]-->


= Release Notes =
GOCDB is provided by STFC for EGI, co-funded by EGI.eu and EOSC-hub.
GOCDB [https://www.sysadmin.hep.ac.uk/svn/grid-monitoring/tags/gocdb/GOCDB-4.4/changeLog.txt Release notes]


= [[GOCDB/Documentation_Index| Enter GOCDB Documentation Index Here]]=
<br>


= Extract information from GOCDB =
{| class="wikitable"
Information is extracted by means of the [[GOCDB/PI/Technical_Documentation#Interface_description|GOCDB Programmatic Interface]]
|-
| '''Tool name'''
| ''Grid Configuration Database (GOCDB)''
|-
| '''Tool Category and description'''
| ''EGI Core service''
GOCDB is a central registry to record information about the topology of an e-Infrastructure. This includes entities such as Operations Centres, Resource Centres, service endpoints and their downtimes, contact information and roles of users responsible for operations at different levels. The service enforces a number of business rules and defines different grouping mechanisms and object-tagging for the purposes of fine-grained resource filtering.


== Service end-points ==
|-
* Find GOCDB service endpoints [[GOCDB/Input_System_User_Documentation#Service_types |by service type]]
| '''Tool url'''
* Find all service-end points that are [https://goc.egi.eu/gocdbpi/private/?method=get_service_endpoint&monitored=N NOT monitored]
| http://goc.egi.eu/ (primary instance) http://goc.dl.ac.uk (IPv4-only failover) <br>
|-
| '''Email'''
| gocdb-admins@mailman.egi.eu
|-
| '''GGUS Support unit'''
| ''GOCDB''
|-
| '''GOC&nbsp;DB&nbsp;entry'''
| https://goc.egi.eu/portal/index.php?Page_Type=Site&amp;id=335
|-
| '''Requirements tracking - EGI tracker (GOC-DB Queue)'''
| https://rt.egi.eu/rt/Search/Results.html?Query=Queue%20%3D%20%27GOC-DB%27 <!--https://rt.egi.eu/rt/Dashboards/5541/GOCDB-Requirements-->
|-
| '''Issue tracking - Developers tracker'''
| https://github.com/GOCDB/gocdb/issues
|-
| '''Release schedule'''
| [[GOCDB/Release Schedule]]  
[[https://wiki.egi.eu/wiki/PROC23 EGI Release Procedure]]  


== Resource Centres ==
|-
Find sites in GOCDB by status:
| '''Release notes'''
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Certified Certified] Resource Centres
| [https://github.com/GOCDB/gocdb/releases Release notes]
* Find all Certified sites in a given NGI/EIRO. Example: [https://goc.egi.eu/gocdbpi/public/?method=get_site_list&roc=NGI_DE&certification_status=Certified NGI_DE]
|-
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Candidate Candidate] Resource Centres
| '''Roadmap'''
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Suspended Suspended] Resource Centres
| [[GOCDB/Roadmap]]
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Uncertified Uncertified] Resource Centres
|-
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site&scope=Local Local] Resource Centres (i.e. outside of the EGI scope)
| '''Related OLA'''
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&production_status=Test&certification_status=Certified Test/Certified] Resource Centres
| ''https://documents.egi.eu/public/ShowDocument?docid=2170'' (May-2014-April2015) <br> ''https://documents.egi.eu/public/ShowDocument?docid=2456'' (May2015-April2016) <br>'' https://documents.egi.eu/public/ShowDocument?docid=2770'' (May2016-April2017)<br>QoS Reports: ''https://documents.egi.eu/public/ShowDocument?docid=2284''<br> Availability/Reliability Reports: ''https://documents.egi.eu/public/ShowDocument?docid=2324''
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&production_status=Test&certification_status=Uncertified Test/Uncertified] Resource Centres
|-
| '''Test instance url'''
| https://gocdb-test.esc.rl.ac.uk
|-
| '''Documentation'''
| [[GOCDB/Documentation Index]]  
[https://wiki.egi.eu/w/images/d/d3/GOCDB5_Grid_Topology_Information_System.pdf Executive Summary]  


* Get status transition of a site: [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_changes&site=MK-03-FINKI example]
|-
| '''License'''
| gLite/Apache 2
|-
| '''Provider'''
| STFC
|-
| '''Notifications'''
| [[GOCDB/notifications]]
|-
| '''Source code'''
| https://github.com/GOCDB
|-
| '''Data Privacy / Code of Conduct'''
| [[GOCDB/data privacy]]  
| <br>
|}


* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&certification_status=Certified&scope=Local Certified/Local] Resource Centres
= Change, Release and Deployment  =
* Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&certification_status=Uncertified&scope=Local Uncertified/Local] Resource Centres


*[[Grid_operations_oversight/CandidateSuspendedSitesList|List]] of CANDIDATE/SUSPENDED sites waiting to be certified
This sections are providing detailed agreement in terms of requirements gathering, release and deployment of GOC DB which extend [[Instructions for Operations Tools teams|Instructions for Operations Tools teams]]  


== Status transitions ==
<br>
Get status transition of a site: [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_changes&site=MK-03-FINKI example]


== Service groupings ==
#All requirements are gathered in EGI Request Tracker
* [https://goc.egi.eu/gocdbpi/public/?method=get_service_group List]
#Prioritization and testing is done by development team, in case of need separated OTAG team will be introduced
#EGI RT statuses of requests are as follow
#*New - newly recorded in system
#*Accepted - accepted by OTAG team
#*Rejected - rejected by OTAG team
#*Open - (In progress) development team is implementing change<br>
#*Resolved - released
#*Stalled - on hold
#Priority of requests are as follow
#*None - 0
#*Low - 1<br>
#*Normal - 2 <br>
#*High - 3<br>
#*Immediate (i.e. emergency) - 4 <br>
#Standard changes (routine actions, no need for approval)
#*changes related to database information update
#*bug fixing - restoring service to expected functionality
#Emergency changes (implemented without approval but subject of post-review)
#*Security incidents
#Releases
#*Frequency: every 2-3 months
 
= Documentation  =
 
[[GOCDB/Documentation Index|Enter GOCDB Documentation Index Here]]
 
== Extract information from GOCDB  ==
 
Information is extracted by means of the [[GOCDB/PI/Technical Documentation#Interface_description|GOCDB Programmatic Interface]]
 
=== Service end-points  ===
 
*Find GOCDB service endpoints [[GOCDB/Input System User Documentation#Service_types|by service type]]
*Find all service-end points that are [https://goc.egi.eu/gocdbpi/private/?method=get_service_endpoint&monitored=N NOT monitored]
 
=== Resource Centres  ===
 
Find sites in GOCDB by status:
 
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Certified Certified] Resource Centres
*Find all Certified sites in a given NGI/EIRO. Example: [https://goc.egi.eu/gocdbpi/public/?method=get_site_list&roc=NGI_DE&certification_status=Certified NGI_DE]
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Candidate Candidate] Resource Centres
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Suspended Suspended] Resource Centres
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_date&certification_status=Uncertified Uncertified] Resource Centres
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site&scope=Local Local] Resource Centres (i.e. outside of the EGI scope)
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&production_status=Test&certification_status=Certified Test/Certified] Resource Centres
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&production_status=Test&certification_status=Uncertified Test/Uncertified] Resource Centres
 
*Get status transition of a site: [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_changes&site=MK-03-FINKI example]
 
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&certification_status=Certified&scope=Local Certified/Local] Resource Centres
*Find all [https://goc.egi.eu/gocdbpi/private/?method=get_site_list&certification_status=Uncertified&scope=Local Uncertified/Local] Resource Centres
 
*[[Grid operations oversight/CandidateSuspendedSitesList|List]] of CANDIDATE/SUSPENDED sites waiting to be certified
 
=== Status transitions  ===
 
Get status transition of a site: [https://goc.egi.eu/gocdbpi/private/?method=get_cert_status_changes&site=MK-03-FINKI example]
 
=== Service groupings ===
 
*[https://goc.egi.eu/gocdbpi/public/?method=get_service_group List]
 
[[Category:Tools]]

Revision as of 12:31, 10 March 2020

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Tools menu: Main page Instructions for developers AAI Proxy Accounting Portal Accounting Repository AppDB ARGO GGUS GOCDB
Message brokers Licenses OTAGs Operations Portal Perun EGI Collaboration tools LToS EGI Workload Manager




Grid Configuration Database (GOCDB) contains general information about the sites participating to the production Grid. Accessed by all the project actors (end-users, sitemanagers, NGI mangers, support teams, VO managers), by other tools and by third party middleware in order to get Grid topology. The portal has a single central installation but interested NGIs can download and install their own instance.


GOCDB is one of EGI core services and part of EGI Federated Operations service.

GOCDB is provided by STFC for EGI, co-funded by EGI.eu and EOSC-hub.


Tool name Grid Configuration Database (GOCDB)
Tool Category and description EGI Core service

GOCDB is a central registry to record information about the topology of an e-Infrastructure. This includes entities such as Operations Centres, Resource Centres, service endpoints and their downtimes, contact information and roles of users responsible for operations at different levels. The service enforces a number of business rules and defines different grouping mechanisms and object-tagging for the purposes of fine-grained resource filtering.

Tool url http://goc.egi.eu/ (primary instance) http://goc.dl.ac.uk (IPv4-only failover)
Email gocdb-admins@mailman.egi.eu
GGUS Support unit GOCDB
GOC DB entry https://goc.egi.eu/portal/index.php?Page_Type=Site&id=335
Requirements tracking - EGI tracker (GOC-DB Queue) https://rt.egi.eu/rt/Search/Results.html?Query=Queue%20%3D%20%27GOC-DB%27
Issue tracking - Developers tracker https://github.com/GOCDB/gocdb/issues
Release schedule GOCDB/Release Schedule

[EGI Release Procedure]

Release notes Release notes
Roadmap GOCDB/Roadmap
Related OLA https://documents.egi.eu/public/ShowDocument?docid=2170 (May-2014-April2015)
https://documents.egi.eu/public/ShowDocument?docid=2456 (May2015-April2016)
https://documents.egi.eu/public/ShowDocument?docid=2770 (May2016-April2017)
QoS Reports: https://documents.egi.eu/public/ShowDocument?docid=2284
Availability/Reliability Reports: https://documents.egi.eu/public/ShowDocument?docid=2324
Test instance url https://gocdb-test.esc.rl.ac.uk
Documentation GOCDB/Documentation Index

Executive Summary

License gLite/Apache 2
Provider STFC
Notifications GOCDB/notifications
Source code https://github.com/GOCDB
Data Privacy / Code of Conduct GOCDB/data privacy

Change, Release and Deployment

This sections are providing detailed agreement in terms of requirements gathering, release and deployment of GOC DB which extend Instructions for Operations Tools teams


  1. All requirements are gathered in EGI Request Tracker
  2. Prioritization and testing is done by development team, in case of need separated OTAG team will be introduced
  3. EGI RT statuses of requests are as follow
    • New - newly recorded in system
    • Accepted - accepted by OTAG team
    • Rejected - rejected by OTAG team
    • Open - (In progress) development team is implementing change
    • Resolved - released
    • Stalled - on hold
  4. Priority of requests are as follow
    • None - 0
    • Low - 1
    • Normal - 2
    • High - 3
    • Immediate (i.e. emergency) - 4
  5. Standard changes (routine actions, no need for approval)
    • changes related to database information update
    • bug fixing - restoring service to expected functionality
  6. Emergency changes (implemented without approval but subject of post-review)
    • Security incidents
  7. Releases
    • Frequency: every 2-3 months

Documentation

Enter GOCDB Documentation Index Here

Extract information from GOCDB

Information is extracted by means of the GOCDB Programmatic Interface

Service end-points

Resource Centres

Find sites in GOCDB by status:

  • Get status transition of a site: example
  • List of CANDIDATE/SUSPENDED sites waiting to be certified

Status transitions

Get status transition of a site: example

Service groupings