Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "GOCDB/Release4/Development/VSites/VOFeedXML"

From EGIWiki
< GOCDB‎ | Release4‎ | Development‎ | VSites
Jump to navigation Jump to search
Line 16: Line 16:
Pseudo-code for the XML construction logic:  
Pseudo-code for the XML construction logic:  
<pre>
<pre>
First query for all VSites and inner join member SEs


foreach VSite {
foreach VSite {
Line 21: Line 23:
     atpSiteElems[key='siteName', value='XML of this <atp_site> element']
     atpSiteElems[key='siteName', value='XML of this <atp_site> element']


   foreach SE of the current VSite {
   foreach VSite.SE {
       - Get the hosting physical site name (key = ‘mySiteX’).  
       - Get the hosting physical site name (key = ‘mySiteX’).  
       - Create a new atpSiteElem[‘mySiteX’] entry (if not already created).   
       - Create a new atpSiteElem[‘mySiteX’] entry (if not already created).   

Revision as of 18:07, 21 February 2012

<< Back to Virtual Sites

VO Feed Example

VO feed for the GOCDB EGI scoped data (ATP will recognize this gocdb data as the 'OPS' VO topology feed).

  • The GOCDB physical sites are mapped to <atp_site> elements.
  • If an endpoint is included in a virtual site, a corresponding <service> element must appear in this VO feed as a child of an <atp_site> element.
  • The VO feed should include all service endpoints, both visible and invisible to EGI.
  • For each physical site a <group> element will be used to indicate that all child endpoints belong to the virtual site named by the group.
    • It is permitted duplicate <atp_site> elements where necessary. e.g. RAL_LCG2 may appear twice with two different sets of endpoints linked to two different virtual sites.
  • The feed specifies that all sites are under the ops VO using the <vo>OPS</vo> element.

In summary, the GOCDB to ATP mappings are:

  • Site == <atp_site>
  • ServiceEndpoint == <service>
  • VSite == <group>

Pseudo-code for the XML construction logic:


First query for all VSites and inner join member SEs 

foreach VSite {
   - Create a new in-memory <atp_site> element hashmap: 
     atpSiteElems[key='siteName', value='XML of this <atp_site> element']

   foreach VSite.SE  {
      - Get the hosting physical site name (key = ‘mySiteX’). 
      - Create a new atpSiteElem[‘mySiteX’] entry (if not already created).   
      + Add a new child <service> element to atpSiteElem[‘mySiteX’] 
   }

   foreach atpSiteElem[] {
      - Add a single child <group> element (VSite name defines the ‘name’ attribute) 
   }

   - Write all atpSiteElem[] elements to the XML document. 
   - Loop next VSite. 
}


This way, <atp_site> elements will only ever have a single nested <group> element, however, 
it ensures that ALL the VSites SEs are included correctly in the XML document. The <atp_site> elements
will also be duplicated (which is permitted). 

Monitoring Details

The following details about how virtual sites will be monitored is provided by Marian Babik:

Data scoping

  • EGI/non-EGI scope is implemented in both regional and central GOCDB
  • SAM will fetch both scopes from the central GOCDB, which would make it possible to have non-EGI scoped services monitored by the regional SAM (non-egi services won't be distinguished from EGI ones in any way)
  • central SAM will show only EGI scoped services

Virtual Sites

  • SAM's vo feed concept currently enables creation of arbitrary groups of services that must be already defined in GOCDB (if a group is defined and none of its services are in GOCDB the entire group is rejected, all services/sites listed in the vo feed that are not in GOCDB are automatically rejected)
  • Virtual sites can be integrated with SAM via VO feed, which would list all the virtual sites defined in the GOCDB (including all scopes; all such sites and their services would be considered supporting OPS VO)
  • With current implementation of ATP at least the following issues can be seen:
  1. virtual sites containing services outside of given region (no matter what scope) will be shown on the SAM regional instance (e.g. EGI_WMS virtual site would be visible on regional SAM showing only WMSes for that particular region). I'm not sure if this is actually an issue as this might be useful if properly explained in the docs.
  2. virtual sites (non-egi scoped) containing egi-scoped services will be shown on the SAM central instance
  3. virtual sites (egi scoped) containing mixture of egi-scoped and non-egi scoped services would be visible correctly on the SAM regional instance (cf. point 1), but on the central instance non-egi scoped services would be cut off from the virtual site (we need to clarify if such use case actually exists)
  • In summary, none of those issues are critical, but we will need to discuss them during OTAG to see if there actual use cases behind.

Questions for ATP:

  • We've left the infrast="EGEE" attribute on the atp_site element. Is this correct?


 todo