Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:Interoperations"

From EGIWiki
Jump to navigation Jump to search
 
(27 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{Template:Op menubar}}
{{EGI-Inspire_menubar}}
{{Template:Interop_menubar}}
{{TOC_right}}  
{{Template:Interop_menubar}}  
 
{| width="100%" style="background: none repeat scroll 0% 0% rgb(249, 249, 249); margin: 1.2em 0px 6px; border: 1px solid rgb(221, 221, 221);"
{| width="100%" style="background: none repeat scroll 0% 0% rgb(249, 249, 249); margin: 1.2em 0px 6px; border: 1px solid rgb(221, 221, 221);"
|-
|-
| style="width:61%; color:#000;" |
| style="width:61%; color:#000;" |  
{| style="width:280px; border:none; background:none;"
{| style="width:280px; border:none; background:none;"
|-
|-
Line 9: Line 11:
|}
|}


| style="width:40%; font-size:95%;" |  
| style="width:40%; font-size:95%;" | <br>
|}
|}


{{TOC_right}}
{{TOC_right}}  


This is an activity funded in the framework of the SA1 task TSA1.3, which takes care of the integration of EGI with European Distributed Computing Infrastructures (DCIs). The purpose of this activity is to ensure that the operations of Resource Infrastructures based on different grid middleware stacks and/or architectures can interwork at different interface levels: monitoring, accounting, support and operations.  
This is an activity funded in the framework of the SA1 task TSA1.3, which takes care of the integration of EGI with European Distributed Computing Infrastructures (DCIs). The purpose of this activity is to ensure that the operations of Resource Infrastructures based on different grid middleware stacks and/or architectures can interwork at different interface levels: monitoring, accounting, support and operations.  
Line 21: Line 23:
|-
|-
| '''Coordinator'''  
| '''Coordinator'''  
| M.&nbsp;Krakowian/EGI.eu
|  
|-
M.&nbsp;Krakowian/EGI.eu<br>
| '''Deputy'''
 
| M. David/LIP
|}
|}


= Distribution of Grid platforms  =
<br>


Page which allows you to track the deployment of services across EGI by querying the EGI grid service registry can be found [[GOCDB/services| here]]<br>
Milestones describing integration activity results and plans:


= UNICORE Integration  =
*[https://documents.egi.eu/public/ShowDocument?docid=1894 MS472 Integrating Resources into the EGI Production Infrastructure.]


*[[UNICORE integration task force|UNICORE Task force]] page - list of actions
*[https://documents.egi.eu/public/ShowDocument?docid=1308 MS421 Integrating Resources into the EGI Production Infrastructure.]  
*[https://www.egi.eu/indico/categoryDisplay.py?categId=49 Indico agendas and minutes]
*[[UNICORE 6 Nagios sensors implementation]]<br>


= Globus Integration  =
*[https://documents.egi.eu/public/ShowDocument?docid=650 MS414 Integrating Resources into the EGI Production Infrastructure.]


*[[Globus integration task force|Globus Task force]] page - list of actions
*[https://documents.egi.eu/secure/ShowDocument?docid=111 MS407 Integrating Resources into the EGI Production Infrastructure.]  
*[https://indico.egi.eu/indico/categoryDisplay.py?categId=53 Indico agendas and minutes]


= MAPPER/QCG Middleware =
= Integration areas&nbsp; =


*[[MAPPER-PRACE-EGI Task Force (MTF)|MAPPER-PRACE-EGI Task Force Phase 1]] page
Integration covers following areas:  
*[[MAPPER-PRACE-EGI Task Force (MTF)-II|MAPPER-PRACE-EGI Task Force Phase 2]] page
*[https://indico.egi.eu/indico/categoryDisplay.py?categId=68 Indico agendas and minutes]


= Desktop Grids  =
#'''Management '''- integration with Grid Configuration Database [GOCDB] (http://goc.egi.eu/)<br>
#*e.g. creation of a service type<br>
#'''Monitoring '''- integration with Service Availability Monitoring [SAM] <br>
#*development of monitoring probes <br>
#*integration of probes into SAM release<br>
#*integration of probes with Ava/Rel profile<br>
#'''Accounting '''- integration with EGI Accounting Infrastructure<br>
#*enabling all the accounting data to be collected in one place for a unified view<br>
#'''Support '''- integration with EGI Helpdesk [GGUS] (http://ggus.eu)<br>
#*creation of support unit and using it to provide support<br>
#'''Dashboard '''- integration with Operations Portal (http://operations-portal.egi.eu/)
#*integration of probes into Operations Tests pool
#'''Documentation '''- integration with existing operations procedures <br>
#*integration with Resource Center OLA
#*integration with Resource Center registration and certyfication procedure
#**creation of how to manually test the middleware
#'''Information System''' - integration with EGI Information system


*[[Desktop Grids integration|Desktop Grid integration page]] - status of the integration
= Middleware integration =
*[http://edgi-project.eu/ EDGI web site]
 
= Overall Middleware Integration Status =


{| cellspacing="1" cellpadding="1" border="1" class="wikitable"
{| cellspacing="1" cellpadding="1" border="1" class="wikitable"
|+ Status of integration
|-
|-
! scope="col" | <br>  
! scope="col" | <br>  
! scope="col" | gLite  
! scope="col" | gLite  
! scope="col" | ARC  
! scope="col" | [[ARC integration#Current_status|ARC]]
! scope="col" | UNICORE  
! scope="col" | [[UNICORE integration task force#Current_status|UNICORE]]
! scope="col" | Globus  
! scope="col" | [[Globus integration task force#Current_status|Globus]]
! scope="col" | Desktop Grids
! scope="col" | [[MAPPER-PRACE-EGI Task Force (MTF)-II#Current_status_of_integration|MAPPER/QCG]]
! scope="col" | MAPPER/QCG
|-
|-
| '''Management'''  
| '''Management'''  
| Completed
| Completed  
| Completed  
| Completed  
| Completed  
Line 75: Line 81:
|-
|-
| '''Monitoring'''  
| '''Monitoring'''  
| Completed
| Completed  
| Completed  
| Completed  
| Completed  
Line 84: Line 89:
| '''Accounting'''  
| '''Accounting'''  
| Completed  
| Completed  
| Completed
| '''In progress'''  
|
'''In progress '''<br>
 
*'''waiting for a new APEL client - EMI 3 release'''
 
|  
|  
'''In progress <br>'''  
'''In progress <br>'''  
*'''waiting for GridSAFE- IGE&nbsp;3.0 release'''


|  
|  
'''Under development'''
Completed
 
*'''desing study in ready'''<br>


|  
|  
'''In progress '''<br>
Completed
 
*'''waiting for a new APEL client - EMI 3 release'''


|-
|-
Line 111: Line 105:
| Completed  
| Completed  
| Completed  
| Completed  
| '''Not started'''
|  
|  
'''In progress'''
Completed<br>  
 
*'''request to GGUS&nbsp;for SU&nbsp;send<br>'''
*'''an independent xGUS instance will be provided for broader MAPPER suport activities'''<br>


|-
|-
Line 125: Line 115:
| Completed&nbsp;  
| Completed&nbsp;  
|  
|  
'''Not started '''<br>  
Completed<br>
 
|-
| '''Documentation'''<br>
| Completed
| Completed
| Completed
| Completed
| Completed
|-
| '''Information System'''
| Completed
| '''In progress '''
|
'''In progress'''<br>
 
| Completed
| '''In progress'''<br>
|}
 
== UNICORE Integration  ==
 
*[[UNICORE integration task force|UNICORE Task force]] page with current detailed integration status
 
== Globus Integration  ==
 
*[[Globus integration task force|Globus Task force]] page with current detailed integration status
 
== MAPPER/QCG Middleware  ==


*'''waiting for SAM release Update-17'''
*[[MAPPER-PRACE-EGI Task Force (MTF)|MAPPER-PRACE-EGI Task Force Phase 1]] page
*[[MAPPER-PRACE-EGI Task Force (MTF)-II|MAPPER-PRACE-EGI Task Force Phase 2]] page with current detailed integration status


|
<br>
'''Not started <br>'''


*'''waiting for SAM release Update-19'''
= E-Infrastructure integration  =


{| cellspacing="1" cellpadding="1" border="1" class="wikitable"
|-
! scope="col" | <br>
! scope="col" | PRACE
! scope="col" | OSG<br>
! scope="col" | [[EGI-XSEDE:Collaboration|XSEDE]]<br>
! scope="col" | EUDAT<br>
! scope="col" | [[EGI_Federated_Cloud_integration#Current_status|Cloud]]
! scope="col" | [[Desktop_Grids_integration#Current_status|Desktop Grid]]<br>
|-
|-
| '''Documentation'''<br>  
| '''Management'''
| Completed
| '''tbd - GOC&nbsp;DB&nbsp;5?'''
| no plans
| '''tbd'''
| '''tbd - GOC&nbsp;DB&nbsp;5?'''<br>  
| Completed  
| Completed  
| Completed
|-
| '''Monitoring'''
| no plans
| Monitoring results are populated to EGI central database.
| '''tbd'''
| '''Investigation to use VO SAM instance as solution'''
| '''In progress'''<br>
| Completed
|-
| '''Accounting'''
|  
|  
'''In progress'''
It was accepted that data would only be passed for requesting VOs.
 
*'''RC OLA integration missing'''<br>


| '''Data is only passed from OSG to APEL for an agreed set of VOs.<br>Future work is needed in terms of SSM 2 <br>migration and is planned for year four.'''
| '''in progress<br>'''
| no plans<br>
| '''In progress'''<br>
| '''In progress'''
|-
| '''Support'''
| no plans
|  
|  
'''In progress'''
The support infrastructure is fully synchronized


*'''RC OLA integration missing'''<br>
since 2006 with the OSG Footprints system.


| '''in progress'''<br>
| '''tbd'''<br>
| '''In progress'''<br>
| '''In progress'''
|-
| '''Dashboard'''
| no plans
| no plans
| '''tbd'''
| no plans<br>
| '''Not started'''<br>  
| '''Not started'''<br>  
|  
|  
'''Not started'''<br>
'''Not started '''  


|-
| '''Documentation'''<br>
| no plans
| no plans
| '''tbd'''
| no plans<br>
| '''In progress'''<br>
| '''In progress'''
|-
|-
| '''Information System'''  
| '''Information System'''  
| Completed  
| no plans
| '''??'''  
| Completed<br>
|  
| '''tbd'''  
'''In progress'''  
| '''tbd'''<br>
 
| '''In progress'''<br>
*'''The BDII publishing will be in the EMI-3 release of the UNICORE/X component which is due in February.'''
| '''In progress'''
|}


<br>  
<br>  


<br>  
== XSEDE<br> ==


<br>
Details about integration XSEDE and EGI project are documented on [[EGI-XSEDE:Collaboration|EGI-XSEDE:Collaboration wiki page]].


| '''??'''
== EGI Federated Cloud<br>  ==
| '''??'''
| '''??'''
|}


For detailed information please check related Task Force pages.<br>
[[EGI Federated Cloud integration|EGI Federated Cloud integration page]] with current detailed integration status


Legend:
== Desktop Grids  ==


#'''Management '''- integration with Grid Configuration Database [GOCDB] (http://goc.egi.eu/)<br>
*[[Desktop Grids integration|Desktop Grid integration page]] with current detailed integration status
#*creation of a new service type<br>
*[http://edgi-project.eu/ EDGI web site]<br>
#'''Monitoring '''- integration with Service Availability Monitoring [SAM] <br>
#*development of new monitoring probes <br>
#*integration of new probes into SAM release<br>
#'''Accounting '''- integration with EGI Accounting Infrastructure<br>
#*enabling all the accounting data to be collected in one place for a unified view<br>
#'''Support '''- integration with EGI Helpdesk [GGUS] (http://ggus.eu)<br>
#*creation of new support unit and using it to provide support<br>
#'''Dashboard '''- integration with Operations Portal (http://operations-portal.egi.eu/)
#*integration of new probes into Operations Tests pool
#'''Documentation '''- integration with existing operations procedures <br>  
#*integration with Resource Center OLA
#*integration with Resource Center registration and certyfication procedure
#**creation of how to manually test the middleware
#'''Information System''' - integration with EGI Information system


<br>
= Contact  =


= Contact =
Interoperations&nbsp;: operations@egi.eu


Interoperations : operations@egi.eu
Unicore mailing list: unicore-integration-tf@mailman.egi.eu  


Unicore mailing list: unicore-integration-tf@mailman.egi.eu
Globus mailing list: globus-integration-tf@mailman.egi.eu  
Globus mailing list: globus-integration-tf@mailman.egi.eu


Mapper/QCG mailing list: mapper-integration-tf@mailman.egi.eu
Mapper/QCG mailing list: mapper-integration-tf@mailman.egi.eu  


= Resources <!--* [https://twiki.cern.ch/twiki/bin/view/EGEE/Interoperation EGEE-III WLCG Interoperations]-->  =
= Resources <!--* [https://twiki.cern.ch/twiki/bin/view/EGEE/Interoperation EGEE-III WLCG Interoperations]--><br>  =


*Lechner, M. et alt.; ''Integrating Resources into the EGI Production Infrastructure'', EGI-InSPIRE Milestone [https://documents.egi.eu/document/650 MS414] (Sep 2011), (obsoletes [https://documents.egi.eu/public/ShowDocument?docid=209 MS408], Dec 2010)
*''[https://documents.egi.eu/public/ShowDocument?docid=172 Distributed Computing Infrastructure (DCI) Collaborative Roadmap]'', Dec 2010  
*''[https://documents.egi.eu/public/ShowDocument?docid=172 Distributed Computing Infrastructure (DCI) Collaborative Roadmap]'', Dec 2010  
*Ferrari, T.; ''Operations Architecture'', EGI-InSPIRE Deliverable [https://documents.egi.eu/secure/ShowDocument?docid=218 D4.1], Jan 2011
*Ferrari, T.; ''Operations Architecture'', EGI-InSPIRE Deliverable [https://documents.egi.eu/secure/ShowDocument?docid=218 D4.1], Jan 2011
[[Category:Interoperations|*]]

Latest revision as of 22:27, 24 December 2014

EGI Inspire Main page



Interoperations menu: Home Unicore Globus Mapper/QCG ARC Desktop Grids EGI Federated Cloud XSEDE Contact


Welcome to EGI Interoperations,


This is an activity funded in the framework of the SA1 task TSA1.3, which takes care of the integration of EGI with European Distributed Computing Infrastructures (DCIs). The purpose of this activity is to ensure that the operations of Resource Infrastructures based on different grid middleware stacks and/or architectures can interwork at different interface levels: monitoring, accounting, support and operations.

For all grid middlewares you can find a Task force, a unit established to work on a single defined task - integration of given middleware with EGI.

Coordinator

M. Krakowian/EGI.eu


Milestones describing integration activity results and plans:

Integration areas 

Integration covers following areas:

  1. Management - integration with Grid Configuration Database [GOCDB] (http://goc.egi.eu/)
    • e.g. creation of a service type
  2. Monitoring - integration with Service Availability Monitoring [SAM]
    • development of monitoring probes
    • integration of probes into SAM release
    • integration of probes with Ava/Rel profile
  3. Accounting - integration with EGI Accounting Infrastructure
    • enabling all the accounting data to be collected in one place for a unified view
  4. Support - integration with EGI Helpdesk [GGUS] (http://ggus.eu)
    • creation of support unit and using it to provide support
  5. Dashboard - integration with Operations Portal (http://operations-portal.egi.eu/)
    • integration of probes into Operations Tests pool
  6. Documentation - integration with existing operations procedures
    • integration with Resource Center OLA
    • integration with Resource Center registration and certyfication procedure
      • creation of how to manually test the middleware
  7. Information System - integration with EGI Information system

Middleware integration


gLite ARC UNICORE Globus MAPPER/QCG
Management Completed Completed Completed Completed Completed
Monitoring Completed Completed Completed Completed Completed
Accounting Completed In progress

In progress

Completed

Completed

Support Completed Completed Completed Completed

Completed

Dashboard Completed Completed Completed Completed 

Completed

Documentation
Completed Completed Completed Completed Completed
Information System Completed In progress

In progress

Completed In progress

UNICORE Integration

Globus Integration

MAPPER/QCG Middleware


E-Infrastructure integration


PRACE OSG
XSEDE
EUDAT
Cloud Desktop Grid
Management tbd - GOC DB 5? no plans tbd tbd - GOC DB 5?
Completed Completed
Monitoring no plans Monitoring results are populated to EGI central database. tbd Investigation to use VO SAM instance as solution In progress
Completed
Accounting

It was accepted that data would only be passed for requesting VOs.

Data is only passed from OSG to APEL for an agreed set of VOs.
Future work is needed in terms of SSM 2
migration and is planned for year four.
in progress
no plans
In progress
In progress
Support no plans

The support infrastructure is fully synchronized

since 2006 with the OSG Footprints system.

in progress
tbd
In progress
In progress
Dashboard no plans no plans tbd no plans
Not started

Not started

Documentation
no plans no plans tbd no plans
In progress
In progress
Information System no plans Completed
tbd tbd
In progress
In progress


XSEDE

Details about integration XSEDE and EGI project are documented on EGI-XSEDE:Collaboration wiki page.

EGI Federated Cloud

EGI Federated Cloud integration page with current detailed integration status

Desktop Grids

Contact

Interoperations : operations@egi.eu

Unicore mailing list: unicore-integration-tf@mailman.egi.eu

Globus mailing list: globus-integration-tf@mailman.egi.eu

Mapper/QCG mailing list: mapper-integration-tf@mailman.egi.eu

Resources