Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "HOWTO19"

From EGIWiki
Jump to navigation Jump to search
(Created page with "{{Template:Op menubar}} {{Template:Doc_menubar}} {{TOC_right}} Category:Operations_Manuals The [http://www.catania-science-gateways.it/ Catania Science Gateway Framework] (C...")
 
 
(22 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{Template:Op menubar}} {{Template:Doc_menubar}} {{TOC_right}}  
{{Template:Op menubar}} {{Template:Doc_menubar}}
[[Category:Operations_Manuals]]
[[Category:Deprecated]]
The [http://www.catania-science-gateways.it/ Catania Science Gateway Framework] (CSGF) has been developed by INFN, Division of Catania (Italy), to provide application developers with a tool to create Science Gateways (SGs) in short time and in a very easy way. CSGF is made of a set of libraries to manage Authentication & Authorization mechanisms and to interact with several different kinds of DCIs (grid, cloud, HPC, local, etc.). The CSGF is based on well established and widely adopted standards, such as SAGA, SAML, OCCI, JSR 286, etc. and it is fully compliant with both the [https://documents.egi.eu/document/80 EGI.eu VO Portal] and [https://documents.egi.eu/document/81 User Traceability] policies.
{| style="border:1px solid black; background-color:lightgrey; color: black; padding:5px; font-size:140%; width: 90%; margin: auto;"
| style="padding-right: 15px; padding-left: 15px;" |
|[[File:Alert.png]] This page is '''Deprecated''' and should no longer be used
|}
 
{{TOC_right}}
 
= SLA validation for a VO configuration at a specific Resource Centre<br>  =
 
== Prerequirements ==
Before starting the validation phase, each VO should provide:
* the list of the RCs
* a non-empty Vo image list to be applied to cloud RCs (if any)
* a VO ID card with all the necessary information, in particular the VOMS server publishing the configuration information (Enrollment URL)
 
== Testing OCCI server at a specific site with a specific VO<br>  ==
 
<br>Create a VOMS proxy for the VO to be tested:&nbsp; <br>
<pre>[spinoso@ui test_cloud]$ voms-proxy-init -voms vo.nbis.se  --rfc
Enter GRID pass phrase for this identity:
Contacting voms2.grid.cesnet.cz:15033 [/DC=org/DC=terena/DC=tcs/C=CZ/ST=Hlavni mesto Praha/L=Praha 6/O=CESNET/CN=voms2.grid.cesnet.cz] "vo.nbis.se"...
Remote VOMS server contacted succesfully.
Created proxy in /tmp/x509up_u500.
Your proxy is valid until Thu Sep 01 23:10:35 CEST 2016
</pre>
<br>Get site OCCI endpoint from GOCDB: <br><br>
 
#site is TR-FC1-ULAKBIM<br>
#on GOCDB: https://goc.egi.eu/portal/index.php?Page_Type=Site&amp;id=982 <br>
#check for service ''eu.egi.cloud.vm-management.occi'' <br>
#value is ''http://fcctrl.ulakbim.gov.tr:8787/occi1.1?image=439e3478-df3f-4249-ac1b-28ae3933c09b&amp;platform=openstack&amp;resource=bc5ed503-c066-4d00-b99e-6bef76bcb732'' <br>
#'''"http://fcctrl.ulakbim.gov.tr:8787/occi1.1"'''
 
<br>Export it in the BASH env: <br>
<pre>[spinoso@ui test_cloud]$ export ENDPOINT="http://fcctrl.ulakbim.gov.tr:8787/occi1.1"
</pre>
<br>Perform OCCI access to the endpoint using a simple OCCI command, like: <br>
<pre>[spinoso@ui test_cloud]$ /opt/occi-cli/bin/occi --endpoint $ENDPOINT --auth x509 --user-cred /tmp/x509up_u500 --voms --action describe --resource os_tpl
########################################################################################################################################################################################################################################
[[ http://schemas.openstack.org/template/os#661a2b1e-8a10-4ed2-ae6b-5a56c50e62bc ]]
title:        Ubuntu-TrustyServer
term:        661a2b1e-8a10-4ed2-ae6b-5a56c50e62bc
location:    /occi1.1/os_tpl/661a2b1e-8a10-4ed2-ae6b-5a56c50e62bc
[cut]
 
 
</pre>
<br>
 
== Check that the VO image list is available at the RC  ==
 
To check if the site is supporting the VO images:
 
*go to https://appdb.egi.eu  
*Cloud Marketplace -&gt; Sites/Resource Providers -&gt; go to the Resource Centre, click on it
*in the "filter by" check that the VO is listed
 
To get the VO image list:
 
*go to https://appdb.egi.eu
**Cloud Marketplace -&gt; Virtual Organizations -&gt; go to the VO, click on it
* you will find the "VMCatcher image list" link in the page
 
== Check that the VO ID card is OK  ==
 
Check VO ID card on https://operations-portal.egi.eu/vo/search
Requirements are:
* check that the VOMS server is available if needed (Yes/No), if yes if URL is available and the configuration info published on the VOMS server
* check if the Enrollment Url is available


The CSGF allows users to execute applications on the EGI Federated Cloud through web portals/SGs. The Science Gateways based on CSGF provide users with intuitive web interface to execute applications on the Cloud as jobs and to manage these jobs during their running (check the status and download the output). The SGs takes care of starting the VMs on the EGI Federated Cloud, transfer the needed files (e.g. executable, input files, etc.), stop the VMs and download the output in behalf of the user.
= Template for the ticket =
<pre>
Subject: Please configure VO_NAME at RESOURCE_CENTRE


A list of Science Gateways based on the CSGF is available [http://gridp.garr.it/service-providers.html here].
Body:  


The EGI Federated Cloud users can exploit the CSGF features to:
Dear Resource Centre,
* [[Fedcloud-tf:How_to_use_the_Catania_Science_Gateway_Framework_as_Application_Broker#Execute_applications_already_integrated_in_a_Science_Gateway|Execute applications already integrated in one of the existing Science Gateways]]
* [[Fedcloud-tf:How_to_use_the_Catania_Science_Gateway_Framework_as_Application_Broker#Add_your_application_to_a_Science_Gateway|Add their applications in one of the existing Science Gateways]]
* [[Fedcloud-tf:How_to_use_the_Catania_Science_Gateway_Framework_as_Application_Broker#Deploy_your_Science_Gateway_based_on_the_Catania_Science_Gateway_Framework|Deploy a new Science Gateway]]


In the following sections are available step by step instructions for the users.
as per SLA: SLA_DOCUMENT_URL


== Execute applications already integrated in a Science Gateway ==
you are kindly requested to check the configuration of the following VOs:
The list of all the applications available in the CSGF based Science Gateways is available in the [http://science-gateway.chain-project.eu/general-overview CHAIN-REDS Application Database]. The [http://www.chain-project.eu/ CHAIN-REDS] application database gives you the direct link to the application run pages.
Otherwise you can decide to directly visit one of the Science Gateway of [http://gridp.garr.it/service-providers.html this list].


Once you identified the applications you would like to execute, you have to follow the below described steps:
VO_NAME
* Click on the "Sign In" link in the main page of the chosen Science Gateway
* Select your identity federation. If you don't find any identity provider suitable for you, you can use the catch-all one: GrIDP.
<BR>
[[File:CSGF-IdentityFederations.jpg|center|x400px|A subset of Identity Federations supported by the CSGF]]
<BR>
* Select your identity providers and login on the Science Gateway using your standard credential. EGI.eu SSO is available as identity provider of the catch-all identity federation GrIDP. If you don't find any identity provider suitable for you, you can use the catch-all one: IDOPEN GARR. See the below image for a subset of the identity providers supported by the CSGF.
<BR>
[[File:CSGF_IdentityProviders.jpg|center|x400px|A subset of the Identity Providers supported by the GrIDP federation]]
<BR>
* If this is the first time you are logging in the selected Science Gateway, you'll be redirect to the Science Gateway registration page. Fill in the form and submit it.
* Your registration request will be sent to the Science Gateway administrator. He will evaluate your request and accept or reject it. You will be notified by e-mail at the end of the process. This is a manual process, then you could wait for 1-2 working days until your request will be evaluted.
* After your registration is accepted, you can login again on the Science Gateway following the same procedure above described. Now you are an authorised user and you are able to access the run pages of the applications integrated in the Science Gateway
* Select the application you are willing to execute and go to the run page
* Fill in the form showed in the run page with your input parameters and click on the run button
<BR>
[[File:WRF.jpg|center|x400px|Form to submit WRF application on the EGI Federated Cloud]]
<BR>
* Now your application is running. You can monitor it (checking the status, run, done, etc.) accessing the '''My Workspace''' web page page of the Science Gateway.
<BR>
[[File:CSGF_myworkspace.jpg|center|x400px|MyWorkspace allows users to check the job status and downloand the output of done jobs]]
<BR>
* When your application execution is completed, you can download the output accessing the '''My Workspace''' web page page.


== Add your application to a Science Gateway ==
to allow users access to the provided resources.  
The currently existing Science Gateways are running on top of a [https://www.liferay.com/ Liferay] instance (although this is not a mandatory requirement). Then, to add your application to one of the already running SGs based on the CSGF, you have to develop a Java portlet according to the [https://jcp.org/en/jsr/detail?id=286 JSR 286] specification.


The CSGF provides portlet developers with a library, the Catania Grid & Cloud engine, exposing all the methods needed to interact with the EGI Federated Cloud and, in general, with the EGI e-infrastructure. Catania Grid & Cloud engine documentation is available [http://www.catania-science-gateways.it/documentation here].
In the case you need it, the VO Id Card can be found at the following URL: VO_ID_CARD_URL


The Catania Grid & Cloud engine is a Java library that can be used in any Java enabled environment.
It is also required to configure the vmcatcher with the VO-specific VMCatcher image list available here: VO_IMAGE_LIST


The CSGF team is keen to help you in the integration of new applications on the CSGF SGs. Then, if you need any assistance or help, contact the [mailto:sg-licence@ct.infn.it CSGF Support Team].
You will find there all the information you need to set up the VO. Let us know if you need more information.


== Deploy your Science Gateway based on the Catania Science Gateway Framework ==
Thank you.
If you would like to deploy a new Science Gateway based on the CSGF, please contact the [mailto:sg-licence@ct.infn.it CSGF Support Team].
EGI Operations
</pre>


== References ==
[[Category:Operations_Manuals]]
* The Catania Science Gateway Framework web site can be reached at the following URL: http://www.catania-science-gateways.it

Latest revision as of 14:47, 10 September 2021

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Documentation menu: Home • Manuals • Procedures • Training • Other • Contact ► For: VO managers • Administrators
Alert.png This page is Deprecated and should no longer be used


SLA validation for a VO configuration at a specific Resource Centre

Prerequirements

Before starting the validation phase, each VO should provide:

  • the list of the RCs
  • a non-empty Vo image list to be applied to cloud RCs (if any)
  • a VO ID card with all the necessary information, in particular the VOMS server publishing the configuration information (Enrollment URL)

Testing OCCI server at a specific site with a specific VO


Create a VOMS proxy for the VO to be tested:  

[spinoso@ui test_cloud]$ voms-proxy-init -voms vo.nbis.se  --rfc
Enter GRID pass phrase for this identity:
Contacting voms2.grid.cesnet.cz:15033 [/DC=org/DC=terena/DC=tcs/C=CZ/ST=Hlavni mesto Praha/L=Praha 6/O=CESNET/CN=voms2.grid.cesnet.cz] "vo.nbis.se"...
Remote VOMS server contacted succesfully.
Created proxy in /tmp/x509up_u500.
Your proxy is valid until Thu Sep 01 23:10:35 CEST 2016


Get site OCCI endpoint from GOCDB:

  1. site is TR-FC1-ULAKBIM
  2. on GOCDB: https://goc.egi.eu/portal/index.php?Page_Type=Site&id=982
  3. check for service eu.egi.cloud.vm-management.occi
  4. value is http://fcctrl.ulakbim.gov.tr:8787/occi1.1?image=439e3478-df3f-4249-ac1b-28ae3933c09b&platform=openstack&resource=bc5ed503-c066-4d00-b99e-6bef76bcb732
  5. "http://fcctrl.ulakbim.gov.tr:8787/occi1.1"


Export it in the BASH env: 

[spinoso@ui test_cloud]$ export ENDPOINT="http://fcctrl.ulakbim.gov.tr:8787/occi1.1"


Perform OCCI access to the endpoint using a simple OCCI command, like: 

[spinoso@ui test_cloud]$ /opt/occi-cli/bin/occi --endpoint $ENDPOINT --auth x509 --user-cred /tmp/x509up_u500 --voms --action describe --resource os_tpl
########################################################################################################################################################################################################################################
[[ http://schemas.openstack.org/template/os#661a2b1e-8a10-4ed2-ae6b-5a56c50e62bc ]]
title:        Ubuntu-TrustyServer
term:         661a2b1e-8a10-4ed2-ae6b-5a56c50e62bc
location:     /occi1.1/os_tpl/661a2b1e-8a10-4ed2-ae6b-5a56c50e62bc
[cut]


Check that the VO image list is available at the RC

To check if the site is supporting the VO images:

  • go to https://appdb.egi.eu
  • Cloud Marketplace -> Sites/Resource Providers -> go to the Resource Centre, click on it
  • in the "filter by" check that the VO is listed

To get the VO image list:

  • go to https://appdb.egi.eu
    • Cloud Marketplace -> Virtual Organizations -> go to the VO, click on it
  • you will find the "VMCatcher image list" link in the page

Check that the VO ID card is OK

Check VO ID card on https://operations-portal.egi.eu/vo/search Requirements are:

  • check that the VOMS server is available if needed (Yes/No), if yes if URL is available and the configuration info published on the VOMS server
  • check if the Enrollment Url is available

Template for the ticket

Subject: Please configure VO_NAME at RESOURCE_CENTRE

Body: 

Dear Resource Centre, 

as per SLA: SLA_DOCUMENT_URL

you are kindly requested to check the configuration of the following VOs:

VO_NAME

to allow users access to the provided resources. 

In the case you need it, the VO Id Card can be found at the following URL: VO_ID_CARD_URL

It is also required to configure the vmcatcher with the VO-specific VMCatcher image list available here: VO_IMAGE_LIST

You will find there all the information you need to set up the VO. Let us know if you need more information.

Thank you.
EGI Operations
Retrieved from "https://wiki.egi.eu/w/index.php?title=HOWTO19&oldid=113300"