The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.
Difference between revisions of "HOWTO22"
Jump to navigation
Jump to search
| Line 123: | Line 123: | ||
$ source bashrc | $ source bashrc | ||
Then you can generate the proxy containing the credentials of your VO. Specify the VO in the "--group" option: | |||
$ dirac-proxy-init --debug --group compchem -U --rfc | |||
Generating proxy... | Generating proxy... | ||
Your certificate will expire in 19 days. Please renew it! | |||
Enter Certificate password: | Enter Certificate password: | ||
====================================================================== | Contacting CS... | ||
Your certificate will expire in less than | Checking DN /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | ||
====================================================================== | Username is apaolini | ||
Uploading proxy for compchem... | Creating proxy for apaolini@compchem (/O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini) | ||
Proxy generated: | X509_CERT_DIR is unset. Abort check of CAs | ||
subject : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN= | ======================================================================= | ||
Your certificate will expire in less than 19 days. Please renew it! | |||
======================================================================= | |||
Uploading proxy for compchem... | |||
Uploading compchem proxy to ProxyManager... | |||
Loading user proxy | |||
Uploading proxy on-the-fly | |||
Cert file /home/paolini/.globus/usercert.pem | |||
Key file /home/paolini/.globus/userkey.pem | |||
Loading cert and key | |||
User credentials loaded | |||
Uploading... | |||
Proxy uploaded | |||
Proxy generated: | |||
subject : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=7349567351 | |||
issuer : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | issuer : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | ||
identity : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | identity : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | ||
timeleft : 23:59:58 | timeleft : 23:59:58 | ||
DIRAC group : compchem | DIRAC group : compchem | ||
rfc : | rfc : True | ||
path : /tmp/x509up_u516 | path : /tmp/x509up_u516 | ||
username : apaolini | username : apaolini | ||
properties : NormalUser, Pilot | properties : NormalUser, Pilot | ||
Proxies uploaded: | Proxies uploaded: | ||
DN | Group | Until (GMT) | DN | Group | Until (GMT) | ||
/O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | | /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2017/11/01 16:17 | ||
== Jobs submission == | == Jobs submission == | ||
Revision as of 10:33, 13 October 2017
| Main | EGI.eu operations services | Support | Documentation | Tools | Activities | Performance | Technology | Catch-all Services | Resource Allocation | Security |
| Documentation menu: | Home • | Manuals • | Procedures • | Training • | Other • | Contact ► | For: | VO managers • | Administrators |
| Title | Usage comparison betwwen DIRAC and WMS |
| Document link | https://wiki.egi.eu/wiki/MAN13 |
| Last modified | Oct 2017 |
| Policy Group Acronym | |
| Policy Group Name | |
| Contact Group | |
| Document Status | DRAFT |
| Approved Date | |
| Procedure Statement | |
| Owner | Owner of procedure |
Usage comparison betwwen DIRAC and WMS
DIRAC client installation
The generic installation and configuration of the client is shown in the DIRAC official documentation. We are reporting here the client installation using the EGI default configuration.
- Download the DIRAC installation script:
$ mkdir DIRAC $ cd DIRAC/ $ wget -np -O dirac-install http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/dirac-install --no-check-certificate --2016-11-03 11:27:27-- http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/dirac-install Resolving lhcbproject.web.cern.ch... 188.184.65.125, 188.184.67.62 Connecting to lhcbproject.web.cern.ch|188.184.65.125|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 53970 (53K) [text/plain] Saving to: âdirac-installâ 100%[================================================================================================================================================================================>] 53,970 --.-K/s in 0.08s 2016-11-03 11:27:28 (675 KB/s) - âdirac-installâsaved [53970/53970] $ chmod +x dirac-install
- DIRAC team prepared default settings for the VOs that requested to use the service. Run the script using the EGI defualt configuration:
$ ./dirac-install -V egi 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Processing installation requirements 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Destination path for installation is /home/paolini/DIRAC 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Discovering modules to install 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Installing modules... 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Installing COMDIRAC:v0r12 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/COMDIRAC-v0r12.tar.gz 2016-11-03 10:32:56 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/COMDIRAC-v0r12.md5 2016-11-03 10:32:56 UTC dirac-install [NOTICE] Installing DIRAC:v6r14p4 2016-11-03 10:32:56 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/DIRAC-v6r14p4.tar.gz 2016-11-03 10:32:57 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/DIRAC-v6r14p4.md5 2016-11-03 10:32:57 UTC dirac-install [NOTICE] Deploying scripts... Scripts will be deployed at /home/paolini/DIRAC/scripts Inspecting DIRAC module Inspecting COMDIRAC module 2016-11-03 10:32:57 UTC dirac-install [NOTICE] Installing client externals... 2016-11-03 10:32:58 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/Externals-client-v6r3p2-Linux_x86_64_glibc-2.12-python27.tar.gz 2016-11-03 10:32:59 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/Externals-client-v6r3p2-Linux_x86_64_glibc-2.12-python27.md5 2016-11-03 10:33:03 UTC dirac-install [NOTICE] Fixing externals paths... 2016-11-03 10:33:04 UTC dirac-install [NOTICE] Running externals post install... 2016-11-03 10:33:04 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/../lcgBundles/DIRAC-lcg-2015-07-09-Linux_x86_64_glibc-2.12-python27.tar.gz 2016-11-03 10:33:28 UTC dirac-install [NOTICE] Executing /home/paolini/DIRAC/scripts/dirac-fix-mysql-script... 2016-11-03 10:33:35 UTC dirac-install [NOTICE] Creating /home/paolini/DIRAC/bashrc 2016-11-03 10:33:35 UTC dirac-install [NOTICE] Creating /home/paolini/DIRAC/cshrc 2016-11-03 10:33:36 UTC dirac-install [NOTICE] Defaults written to defaults-egi.cfg 2016-11-03 10:33:36 UTC dirac-install [NOTICE] Executing /home/paolini/DIRAC/scripts/dirac-externals-requirements... 2016-11-03 10:33:38 UTC dirac-install [NOTICE] egi properly installed [paolini@test13 DIRAC]$ ls -ltr total 100 -rwxrwxr-x 1 paolini paolini 53970 Aug 28 2012 dirac-install -rw-r--r-- 1 paolini paolini 722 Jul 9 2015 version-2015-07-09.txt drwxr-xr-x 10 paolini paolini 4096 Jul 9 2015 Linux_x86_64_glibc-2.12 drwxr-xr-x 3 paolini paolini 4096 Oct 29 22:41 COMDIRAC drwxr-xr-x 15 paolini paolini 4096 Nov 3 11:33 DIRAC -rw-rw-r-- 1 paolini paolini 918 Nov 3 11:33 cshrc -rw-rw-r-- 1 paolini paolini 1111 Nov 3 11:33 bashrc drwxrwxr-x 2 paolini paolini 12288 Nov 3 11:33 scripts -rw-rw-r-- 1 paolini paolini 296 Nov 3 11:33 defaults-egi.cfg
- Once the client software is installed, it should be configured in order to access the DIRAC4EGI service:
$ source bashrc $ dirac-configure defaults-egi.cfg Executing: /home/paolini/DIRAC/DIRAC/Core/scripts/dirac-configure.py defaults-egi.cfg Checking DIRAC installation at "/home/paolini/DIRAC" Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vo.formation.idgrilles.fr/cclcgvomsli01.in2p3.fr.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vo.formation.idgrilles.fr Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eli-beams.eu/voms1.egee.cesnet.cz.lsc Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eli-beams.eu/voms2.grid.cesnet.cz.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eli-beams.eu Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vlemed/voms.grid.sara.nl.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vlemed Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/hungrid/grid11.kfki.hu.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/hungrid Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eng.vo.ibergrid.eu/voms01.ncg.ingrid.pt.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eng.vo.ibergrid.eu Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/compchem/voms-01.pd.infn.it.lsc Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/compchem/voms.cnaf.infn.it.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/compchem Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/enmr.eu/voms-02.pd.infn.it.lsc Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/enmr.eu/voms2.cnaf.infn.it.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/enmr.eu Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eiscat.se/voms1.grid.cesnet.cz.lsc Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eiscat.se/voms2.grid.cesnet.cz.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eiscat.se Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/training.egi.eu/voms1.egee.cesnet.cz.lsc Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/training.egi.eu/voms2.grid.cesnet.cz.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/training.egi.eu Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vo.plgrid.pl/voms.cyf-kr.edu.pl.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vo.plgrid.pl Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/fedcloud.egi.eu/voms1.grid.cesnet.cz.lsc Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/fedcloud.egi.eu/voms2.grid.cesnet.cz.lsc Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/fedcloud.egi.eu
Managing proxies
First you need to setup the DIRAC environment:
$ cd DIRAC/ $ source bashrc
Then you can generate the proxy containing the credentials of your VO. Specify the VO in the "--group" option:
$ dirac-proxy-init --debug --group compchem -U --rfc Generating proxy... Your certificate will expire in 19 days. Please renew it! Enter Certificate password: Contacting CS... Checking DN /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini Username is apaolini Creating proxy for apaolini@compchem (/O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini) X509_CERT_DIR is unset. Abort check of CAs ======================================================================= Your certificate will expire in less than 19 days. Please renew it! ======================================================================= Uploading proxy for compchem... Uploading compchem proxy to ProxyManager... Loading user proxy Uploading proxy on-the-fly Cert file /home/paolini/.globus/usercert.pem Key file /home/paolini/.globus/userkey.pem Loading cert and key User credentials loaded Uploading... Proxy uploaded Proxy generated: subject : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=7349567351 issuer : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini identity : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini timeleft : 23:59:58 DIRAC group : compchem rfc : True path : /tmp/x509up_u516 username : apaolini properties : NormalUser, Pilot Proxies uploaded: DN | Group | Until (GMT) /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2017/11/01 16:17
Jobs submission
| gLite-WMS command | DIRAC command | Note |
|---|---|---|
| glite-wms-job-list-match | --------------- | not needed |
| glite-wms-job-submit | dirac-wms-job-submit | to submit a job |
| glite-wms-job-status | dirac-wms-job-status | to check the status of a job |
| glite-wms-job-output | dirac-wms-job-get-output | to retrieve the job output |
| glite-wms-job-logging-info | dirac-wms-job-logging-info | to retrieve history of transitions for a DIRAC job |
| glite-wms-job-cancel | dirac-wms-job-delete | to delete a job |
| glite-wms-job-delegate-proxy | ------------- | not needed |
Have a look at the official command reference documentation for the complete list of the Workload Management commands.
cha cha cha
[paolini@test13 ~]$ dirac-wms-job-submit test.jdl JobID = 15929531 [paolini@test13 ~]$ [paolini@test13 ~]$ dirac-wms-job-delete 15929531 Deleted jobs 15929531 [paolini@test13 ~]$ [paolini@test13 ~]$ [paolini@test13 ~]$ dirac-proxy-init Generating proxy... Enter Certificate password: Uploading proxy for compchem... Proxy generated: subject : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=proxy issuer : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini identity : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini timeleft : 23:59:58 DIRAC group : compchem rfc : False path : /tmp/x509up_u516 username : apaolini properties : NormalUser, Pilot Proxies uploaded: DN | Group | Until (GMT) /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2017/11/01 16:17 [paolini@test13 ~]$ [paolini@test13 ~]$ dirac-wms-job-submit test.jdl JobID = 15929532 [paolini@test13 ~]$ [paolini@test13 ~]$ dirac-wms-job-status 15929532 JobID=15929532 Status=Waiting; MinorStatus=Pilot Agent Submission; Site=ANY; [paolini@test13 ~]$ [paolini@test13 ~]$ dirac-wms-job-status 15929532 JobID=15929532 Status=Done; MinorStatus=Execution Complete; Site=EGI.BARI.it; [paolini@test13 ~]$ dirac-wms-job-get-output 15929532 Job output sandbox retrieved in /home/paolini/15929532/