Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "HOWTO22"

From EGIWiki
Jump to navigation Jump to search
Line 13: Line 13:
}}
}}


= DIRAC client installation =
== DIRAC client installation ==


The generic installation and configuration of the client is shown in the [http://dirac.readthedocs.io/en/latest/UserGuide/GettingStarted/InstallingClient/index.html DIRAC official documentation]. We are reporting here the client installation using the EGI default configuration.
The generic installation and configuration of the client is shown in the [http://dirac.readthedocs.io/en/latest/UserGuide/GettingStarted/InstallingClient/index.html DIRAC official documentation]. We are reporting here the client installation using the EGI default configuration.
Line 38: Line 38:
*DIRAC team prepared default settings for the VOs that requested to use the service. Run the script using the EGI defualt configuration:
*DIRAC team prepared default settings for the VOs that requested to use the service. Run the script using the EGI defualt configuration:


  [paolini@test13 DIRAC]$ ./dirac-install -V egi
  $ ./dirac-install -V egi
  2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Processing installation requirements
  2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Processing installation requirements
  2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Destination path for installation is /home/paolini/DIRAC
  2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Destination path for installation is /home/paolini/DIRAC
Line 65: Line 65:
  2016-11-03 10:33:36 UTC dirac-install [NOTICE]  Executing /home/paolini/DIRAC/scripts/dirac-externals-requirements...
  2016-11-03 10:33:36 UTC dirac-install [NOTICE]  Executing /home/paolini/DIRAC/scripts/dirac-externals-requirements...
  2016-11-03 10:33:38 UTC dirac-install [NOTICE]  egi properly installed
  2016-11-03 10:33:38 UTC dirac-install [NOTICE]  egi properly installed
[paolini@test13 DIRAC]$
 
  [paolini@test13 DIRAC]$ ls -ltr
  [paolini@test13 DIRAC]$ ls -ltr
  total 100
  total 100
Line 79: Line 77:
  drwxrwxr-x  2 paolini paolini 12288 Nov  3 11:33 scripts
  drwxrwxr-x  2 paolini paolini 12288 Nov  3 11:33 scripts
  -rw-rw-r--  1 paolini paolini  296 Nov  3 11:33 defaults-egi.cfg
  -rw-rw-r--  1 paolini paolini  296 Nov  3 11:33 defaults-egi.cfg
*Once the client software is installed, it should be configured in order to access the DIRAC4EGI service:
$ source bashrc
   
   
  [paolini@test13 DIRAC]$ source bashrc
  $ dirac-configure defaults-egi.cfg  
[paolini@test13 DIRAC]$ dirac-
Display all 169 possibilities? (y or n)
dirac-accounting-decode-fileid            dirac-admin-request-summary              dirac-dms-data-size                      dirac-install-component                  dirac-start-mysql
dirac-accounting-report-cli              dirac-admin-reset-job                    dirac-dms-filecatalog-cli                dirac-install-db                          dirac-status-component
dirac-admin-accounting-cli                dirac-admin-select-requests              dirac-dms-find-lfns                      dirac-install-mysql                      dirac-stop-component
dirac-admin-add-group                    dirac-admin-service-ports                dirac-dms-ftsdb-summary                  dirac-install-web-portal                  dirac-stop-mysql
dirac-admin-add-host                      dirac-admin-set-site-protocols            dirac-dms-fts-monitor                    dirac-jobexec                            dirac-sys-sendmail
dirac-admin-add-resources                dirac-admin-show-task-queues              dirac-dms-fts-submit                      dirac-monitoring-get-components-status    dirac-transformation-archive
dirac-admin-add-shifter                  dirac-admin-site-info                    dirac-dms-get-file                        dirac-myproxy-upload                      dirac-transformation-clean
dirac-admin-add-site                      dirac-admin-site-mask-logging            dirac-dms-lfn-accessURL                  dirac-platform                            dirac-transformation-cli
dirac-admin-add-user                      dirac-admin-sort-cs-sites                dirac-dms-lfn-logging-info                dirac-populate-component-db              dirac-transformation-remove-output
dirac-admin-allow-se                      dirac-admin-sync-users-from-file          dirac-dms-lfn-metadata                    dirac-proxy-get-uploaded-info            dirac-transformation-verify-outputdata
dirac-admin-allow-site                    dirac-admin-sysadmin-cli                  dirac-dms-lfn-replicas                    dirac-proxy-info                          dirac-uninstall-component
dirac-admin-ban-se                        dirac-admin-user-quota                    dirac-dms-pfn-accessURL                  dirac-proxy-init                          dirac-utils-file-adler
dirac-admin-ban-site                      dirac-admin-users-with-proxy              dirac-dms-pfn-metadata                    dirac-repo-monitor                        dirac-utils-file-md5
dirac-admin-bdii-info                    dirac-agent                              dirac-dms-put-and-register-request        dirac-restart-component                  dirac-version
dirac-admin-ce-info                      dirac-bash                                dirac-dms-remove-catalog-files            dirac-restart-mysql                      dirac-wms-cpu-normalization
dirac-admin-delete-user                  dirac-cert-convert.sh                    dirac-dms-remove-catalog-replicas        dirac-rms-cancel-request                  dirac-wms-get-normalized-queue-length
dirac-admin-externals-versions            dirac-compile-externals                  dirac-dms-remove-files                    dirac-rms-reqdb-summary                  dirac-wms-get-queue-cpu-time
dirac-admin-get-banned-sites              dirac-config-ce                          dirac-dms-remove-replicas                dirac-rms-reset-request                  dirac-wms-get-queue-normalization
dirac-admin-get-CAs                      dirac-configuration-cli                  dirac-dms-replica-metadata                dirac-rms-show-request                    dirac-wms-job-attributes
dirac-admin-get-job-pilot-output          dirac-configuration-dump-local-cache      dirac-dms-replicate-and-register-request  dirac-rss-list-status                    dirac-wms-job-delete
dirac-admin-get-job-pilots                dirac-configuration-shell                dirac-dms-replicate-lfn                  dirac-rss-query-db                        dirac-wms-job-get-input
dirac-admin-get-pilot-info                dirac-configure                          dirac-dms-resolve-guid                    dirac-rss-query-dtcache                  dirac-wms-job-get-jdl
dirac-admin-get-pilot-logging-info        dirac-create-distribution-tarball        dirac-dms-set-replica-status              dirac-rss-set-status                      dirac-wms-job-get-output
dirac-admin-get-pilot-output              dirac-create-svn-branch                  dirac-dms-show-ftsjobs                    dirac-rss-set-token                      dirac-wms-job-get-output-data
dirac-admin-get-proxy                    dirac-create-svn-tag                      dirac-dms-show-se-status                  dirac-rss-sync                            dirac-wms-job-kill
dirac-admin-get-site-mask                dirac-deploy-scripts                      dirac-dms-user-lfns                      dirac-service                            dirac-wms-job-logging-info
dirac-admin-get-site-protocols            dirac-distribution                        dirac-dms-user-quota                      dirac-setup-site                          dirac-wms-job-parameters
dirac-admin-kill-pilot                    dirac-dms-add-file                        dirac-executor                            dirac-stager-monitor-file                dirac-wms-job-peek
dirac-admin-list-hosts                    dirac-dms-add-files                      dirac-externals-requirements              dirac-stager-monitor-jobs                dirac-wms-job-reschedule
dirac-admin-list-users                    dirac-dms-catalog-metadata                dirac-fix-ld-library-path                dirac-stager-monitor-request              dirac-wms-jobs-select-output-search
dirac-admin-modify-user                  dirac-dms-change-replica-status          dirac-fix-mysql-script                    dirac-stager-monitor-requests            dirac-wms-job-status
dirac-admin-pilot-summary                dirac-dms-clean-directory                dirac-framework-ping-service              dirac-stager-show-stats                  dirac-wms-job-submit
dirac-admin-proxy-upload                  dirac-dms-create-removal-request          dirac-info                                dirac-stager-stage-files                  dirac-wms-select-jobs
dirac-admin-reoptimize-jobs              dirac-dms-create-replication-request      dirac-install                            dirac-start-component                   
[paolini@test13 DIRAC]$ dirac-
[paolini@test13 DIRAC]$ dirac-proxy-init
Generating proxy...
Your certificate will expire in 2 days. Please renew it!
 
Enter Certificate password:
Bad passphrase
[paolini@test13 DIRAC]$ dirac-proxy-init
Generating proxy...
Your certificate will expire in 2 days. Please renew it!
 
Enter Certificate password:
DN /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini is not registered
[paolini@test13 DIRAC]$
[paolini@test13 DIRAC]$ dirac-configure defaults-egi.cfg  
  Executing: /home/paolini/DIRAC/DIRAC/Core/scripts/dirac-configure.py defaults-egi.cfg   
  Executing: /home/paolini/DIRAC/DIRAC/Core/scripts/dirac-configure.py defaults-egi.cfg   
  Checking DIRAC installation at "/home/paolini/DIRAC"  
  Checking DIRAC installation at "/home/paolini/DIRAC"  

Revision as of 17:11, 9 October 2017

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Documentation menu: Home • Manuals • Procedures • Training • Other • Contact ► For: VO managers • Administrators



Title Usage comparison betwwen DIRAC and WMS
Document link https://wiki.egi.eu/wiki/MAN13
Last modified Oct 2017
Policy Group Acronym
Policy Group Name
Contact Group
Document Status DRAFT
Approved Date
Procedure Statement
Owner Owner of procedure


DIRAC client installation

The generic installation and configuration of the client is shown in the DIRAC official documentation. We are reporting here the client installation using the EGI default configuration.

  • Download the DIRAC installation script:
$ mkdir DIRAC
$ cd DIRAC/

$ wget -np -O dirac-install http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/dirac-install --no-check-certificate
--2016-11-03 11:27:27--  http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/dirac-install
Resolving lhcbproject.web.cern.ch... 188.184.65.125, 188.184.67.62
Connecting to lhcbproject.web.cern.ch|188.184.65.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 53970 (53K) [text/plain]
Saving to: âdirac-installâ

100%[================================================================================================================================================================================>] 53,970      --.-K/s   in 0.08s   

2016-11-03 11:27:28 (675 KB/s) - âdirac-installâsaved [53970/53970]

[paolini@test13 DIRAC]$ chmod +x dirac-install
  • DIRAC team prepared default settings for the VOs that requested to use the service. Run the script using the EGI defualt configuration:
$ ./dirac-install -V egi
2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Processing installation requirements
2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Destination path for installation is /home/paolini/DIRAC
2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Discovering modules to install
2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Installing modules...
2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Installing COMDIRAC:v0r12
2016-11-03 10:32:55 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/COMDIRAC-v0r12.tar.gz
2016-11-03 10:32:56 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/COMDIRAC-v0r12.md5
2016-11-03 10:32:56 UTC dirac-install [NOTICE]  Installing DIRAC:v6r14p4
2016-11-03 10:32:56 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/DIRAC-v6r14p4.tar.gz
2016-11-03 10:32:57 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/DIRAC-v6r14p4.md5
2016-11-03 10:32:57 UTC dirac-install [NOTICE]  Deploying scripts...
  Scripts will be deployed at /home/paolini/DIRAC/scripts
  Inspecting DIRAC module
  Inspecting COMDIRAC module
2016-11-03 10:32:57 UTC dirac-install [NOTICE]  Installing client externals...
2016-11-03 10:32:58 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/Externals-client-v6r3p2-Linux_x86_64_glibc-2.12-python27.tar.gz
2016-11-03 10:32:59 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/Externals-client-v6r3p2-Linux_x86_64_glibc-2.12-python27.md5
2016-11-03 10:33:03 UTC dirac-install [NOTICE]  Fixing externals paths...
2016-11-03 10:33:04 UTC dirac-install [NOTICE]  Running externals post install...
2016-11-03 10:33:04 UTC dirac-install [NOTICE]  Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/../lcgBundles/DIRAC-lcg-2015-07-09-Linux_x86_64_glibc-2.12-python27.tar.gz
2016-11-03 10:33:28 UTC dirac-install [NOTICE]  Executing /home/paolini/DIRAC/scripts/dirac-fix-mysql-script...                                                                        
2016-11-03 10:33:35 UTC dirac-install [NOTICE]  Creating /home/paolini/DIRAC/bashrc
2016-11-03 10:33:35 UTC dirac-install [NOTICE]  Creating /home/paolini/DIRAC/cshrc
2016-11-03 10:33:36 UTC dirac-install [NOTICE]  Defaults written to defaults-egi.cfg
2016-11-03 10:33:36 UTC dirac-install [NOTICE]  Executing /home/paolini/DIRAC/scripts/dirac-externals-requirements...
2016-11-03 10:33:38 UTC dirac-install [NOTICE]  egi properly installed
 
[paolini@test13 DIRAC]$ ls -ltr
total 100
-rwxrwxr-x  1 paolini paolini 53970 Aug 28  2012 dirac-install
-rw-r--r--  1 paolini paolini   722 Jul  9  2015 version-2015-07-09.txt
drwxr-xr-x 10 paolini paolini  4096 Jul  9  2015 Linux_x86_64_glibc-2.12
drwxr-xr-x  3 paolini paolini  4096 Oct 29 22:41 COMDIRAC
drwxr-xr-x 15 paolini paolini  4096 Nov  3 11:33 DIRAC
-rw-rw-r--  1 paolini paolini   918 Nov  3 11:33 cshrc
-rw-rw-r--  1 paolini paolini  1111 Nov  3 11:33 bashrc
drwxrwxr-x  2 paolini paolini 12288 Nov  3 11:33 scripts
-rw-rw-r--  1 paolini paolini   296 Nov  3 11:33 defaults-egi.cfg
  • Once the client software is installed, it should be configured in order to access the DIRAC4EGI service:
$ source bashrc

$ dirac-configure defaults-egi.cfg 
Executing: /home/paolini/DIRAC/DIRAC/Core/scripts/dirac-configure.py defaults-egi.cfg  
Checking DIRAC installation at "/home/paolini/DIRAC" 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vo.formation.idgrilles.fr/cclcgvomsli01.in2p3.fr.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vo.formation.idgrilles.fr 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eli-beams.eu/voms1.egee.cesnet.cz.lsc 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eli-beams.eu/voms2.grid.cesnet.cz.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eli-beams.eu 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vlemed/voms.grid.sara.nl.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vlemed 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/hungrid/grid11.kfki.hu.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/hungrid 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eng.vo.ibergrid.eu/voms01.ncg.ingrid.pt.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eng.vo.ibergrid.eu 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/compchem/voms-01.pd.infn.it.lsc 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/compchem/voms.cnaf.infn.it.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/compchem 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/enmr.eu/voms-02.pd.infn.it.lsc 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/enmr.eu/voms2.cnaf.infn.it.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/enmr.eu 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eiscat.se/voms1.grid.cesnet.cz.lsc 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eiscat.se/voms2.grid.cesnet.cz.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eiscat.se 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/training.egi.eu/voms1.egee.cesnet.cz.lsc 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/training.egi.eu/voms2.grid.cesnet.cz.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/training.egi.eu 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vo.plgrid.pl/voms.cyf-kr.edu.pl.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vo.plgrid.pl 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/fedcloud.egi.eu/voms1.grid.cesnet.cz.lsc 
Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/fedcloud.egi.eu/voms2.grid.cesnet.cz.lsc 
Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/fedcloud.egi.eu 
[paolini@test13 DIRAC]$ 


[paolini@test13 DIRAC]$ dirac-proxy-init
Generating proxy... 

Your certificate will expire in 2 days. Please renew it!
 
Enter Certificate password:
======================================================================
  Your certificate will expire in less than 2 days. Please renew it!  
====================================================================== 
Uploading proxy for compchem... 
Proxy generated: 
subject      : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=proxy
issuer       : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
identity     : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
timeleft     : 23:59:58
DIRAC group  : compchem
rfc          : False
path         : /tmp/x509up_u516
username     : apaolini
properties   : NormalUser, Pilot 

Proxies uploaded: 
 DN                                               | Group    | Until (GMT) 
 /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2016/11/05 15:00 
[paolini@test13 DIRAC]$ 


[paolini@test13 ~]$ dirac-wms-job-submit test.jdl 
JobID = 15929531
[paolini@test13 ~]$ 

[paolini@test13 ~]$ dirac-wms-job-delete 15929531
Deleted jobs 15929531
[paolini@test13 ~]$ 
[paolini@test13 ~]$ 
[paolini@test13 ~]$ dirac-proxy-init
Generating proxy... 
Enter Certificate password:
Uploading proxy for compchem... 
Proxy generated: 
subject      : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=proxy
issuer       : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
identity     : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
timeleft     : 23:59:58
DIRAC group  : compchem
rfc          : False
path         : /tmp/x509up_u516
username     : apaolini
properties   : NormalUser, Pilot 

Proxies uploaded: 
 DN                                               | Group    | Until (GMT) 
 /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2017/11/01 16:17 
[paolini@test13 ~]$ 
[paolini@test13 ~]$ dirac-wms-job-submit test.jdl 
JobID = 15929532
[paolini@test13 ~]$ 
[paolini@test13 ~]$ dirac-wms-job-status 15929532
JobID=15929532 Status=Waiting; MinorStatus=Pilot Agent Submission; Site=ANY;
[paolini@test13 ~]$

[paolini@test13 ~]$ dirac-wms-job-status 15929532
JobID=15929532 Status=Done; MinorStatus=Execution Complete; Site=EGI.BARI.it;

[paolini@test13 ~]$ dirac-wms-job-get-output 15929532
Job output sandbox retrieved in /home/paolini/15929532/
Retrieved from "https://wiki.egi.eu/w/index.php?title=HOWTO22&oldid=97246"