|
|
| (71 intermediate revisions by 4 users not shown) |
| Line 1: |
Line 1: |
| {{Template:Op menubar}} {{Template:Doc_menubar}} {{TOC_right}} | | {{Template:Op menubar}} {{Template:Doc_menubar}} {{TOC_right}} |
| | | [[Category:Operations_Manuals]] |
| {{Ops_procedures
| | {{DeprecatedAndMovedTo|new_location=https://docs.egi.eu/users/workload-manager/}} |
| |Doc_title = Usage comparison betwwen DIRAC and WMS
| |
| |Doc_link = [[MAN13|https://wiki.egi.eu/wiki/MAN13]]
| |
| |Version = Oct 2017 | |
| |Policy_acronym =
| |
| |Policy_name =
| |
| |Contact_group =
| |
| |Doc_status = DRAFT
| |
| |Approval_date =
| |
| |Procedure_statement =
| |
| }}
| |
| | |
| = DIRAC client installation =
| |
| | |
| The generic installation and configuration of the client is shown in the [http://dirac.readthedocs.io/en/latest/UserGuide/GettingStarted/InstallingClient/index.html DIRAC official documentation]. We are reporting here the client installation using the EGI default configuration.
| |
| | |
| *Download the DIRAC installation script:
| |
| | |
| | |
| $ mkdir DIRAC
| |
| $ cd DIRAC/
| |
|
| |
| $ wget -np -O dirac-install http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/dirac-install --no-check-certificate
| |
| --2016-11-03 11:27:27-- http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/dirac-install
| |
| Resolving lhcbproject.web.cern.ch... 188.184.65.125, 188.184.67.62
| |
| Connecting to lhcbproject.web.cern.ch|188.184.65.125|:80... connected.
| |
| HTTP request sent, awaiting response... 200 OK
| |
| Length: 53970 (53K) [text/plain]
| |
| Saving to: âdirac-installâ
| |
|
| |
| 100%[================================================================================================================================================================================>] 53,970 --.-K/s in 0.08s
| |
|
| |
| 2016-11-03 11:27:28 (675 KB/s) - âdirac-installâsaved [53970/53970]
| |
|
| |
| [paolini@test13 DIRAC]$ chmod +x dirac-install
| |
|
| |
| [paolini@test13 DIRAC]$ ./dirac-install -V egi
| |
| 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Processing installation requirements
| |
| 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Destination path for installation is /home/paolini/DIRAC
| |
| 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Discovering modules to install
| |
| 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Installing modules...
| |
| 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Installing COMDIRAC:v0r12
| |
| 2016-11-03 10:32:55 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/COMDIRAC-v0r12.tar.gz
| |
| 2016-11-03 10:32:56 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/COMDIRAC-v0r12.md5
| |
| 2016-11-03 10:32:56 UTC dirac-install [NOTICE] Installing DIRAC:v6r14p4
| |
| 2016-11-03 10:32:56 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/DIRAC-v6r14p4.tar.gz
| |
| 2016-11-03 10:32:57 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/DIRAC-v6r14p4.md5
| |
| 2016-11-03 10:32:57 UTC dirac-install [NOTICE] Deploying scripts...
| |
| Scripts will be deployed at /home/paolini/DIRAC/scripts
| |
| Inspecting DIRAC module
| |
| Inspecting COMDIRAC module
| |
| 2016-11-03 10:32:57 UTC dirac-install [NOTICE] Installing client externals...
| |
| 2016-11-03 10:32:58 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/Externals-client-v6r3p2-Linux_x86_64_glibc-2.12-python27.tar.gz
| |
| 2016-11-03 10:32:59 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/Externals-client-v6r3p2-Linux_x86_64_glibc-2.12-python27.md5
| |
| 2016-11-03 10:33:03 UTC dirac-install [NOTICE] Fixing externals paths...
| |
| 2016-11-03 10:33:04 UTC dirac-install [NOTICE] Running externals post install...
| |
| 2016-11-03 10:33:04 UTC dirac-install [NOTICE] Retrieving http://lhcbproject.web.cern.ch/lhcbproject/dist/Dirac_project/installSource/../lcgBundles/DIRAC-lcg-2015-07-09-Linux_x86_64_glibc-2.12-python27.tar.gz
| |
| 2016-11-03 10:33:28 UTC dirac-install [NOTICE] Executing /home/paolini/DIRAC/scripts/dirac-fix-mysql-script...
| |
| 2016-11-03 10:33:35 UTC dirac-install [NOTICE] Creating /home/paolini/DIRAC/bashrc
| |
| 2016-11-03 10:33:35 UTC dirac-install [NOTICE] Creating /home/paolini/DIRAC/cshrc
| |
| 2016-11-03 10:33:36 UTC dirac-install [NOTICE] Defaults written to defaults-egi.cfg
| |
| 2016-11-03 10:33:36 UTC dirac-install [NOTICE] Executing /home/paolini/DIRAC/scripts/dirac-externals-requirements...
| |
| 2016-11-03 10:33:38 UTC dirac-install [NOTICE] egi properly installed
| |
| [paolini@test13 DIRAC]$
| |
|
| |
|
| |
| [paolini@test13 DIRAC]$ ls -ltr
| |
| total 100
| |
| -rwxrwxr-x 1 paolini paolini 53970 Aug 28 2012 dirac-install
| |
| -rw-r--r-- 1 paolini paolini 722 Jul 9 2015 version-2015-07-09.txt
| |
| drwxr-xr-x 10 paolini paolini 4096 Jul 9 2015 Linux_x86_64_glibc-2.12
| |
| drwxr-xr-x 3 paolini paolini 4096 Oct 29 22:41 COMDIRAC
| |
| drwxr-xr-x 15 paolini paolini 4096 Nov 3 11:33 DIRAC
| |
| -rw-rw-r-- 1 paolini paolini 918 Nov 3 11:33 cshrc
| |
| -rw-rw-r-- 1 paolini paolini 1111 Nov 3 11:33 bashrc
| |
| drwxrwxr-x 2 paolini paolini 12288 Nov 3 11:33 scripts
| |
| -rw-rw-r-- 1 paolini paolini 296 Nov 3 11:33 defaults-egi.cfg
| |
|
| |
| [paolini@test13 DIRAC]$ source bashrc
| |
|
| |
| [paolini@test13 DIRAC]$ dirac-
| |
| Display all 169 possibilities? (y or n)
| |
| dirac-accounting-decode-fileid dirac-admin-request-summary dirac-dms-data-size dirac-install-component dirac-start-mysql
| |
| dirac-accounting-report-cli dirac-admin-reset-job dirac-dms-filecatalog-cli dirac-install-db dirac-status-component
| |
| dirac-admin-accounting-cli dirac-admin-select-requests dirac-dms-find-lfns dirac-install-mysql dirac-stop-component
| |
| dirac-admin-add-group dirac-admin-service-ports dirac-dms-ftsdb-summary dirac-install-web-portal dirac-stop-mysql
| |
| dirac-admin-add-host dirac-admin-set-site-protocols dirac-dms-fts-monitor dirac-jobexec dirac-sys-sendmail
| |
| dirac-admin-add-resources dirac-admin-show-task-queues dirac-dms-fts-submit dirac-monitoring-get-components-status dirac-transformation-archive
| |
| dirac-admin-add-shifter dirac-admin-site-info dirac-dms-get-file dirac-myproxy-upload dirac-transformation-clean
| |
| dirac-admin-add-site dirac-admin-site-mask-logging dirac-dms-lfn-accessURL dirac-platform dirac-transformation-cli
| |
| dirac-admin-add-user dirac-admin-sort-cs-sites dirac-dms-lfn-logging-info dirac-populate-component-db dirac-transformation-remove-output
| |
| dirac-admin-allow-se dirac-admin-sync-users-from-file dirac-dms-lfn-metadata dirac-proxy-get-uploaded-info dirac-transformation-verify-outputdata
| |
| dirac-admin-allow-site dirac-admin-sysadmin-cli dirac-dms-lfn-replicas dirac-proxy-info dirac-uninstall-component
| |
| dirac-admin-ban-se dirac-admin-user-quota dirac-dms-pfn-accessURL dirac-proxy-init dirac-utils-file-adler
| |
| dirac-admin-ban-site dirac-admin-users-with-proxy dirac-dms-pfn-metadata dirac-repo-monitor dirac-utils-file-md5
| |
| dirac-admin-bdii-info dirac-agent dirac-dms-put-and-register-request dirac-restart-component dirac-version
| |
| dirac-admin-ce-info dirac-bash dirac-dms-remove-catalog-files dirac-restart-mysql dirac-wms-cpu-normalization
| |
| dirac-admin-delete-user dirac-cert-convert.sh dirac-dms-remove-catalog-replicas dirac-rms-cancel-request dirac-wms-get-normalized-queue-length
| |
| dirac-admin-externals-versions dirac-compile-externals dirac-dms-remove-files dirac-rms-reqdb-summary dirac-wms-get-queue-cpu-time
| |
| dirac-admin-get-banned-sites dirac-config-ce dirac-dms-remove-replicas dirac-rms-reset-request dirac-wms-get-queue-normalization
| |
| dirac-admin-get-CAs dirac-configuration-cli dirac-dms-replica-metadata dirac-rms-show-request dirac-wms-job-attributes
| |
| dirac-admin-get-job-pilot-output dirac-configuration-dump-local-cache dirac-dms-replicate-and-register-request dirac-rss-list-status dirac-wms-job-delete
| |
| dirac-admin-get-job-pilots dirac-configuration-shell dirac-dms-replicate-lfn dirac-rss-query-db dirac-wms-job-get-input
| |
| dirac-admin-get-pilot-info dirac-configure dirac-dms-resolve-guid dirac-rss-query-dtcache dirac-wms-job-get-jdl
| |
| dirac-admin-get-pilot-logging-info dirac-create-distribution-tarball dirac-dms-set-replica-status dirac-rss-set-status dirac-wms-job-get-output
| |
| dirac-admin-get-pilot-output dirac-create-svn-branch dirac-dms-show-ftsjobs dirac-rss-set-token dirac-wms-job-get-output-data
| |
| dirac-admin-get-proxy dirac-create-svn-tag dirac-dms-show-se-status dirac-rss-sync dirac-wms-job-kill
| |
| dirac-admin-get-site-mask dirac-deploy-scripts dirac-dms-user-lfns dirac-service dirac-wms-job-logging-info
| |
| dirac-admin-get-site-protocols dirac-distribution dirac-dms-user-quota dirac-setup-site dirac-wms-job-parameters
| |
| dirac-admin-kill-pilot dirac-dms-add-file dirac-executor dirac-stager-monitor-file dirac-wms-job-peek
| |
| dirac-admin-list-hosts dirac-dms-add-files dirac-externals-requirements dirac-stager-monitor-jobs dirac-wms-job-reschedule
| |
| dirac-admin-list-users dirac-dms-catalog-metadata dirac-fix-ld-library-path dirac-stager-monitor-request dirac-wms-jobs-select-output-search
| |
| dirac-admin-modify-user dirac-dms-change-replica-status dirac-fix-mysql-script dirac-stager-monitor-requests dirac-wms-job-status
| |
| dirac-admin-pilot-summary dirac-dms-clean-directory dirac-framework-ping-service dirac-stager-show-stats dirac-wms-job-submit
| |
| dirac-admin-proxy-upload dirac-dms-create-removal-request dirac-info dirac-stager-stage-files dirac-wms-select-jobs
| |
| dirac-admin-reoptimize-jobs dirac-dms-create-replication-request dirac-install dirac-start-component
| |
| [paolini@test13 DIRAC]$ dirac-
| |
|
| |
|
| |
| [paolini@test13 DIRAC]$ dirac-proxy-init
| |
| Generating proxy...
| |
|
| |
| Your certificate will expire in 2 days. Please renew it!
| |
|
| |
| Enter Certificate password:
| |
| Bad passphrase
| |
| [paolini@test13 DIRAC]$ dirac-proxy-init
| |
| Generating proxy...
| |
|
| |
| Your certificate will expire in 2 days. Please renew it!
| |
|
| |
| Enter Certificate password:
| |
| DN /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini is not registered
| |
| [paolini@test13 DIRAC]$
| |
|
| |
| [paolini@test13 DIRAC]$ dirac-configure defaults-egi.cfg
| |
| Executing: /home/paolini/DIRAC/DIRAC/Core/scripts/dirac-configure.py defaults-egi.cfg
| |
| Checking DIRAC installation at "/home/paolini/DIRAC"
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vo.formation.idgrilles.fr/cclcgvomsli01.in2p3.fr.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vo.formation.idgrilles.fr
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eli-beams.eu/voms1.egee.cesnet.cz.lsc
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eli-beams.eu/voms2.grid.cesnet.cz.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eli-beams.eu
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vlemed/voms.grid.sara.nl.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vlemed
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/hungrid/grid11.kfki.hu.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/hungrid
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eng.vo.ibergrid.eu/voms01.ncg.ingrid.pt.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eng.vo.ibergrid.eu
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/compchem/voms-01.pd.infn.it.lsc
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/compchem/voms.cnaf.infn.it.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/compchem
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/enmr.eu/voms-02.pd.infn.it.lsc
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/enmr.eu/voms2.cnaf.infn.it.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/enmr.eu
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eiscat.se/voms1.grid.cesnet.cz.lsc
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/eiscat.se/voms2.grid.cesnet.cz.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/eiscat.se
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/training.egi.eu/voms1.egee.cesnet.cz.lsc
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/training.egi.eu/voms2.grid.cesnet.cz.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/training.egi.eu
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/vo.plgrid.pl/voms.cyf-kr.edu.pl.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/vo.plgrid.pl
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/fedcloud.egi.eu/voms1.grid.cesnet.cz.lsc
| |
| Created vomsdir file /home/paolini/DIRAC/etc/grid-security/vomsdir/fedcloud.egi.eu/voms2.grid.cesnet.cz.lsc
| |
| Created vomses file /home/paolini/DIRAC/etc/grid-security/vomses/fedcloud.egi.eu
| |
| [paolini@test13 DIRAC]$
| |
|
| |
|
| |
| [paolini@test13 DIRAC]$ dirac-proxy-init
| |
| Generating proxy...
| |
|
| |
| Your certificate will expire in 2 days. Please renew it!
| |
|
| |
| Enter Certificate password:
| |
| ======================================================================
| |
| Your certificate will expire in less than 2 days. Please renew it!
| |
| ======================================================================
| |
| Uploading proxy for compchem...
| |
| Proxy generated:
| |
| subject : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=proxy
| |
| issuer : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
| |
| identity : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
| |
| timeleft : 23:59:58
| |
| DIRAC group : compchem
| |
| rfc : False
| |
| path : /tmp/x509up_u516
| |
| username : apaolini
| |
| properties : NormalUser, Pilot
| |
|
| |
| Proxies uploaded:
| |
| DN | Group | Until (GMT)
| |
| /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2016/11/05 15:00
| |
| [paolini@test13 DIRAC]$
| |
|
| |
|
| |
| [paolini@test13 ~]$ dirac-wms-job-submit test.jdl
| |
| JobID = 15929531
| |
| [paolini@test13 ~]$
| |
|
| |
| [paolini@test13 ~]$ dirac-wms-job-delete 15929531
| |
| Deleted jobs 15929531
| |
| [paolini@test13 ~]$
| |
| [paolini@test13 ~]$
| |
| [paolini@test13 ~]$ dirac-proxy-init
| |
| Generating proxy...
| |
| Enter Certificate password:
| |
| Uploading proxy for compchem...
| |
| Proxy generated:
| |
| subject : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini/CN=proxy
| |
| issuer : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
| |
| identity : /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini
| |
| timeleft : 23:59:58
| |
| DIRAC group : compchem
| |
| rfc : False
| |
| path : /tmp/x509up_u516
| |
| username : apaolini
| |
| properties : NormalUser, Pilot
| |
|
| |
| Proxies uploaded:
| |
| DN | Group | Until (GMT)
| |
| /O=dutchgrid/O=users/O=egi/CN=Alessandro Paolini | compchem | 2017/11/01 16:17
| |
| [paolini@test13 ~]$
| |
| [paolini@test13 ~]$ dirac-wms-job-submit test.jdl
| |
| JobID = 15929532
| |
| [paolini@test13 ~]$
| |
| [paolini@test13 ~]$ dirac-wms-job-status 15929532
| |
| JobID=15929532 Status=Waiting; MinorStatus=Pilot Agent Submission; Site=ANY;
| |
| [paolini@test13 ~]$
| |
|
| |
| [paolini@test13 ~]$ dirac-wms-job-status 15929532
| |
| JobID=15929532 Status=Done; MinorStatus=Execution Complete; Site=EGI.BARI.it;
| |
|
| |
| [paolini@test13 ~]$ dirac-wms-job-get-output 15929532
| |
| Job output sandbox retrieved in /home/paolini/15929532/
| |
The wiki is deprecated and due to be decommissioned by the end of September 2022.