Difference between revisions of "NGI CZ:DIRAC for Auger"
(8 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
= DIRAC for Auger = | = DIRAC for Auger = | ||
We have chosen [http://diracgrid.org/ DIRAC interware] as a base underlying software for distributed computing. | We have chosen [http://diracgrid.org/ DIRAC interware] as a base underlying software for distributed computing. | ||
The generic DIRAC documentation for users is available on [http://dirac.readthedocs.io/en/latest/ readthedocs]. | |||
== Client Installation == | == Client Installation == | ||
Users can install DIRAC client on their local computer. First, they must be registered on the DIRAC portal. | Users can install DIRAC client on their local computer. First, they must be registered on the DIRAC portal. | ||
Since April 2018 users are automatically propagated to DIRAC server from the VOMS server. | |||
Instructions for client installation are on [http://dirac.readthedocs.io/en/rel-v6r15/UserGuide/GettingStarted/InstallingClient/index.html DIRAC web site] | Instructions for client installation are on [http://dirac.readthedocs.io/en/rel-v6r15/UserGuide/GettingStarted/InstallingClient/index.html DIRAC web site] | ||
Line 34: | Line 35: | ||
Another possibility suitable mostly for test job submission, job monitoring and accounting is to connect to the [https://dirac.in2p3.fr/ France Grille DIRAC web server]. | Another possibility suitable mostly for test job submission, job monitoring and accounting is to connect to the [https://dirac.in2p3.fr/ France Grille DIRAC web server]. | ||
Command line interface is also available on ui1.grid.cesnet.cz. | Command line interface is also available on ui1.grid.cesnet.cz. An example how to start a session: | ||
<pre> | <pre> | ||
# initialisation | # initialisation | ||
Line 40: | Line 41: | ||
dirac-proxy-init -g auger_user -M | dirac-proxy-init -g auger_user -M | ||
</pre> | </pre> | ||
Users with a local account on Golias farm at FZU can also use UIs there. An example how to start a session from ui.farm.particle.cz: | |||
<pre> | |||
# initialisation | |||
source /home/chudoba/dirac/bashrc | |||
dirac-proxy-init -g auger_user -M | |||
</pre> | |||
''Under preparation:''<br> | |||
Users on servers with SL6 (and compatible OS's) can also install CVMFS and use DIRAC client available on CVMFS: | |||
<pre> | |||
source /cvmfs/dirac.egi.eu/dirac/bashrc_gridfr | |||
</pre> | |||
(There is no specific version for auger, but settings for auger and gridfr are the same.)<br> | |||
The /cvmfs installation does not work yet because VOMS servers in /cvmfs/grid.cern.ch/etc/grid-security/vomses | |||
were not yet updated. | |||
== Client update == | |||
If you have installed the dirac client in past and there is a new recommended version for the VO auger, do: | |||
<pre> | |||
cd /path/to/your/local/client/installation | |||
source bashrc | |||
dirac-install -V auger | |||
</pre> | |||
If you want a specific version (for example v6r19p20), do: | |||
<pre> | |||
cd /path/to/your/local/client/installation | |||
source bashrc | |||
dirac-install -V auger -r v6r19p20 | |||
</pre> | |||
== Web interface == | |||
Web interface is via [https://dirac.france-grilles.fr/DIRAC/ France Grille server] | |||
== Basic Examples == | == Basic Examples == | ||
Initialize the environment and certificate proxy. Then: | Initialize the environment and certificate proxy. Then: | ||
Line 78: | Line 116: | ||
Obsolete since April 2018: | === Client Installation === | ||
The ''auger'' installation name is an alias for ''gridfr''. So, when a default version for ''gridfr'' is changed, the | |||
version for ''auger'' is also changed. | |||
''Obsolete since April 2018:'' | |||
Each user must be added (registered) to the DIRAC portal. The command must be issued by user with dirac_admin role. | Each user must be added (registered) to the DIRAC portal. The command must be issued by user with dirac_admin role. | ||
Example: | Example: |
Latest revision as of 17:50, 24 April 2018
DIRAC for Auger
We have chosen DIRAC interware as a base underlying software for distributed computing. The generic DIRAC documentation for users is available on readthedocs.
Client Installation
Users can install DIRAC client on their local computer. First, they must be registered on the DIRAC portal. Since April 2018 users are automatically propagated to DIRAC server from the VOMS server. Instructions for client installation are on DIRAC web site
The VO auger specific installation instructions: Create or choose a directory where you want to install the DIRAC software and set it as the current working directory (e.g. mkdir ~/dirac; cd dirac). Download it, change permissions and run it with teh strinng "auger" as a parameter:
wget -np -O dirac-install https://github.com/DIRACGrid/DIRAC/raw/integration/Core/scripts/dirac-install.py --no-check-certificate chmod +x dirac-install ./dirac-install -V auger source bashrc
The next step is to configure the client. You need a valid X509 certificate in a standard place (~/.globus directory)
dirac-proxy-init -x dirac-configure defaults-auger.cfg
Now you can initialize your proxy with auger group and test it:
dirac-proxy-init -g auger_user -M dls /
You should get:
/: auger
Another possibility suitable mostly for test job submission, job monitoring and accounting is to connect to the France Grille DIRAC web server.
Command line interface is also available on ui1.grid.cesnet.cz. An example how to start a session:
# initialisation source /home/chudoba/dirac/bashrc dirac-proxy-init -g auger_user -M
Users with a local account on Golias farm at FZU can also use UIs there. An example how to start a session from ui.farm.particle.cz:
# initialisation source /home/chudoba/dirac/bashrc dirac-proxy-init -g auger_user -M
Under preparation:
Users on servers with SL6 (and compatible OS's) can also install CVMFS and use DIRAC client available on CVMFS:
source /cvmfs/dirac.egi.eu/dirac/bashrc_gridfr
(There is no specific version for auger, but settings for auger and gridfr are the same.)
The /cvmfs installation does not work yet because VOMS servers in /cvmfs/grid.cern.ch/etc/grid-security/vomses
were not yet updated.
Client update
If you have installed the dirac client in past and there is a new recommended version for the VO auger, do:
cd /path/to/your/local/client/installation source bashrc dirac-install -V auger
If you want a specific version (for example v6r19p20), do:
cd /path/to/your/local/client/installation source bashrc dirac-install -V auger -r v6r19p20
Web interface
Web interface is via France Grille server
Basic Examples
Initialize the environment and certificate proxy. Then:
# job submission dirac-wms-job-submit auger_basic_test_cesnet.jdl JobID = 29086015 # job status query dirac-wms-job-status 29086015 JobID=29086015 Status=Done; MinorStatus=Execution Complete; Site=LCG.CESNET.cz; # output download dirac-wms-job-get-output -D out 29086015
The JDL file is simillar to gLite JDL files. Only syntax to specify a concrete site via requirements is different. An example for the CESNET site
[chudoba@ui1 dirac]$ cat auger_basic_test_cesnet.jdl Executable = "/bin/sh"; StdOutput = "auger_basic_test.out"; StdError = "auger_basic_test.err"; InputSandbox = {"auger_basic_test.sh"}; OutputSandbox = {"auger_basic_test.err","auger_basic_test.out"}; RetryCount = 3; VirtualOrganisation = "auger"; Arguments = "auger_basic_test.sh 1"; Site = {LCG.CESNET.cz};
For DIRAC Admins
User registration
Since April 2018 users are automatically propagated to DIRAC server from the VOMS server. The nickname field in the VOMS is used for user names. There were several cases when a user has more than one certificate registered in Perun. This creates two or more "users" in the VOMS server with the same nickname. The export procedure to DIRAC server can map correctly these multiple entries to a single user according the nickname. However we encourage users to remove obsolete certificates from Perun.
Client Installation
The auger installation name is an alias for gridfr. So, when a default version for gridfr is changed, the version for auger is also changed.
Obsolete since April 2018:
Each user must be added (registered) to the DIRAC portal. The command must be issued by user with dirac_admin role. Example:
# get dirac admin role dirac-proxy-init -g dirac_admin -M # add a user dirac-admin-add-user -N grubio -D /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio -M grubio@ugr.es -G auger_user
Other possibility is to use the web interface: Applications, Registry Manager, Users. One must have a role dirac_admin. Do not forget to add the new user to the group auger_user (separate step).
Note: the long version of options for user registration did not work (16 march 2015):
dirac-admin-add-user --UserName grubio --UserDN /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio --UserMail grubio@ugr.es --UserGroup auger_user