Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "NGI CZ:DIRAC for Auger"

From EGIWiki
Jump to navigation Jump to search
 
(12 intermediate revisions by the same user not shown)
Line 1: Line 1:
= DIRAC for Auger =
= DIRAC for Auger =
We have chosen [http://diracgrid.org/ DIRAC interware] as a base underlying software for distributed computing.
We have chosen [http://diracgrid.org/ DIRAC interware] as a base underlying software for distributed computing.
The generic DIRAC documentation for users is available on [http://dirac.readthedocs.io/en/latest/ readthedocs].


== Client Installation ==
== Client Installation ==
Users can install DIRAC client on their local computer. First, they must be registered on the DIRAC portal.
Users can install DIRAC client on their local computer. First, they must be registered on the DIRAC portal.
Contact me (chudoba@fzu.cz) if you want to be registered.
Since April 2018 users are automatically propagated to DIRAC server from the VOMS server.  
Instructions for client installation are on [http://dirac.readthedocs.io/en/rel-v6r15/UserGuide/GettingStarted/InstallingClient/index.html DIRAC web site]
Instructions for client installation are on [http://dirac.readthedocs.io/en/rel-v6r15/UserGuide/GettingStarted/InstallingClient/index.html DIRAC web site]


Line 34: Line 35:
Another possibility suitable mostly for test job submission, job monitoring and accounting is to connect to the [https://dirac.in2p3.fr/ France Grille DIRAC web server].
Another possibility suitable mostly for test job submission, job monitoring and accounting is to connect to the [https://dirac.in2p3.fr/ France Grille DIRAC web server].


Command line interface is also available on ui1.grid.cesnet.cz. Example of a session:
Command line interface is also available on ui1.grid.cesnet.cz. An example how to start a session:
<pre>
<pre>
# initialisation
# initialisation
source /home/chudoba/dirac/bashrc
source /home/chudoba/dirac/bashrc
dirac-proxy-init -g auger_user -M  
dirac-proxy-init -g auger_user -M  
</pre>
Users with a local account on Golias farm at FZU can also use UIs there. An example how to start a session from ui.farm.particle.cz:
<pre>
# initialisation
source /home/chudoba/dirac/bashrc
dirac-proxy-init -g auger_user -M
</pre>
''Under preparation:''<br>
Users on servers with SL6 (and compatible OS's) can also install CVMFS and use DIRAC client available on CVMFS:
<pre>
source /cvmfs/dirac.egi.eu/dirac/bashrc_gridfr
</pre>
(There is no specific version for auger, but settings for auger and gridfr are the same.)<br>
The /cvmfs installation does not work yet because VOMS servers in /cvmfs/grid.cern.ch/etc/grid-security/vomses
were not yet updated.
== Client update ==
If you have installed the dirac client in past and there is a new recommended version for the VO auger, do:
<pre>
cd /path/to/your/local/client/installation
source bashrc
dirac-install -V auger
</pre>
If you want a specific version (for example v6r19p20), do:
<pre>
cd /path/to/your/local/client/installation
source bashrc
dirac-install -V auger -r v6r19p20
</pre>
== Web interface ==
Web interface is via [https://dirac.france-grilles.fr/DIRAC/ France Grille server]


== Basic Examples ==
== Basic Examples ==
Initialize the environment and certificate proxy. Then:
<pre>
# job submission
# job submission
dirac-wms-job-submit auger_basic_test_cesnet.jdl  
dirac-wms-job-submit auger_basic_test_cesnet.jdl  
Line 71: Line 111:


=== User registration ===
=== User registration ===
Since April 2018 users are automatically propagated to DIRAC server from the VOMS server. The nickname field
in the VOMS is used for user names. There were several cases when a user has more than one certificate registered in Perun. This creates two or more "users" in the VOMS server with the same nickname. The export
procedure to DIRAC server can map correctly these multiple entries to a single user according the nickname. However we encourage users to remove obsolete certificates from Perun.
=== Client Installation ===
The ''auger'' installation name is an alias for ''gridfr''. So, when a default version for ''gridfr'' is changed, the
version for ''auger'' is also changed.
''Obsolete since April 2018:''
Each user must be added (registered) to the DIRAC portal. The command must be issued by user with dirac_admin role.
Each user must be added (registered) to the DIRAC portal. The command must be issued by user with dirac_admin role.
Example:
Example:
Line 79: Line 131:
dirac-admin-add-user -N grubio -D /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio -M grubio@ugr.es -G auger_user
dirac-admin-add-user -N grubio -D /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio -M grubio@ugr.es -G auger_user
</pre>
</pre>
Other possibility is to use the web interface: Applications, Registry Manager, Users. One must have a role dirac_admin. Do not forget to add the
new user to the group auger_user (separate step).
Note: the long version of options for user registration did not work (16 march 2015):
Note: the long version of options for user registration did not work (16 march 2015):
<pre>
<pre>
dirac-admin-add-user --UserName grubio --UserDN /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio --UserMail grubio@ugr.es --UserGroup auger_user
dirac-admin-add-user --UserName grubio --UserDN /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio --UserMail grubio@ugr.es --UserGroup auger_user
</pre>
</pre>

Latest revision as of 16:50, 24 April 2018

DIRAC for Auger

We have chosen DIRAC interware as a base underlying software for distributed computing. The generic DIRAC documentation for users is available on readthedocs.

Client Installation

Users can install DIRAC client on their local computer. First, they must be registered on the DIRAC portal. Since April 2018 users are automatically propagated to DIRAC server from the VOMS server. Instructions for client installation are on DIRAC web site

The VO auger specific installation instructions: Create or choose a directory where you want to install the DIRAC software and set it as the current working directory (e.g. mkdir ~/dirac; cd dirac). Download it, change permissions and run it with teh strinng "auger" as a parameter:

wget -np -O dirac-install https://github.com/DIRACGrid/DIRAC/raw/integration/Core/scripts/dirac-install.py --no-check-certificate
chmod +x dirac-install
./dirac-install -V auger
source bashrc

The next step is to configure the client. You need a valid X509 certificate in a standard place (~/.globus directory)

dirac-proxy-init -x
dirac-configure defaults-auger.cfg

Now you can initialize your proxy with auger group and test it:

dirac-proxy-init -g auger_user -M 
dls /

You should get:

/:
auger

Another possibility suitable mostly for test job submission, job monitoring and accounting is to connect to the France Grille DIRAC web server.

Command line interface is also available on ui1.grid.cesnet.cz. An example how to start a session:

# initialisation
source /home/chudoba/dirac/bashrc
dirac-proxy-init -g auger_user -M 

Users with a local account on Golias farm at FZU can also use UIs there. An example how to start a session from ui.farm.particle.cz:

# initialisation
source /home/chudoba/dirac/bashrc
dirac-proxy-init -g auger_user -M 

Under preparation:
Users on servers with SL6 (and compatible OS's) can also install CVMFS and use DIRAC client available on CVMFS:

source /cvmfs/dirac.egi.eu/dirac/bashrc_gridfr

(There is no specific version for auger, but settings for auger and gridfr are the same.)
The /cvmfs installation does not work yet because VOMS servers in /cvmfs/grid.cern.ch/etc/grid-security/vomses were not yet updated.

Client update

If you have installed the dirac client in past and there is a new recommended version for the VO auger, do:

cd /path/to/your/local/client/installation
source bashrc
dirac-install -V auger

If you want a specific version (for example v6r19p20), do:

cd /path/to/your/local/client/installation
source bashrc
dirac-install -V auger -r v6r19p20


Web interface

Web interface is via France Grille server

Basic Examples

Initialize the environment and certificate proxy. Then:

# job submission
dirac-wms-job-submit auger_basic_test_cesnet.jdl 
JobID = 29086015

# job status query
dirac-wms-job-status 29086015
JobID=29086015 Status=Done; MinorStatus=Execution Complete; Site=LCG.CESNET.cz;

# output download
dirac-wms-job-get-output -D out 29086015

The JDL file is simillar to gLite JDL files. Only syntax to specify a concrete site via requirements is different. An example for the CESNET site

[chudoba@ui1 dirac]$ cat auger_basic_test_cesnet.jdl
Executable = "/bin/sh";
StdOutput = "auger_basic_test.out";
StdError = "auger_basic_test.err";
InputSandbox = {"auger_basic_test.sh"};
OutputSandbox = {"auger_basic_test.err","auger_basic_test.out"};
RetryCount = 3;
VirtualOrganisation = "auger";
Arguments = "auger_basic_test.sh 1";

Site = {LCG.CESNET.cz};

For DIRAC Admins

User registration

Since April 2018 users are automatically propagated to DIRAC server from the VOMS server. The nickname field in the VOMS is used for user names. There were several cases when a user has more than one certificate registered in Perun. This creates two or more "users" in the VOMS server with the same nickname. The export procedure to DIRAC server can map correctly these multiple entries to a single user according the nickname. However we encourage users to remove obsolete certificates from Perun.


Client Installation

The auger installation name is an alias for gridfr. So, when a default version for gridfr is changed, the version for auger is also changed.


Obsolete since April 2018:

Each user must be added (registered) to the DIRAC portal. The command must be issued by user with dirac_admin role. Example:

# get dirac admin role
dirac-proxy-init -g dirac_admin -M
# add a user
dirac-admin-add-user -N grubio -D /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio -M grubio@ugr.es -G auger_user

Other possibility is to use the web interface: Applications, Registry Manager, Users. One must have a role dirac_admin. Do not forget to add the new user to the group auger_user (separate step).

Note: the long version of options for user registration did not work (16 march 2015):

dirac-admin-add-user --UserName grubio --UserDN /DC=es/DC=irisgrid/O=ugr/CN=gines.rubio --UserMail grubio@ugr.es --UserGroup auger_user