Difference between revisions of "Tools/Manuals/TS122"
(Created page with '{{TOC_right}} Category:FAQ ------ Back to Administration FAQ ------ = How to let jobs run in local scratch space on the WN = Today there…') |
|||
Line 1: | Line 1: | ||
{{Template:Op menubar}} | |||
{{Template:Doc_menubar}} | |||
[[Category:Operations Manuals]] | |||
{{TOC_right}} | {{TOC_right}} | ||
------ | ------ | ||
Back to [[Tools/Manuals/AdministrationFaq|Administration FAQ]] | Back to [[Tools/Manuals/AdministrationFaq|Administration FAQ]] |
Revision as of 13:38, 23 November 2012
Main | EGI.eu operations services | Support | Documentation | Tools | Activities | Performance | Technology | Catch-all Services | Resource Allocation | Security |
Documentation menu: | Home • | Manuals • | Procedures • | Training • | Other • | Contact ► | For: | VO managers • | Administrators |
Back to Administration FAQ
How to let jobs run in local scratch space on the WN
Today there is no commonly accepted environment variable to identify the scratch space for jobs to use on the WN. Therefore the site needs to ensure the job starts in the right place.
CREAM and WMS solution
For a CREAM CE and for jobs submitted to an LCG-CE via a gLite WMS the site admin can easily control the desired behavior by defining the GLITE_LOCAL_CUSTOMIZATION_DIR environment variable on the WN (e.g. in an extra script in /etc/profile.d) and creating the necessary scripts in the corresponding directory as explained here.
For example, the cp_1.sh script could contain something like this:
cd /scratch my_local_job_dir=`mktemp -d job-XXXXXXXX` if [ "X$my_local_job_dir" != X ] then cd "$my_local_job_dir" my_local_job_dir=`/bin/pwd` fi
And cp_3.sh then could contain this:
if [ "X$my_local_job_dir" != X ] then cd "$my_local_job_dir" && cd .. && /bin/rm -r "$my_local_job_dir" fi
However, beware that the job may get killed before it executes cp_3.sh, so the admin should also create a daily or hourly cron job that cleans up any stale job directories.
Torque solution
For Torque one can use its "tmpdir" feature instead and let Torque handle the whole thing, which then would cover all uses of the batch system, not just CREAM or WMS job submission:
But watch out for this problem in the 2.4 series:
http://comments.gmane.org/gmane.comp.clustering.torque.user/10384