GPGPU-WG KnowledgeBase Batch Schedulers LSF
|Main||EGI.eu operations services||Support||Documentation||Tools||Activities||Performance||Technology||Catch-all Services||Resource Allocation||Security|
LSF version 8.0.1 has some limited support for GPUS, via the esub plugin mechanism. The GPU support is supposed to be improved in LSF 9, but this has not been tested yet.
The plugin is capable of setting CUDA_VISIBLE_DEVICES for GPUs allocated to a job by using LSF application profiles, which have to be specified on the command line, with a profile each for how many GPUs were required. However testing discovered some limitations - the environment variable is identical across all ranks of the MPI jobs, even when running on different hosts with different GPUs in use. And this has no effect on OpenCL binaries.