|
|
| (21 intermediate revisions by 2 users not shown) |
| Line 1: |
Line 1: |
| == Single GPGPU per node ==
| | {{Template:Op menubar}} {{TOC_right}} |
| A simple batch setup that assumes a physical node and its componenent GPGPU card expose a single '''Job Slot''' would simplify Resource Centre setup. Each GPGPU node could be partitioned from the non-GPGPU nodes using an access-control-list. However, most modern physical nodes contain and expose multiple CPU-cores to the batch system. If the physical system supports '''Virtualisation''', a CPU-core could be allocated to the GPU on the phsical node, and a single virtual machine could expose the remainder of the job slots. For example: Assume the physical host (wn1) has 8-cores, we can configure the node to declare (in torque) "np=1" to the batch system. If we create a VM with "np=7", then all cores can be allocated to the batch system.
| | [[Category:Task_forces]] |
|
| |
|
| | '''[[GPGPU_Working_Group| << GPGPU Working Group main page]]''' |
|
| |
|
| === Options for RC ===
| | [[GPGPU-WG:GPGPU_Working_Group_KnowledgeBase | To Parent Page]] |
| * Define a queue with name tagged '''gpgpu'''
| |
| * Apply the usual VO restrictions on the queue
| |
| * Define an ACL that partitions these nodes from non-GPGPU nodes
| |
| * Publish basic SoftwareEnvironment (eg. CUDA, CUDA-5, CUDA-5.5)
| |
| * Ensure the WN environment is configured with all relevant GPGPU Software development kit installed.
| |
|
| |
|
| === JDL ===
| | * [[GPGPU-WG:GPGPU_Working_Group_KnowledgeBase:Batch_Schedulers:SchedulerScenarios:GPUOnlyQueue | GPGPU Queues assuming 1-core per GPGPU ]] |
| | | * [[GPGPU-WG:GPGPU_Working_Group_KnowledgeBase:Batch_Schedulers:SchedulerScenarios:MixedCPU_GPU_Queue | GPGPUs as a subset of queue resources]] |
| <nowiki>
| |
| [ | |
| Type="Job";
| |
| | |
| JobType="Normal";
| |
| Executable = "myScript.sh";
| |
| StdOutput = "std.out";
| |
| StdError = "std.err";
| |
| InputSandbox = {"myScript.sh"};
| |
| Requirements = ( RegExp("*gpgpu$", other.GlueCEUniqueID) && Member("CUDA", other.GlueHostApplicationSoftwareRunTimeEnvironment);
| |
| ]
| |
| </nowiki>
| |
| | |
| == Multiple GPGPUs per Physical Node ==
| |
| Similar to the Virtualisation example above, a physical node with '''N'''-gpgpu cards could be configured with:
| |
| | |
| ''np=#NUM_OF_GPGPUS''
| |
| | |
| A virtual machine could the remaining number of cores:
| |
| | |
| ''np=#NUM_OF_CORES-#NUM_OF_GPGPUS'' job slots
| |
| | |
| | |
| The drawback of this scheme is that we need to develop a scheme to ensure that jobs from distinct users cannot interfere with each other. User code could try to enumerate and use all the GPGPUs on the node. This will have (potentially job-catastrophic) unintended side-effects, so we need some mechanism to ensure that a user-job does not consume more than its allocation.
| |
The wiki is deprecated and due to be decommissioned by the end of September 2022.