Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Parallel Computing Support User Guide"

From EGIWiki
Jump to navigation Jump to search
Line 17: Line 17:


JobType      = "Normal";
JobType      = "Normal";
CPUNumber    = 4;
CPUNumber    = 4;
Executable    = "starter.sh";
Executable    = "starter.sh";
Arguments    = "OPENMPI hello_bin hello";
Arguments    = "OPENMPI hello_bin hello";
InputSandbox  = {"starter.sh", "hello_bin"};
InputSandbox  = {"starter.sh", "hello_bin"};
OutputSandbox = {"std.out", "std.err"};
OutputSandbox = {"std.out", "std.err"};
StdOutput    = "std.out";
StdOutput    = "std.out";
StdError      = "std.err";
StdError      = "std.err";
Requirements  = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment) && member("OPENMPI", other.GlueHostApplicationSoftwareRunTimeEnvironment);
Requirements  = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment) && member("OPENMPI", other.GlueHostApplicationSoftwareRunTimeEnvironment);



Revision as of 16:21, 1 March 2012

Summary

This page discusses support for generic parallel computing jobs on the EGI infrastructure. We consider using the MPI-START framework as a means for launching multiple jobs on a cluster. The are several clearly apparent application areas:

* Hadoop-On-Demand/myHadoop
* Charm++
* Parallel R

This is a work in progress.

JDL requirements

As we are using the MPI-START framework, the format of the JDL is the same as for an MPI job JobType = "Normal"; CPUNumber = 4; Executable = "starter.sh"; Arguments = "OPENMPI hello_bin hello"; InputSandbox = {"starter.sh", "hello_bin"}; OutputSandbox = {"std.out", "std.err"}; StdOutput = "std.out"; StdError = "std.err"; Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment) && member("OPENMPI", other.GlueHostApplicationSoftwareRunTimeEnvironment);

Using MPI-START and mpiexec to perform non mpi workloads