Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

EGI-Engage:WP4.3-D4Science

From EGIWiki
Jump to navigation Jump to search
EGI-Engage project: Main page WP1(NA1) WP3(JRA1) WP5(SA1) PMB Deliverables and Milestones Quality Plan Risk Plan Data Plan
Roles and
responsibilities
WP2(NA2) WP4(JRA2) WP6(SA2) AMB Software and services Metrics Project Office Procedures





Objective

Integration for gCube and the D4Science infrastructure (M1 - M12)
This activity will integrate D4Science resources at Engineering (commercial) and CNR (public) into the EGI Federated Clouds infrastructure. The gCube framework will be extended to use EGI Federated Cloud resources through implementing OCCI client capabilities.

Involved Partners

CNR - ISTI

Engineering

Roadmap

Two use cases were selected to start the integration:

  • running a gCube WN in FedCloud. The gCube worker node (the name of the gCube service is Executor) is the service where the D4Science computations are executed. The Executor can perform several types of job depending on the way the job is assigned to it. Among those different policies it is worth noticing the following ones: as a scheduler, it executes local code at regular intervals as specified in the job activation, similar to a cron command; as a worker node It fetches job from an ActiveMQ. This last case is the most demanding one, The job to be executed, the data to be processed and the configuration to be applied are all downloaded from the gCube storage via the persistent identifiers collected in the job description.
  • running a DataMiner in FedCloud. The gCube DataMiner is a service hosting a number of models. It adopts a plugin-based architecture where each model is implemented via a service plugin. New models can easily be added by simply deploying a new plugin in the service. The interface exposed is a WPS standard Interface.

These WNs/DataMiner would be deployed by human triggered action from the D4Science UI. Plan to use jOCCI to interact with resources.

Documentation