Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-DRIHM:Collaboration"

From EGIWiki
Jump to navigation Jump to search
Line 13: Line 13:
{{TOC_right}}  
{{TOC_right}}  


== Goals ==
== Goal ==


The goal of the collaboration is to setup a web based science gateway for the hydrometeorogycal community to enable them running pre-defined simulation workflows useing resources from the European Grid Infrastructure. To achieve this goal the collaboration has to integrate varioushydrometeorological models with EGI, setup of a science gateway, develop workflows in the science gateway, develop unique interfaces for the workflows to simpify their use by scientists.  
The goal of the collaboration is to setup a web based science gateway for the hydrometeorogycal community to enable them running pre-defined simulation workflows useing resources from the European Grid Infrastructure. To achieve this goal the collaboration has to integrate varioushydrometeorological models with EGI, setup of a science gateway, develop workflows in the science gateway, develop unique interfaces for the workflows to simpify their use by scientists.  


Additional details:
Details - the approach:
* Demonstration at the 2nd DRIHM EC project review (Date: End of October)
* Demonstre the system at the 2nd DRIHM EC project review (Date: End of October)
* Demo goal 1: demonstrate that hydrometeorology models can run on EGI
* Demo goal 1: demonstrate that hydrometeorology models can run on EGI
* Demo goal 2: demonstrate that data transfer between models works in workflow/pipleline
* Demo goal 2: demonstrate that data transfer between models works in workflow/pipleline

Revision as of 18:23, 20 July 2013

Welcome to the page of the EGI-DRIHM collaboration

EGI DRIHAM collaboration menu: Home Members Infrastructure Roadmap



Goal

The goal of the collaboration is to setup a web based science gateway for the hydrometeorogycal community to enable them running pre-defined simulation workflows useing resources from the European Grid Infrastructure. To achieve this goal the collaboration has to integrate varioushydrometeorological models with EGI, setup of a science gateway, develop workflows in the science gateway, develop unique interfaces for the workflows to simpify their use by scientists.

Details - the approach:

  • Demonstre the system at the 2nd DRIHM EC project review (Date: End of October)
  • Demo goal 1: demonstrate that hydrometeorology models can run on EGI
  • Demo goal 2: demonstrate that data transfer between models works in workflow/pipleline
  • Demo goal 3: demonstrate the workflows can be hidden behind unique interfaces, simplifying access for scientists
  • Workflow 1: WRF-NMM --> RainFARM --> DRIFT
  • Workflow 2: WRF-NMM --> RainFARM --> RIBS
  • Task 1: Integration of four models with EGI,
  • Task 2: setup of a science gateway and integrate with the ‘DRIHM Repository’
  • Task 3: development of workflows
  • Task 4: development of unique interfaces for the workflows

Background information: DRIHM project

  • DRIHM aims for facilitating the access to hydrometeorological data and models, the collaboration between meteorologists, hydrologists, and Earth science experts for accelerated scientific advances in hydrometeorological research (HMR).
  • Leader: Antonio Parodi (antonio.parodi @ cimafoundation.org)

EGI-DRIHM collaboration

  • Coordinator: Gergely Sipos, Technical Outreach Manager, EGI.eu (gergely.sipos@egi.eu)
  • Start Date: 17. May 2013
  • End Date: First phase to end by the 2nd DRIHM EC review (end of October)
  • Mailinglist: egi-drihm @ mailman.egi.eu
  • Meetings: Indico page (slides and minutes from meetings)

Requirements

DRIHM meteorological models is based on WRF (Weather Research and Forecasting). WRF is a community model with open source license.

WRF requirements for EGI sites:

  • MPICH or MPICH2 or OPENMPI
  • 160-240 processors, but the simulations can be designed also to run on 50-100 processors
  • about 24 hours of physical simulation time, to an elapsed time of a single run of 144--96 hours (6--4 days).
  • Temporary disk space (GB): 80 GB for input, output, which corresponds to 24 h physical time, saving the data every 30 minutes of physical time. 28 GB for restart files, saving files every 6 hours of physical time.
  • submission is through the DRIHM portal, based on SCI-BUS (http://www.sci-bus.eu/)

Virtual organization

  • DRIHM VO is in production
  • ID Card: https://operations-portal.egi.eu/vo/update/283
  • vousers at drihm.eu: Write to all VO users
  • vousersupport at drihm.eu: Write to the VO support
  • vosecurity at drihm.eu: Write to security representatives of the VO
  • vomanagers at drihm.eu: Write to VO managers

VOMS

Primary/master instance

  • Hosted in Italy by Italian NGI at CNAF (in Bologna)
  • Host name: vomsmania.cnaf.infn.it
  • HTTPS port: 8443
  • VOMSES port: 15005

Secondary/slave instance

  • Hosted in Italy by Italian NGI in Naples
  • Host name: vomsIGI-NA.unina.it
  • HTTPS port: 8443
  • VOMSES port: 15005

Progress