Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-DRIHM:Collaboration"

From EGIWiki
Jump to navigation Jump to search
 
(42 intermediate revisions by 5 users not shown)
Line 10: Line 10:
|}
|}


<br> {{TOC_right}}  
{{EGI-DRIHM_menubar}}
{{TOC_right}}  


== <span class="toctext">General Project Information</span>  ==
== Administrative ==
 
*Coordinator: Gergely Sipos, Technical Outreach Manager, EGI.eu (gergely.sipos@egi.eu)
*Leader: Tiziana Ferrari (tiziana.ferrari @ egi.eu) <br>
*Start Date:&nbsp;17. May 2013  
*Start Date:&nbsp;17.05.2013  
*End Date: End of DRIHM project (31st March 2015)
*End Date: <br>
*Mailinglist: egi-drihm @ mailman.egi.eu
*Mailinglist: egi-drihm @ mailman.egi.eu
*Meetings: [https://indico.egi.eu/indico/categoryDisplay.py?categId=109 Indico page] (slides and minutes from meetings)
*Meetings: [https://indico.egi.eu/indico/categoryDisplay.py?categId=109 Indico page] (slides and minutes from meetings)
*Status of ongoing work is described at [http://www.drihm.eu/index.php/ict-status-roadmap DRIHM ICT Status page] (The page requires authentication. Email Christian Straube drihm@nm.ifi.lmu.de to request an account.)
* Read more about the resources that participate in the DRIHM VO in the Testbed section: [[EGI-DRIHM:Testbed]]


DRIHM aims for facilitating the access to hydrometeorological data and models, the collaboration between meteorologists, hydrologists, and Earth science experts for accelerated scientific advances in hydrometeorological research (HMR). A DRIHMS VO will be soon created.
=== Goal ===
 
== <span class="toctext">Requirements</span><br>  ==
The goal of the EGI-DRIHM collaboration is to facilitate the setup of a web based science gateway for the hydrometeorogy community to enable them running pre-defined simulation workflows on resources from European e-infrastructures, including EGI. To achieve this goal the collaboration has to integrate various hydrometeorology models with e-infrastructures, setup a science gateway, develop and integrated workflows in the science gateway and develop unique interfaces for workflow users.
DRIHM meteorological models is based on WRF (Weather Research and Forecasting). WRF is a community model with open source license.
 
WRF requirements for EGI sites:
 
*MPICH or  MPICH2 or OPENMPI
*WRF model can work both with Distributed-Memory Parallelism and Shared-Memory Parallelism, with different combinations of compilers (PGI, INTEL, gfortran/gcc and so forth). WRF should be provided with mpich or mpich2 and ifort, icc (or as alternative gfortran, gcc) to ensure the best scalability and portability performances for this modeling suite. Additional WRF dependencies for weather specific formats: NetCDF, GRIB2.
*160-240 processors, but the simulations can be designed also to run on 50-100 processors
*about 24 hours of physical simulation time, to an elapsed time of a single run of 144--96 hours (6--4 days).
*Temporary disk space (GB): 80 GB for input, output, which corresponds to 24 h physical time, saving the data every 30 minutes of physical time. 28 GB for restart files, saving files every 6 hours of physical time.
*submission is through the DRIHM portal, based on SCI-BUS (http://www.sci-bus.eu/)
 
== <span class="mw-headline" id="Members">Members  </span>  ==
 
'''EGI.eu'''<br>
 
*Tiziana Ferrari
*Gergely Sipos
*Malgorzata Krakowian
*Karolis Eigelis
 
'''DRIHM'''<br>
 
*Antonio Parodi
*Fabio Pintus
*Andrea Clematis
*Michael Schiffers
*Daniele D'Agostino
*Emanuele Danovaro
*Christian Straube
*Antonella Galizia
*Quarati Alfonso
*Nils Felde
*Daniele D'Agostino
*Antonella Galizia
 
'''NGIs: '''<br>
 
Croatia
*Emir Imamagic
 
Germany
*Helmut Heller
*Siew Hoon Leong
 
Greece
*Kostas Koumantaros
 
Italy
*Daniele Cesini
 
Macedonia
*Boro Jakimovski
 
Serbia
*Antun Balaz
*Vladimir Slavnic
 
Spain
*Esteban Freire
 
Netherlands
*David Groep
*Dennis van Dok
*Coen
 
France (WRF expertise)
*Gilles Mathieu
 
'''Providers of the science gateway and workflow technology (gUSE WS-PGRADE, SHIWA)'''
*FARKAS Zoltán
*Peter Kacsuk
* Gabor Terstyanszky
 
== Progress ==
 
'''DRIHM VO in production'''
 
<pre>
Virtual Organization
====================
- ID Card: https://operations-portal.egi.eu/vo/update/283
 
mailinglists
-------------
- vousers at drihm.eu
- vousersupport at drihm.eu
- vosecurity at drihm.eu
- vomanagers at drihm.eu
 
VOMS
====
- Hostet in Italy by Italian NGI
    -> Master instance at CNAF (in Bologna): vomsmania.cnaf.infn.it
    -> Replica instance in Naples: vomsIGI-NA.unina.it
- Https port: 8443
- VOMSES port: 15005
- Member list url: https://vomsmania.cnaf.infn.it:8443/voms/drihm.eu/services/VOMSAdmin?method=listMembers
 
</pre>
 
 
'''CONFIRMED SITES'''
 
List of sites which did confirm of their interest and participation:
 
Croatia
*3 sites, not supporting MPI at the moment but will do in a short time, DRIHM will be enabled then
*Contact: Emir Imamagic
 
Germany
*LRZ already supported initial testing of the hydro simulations
 
Greece:
*all mpich2 sites (TODO: define exact list)
*contact: Kostas
 
Italy
*IGI-BOLOGNA. Level of parallelism offered: 48-64 nodes
**cream-01.cnaf.infn.it:8443/cream-pbs-prod-sl5 (SL5 - no infiniband - 24 core per node - 80 GB per node)
**cream-02.cnaf.infn.it:8443/cream-pbs-test-sl6 (SL6 -no infiniband - 24 core per node - 80 GB per node)
**Issues reported by D. Cesini in compiling WRF code on SL6
*NAPLES: level of parallelism offered: 48-64 nodes
**emi-ce01.scope.unina.it:8443/cream-pbs-hpc (SL6 infiniband enabled - 8 core per node - 16GB per node)
*NAPLES, ROma3 INFN (tentative, sys admins being contacted)
*Contact: Daniele Cesini
 
*Note: Daniele reported that site IGI-BOLOGNA will be used by DRIHM to use virtualized resources using the WNODES technology (DRIHM needs virtual machines requiring windows as suppor OS)
 
Macedonia:
*MK-03-FINKI
*contact: Boro Jakimovski
 
Serbia:
*AEGIS01-IPB-SCL site (hosting cream.ipb.ac.rs, ce64.ipb.ac.rs).
*contact: Antun Balaz
 
Spain
*cream.egi.cesga.es (only MPICH2)
*contact: Esteban Freire


=== DRIHM project ===
* [http://www.drihm.eu DRIHM] aims for facilitating the access to hydrometeorological data and models, the collaboration between meteorologists, hydrologists, and Earth science experts for accelerated scientific advances in hydrometeorological research (HMR).
* Leader: Antonio Parodi (antonio.parodi @ cimafoundation.org)


[[Category:EGI_DRIHM]]
== Infrastructure ==
* The collaboration setup a new production VO on EGI: vo.drihm.eu.
** Member list url: https://vomsmania.cnaf.infn.it:8443/voms/drihm.eu/services/VOMSAdmin?method=listMembers
** VO ID Card: https://operations-portal.egi.eu/vo/update/283
** vousers at drihm.eu: Write to all VO users
** vousersupport at drihm.eu: Write to the VO support
** vosecurity at drihm.eu: Write to security representatives of the VO
** vomanagers at drihm.eu: Write to VO managers

Latest revision as of 16:07, 26 March 2014

Welcome to the page of the EGI-DRIHM collaboration

EGI DRIHAM collaboration menu: Home Members Infrastructure Roadmap



Administrative

  • Coordinator: Gergely Sipos, Technical Outreach Manager, EGI.eu (gergely.sipos@egi.eu)
  • Start Date: 17. May 2013
  • End Date: End of DRIHM project (31st March 2015)
  • Mailinglist: egi-drihm @ mailman.egi.eu
  • Meetings: Indico page (slides and minutes from meetings)
  • Status of ongoing work is described at DRIHM ICT Status page (The page requires authentication. Email Christian Straube drihm@nm.ifi.lmu.de to request an account.)
  • Read more about the resources that participate in the DRIHM VO in the Testbed section: EGI-DRIHM:Testbed

Goal

The goal of the EGI-DRIHM collaboration is to facilitate the setup of a web based science gateway for the hydrometeorogy community to enable them running pre-defined simulation workflows on resources from European e-infrastructures, including EGI. To achieve this goal the collaboration has to integrate various hydrometeorology models with e-infrastructures, setup a science gateway, develop and integrated workflows in the science gateway and develop unique interfaces for workflow users.

DRIHM project

  • DRIHM aims for facilitating the access to hydrometeorological data and models, the collaboration between meteorologists, hydrologists, and Earth science experts for accelerated scientific advances in hydrometeorological research (HMR).
  • Leader: Antonio Parodi (antonio.parodi @ cimafoundation.org)

Infrastructure