Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI ENVRI"

From EGIWiki
Jump to navigation Jump to search
Line 66: Line 66:
== <span id="Progress" class="mw-headline">Progress  </span><br>  ==
== <span id="Progress" class="mw-headline">Progress  </span><br>  ==


=== Actions  ===
=== EISCAT-3D===
A short document will be prepared that outlines the scope of the EISCAT_3D - EGI collaboration. The document would be used by EGI and by EISCAT_3D to invite contributors into the collaboration (NGIs, institutes)


{| class="wikitable"
Key points in the document:
|-
- EISCAT archive includes 60TB of correlated data collected during 1981-2013. There are interfaces to interact with the data but the data is not searchable.
! scope="col" | no
- The collaboration would make the archive searchable by:
! scope="col" | Action
1. moving the data to EGI storages (grid or cloud to be decided later)
! scope="col" | Start Date
2. registering the data into EGI file catalogues and metadata services
! scope="col" | Responsible
3. studying, identifying and - if feasible - implementing data mirroring and indexing strategies that would suit to the envisaged processing strategies of EISCAT_3D. The studies could cover areas such as use of Hadoop or other big-data technologies on EGI.
! scope="col" | Status
|-
| 1
| Find EUDAT presentation about services which are provided by the project
| 13.02
| Gergely
| done
|-
| 2  
| Contact EUROArgo and EISCAT3d and inform about plans
| 13.02
| Małgorzata
| done
|-
| 3
| Create architecture diagram and requirements table for EISCAT-3d and EUROARGO
| 13.02
| Gergely &amp; Małgorzata
| <br>
|-
| 4
| Create a wiki page to coordinate actions
| 13.02
| Małgorzata
| done
|}


=== Euro-ARGO===
[[Category:EGI_ENVRI]]
[[Category:EGI_ENVRI]]

Revision as of 13:21, 17 May 2013

Welcome to the page of the EGI ENVRI Study Case page



General Project Information

  • Leader: Malgorzata Krakowian (malgorzata.krakowian @ egi.eu)
  • Start Date: 1.02.2013
  • End Date:
  • Meetings: Indico page (slides and minutes from meetings)

Motivation

A study case was set up to identify existing services and solutions from EGI that could address the data pre-processing, post-processing, publishing needs of these two ESFRI projects. The outcome of the pilot is expected to be directly applicable to EISCAT_3D and EURO-ARGO, and indirectly by other ESFRIs of ENVRI.  In cooperation with EISCAT-3D and EURO-ARGO representatives in ENVRI, EGI.eu will try to find best suitable solutions for data pre-processing of primary data and post-processing toward publishing.

Output

Tasks

Members

EGI.eu

  • (Technical Outreach Manager) Gergely Sipos gergely.sipos [at] egi.eu
  • (User Community Support Officer) Nuno Ferreira nuno.ferreir [at] egi.eu

EISCAT-3D:

  • Dr. Ingemar Haggstrom Ingemar.Haggstrom [at] eiscat.se
  • Dr Ingrid Mann ingrid.mann [at] eiscat.se

EURO-ARGO:

  • Thierry Carval Thierry.Carval [at] ifremer.fr
  • Jerome Detoc Jerome.Detoc [at] ifremer.fr (data management, big data)


Resources

External tools and presentations (could be useful)

ENVRI wiki

Progress

EISCAT-3D

A short document will be prepared that outlines the scope of the EISCAT_3D - EGI collaboration. The document would be used by EGI and by EISCAT_3D to invite contributors into the collaboration (NGIs, institutes)

Key points in the document: - EISCAT archive includes 60TB of correlated data collected during 1981-2013. There are interfaces to interact with the data but the data is not searchable. - The collaboration would make the archive searchable by: 1. moving the data to EGI storages (grid or cloud to be decided later) 2. registering the data into EGI file catalogues and metadata services 3. studying, identifying and - if feasible - implementing data mirroring and indexing strategies that would suit to the envisaged processing strategies of EISCAT_3D. The studies could cover areas such as use of Hadoop or other big-data technologies on EGI.


Euro-ARGO