Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI Federated Data"

From EGIWiki
Jump to navigation Jump to search
(Link community forum and readthedocs doc.)
 
(6 intermediate revisions by one other user not shown)
Line 1: Line 1:
== Overview  ==
== Overview  ==


The EGI Data Federation is part of '''EGI infrastructure'''.  It is built using the EGI Open Data Platform, based on [https://onedata.org Onedata] technology.
The EGI Data Federation is part of the EGI infrastructure.  It is built using the EGI Open Data Platform, based on [https://onedata.org Onedata] technology.


For scientists or member of research projects, the EGI Data Federation provides you with a means of accessing and working with data from the cloud.  It also allows your data to be made discoverable and accessible to the general public via the EGI DataHub.   
For scientists or member of research projects, the EGI Data Federation provides you with a means of accessing and working with data from the cloud.  It also allows your data to be made discoverable and accessible to the general public via the EGI DataHub.   
Line 11: Line 11:
== EGI DataHub ==
== EGI DataHub ==


The [https://datahub.egi.eu EGI DataHub] is the front end of the EGI Data Federation.  It is a Data as a Service (DaaS) and is the first port of call to datasets hosted by data providers who are members of the EGI infrastructure - or to users' datasets themselves.  Whilst the EGI DataHub does not store data itself, it provides an easy means of discovering datasets hosted by different data providers, and making those datasets easily accessible via different means.  This could be by using a simple web browser or over POSIX to virtual machines on the cloud.
The [https://datahub.egi.eu EGI DataHub] is the front end of the EGI Data Federation.  It is a Data as a Service (DaaS) and is the first port of call to datasets hosted by data providers who are members of the EGI infrastructure - or to users' datasets themselves.   


== Getting started  ==
[[File:Egi_datahub_1.jpg|center]]
 
Whilst the EGI DataHub does not store data itself, it provides an easy means of discovering datasets hosted by different data providers, and making those datasets easily accessible via different means.  This could be by using a simple web browser or over POSIX to virtual machines on the cloud, as illustrated here:
 
[[File:Egi_datahub_2.jpg|center]]
 
== Getting started  with the EGI Data Federation ==
 
=== Documentation "readthedocs" ===
Some documentation (readthedocs) can be found here: https://egi-datahub.readthedocs.io/en/latest/.
 
It can be updated using https://github.com/EGI-Foundation/datahub-documentation
 
=== DataHub space on the community forum ===
 
A DataHub-dedicated space was created on the EGI community forum: https://community.egi.eu/c/egi-services/datahub.
 
=== Guides (in progress ===


For the meaning of the terms in the following guides, please refer to the [https://wiki.egi.eu/wiki/Glossary EGI Glossary].
For the meaning of the terms in the following guides, please refer to the [https://wiki.egi.eu/wiki/Glossary EGI Glossary].
Line 19: Line 36:
{|
{|
| [[Federated Data user support|For users]]
| [[Federated Data user support|For users]]
| Individuals and institutions using or planning to use federated data technologies for their activities
| Are you a scientist or other end user interested in finding more about the EGI DataHub or how to access datasets from your applications/virtual machines?
|-
|-
| [[Federated Data resource providers support|For resource providers]]
| [[Federated Data resource providers support|For resource providers]]
| Institutions and companies contributing or willing to contribute to the FedData providing access to their cloud infrastructure via the Federation
| Are you an institution or companies interested in providing access to your data infrastructure via the Federation?
|-
|-
| [[Federated Data infrastructure status|Infrastructure Status]]
| [[Federated Data infrastructure status|Infrastructure Status]]
Line 28: Line 45:
|-
|-
| [[Federated Data innovation roadmap|Innovation roadmap]]
| [[Federated Data innovation roadmap|Innovation roadmap]]
| Developments ongoing and planned for the EGI Federated Cloud
| Developments ongoing and planned for the EGI Federated Data infrastructure
|-
|-



Latest revision as of 11:19, 13 December 2018

Overview

The EGI Data Federation is part of the EGI infrastructure. It is built using the EGI Open Data Platform, based on Onedata technology.

For scientists or member of research projects, the EGI Data Federation provides you with a means of accessing and working with data from the cloud. It also allows your data to be made discoverable and accessible to the general public via the EGI DataHub.

For organizations, institutions or companies which provide data storage or hosting of open data, the EGI Data Federation can easily link you to a wide research and public European network.

Data hosted in the EGI Data Federation may be completely open without any barriers to access, or restricted to specific user communities or individual users.

EGI DataHub

The EGI DataHub is the front end of the EGI Data Federation. It is a Data as a Service (DaaS) and is the first port of call to datasets hosted by data providers who are members of the EGI infrastructure - or to users' datasets themselves.

Egi datahub 1.jpg

Whilst the EGI DataHub does not store data itself, it provides an easy means of discovering datasets hosted by different data providers, and making those datasets easily accessible via different means. This could be by using a simple web browser or over POSIX to virtual machines on the cloud, as illustrated here:

Egi datahub 2.jpg

Getting started with the EGI Data Federation

Documentation "readthedocs"

Some documentation (readthedocs) can be found here: https://egi-datahub.readthedocs.io/en/latest/.

It can be updated using https://github.com/EGI-Foundation/datahub-documentation

DataHub space on the community forum

A DataHub-dedicated space was created on the EGI community forum: https://community.egi.eu/c/egi-services/datahub.

Guides (in progress

For the meaning of the terms in the following guides, please refer to the EGI Glossary.

For users Are you a scientist or other end user interested in finding more about the EGI DataHub or how to access datasets from your applications/virtual machines?
For resource providers Are you an institution or companies interested in providing access to your data infrastructure via the Federation?
Infrastructure Status Updated status of the data infrastructure via the Federation
Innovation roadmap Developments ongoing and planned for the EGI Federated Data infrastructure