The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.
Difference between revisions of "CANFAR"
m (→Reference) |
|||
| Line 1: | Line 1: | ||
==Community Information== | |||
===Community Name=== | |||
Canadian Advanced Network for Astronomical Research | |||
===Community Short Name if any=== | |||
CANFAR | |||
===Community website=== | |||
http://www.canfar.phys.uvic.ca/canfar/ | |||
===Community Description=== | |||
The Canadian Advanced Network for Astronomical Research (CANFAR) is a computing infrastructure for astronomers. CANFAR aims to provide to its users easy access to very large resources for both storage and processing, using a cloud based framework. CANFAR allows astronomers to run processing jobs on a set of computing clusters, and to store data at a set of data centres. (From http://www.canfar.net/about) | |||
===Community Objectives=== | |||
The main objectives of the community include: | |||
* Manage large astronomical and astrophysical data sets, | |||
* Allow users to share the data sets between European and Canadian infrastructures, | |||
* Provide means for data set querying using FITS metadata, | |||
* Enable running computations on large data sets. | |||
===Main Contact Institutions=== | |||
Instituto Nazionale di Astrofisica (INAF), Via G.B. Tiepolo, 11 I-34143 Trieste, Italy - Tel. +39 040 3199 111 - infoats@oats.inaf.it | |||
===Main Contact=== | |||
Giuliano Taffoni <taffoni@oats.inaf.it> | |||
==Collaborations with EGI Engage Open Data Platform== | |||
===Scientific challenges=== | |||
The main problem related to CANFAR case study is that European A&A community has only storage infrastructure, without computing, which is available in the Canadian A&A cloud. The typical observation files are very large, and thus very expensive to transfer to computational sites. After the data is made public (typically after 1 year) it should be replicated between European and Canadian cloud storage. | |||
===Objectives === | |||
The main objectives of this community with respect to Open Data Cloud include: | |||
* Establish close collaboration between European and Canadian astronomy and astrophysics (A&A) communities, | |||
* Enable sharing large volumes of astronomical observation and simulation data according to agreed policies (e.g. after 1 year of publication data should be public) | |||
* Enable replication of data between Canadian and European Cloud storage infrastructures. | |||
===Use Stories=== | |||
'''UC1: User data is made public automatically after 1 year'''. | |||
'''Actors''': | |||
* Principal Investigator who created the original data. | |||
'''Action''': | |||
* Access to the data is automatically enabled after 1 year from creation by the Open Data Platform | |||
* Data is replicated between CANFAR and EGI infrastructures | |||
* Data is available through EGI Open Data Platform portal | |||
'''Current solutions''': | |||
* Data transfers are initiated manually | |||
'''UC2: User wants to find publicly available data set.''' | |||
'''Actors''': | |||
* Community user interested in accessing particular observation data set. | |||
'''Action''': | |||
* User enters in the community portal query specifying selected FITS metadata key/value pairs. Matching data sets are located, and filtered based on the privacy ACL’s set for data (all public data sets matching the query will be returned to any user.) | |||
Problems to be solved: | |||
* Enable automatic ACL modification based on time of data creation | |||
* Enable public access over specified protocols (e.g. HTTP, FTP) of the public files | |||
==Meetings and minutes== | ==Meetings and minutes== | ||
Revision as of 17:42, 14 July 2015
Community Information
Community Name
Canadian Advanced Network for Astronomical Research
Community Short Name if any
CANFAR
Community website
http://www.canfar.phys.uvic.ca/canfar/
Community Description
The Canadian Advanced Network for Astronomical Research (CANFAR) is a computing infrastructure for astronomers. CANFAR aims to provide to its users easy access to very large resources for both storage and processing, using a cloud based framework. CANFAR allows astronomers to run processing jobs on a set of computing clusters, and to store data at a set of data centres. (From http://www.canfar.net/about)
Community Objectives
The main objectives of the community include:
- Manage large astronomical and astrophysical data sets,
- Allow users to share the data sets between European and Canadian infrastructures,
- Provide means for data set querying using FITS metadata,
- Enable running computations on large data sets.
Main Contact Institutions
Instituto Nazionale di Astrofisica (INAF), Via G.B. Tiepolo, 11 I-34143 Trieste, Italy - Tel. +39 040 3199 111 - infoats@oats.inaf.it
Main Contact
Giuliano Taffoni <taffoni@oats.inaf.it>
Collaborations with EGI Engage Open Data Platform
Scientific challenges
The main problem related to CANFAR case study is that European A&A community has only storage infrastructure, without computing, which is available in the Canadian A&A cloud. The typical observation files are very large, and thus very expensive to transfer to computational sites. After the data is made public (typically after 1 year) it should be replicated between European and Canadian cloud storage.
Objectives
The main objectives of this community with respect to Open Data Cloud include:
- Establish close collaboration between European and Canadian astronomy and astrophysics (A&A) communities,
- Enable sharing large volumes of astronomical observation and simulation data according to agreed policies (e.g. after 1 year of publication data should be public)
- Enable replication of data between Canadian and European Cloud storage infrastructures.
Use Stories
UC1: User data is made public automatically after 1 year. Actors:
- Principal Investigator who created the original data.
Action:
- Access to the data is automatically enabled after 1 year from creation by the Open Data Platform
- Data is replicated between CANFAR and EGI infrastructures
- Data is available through EGI Open Data Platform portal
Current solutions:
- Data transfers are initiated manually
UC2: User wants to find publicly available data set. Actors:
- Community user interested in accessing particular observation data set.
Action:
- User enters in the community portal query specifying selected FITS metadata key/value pairs. Matching data sets are located, and filtered based on the privacy ACL’s set for data (all public data sets matching the query will be returned to any user.)
Problems to be solved:
- Enable automatic ACL modification based on time of data creation
- Enable public access over specified protocols (e.g. HTTP, FTP) of the public files
Meetings and minutes
- CANFAR meeting page: https://indico.egi.eu/indico/categoryDisplay.py?categId=167
Reference
- CANFAR VO space: http://www.ivoa.net/deployers/intro_to_vo_concepts.html
- CADC & CANFAR presentation given by Severin Gaudet .ppt
- Requirements notes from 1 Jul meeting: google doc
- EGI Engage Deliverable D4.1 CANFAR Integration Roadmap TOC: .doc
- Requirement extraction using template .doc