Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-Engage:PY2 review"

From EGIWiki
Jump to navigation Jump to search
Line 132: Line 132:
   - http://py-enmr.cerm.unifi.it/access/index/amps-nmr
   - http://py-enmr.cerm.unifi.it/access/index/amps-nmr
   The portals are in production with a growing user community and making use of INDIGO-Datacloud solutions.
   The portals are in production with a growing user community and making use of INDIGO-Datacloud solutions.
* Created a Virtualised Appliance from the Scipion framework (to obtain 3D maps of macromolecular complexes). This image has mainly been used in workshops so far with the most recent one the cryo-EM workshop at ISGC2017 where also DisVis, PowerFit and AMBER were demonstrated.
* Created a Virtualised Appliance from the Scipion framework (to obtain 3D maps of macromolecular complexes).  
  This image has mainly been used in workshops so far with the most recent one the cryo-EM workshop at ISGC2017  
  where also DisVis, PowerFit and AMBER were demonstrated.
  The VM is available from the EGI appdb: https://appdb.egi.eu/store/vappliance/scipion.v1.0
* Contributed to the development of a solution enabling GPU support in CREAM-CE  
* Contributed to the development of a solution enabling GPU support in CREAM-CE  



Revision as of 16:52, 31 March 2017

EGI-Engage project: Main page WP1(NA1) WP3(JRA1) WP5(SA1) PMB Deliverables and Milestones Quality Plan Risk Plan Data Plan
Roles and
responsibilities
WP2(NA2) WP4(JRA2) WP6(SA2) AMB Software and services Metrics Project Office Procedures





WP1

  • ISO 9k and 20k certification
  • 2 risk registry reviews conducted

WP2

  • Task2.1
    • New website
    • EGI service catalogue brochure
    • Events: supported DI4R execution and EGI Conference 2017 preparation
  • Task 2.2 (Sergio/Sy)
    • Integrated Management System implemented + ISO9000/ISO2000 Certification
    • Pay for use in production (5 total providers signed LoI - 2)
    • 2 new pay-for-use providers having sent formal Letter of Intent
      • Request via wiki + email in place
      • Request via the EGI Marketplace in progress
    • Service portfolio approved / Catalogue published
    • Procurement study
  • Task 2.3 (Sy/Roberta)
    • MoUs: CloudSME, Terradue
    • Market Analysis
      • Marine Fisheries Market Analysis
      • As follow-up, there is not a defined strategy through BlueBridge; structured business model for collaboration between EGI, BlueBridge and early adopters
    • Agriculture Market Analysis
    • Success stories:
      • IBM Research through PSNC (paid)
      • Pilot on hybrid cloud for exploiting Copernicus data
      • NUMECA SME: training support with EGI FedCloud
      • UberCloud Case Study
    • Expanded the network of relationships with key stakeholders
      • EO sector (e.g. DG Grow, large companies, SMEs)
      • 30 business pilots submissions to EINFRA-12 (at least 6 resulted from NGIs local engagement thanks to EGI-Engage SME engagement activities)
      • 145 Industry contacts in DB


WP3

  • JRA1.1
    • Technical enhancement on CheckIn service
    • Community and operations tools integration
  • JRA1.2
    • Service order management process
      • Integration with LTOS platform and e-Grant
    • PrestaShop Marketplace prototype
    • OpenIRIS prototype
    • Technology assessment
  • JRA1.3
    • New accounting portal
    • New Cloud Usage Record
    • Data Accounting prototype
  • JRA1.4
    • GOCDB, ARGO, Ops Portal new releases
    • New messaging infrastructure
  • JRA1.5
    • Activities re-organised according to the outcome of JRA1.2

WP4

  • (JRA2.1)
    • Release of first prototype of Open Data Platform with support for open data management, DOI and PID support and OAI-PMH interfaces for open data metadata publishing
    • Establishment of EGI DataHub service based on Open Data Platform serving as a repository for reference data sets, currently mirroring a subset of Sentinel-2 data set
  • (JRA2.2)
    • OCCI 1.2 released for OpenStack and OpenNebula, including support for snapshots and resizing of images.
    • Design and first implementation of new image distribution method, providing better integration with CMFs.
  • (JRA2.3)
    • gCube/D4Science integrated into the EGI Federated Cloud, enabling the use of EGI resources for users of the VREs
    • CANFAR integration ready to accept credentials from Europe and Canada, VOSpace prototype available.
    • EGI/EUDAT use cases showing the combined use of both infrastructures started and first pilots deployed.
  • (JRA2.4)
    • Establish GPGPU specific VO acc-comp.egi.eu for accelerated computing, create VO-specific image list with pre-installed GPGPU software
    • Support for GPGPU on OpenNebula (site deployment and certification, upgrade of rOCCI server to support GPGPU in resource template)
    • Deployment and experimentation with support GPGPU via nova-lxd (LXC container instead of KVM hypervisor)

WP5

  • Operational integration of new services such as WebDAV, DataHub and CheckIn
  • Harmonization of cloud and HTC service provisioning
  • New SLAs
  • Security: threat risk assessment follow up and mitigations
  • Strengthen of the site security through new procedures and security trainings
  • Security: international collaboations
  • Support of iMarine and ESA TEP use cases
  • Long tail of science

WP6

Training (SA2.1):

  • Reusable content (reference material) on cloud CMDline & API; Specialised services in the cloud (Docker, Hadoop); DataHub; Security role-play
  • Delivered 13 training events (5 webinars, 7 f2f, 1 remote EGI tutorial). These reached approx 270 participants in total (over 20/event on average).

Technical support for new communities (SA2.2):

  • Finalised and released the Application platform for the Long-tail of science
  • Pilot use of EGI cloud and storage services by EMSO, ICOS, Euro-Argo
  • Delivered two 'Design your e-infrastructure' events co-located with EGI Forums. ICOS, Euro-Argo, ELItrans, ERIC CLL are actively supported since then.) The workshop format is now adopted by the Dutch NGI for national community support
  • ISO-certification for Opportunity prioritization and CRM process (incl. regular interviews with customers)

Competence centres (SA2.3-10):

  • Infrastructure integration concluded for early adopters: ELIXIR, DARIAH, BBMRI. They entered into application development and external promotion phase.
  • Application demonstrators have been setup by EPOS and DMCC
  • Active exploitation of services with uptake of new services: MoBrain (GPGPU), LifeWatch (cloud)

DETAILED VIEW ON CCs:

TSA6.3: ELIXIR:

  • We established an ELIXIR VO which can be accessed by the users with their ELIXIR accounts (no need for X509 certificates!). CESNET, EBI and CNRS clouds are federated in the VO.
  • We simplified the way how OpenStack clouds can federate into EGI VOs.
  • We piloted Terraform orchestrator integration with OCCI and OpenStack Nova on the VO.
  • Life science se cases started integrating with the ELIXIR VO clouds: Metagenomics from CSC, Insyght Comparative Genomics from CNRS, PhenoMeNal from EBI.
  • We started an infrastructure compatibility study with the JetStream cloud system in the US (to see whether life science communities could exchange of applications between Europe and the US).

TSA6.4: BBMRI:

  • Developed an EGI-specific extension of the BioBankCloud platform --> Where is it deployed? What's the scale of use and feedback so far?
  • Identified and started the integration of biobank workflows with EGI and EUDAT services: DNA and RNA genotyping (BBMRI.NL), Identification of proteins, Protein quantitation, HDX analysis (BBMRI.CZ), PIDs for BBMRI data (EUDAT)

TSA6.5: MoBrain:

  • Ported AMBER, DisVis and PowerFit to GPGPUs, then integrated into the respective WeNMR portals:
  - http://milou.science.uu.nl/cgi/enmr/services/DISVIS/disvis/
  - http://milou.science.uu.nl/cgi/enmr/services/POWERFIT/powerfit/
  - http://py-enmr.cerm.unifi.it/access/index/amps-nmr
 The portals are in production with a growing user community and making use of INDIGO-Datacloud solutions.
  • Created a Virtualised Appliance from the Scipion framework (to obtain 3D maps of macromolecular complexes).
  This image has mainly been used in workshops so far with the most recent one the cryo-EM workshop at ISGC2017 
  where also DisVis, PowerFit and AMBER were demonstrated.  
  The VM is available from the EGI appdb: https://appdb.egi.eu/store/vappliance/scipion.v1.0
  • Contributed to the development of a solution enabling GPU support in CREAM-CE

TSA6.6: DARIAH:

  • Science gateway was opened for the community, integrating the following applications:
    • Semantic Search Engine
    • Cloud access
    • Workflow development and management
    • Data transfer
  • Service promotion started --> Which events?, what demos?, what papers? What's the scale of use and feedback so far?

TSA6.7: LifeWatch:

  • The VRE Marine in operation for last year, and being extended to non-marine topics (terrestrial VRE) - Daily usage by the researchers at VLIZ and HCMR centres to assist in the collection and processing of the observations providing the monitoring measurements of the different marine areas in Europe
  • GBIF.es and GBIF.pt, including data support is operating on FedCloud resources in full production (alongside other local resources) - Currently approx 10.000 users.
  • A new Citizen Science Platform, Natusfera, operating on FedCloud resources. The automatic pattern recognition tool for species being integrated, reaching outstanding levels thanks to deep learning on GPUs - Approx 1000 users with 5000 images in the last 12 months.

TSA6.8: EISCAT_3D:

  • New features have been added to the EISCAT_3D portal
    • Data access based on EISCAT data access policy
    • Data downloading refined
    • Submitting files for processing
  • Data Model for EISCAT_3D adopted to the present EISCAT data for evaluation of Dirac
  • Early adoption within the community
  • Presentations in community:
    • EISCAT_3D user meeting and Optical meeting 2016
    • Smaller meetings: SGO observatory days 2017, NEIC user group, EISCAT Scientific Committe

TSA6.9: EPOS:

  • 3 infrastructure assessment pilots have been reached by the end of PY2
    • AAI (Accessing EPOS Distributed Integrated Core Services via EGI CheckIn)
    • Cloud computing (Earthquake simulation on EGI cloud resources from the VERCE gateway)
    • Connecting DInSAR processing chain with EGI Cloud compute and storage services with the use of Terradue's Geohazard Thematic Exploitation Platform

--> Add info on when and who will perform the assessment of these

TSA6.10: Disaster Mitigation: --> Add info based on recent deliverable