From EGIWiki
Revision as of 13:51, 20 January 2017 by Sipos (talk | contribs) (Milestones & Deliverables)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search
EGI-Engage project: Main page WP1(NA1) WP3(JRA1) WP5(SA1) PMB Deliverables and Milestones Quality Plan Risk Plan Data Plan
Roles and
WP2(NA2) WP4(JRA2) WP6(SA2) AMB Software and services Metrics Project Office Procedures


Activity Reports

WP1 (NA1) (Yannick Legre)

Dissemination reports

Milestones & Deliverables

Task NA1.1 Administrative and Financial Management

Task NA1.2 Technical Management

Task NA1.3 Quality and Risk Management

  • ISO audit and addressing audit findings
  • coordinate deliverables and milestone review process

WP2 (NA2) (Sergio Andreozzi)

Dissemination reports

Milestones & Deliverables

  • D2.11 Cross-border procurement of e-Infrastructure services: Opportunities, Barriers, Use cases, Best Practices
    • Internal review completed
    • Sent for feedback from wider procurement mailing list  the 4 ESFRI Research Infrastructures that are funded partners of this activity in the EGI-Engage project: BBMRI-ERIC, CSIC (LifeWatch), RBI (DARIAH), INGV (EPOS)
    • External review to start somewhere between 23-31 January - Still missing external reviewers
  • D6.14 Scipion cloud deployment for MoBrain
    • Served as an external reviewer

Task NA2.1 Communication and Dissemination

  • EGI Conference 2017
    • Conference website online
    • First draft of programme sent for refinement and verification
    • Work on the definition of the registration system (via Indico!)
    • Graphic image of the conference and announcements
  • Newsletter - Issue 26: commissioning the issue
  • News items and blogs
  • Socia media posts: Twitter, Facebook, LinkedIn
  • Website: Dedicated area to Thematic services, with new and updated content

Task NA2.2 Strategy, Business Development and Exploitation

  • Strategic Planning and Evaluation
    • 12 policies (SPG; CSIRT) updated through PDP
  • Service and Solution Strategy
    • SSB #24 held 28 Nov; next meeting planned for 27 Jan
    • ISO 9k and 20k 2nd Stage Audit (21-23 Dec) and all preparations leading up to it
  • Cross-border procurement
    • See Deliverable section above (D2.11)
  • Pay-for-use Implementation
    • P4U options for EGI Marketplace
      • Call held with full P4U group to present EGI Marketplace and P4U options (2 June) with presentation slides -
      • Participation in periodic meetings and feedback provided
    • Pricing model being defined for commercial training support (see NUMECA in SME section below)
    • Billing function being explored through new contact Cyclops Labs Gmbh (see SME engagement below)
  • EGI Marketplace
    • Continued Marketplace prototypes assessment
  • Collaboration Partnerships
    • Formal letter sent to ESA suggesting strategic partnership

Task NA2.3 SME/Industry Engagement and Big Data Value Chain

  • SME engagement
    • NUMECA (Belgium SME)
    • UberCloud
    • Brainprint (Portguese start-up)
      • Coordinating with PT-NGI (LIP) to analyse requirements - added to business opportunity in confluence
    • Cyclops Labs Gmbh
      • New contact for help EGI with a new/better cloud usage accounting system (with e.g. real-time capabilities which is missing from APEL), and could also help pay-for-use scenarios with billing features).
    • Others in progress (Sinergise; Funboostr)
    • Initial questionnaire for private organisations
      • Available on website as an initial means to evaluate potential collaborations -
      • Circulated through SME mailing list in order to collate harmonised data
      • 9 total (3 new; 6 backlogging of current contacts)
    • Next idea is to preparations a webinar on "SME engagement framework for NGIs"
  • Big Data
  • Market analysis, Data policies, legal aspects

WP3 (JRA1) (Diego Scardaci)

Dissemination reports

Milestones & Deliverables

  • D3.8 First Data Accounting prototype (M20): STFC is working with CYFRONET to test the prototype
  • D3.9 Identity Management for Distributed User Communities (M24): GRNET notified of the incoming deadline
  • D3.10 Second release of the accounting and operational tools (M24): TOC available, asked PTs for a contribution
  • D3.14 Report on Data Accounting (M24): TOC available

Task JRA1.1 Authentication and Authorisation Infrastructure

  • entitlement for RCAuth CA, GGUS and GOCDB
  • ELIXIR support
  • CheckIn devel instance integrated with the 2 marketplace prototypes

Task JRA1.2 Service Registry and Marketplace

  • Extensions were made to the Open IRIS prototype to support the EGI use case.
  • Integration into the EGI AAI proxy service.
  • Evaluation, review, and input into the EGI marketplace and service registry requirements.
  • Meetings with Institut Curie ( and PSI ( in providing input into research service registry concept.
  • S-Lab Awards 2017 nomination in category for “Laboratory Effectiveness” based on its concept of enhancing resource sharing.
  • Open IRIS selected for being used as service registry to eScience platform in Switzerland.
  • Requested presentation at "Core Facility Management Software Workshop" at University of Freburg (Germany)
  • Collaborations started with College de France, École normale supérieure, and Bordeaux Imaging Center in resource management.

Task JRA1.3 Accounting

Accounting Repository

  • Preparation for release of APEL 1.6.0
  • Deployment of Cloud usage record v0.4 submitted to EGI change management
  • Re-evaluating solutions for long-running VM support due to unacceptable performance of first solution
  • Added support for GOCDB paging
  • Working with OneData to test prototype data set accounting
  • Issues with storage accounting mostly resolved so will start widening adoption

Accounting Portal

  • Changed landing page according to new requirements.
  • New WLCG sub-portal with dedicated navigation and menu bar
  • Changed WLCG reports, integrated REBUS Tier1 report.
  • Added contextual help
  • Added context-sensitive info on each page.
  • Renamed Sites to Resource Centres, NGIs to Operations Centres.
  • New EGI Resource Centre Report with per-country, top10 and top100 reports for both HTC and Cloud.
  • Added Year, Half-year and Quarter Granularity.
  • Improved discipline view.
  • Reorganization of the menus.
  • Subdiscipline views switch to VO-based view when no subdisciplines are present.
  • Changed EGI country view to only include EGI federation countries, re-implemented view with all countries for WLCG.
  • Modified CSV support back to the server so it can be linked.
  • Changed landing page graph to commas even on dot-based locales.
  • Added extra padding on tables.
  • Reimplemented VO metrics support.
  • Added EGI branding on every page.

Task JRA1.4 Operations Tools

Operations Portal


V5.7 Release:

ARGO & Messaging

  • Add logging mechanism to Web API
  • First version of HTTP based messaging service is released
  • New report on WEB UI
  • Working on integrating HTTP messaging service to the monitoring engine

  • Νew version of POEM service

  • Preliminary version οf the streaming engine

Security Monitoring

Task JRA1.5 Resource Allocation – e-GRANT

PrestaShop instance of EGI Marketplace development - e-GRANT dev suspended

WP4 (JRA2) (Matthew Viljoen)

Dissemination reports

Milestones & Deliverables

Task JRA2.1 Federated Open Data

Task JRA2.2 Federated Cloud

Task JRA2.3 e-Infrastructures Integration

Task JRA2.4 Accelerated Computing

WP5 (SA1) (Peter Solagna)

Dissemination reports

Milestones & Deliverables

Task SA1.1 Operations Coordination

  • Creation of new requirements queues in RT (populate the SSO groups, if you are queue managers, please!)
  • Management of the Preview repository
  • RC and RP OLA monthly enforcing
  • Testing the new VAPOR version before its release
  • Progresses in the deployment of a webdav service type
  • ARGO proposal to use GOCDB as the only source of topology information, instead of BDII. GOC-DB is ready, ARGO in the next weeks
  • partecipation to OMB, Operations, URT and FedCloud meetings
  • Release of first version of CMD for OpenStack (CMD-OS 1.0.0)
  • Preparing CMD-ONE (OpenNebula)
  • Interacting with INDIGO TPs for CMD
  • Releases for UMD3.14.5 + UMD3.14.6 + UMD3.14.7 (all revisions), and UMD 4.3.0 (regular), UMD 4.3.1 + UMD 4.3.2 (revisions)
  • Updating wiki contents for UMD4 (schedule, products)
  • SLA validations follow up: EXTraS,D4Science,Terradue/ESA
  • Chairing Operations meeting (1)
  • Chairing URT meeting (3)
  • Joining WLCG operations monday meeting (3/7), ARGUS meeting (2), FedCloud meeting (4)
  • Follow up closely with Terradue/ESA (liaison with RECAS-BARI, testing 100IT)
  • Follow up closely with D4Science @ RECAS-BARI
  • Handling IPv6 transition first plans (products, informing FedCloud, informing NGIs)
  • Following up with GRIDIFIN, BELSPO
  • OMB agenda preparation and chairing

Task SA1.2 Development of Security Operations

Policies submitted to EB:

  • eInfrastructure security policy
  • Acceptable Authentication Assurance
  • Processing of personal data

Task SA1.3 Integration, Deployment of Grid and Cloud Platforms


  • Re-implementation of the user UID to be non-targeted
  • Test of accounting propagation
  • EC3 testing and improvement. Tools available are: Berkely Lab Checkpoint/Restart (checkpoint tool), Marathon, Cronos, Hadoop
  • Integration with the EGI CheckIn, LTOS is now accessible as a VO
  • User management manual first draft


  • Test the floating IP configuration through OCCI in Open Nebula
  • Tests on 100IT, mostly working; issue with authorizing the client IP, looks like the operator should ask the site to authorize his client IP (to be investigated)
  • Configuration in Bari to allow the DNS to filter whatever is not in the listed subnets


  • Finalizing a solution for the hostname provisioning of the VMs
    • Working also on general solutions to be proposed to fedcloud users

WP6 (SA2) (Gergely Sipos)

Dissemination reports

Milestones & Deliverables

  • 4 deliverables are due at M24 - All are under preparation since Dec and are on track. Reviewers are already negotiated with.
  • Contributions are started to be assembled for the project catalogue of results and exploitation plan. Telcon with task leaders will be on Monday at 9 about this. (Roberta to present)

Task SA2.1 Training

  • Supported the first trial using the UberCloud containers on the EGI FedCloud Infrastructure (Milan, 23 Nov. 2016, Giuseppe)
  • Supported the workshop organized by the Institute of Applied Biosciences (INAB), CERTH (Thessaloniki, 15 Dec. 2016, Giuseppe & Yin)
  • Configured the EGI FedCloud Infrastructure to host the 6 UberCloud containers for supporting the 2nd. NUMECA training (10-13 Jan. 2017, Giuseppe)

Outcomes/Lessons learnt

The two commercial use cases that we have supported so far (e.g. NUMECA and UberCloud) have clearly showed that EGI FedCloud providers (e.g. CESNET-MetaCloud, FZJ) can guaranteed good reliability and high-level performance. This was appreciated both by participants and trainers.

If we want to offer a quality services and hide the complexity not only to commercial providers, but also to users, we have to involve more providers in the loop and, implement a mechanism to make the configuration of docker containers in the EGI FedCloud infrastructure more simple/automatic.

Task SA2.2 Technical User Support

  • Continued support for identified user communities, most relevant activities:
    • Testing and deployment of Apache Storm for ENVRI+
    • Testing and deployment of Kubernetes and Docker Swarm for ICOS
  • New use cases identified:
    • ICOS application using gCube,
    • DISCCo (execution of scratchpads on the fedcloud), user starting tests
    • EMPHASIS (new ESFRI identified in the AGINFRA+ KickOff, initial contact established)
  • Follow CRM process
    • Perform customer satisfaction and service reviews of selected SLAs
    • Handling service complaints from customers


VO setup:

  • First VO tests with ELIXIR ID (!) conducted successfully on CESNET.
  • Issue with IN2P2-IRES is followed up in GGUS.
  • GRNET and EBI configurations/commitment for the VO are checked.

New appliances have been produced to the AppDB Cloud market place:

  • Insyght Comparative Genomics application [1]
  • PheNoMenal MANTL [2]

Task SA2.4 BBMRI

  • Technical meeting conducted between EGI FedCloud and Uni of Groeningen about porting the RNA/DNA analysis pipeline
  • High level discussion was between BBMRI-ERIC, SURFSARA, EGI on how EUDAT services and activities could be included and linked to the CC activities. Detailed workplan is to be written by Petr about this.

Task SA2.5 MoBrain

The GPGPU web portals DISVIS and POWERFIT have been published:

G.C.P. van Zundert, M. Trellet, J. Schaarschmidt, Z. Kurkcuoglu, M. David, M. Verlato, A. Rosato and A.M.J.J. Bonvin. The DisVis and PowerFit web servers: Explorative and Integrative Modeling of Biomolecular Complexes. J. Mol. Biol., Advanced Online Publication (2016).

There also now under the scientific application entries on the EGI web site:

The portals will be demonstrated in practical sessions at the cryo-EM workshop during ISGC 2017 in Taiwan

A research story was published on the EGI site in which the HADDOCK portal featured:

List of 2016 publications acknowledging WeNMR/MoBRain/Westlife compiled in:

List of 2016 presentations:


  • DARIAH-CC was presented at the DARIAH Annual meeting in Ghent, 10-12 Oct 2016. At the meeting, DARIAH-CC was presented in forms of a lighting talk (general audience), demonstration of the services (PSSE, SSE, DBO@Cloud, Simple Cloud Access, DARIAH SG) and a workshop.
  • Extended abstract with the title "Towards a Collaborative Cultural Lexicography Portal: the DARIAH Competence Centre" was accepted for a presentation at COST ENel workshop that will take place in Budapest, 24-25 Feb 2017
  • Short paper under evaluation for the DPASSH2017 conference (14-15 June 2017, Brighton, UK), title: "Preserving and Managing Digital Art and Humanities Data in the Open Science Cloud"
  • Preparing inputs for Template Thematic Service with service (DARIAH Science Gateway) for Digital Arts and Humanities research groups (DARIAH-ERIC)
  • Proposal submitted for RDA call for collaborative projects. The project name is "Dynamic metadata design to support collaborative science approach". Under review.
  • Preparing deliverable D6.17 - "Production level gateway for Arts and Humanities"

Task SA2.7 LifeWatch

Last (long and participative) meeting on Friday 13th January (9.30-11h, more than 20 participants from ES,IT,NL,BE,GR,PT, central team from Granada, at CEAMA, environmental center). Preparing input to Thematic Service (as LIFEWATCH ERIC) using the EINFRA12 template. Completing D6.18 using the indicators agreed. Target: end of this month. Technical Progress also with Observatories, Workflow tools, and Citizen Science tools. Collaboration with COOP+ project (joining RI efforts to address global challenges at world level).

Task SA2.8 EISCAT_3D

Continued work on the Dirac portal, by adding more data with increased complexity of access. Documentation is being prepared for users to test the portal. One issue for users is the certificate handling, which is a new thing to them. Also that it has to be included into perun. Started some processing activity involving staging and simple scripts.

Task SA2.9 EPOS

  • Working on the 3 demonstrators, and writing the deliverable about these - to be released for WP review around Jan 31.

Task SA2.10 Disaster Mitigation