Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:Ibergrid-QR14"

From EGIWiki
Jump to navigation Jump to search
 
(35 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{Template:Op menubar}} {{Template:Inspire_reports_menubar}} {{TOC_right}}  
{{Template:EGI-Inspire menubar}}


{{Template:Inspire_reports_menubar}}
{{TOC_right}}
<br>  
<br>  


Line 33: Line 35:
! Participants
! Participants
! Outcome (Short report &amp; Indico URL)
! Outcome (Short report &amp; Indico URL)
|-
| 17 Sep 2013 
| Madrid, Spain
| New developments in WLCG for Run2
| M. Salichos, G. Donvito, P. Saiz, J. Flix and J. Pina
| A workshop within the EGI Tehcnical Forum celebrated in Madrid from 16-20 September 2013. The link to the session, chaired by J. Flix and M. Delfino, is available in: https://indico.egi.eu/indico/sessionDisplay.py?sessionId=53&confId=1417#20130917
|-
|-
| 19-20 Sep 2013   
| 19-20 Sep 2013   
| Madrid, Spain
| Madrid, Spain
| IBERGRID 2013, 7th Iberian Grid Infrastructure Conference
| IBERGRID 2013, 7th Iberian Grid Infrastructure Conference
| 50
| (~50)
| The 2013 IBERGRID conference was organized by ES-NGI, The Spanish National Grid Initiative, in Madrid and co-located with the EGI Technical Forum 2013. The main topics of IBERGRID 20123 Conference were:  
| The 2013 IBERGRID conference was organized by IBERGRID (ES-NGI and PT-NGI), in Madrid and co-located with the EGI Technical Forum 2013. The main topics of IBERGRID 2013 Conference were:  
Infrastructures, Services and Operations, Innovation in the provision of IT services: virtualization and cloud computing, Data Management and Storage Systems, IT Management and Green Computing, EGI and WLCG Grid Computing Activities, Achievements of e-Infrastructure projects, Community Oriented Services, User and Applications and Technology Transfer to Society. This is the annual meeting gathering IBERGRID operators and user communities to reassess the past activities, debate problems and define joint strategies. Conference URL: http://www.ibergrid.eu/2013/
Infrastructures, Services and Operations, Innovation in the provision of IT services: virtualization and cloud computing, Data Management and Storage Systems, IT Management and Green Computing, EGI and WLCG Grid Computing Activities, Achievements of e-Infrastructure projects, Community Oriented Services, User and Applications and Technology Transfer to Society. This is the annual meeting gathering IBERGRID operators and user communities to reassess the past activities, debate problems and define joint strategies. Conference URL: http://www.ibergrid.eu/2013/
|}
|}
Line 58: Line 66:
| Conference Programe URL: http://hais13.usal.es/
| Conference Programe URL: http://hais13.usal.es/
* CIEMAT
* CIEMAT
# Miguel Cárdenas Montes, Metaoptimization of Differential Evolution by Using Productions of Low-Number of Cycles: the Fitting of Rotation Curves of Spiral Galaxies as Case Study, http://hais13.usal.es/?q=node/6
# Miguel Cárdenas Montes et al, Metaoptimization of Differential Evolution by Using Productions of Low-Number of Cycles: the Fitting of Rotation Curves of Spiral Galaxies as Case Study, http://hais13.usal.es/?q=node/6
|-
|-
| 16-20 Sep 2013   
| 16-20 Sep 2013   
| Madrid, Spain  
| Madrid, Spain  
| EGI Technical Forum 2013
| EGI Technical Forum 2013
| 50
| (~50)
| Conference Programe URL: http://tf2013.egi.eu/
| Conference Programe URL: http://tf2013.egi.eu/
* BIFI
# Jaime Ibar et al, Cloud resources at BIFI, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417
* CESGA:
* CESGA:
# I. Díaz,  participated in the EGI Accounting workshop which enabled the developers of EGI Accounting tools to disseminate information about new versions and latest developments. The workshop covered recent developments in EGI Accounting, including the new APEL Client, the Regional APEL Server and Application Accounting, https://indico.egi.eu/indico/sessionDisplay.py?sessionId=41&confId=1417#20130918
# I. Díaz et al,  participated in the EGI Accounting workshop which enabled the developers of EGI Accounting tools to disseminate information about new versions and latest developments. The workshop covered recent developments in EGI Accounting, including the new APEL Client, the Regional APEL Server and Application Accounting, https://indico.egi.eu/indico/sessionDisplay.py?sessionId=41&confId=1417#20130918
# A. Simon et al, Running Hadoop in the cloud, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417
* CETA-GRID
#Miguel Ángel Díaz Corchero et al, Managing and using interoperable DCIs through a standard-based Science Gateway, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=1&contribId=11&confId=1662
* CIEMAT
* CIEMAT
# M. Cárdena Montes et al, demonstration: Managing and using interoperable DCIs through a standard-based Science Gateway, http://tf2013.egi.eu/posters_demos/
# M. Cárdena Montes et al, demonstration: Managing and using interoperable DCIs through a standard-based Science Gateway, http://tf2013.egi.eu/posters_demos/
# Manuel Rodríguez-Pascual et al, Standard-based Interoperability amongst HPC, Grid and Cloud Resources Distributed Worldwide with Catania Science Gateways, https://indico.egi.eu/indico/contributionDisplay.py?contribId=189&confId=1417
# Manuel Rodríguez-Pascual et al, Standard-based Interoperability amongst HPC, Grid and Cloud Resources Distributed Worldwide with Catania Science Gateways, https://indico.egi.eu/indico/contributionDisplay.py?contribId=189&confId=1417
* IFAE
# J. Flix et al, demonstration: Connecting PIC Tier-1 into the network of the future, http://tf2013.egi.eu/posters_demos/
# J. Flix et al, demonstration: Integrating and testing SLURM in EMI-3 cream-CE, http://tf2013.egi.eu/posters_demos/
# J. Flix et al, demonstration: Setting up a log centralization infrastructure, http://tf2013.egi.eu/posters_demos/
# J. Flix, M. Delfino et al, participated in the following workshop: New developments in WLCG for Run2, https://indico.egi.eu/indico/sessionDisplay.py?sessionId=53&confId=1417#20130917
*IFCA
#Pablo Orviz, Alvaro Lopez, Towards an Agile Infrastructure: IFCA experience, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=27&contribId=256&confId=1417
*LIP
# J. Pina, UMD staged rollout testing, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=53&contribId=248&confId=1417
|-
| 16-20 Sep 2013 
| Madrid, Spain
| LIFEWATCH workshop at EGI TF 2013
| 1
|
* LIP
# J. Gomes, IBERGRID Infrastructure
|-
|-
| 17-20 Sep 2013  
| 17-20 Sep 2013  
Line 77: Line 107:
| Conference Programe URL: http://caepia13.aepia.org/
| Conference Programe URL: http://caepia13.aepia.org/
* CIEMAT
* CIEMAT
# Miguel Cárdenas Montes, Concurrent CPU-GPU code optimization: The two-point angular correlation function as case study
# Miguel Cárdenas Montes et al, Concurrent CPU-GPU code optimization: The two-point angular correlation function as case study
|-
|-
| 19-20 Sep 2013   
| 19-20 Sep 2013   
| Madrid, Spain  
| Madrid, Spain  
| IBERGRID 2013, 7th Iberian Grid Infrastructure Conference   
| IBERGRID 2013, 7th Iberian Grid Infrastructure Conference   
| 50
| (~50)
| Conference Programe URL: http://www.ibergrid.eu/2013/programme.html
| Conference Programe URL: http://www.ibergrid.eu/2013/programme.html
* BIFI
# Jaime Ibar et al, Cloud resources at BIFI
* CESGA:
* CESGA:
# A. Simon et al, Towards Federated Cloud Image Management
# A. Simon et al, Towards Federated Cloud Image Management  
# A. Simon et al, Running Hadoop in the cloud
* CIEMAT
* CIEMAT
# M. Cárdena Montes et al, Calculation of Two-Point Angular Correlation Function: Implementations on Many-Cores and Multicores Processors
# M. Cárdena Montes et al, Calculation of Two-Point Angular Correlation Function: Implementations on Many-Cores and Multicores Processors
Line 95: Line 122:
* IFCA
* IFCA
# E. Fernandez, IberCloud Status Update  
# E. Fernandez, IberCloud Status Update  
# Alvaro Lopez, Analysis of Scientific Cloud Computing requirements
# Alvaro Lopez et al, Analysis of Scientific Cloud Computing requirements
* IFISC-GRID
* IFISC-GRID
# A. Tugores, Big data and urban mobility
# A. Tugores et al, Big data and urban mobility
* LIP
* LIP
# G. Borges, SPARKS, a dynamic power-aware approach for managing computing cluster resources
# G. Borges et al, SPARKS, a dynamic power-aware approach for managing computing cluster resources
# J. Gomes, Ibergrid Status
# J. Gomes, Ibergrid Status
# J. Gomes, Analyzing File Access Patterns in Distributed File-systems
# J. Gomes et al, Analyzing File Access Patterns in Distributed File-systems
* PIC
* PIC
# José Flix, The LHC Tier1 at PIC: experience from first LHC run and getting prepared for the next
# José Flix et al, The LHC Tier1 at PIC: experience from first LHC run and getting prepared for the next
* UPV
* UPV
# I. Blanquer, Leveraging Hybrid Data Infrastructure for Ecological Niche Modeling: The EUBrazilOpenBio Experience
# I. Blanquer et al, Leveraging Hybrid Data Infrastructure for Ecological Niche Modeling: The EUBrazilOpenBio Experience
# I. Blanquer, Improving data locality on distributed Grid applications in bioinformatics
# I. Blanquer et al, Improving data locality on distributed Grid applications in bioinformatics
# M. Caballer, Platform to Ease the Deployment and Improve the Availability of TRENCADIS Infrastructure  
# M. Caballer et al, Platform to Ease the Deployment and Improve the Availability of TRENCADIS Infrastructure  
|-
|-
| 19-20 Sep 2013  
| 19-20 Sep 2013  
Line 124: Line 151:
* CIEMAT
* CIEMAT
# José Luis Velasco Garasa, Invited talk: Neoclassical Viscosity and Rotation in stellarators
# José Luis Velasco Garasa, Invited talk: Neoclassical Viscosity and Rotation in stellarators
|-
| 14 Oct 2013
| Amsterdam
| CHEP2013
| 6
| Conference Programe URL: http://www.chep2013.org/
* IFAE
# V. Méndez et al, Cloud flexibility using Dirac Interware
# J. Flix et al, Operating the Worldwide LHC Computing Grid: current and future challenges
# J. Flix, F. López et al, Deployment of a WLCG network monitoring infrastructure based on the perfSONAR-PS technology
# J. Flix et al, CMS Computing Operations During Run1
# A. Sedov et al, ATLAS Distributed Computing Operation Shift Teams experience during the discovery year and beginning of the Long Shutdown 1
# A. Perez-Calero, CMS Multicore Scheduling Strategy
# M. Delfino, A.Sedov et al, Lessons learned from the ATLAS performance studies of the Iberian Cloud for the first LHC running period
|-
|-
|}
|}
Line 142: Line 183:
! align="left" | Authors ''<br>1.<br>2.<br>3.<br>Et al?''
! align="left" | Authors ''<br>1.<br>2.<br>3.<br>Et al?''
|-
|-
| Cloud resources at BIFI  
| Cloud resources at BIFI
| EGI Technical Forum 2013 Conference Abstract
| https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417
| J. Ibar et al<br>
|-
| Running Hadoop in the cloud
| EGI Technical Forum 2013 Conference Abstract
| https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417
| A. Simon et al<br>
|-
| Managing and using interoperable DCIs through a standard-based Science Gateway
| EGI Technical Forum 2013 Conference Abstract
| https://indico.egi.eu/indico/contributionDisplay.py?sessionId=1&contribId=11&confId=1662
| M. Díaz et al<br>
|-
| Standard-based Interoperability amongst HPC, Grid and Cloud Resources Distributed Worldwide with Catania Science Gateways
| EGI Technical Forum 2013 Conference Abstract
| https://indico.egi.eu/indico/contributionDisplay.py?contribId=189&confId=1417
| M. Rodríguez-Pascual et al<br>
|-
| Towards an Agile Infrastructure: IFCA experience
| EGI Technical Forum 2013 Conference Proceedings
| https://indico.egi.eu/indico/contributionDisplay.py?sessionId=27&contribId=256&confId=1417
| Pablo Orviz, Alvaro Lopez<br>
|-
| SPARKS, a dynamic power-aware approach for managing computing cluster resources
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 3-15
| Jaime Ibar et al, Cloud resources at BIFI<br>
| G. Borges et al<br>
|-
|-
| Towards Federated Cloud Image Management  
| Towards Federated Cloud Image Management  
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 33-44
| A. Simon et albr>
| A. Simon et al<br>
|-
|-
| Running Hadoop in the cloud
| Graph Database for Structured Radiology Reporting
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 61-74
| A. Simon et al<br>
| I. Blanquer et al<br>
|-
|-
| Performance Assessment of a Chaos-based Image Cipher on Multi-GPU
| Big data and urban mobility
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 75-88
|Juan José Rodríguez Vázquez et al<br>
| A. Tugores et al<br>
|-
|-
| An unattended and fault-tolerant approach for the execution of distributed applications
| Analyzing File Access Patterns in Distributed File-systems
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 89-101
| Manuel Rodríguez-Pascual et al<br>
| J. Gomes et al<br>
|-
|-
|-
| Calculation of Two-Point Angular Correlation Function: Implementations on Many-Cores and Multicores Processors
| Studying the improving of data locality on distributed Grid applications in bioinformatics
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 103-115
| Manuel Rodríguez-Pascual et al<br>
| I. Blanquer et al<br>
|-
|-
 
| Platform to Ease the Deployment and Improve the Availability of TRENCADIS Infrastructure
 
 
 
| IberCloud Status Update
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 133-145
| E. Fernandez<br>
| M. Caballer et al<br>
|-
|-
| Analysis of Scientific Cloud Computing requirements  
| Analysis of Scientific Cloud Computing requirements  
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 147-158
| Alvaro Lopez<br>
| Alvaro Lopez et al<br>
|-
|-
| Big data and urban mobility
| Easing the Structural Analysis Migration to the cloud
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 159-171
| A. Tugores<br>
| M. Caballer et al<br>
|-
|-
| SPARKS, a dynamic power-aware approach for managing computing cluster resources
| Leveraging Hybrid Data Infrastructure for Ecological Niche Modeling: The EUBrazilOpenBio Experience
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 175-187
| G. Borges<br>
| I. Blanquer et al<br>
|-
|-
| Ibergrid Status
| An unattended and fault-tolerant approach for the execution of distributed applications
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 189-202
| J. Gomes<br>
| Manuel Rodríguez-Pascual et al<br>
|-
|-
| Analyzing File Access Patterns in Distributed File-systems
| Calculation of Two-Point Angular Correlation Function: Implementations on Many-Cores and Multicores Processors
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 203-214
| J. Gomes<br>
| M. Cárdenas et al<br>
|-
|-
| The LHC Tier1 at PIC: experience from first LHC run and getting prepared for the next
| Performance Assessment of a Chaos-based Image Cipher on Multi-GPU
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 215-226
| José Flix<br>
|J. Rodríguez et al<br>
|-
|-
| Leveraging Hybrid Data Infrastructure for Ecological Niche Modeling: The EUBrazilOpenBio Experience
| The LHC Tier1 at PIC: experience from first LHC run and getting prepared for the next
| 7th Iberian Grid Infrastructure Conference Proceedings
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:  
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 241-253
| I. Blanquer<br>
| J. Flix et al<br>
|-
| Improving data locality on distributed Grid applications in bioinformatics
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:
| I. Blanquer<br>
|-
| Platform to Ease the Deployment and Improve the Availability of TRENCADIS Infrastructure
| 7th Iberian Grid Infrastructure Conference Proceedings
| Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages:
| M. Caballer<br>
|-
|-
|}
|}
Line 233: Line 283:


===2.1. Progress Summary=== <!-- Provide your test below -->  
===2.1. Progress Summary=== <!-- Provide your test below -->  
* Research on automatic failover mechanisms for regional SAM
* Participation in the task force on availability/reliability computation
* Participation in the task force on availability/reliability computation
* Participation in the biweekly operation meetings
* Follow up and support of the SHA-2 compliant infrastructure campaign
* Provide feedback on the survey focused on NGI services provisioning and usage
* Follow up and support of the Glue-validator compliant infrastructure campaign
* Follow up and support of the SHA-2 compliant infrastructure campaign.
* Follow up and support of GOCDB MPI registration campaign
* Review of the "Compromised Certificates and Emergency suspension" Procedure
* Follow up with unresponsive VO managers regarding incomplete information (in the operations portal) for VOs in VOMS inside the iberian infrastructure
* Finalize decommission of two sites: SGAI-CSIC and IAA-CSIC
* Evaluation of operation core activities biding process
* Follow up with regional sites regarding  
* Follow up with regional sites regarding  
# EGI ADVISORY [EGI-ADV-20130514]
# EGI SVG ADVISORY [EGI-SVG-2013-5890]
# EGI SVG ADVISORY [EGI-SVG-2013-5268]
# EGI SVG ADVISORY [EGI-SVG-2013-5266]
# EGI SVG ADVISORY [EGI-SVG-2013-5331]
# EGI SVG ADVISORY [EGI-SVG-2013-5615]
# EGI SVG ADVISORY [EGI-SVG-2012-3306]
# EGI SVG ADVISORY [EGI-SVG-2013-5999]
# EGI SVG ADVISORY [EGI-SVG-2013-5138]


===2.2. Main Achievements===  
===2.2. Main Achievements===  
* Implementation of backup SAM nagios @ LIP
* The WMS used by the Ibergrid Regional Nagios (https://rnagios.ibergrid.cesga.es/nagios/) and the Ibergrid Regional Nagios backup (https://rnagios.ncg.ingrid.pt/nagios/) to submit the SAM tests were migrated to UMD-3. These WMS are:
* Push for the extension of CVMFS client configuration to support phys.vo.ibergrid.eu. CVMFS for phys.vo.ibergrid.eu is already available at almost all WLCG sites
* wms02.ncg.ingrid.pt hosted at LIP.
* Provisioning of resources for the Distributed Research Infrastructure for Hydro-Meteorology Study (DRIHM) project at some of the Iberian sites
* wms03.egi.cesga.es hosted at CESGA.
* 100% availability/reliability for the topbdii.core.ibergrid.eu service during QR13
* 100% availability/reliability for the topbdii.core.ibergrid.eu service during QR14
* Sustainable integrated A/R for ibergrid sites during QR13
* Sustainable integrated A/R for ibergrid sites during QR14
# May (98%/98% A/R)
# Aug (96%/98% A/R)
# June (98%/98% A/R)
# Sept (94%/96% A/R)
# July (96%/97% A/R)


=== 2.3. Issues and mitigation  ===
=== 2.3. Issues and mitigation  ===
Line 265: Line 312:
|-
|-
| SAM tests seems to be failing for a couple of hours during the first hours of the 1st of each month
| SAM tests seems to be failing for a couple of hours during the first hours of the 1st of each month
| Investigation of the issue was inconclusive. For the transition July --> August we have switch to the backup nagios at LIP to understand if the failure is related to the site (main instance is deployed at CESGA) or to the service itself.
| There is already a GGUS ticket opened to track this issue because it is also affecting to other NGIS, https://ggus.eu/ws/ticket_info.php?ticket=87997 . According to the ticket, the fix was released in EMI3 update at the end of September 2013 and it will be released in EMI2 update at the end of October 2013.
|-  
|-  
| Failover between backup SAM instance and main SAM instance is manual
| Failover between backup SAM instance and main SAM instance is manual
| We are investigating in some mechanism to trigger the failover automatically
| We are investigating in some mechanism to trigger the fail-over automatically
|-
| Incident with Top-BDIIs (due to a bug, some top-bdiis were publishing incomplete information, and the failover mechanism was always picking those BDIIs because they were fast to reply)
| Top-BDIIs with problems were fixed and the recomputation of A/R was requested for the time period: https://ggus.eu/ws/ticket_info.php?ticket=97865
|}
|}
[[Category:NGI_QR_Reports]]

Latest revision as of 16:12, 7 January 2015

EGI Inspire Main page


Inspire reports menu: Home • SA1 weekly Reports • SA1 Task QR Reports • NGI QR Reports • NGI QR User support Reports




Quarterly Report Number NGI Name Partner Name Author
QR14 NGI_IBERGRID LIP & CSIC Esteban Freire (CESGA)


1. MEETINGS AND DISSEMINATION

Note: Complete the tables below by adding as many rows as needed.

1.1. CONFERENCES/WORKSHOPS ORGANISED

Date Location Title Participants Outcome (Short report & Indico URL)
17 Sep 2013 Madrid, Spain New developments in WLCG for Run2 M. Salichos, G. Donvito, P. Saiz, J. Flix and J. Pina A workshop within the EGI Tehcnical Forum celebrated in Madrid from 16-20 September 2013. The link to the session, chaired by J. Flix and M. Delfino, is available in: https://indico.egi.eu/indico/sessionDisplay.py?sessionId=53&confId=1417#20130917
19-20 Sep 2013 Madrid, Spain IBERGRID 2013, 7th Iberian Grid Infrastructure Conference (~50) The 2013 IBERGRID conference was organized by IBERGRID (ES-NGI and PT-NGI), in Madrid and co-located with the EGI Technical Forum 2013. The main topics of IBERGRID 2013 Conference were:

Infrastructures, Services and Operations, Innovation in the provision of IT services: virtualization and cloud computing, Data Management and Storage Systems, IT Management and Green Computing, EGI and WLCG Grid Computing Activities, Achievements of e-Infrastructure projects, Community Oriented Services, User and Applications and Technology Transfer to Society. This is the annual meeting gathering IBERGRID operators and user communities to reassess the past activities, debate problems and define joint strategies. Conference URL: http://www.ibergrid.eu/2013/

1.2. OTHER CONFERENCES/WORKSHOPS ATTENDED

Date Location Title Participants Outcome (Short report & Indico URL)
11-13 Sep 2013 Salamanca, Spain HAIS 1 Conference Programe URL: http://hais13.usal.es/
  • CIEMAT
  1. Miguel Cárdenas Montes et al, Metaoptimization of Differential Evolution by Using Productions of Low-Number of Cycles: the Fitting of Rotation Curves of Spiral Galaxies as Case Study, http://hais13.usal.es/?q=node/6
16-20 Sep 2013 Madrid, Spain EGI Technical Forum 2013 (~50) Conference Programe URL: http://tf2013.egi.eu/
  • BIFI
  1. Jaime Ibar et al, Cloud resources at BIFI, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417
  • CESGA:
  1. I. Díaz et al, participated in the EGI Accounting workshop which enabled the developers of EGI Accounting tools to disseminate information about new versions and latest developments. The workshop covered recent developments in EGI Accounting, including the new APEL Client, the Regional APEL Server and Application Accounting, https://indico.egi.eu/indico/sessionDisplay.py?sessionId=41&confId=1417#20130918
  2. A. Simon et al, Running Hadoop in the cloud, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417
  • CETA-GRID
  1. Miguel Ángel Díaz Corchero et al, Managing and using interoperable DCIs through a standard-based Science Gateway, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=1&contribId=11&confId=1662
  • CIEMAT
  1. M. Cárdena Montes et al, demonstration: Managing and using interoperable DCIs through a standard-based Science Gateway, http://tf2013.egi.eu/posters_demos/
  2. Manuel Rodríguez-Pascual et al, Standard-based Interoperability amongst HPC, Grid and Cloud Resources Distributed Worldwide with Catania Science Gateways, https://indico.egi.eu/indico/contributionDisplay.py?contribId=189&confId=1417
  • IFAE
  1. J. Flix et al, demonstration: Connecting PIC Tier-1 into the network of the future, http://tf2013.egi.eu/posters_demos/
  2. J. Flix et al, demonstration: Integrating and testing SLURM in EMI-3 cream-CE, http://tf2013.egi.eu/posters_demos/
  3. J. Flix et al, demonstration: Setting up a log centralization infrastructure, http://tf2013.egi.eu/posters_demos/
  4. J. Flix, M. Delfino et al, participated in the following workshop: New developments in WLCG for Run2, https://indico.egi.eu/indico/sessionDisplay.py?sessionId=53&confId=1417#20130917
  • IFCA
  1. Pablo Orviz, Alvaro Lopez, Towards an Agile Infrastructure: IFCA experience, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=27&contribId=256&confId=1417
  • LIP
  1. J. Pina, UMD staged rollout testing, https://indico.egi.eu/indico/contributionDisplay.py?sessionId=53&contribId=248&confId=1417
16-20 Sep 2013 Madrid, Spain LIFEWATCH workshop at EGI TF 2013 1
  • LIP
  1. J. Gomes, IBERGRID Infrastructure
17-20 Sep 2013 Madrid, Spain CAEPIA 1 Conference Programe URL: http://caepia13.aepia.org/
  • CIEMAT
  1. Miguel Cárdenas Montes et al, Concurrent CPU-GPU code optimization: The two-point angular correlation function as case study
19-20 Sep 2013 Madrid, Spain IBERGRID 2013, 7th Iberian Grid Infrastructure Conference (~50) Conference Programe URL: http://www.ibergrid.eu/2013/programme.html
  • CESGA:
  1. A. Simon et al, Towards Federated Cloud Image Management
  • CIEMAT
  1. M. Cárdena Montes et al, Calculation of Two-Point Angular Correlation Function: Implementations on Many-Cores and Multicores Processors
  2. Juan José Rodríguez Vázquez et al, Performance Assessment of a Chaos-based Image Cipher on Multi-GPU
  3. Manuel Rodríguez-Pascual et al, An unattended and fault-tolerant approach for the execution of distributed applications
  • IFCA
  1. E. Fernandez, IberCloud Status Update
  2. Alvaro Lopez et al, Analysis of Scientific Cloud Computing requirements
  • IFISC-GRID
  1. A. Tugores et al, Big data and urban mobility
  • LIP
  1. G. Borges et al, SPARKS, a dynamic power-aware approach for managing computing cluster resources
  2. J. Gomes, Ibergrid Status
  3. J. Gomes et al, Analyzing File Access Patterns in Distributed File-systems
  • PIC
  1. José Flix et al, The LHC Tier1 at PIC: experience from first LHC run and getting prepared for the next
  • UPV
  1. I. Blanquer et al, Leveraging Hybrid Data Infrastructure for Ecological Niche Modeling: The EUBrazilOpenBio Experience
  2. I. Blanquer et al, Improving data locality on distributed Grid applications in bioinformatics
  3. M. Caballer et al, Platform to Ease the Deployment and Improve the Availability of TRENCADIS Infrastructure
19-20 Sep 2013 Barcelona, Spain European Conference on Complex Systems 2013 1 Conference Programe URL: http://www.eccs13.eu/
  • CIEMAT
  1. Francisco Prieto, Modeling Grid Environments as a Small-World Network. An Efficient Resources Selection Model
22-27 Sep 2013 Oxford (UK) EFTC2013 1 Conference Programe URL: http://www.eftc2013.org.uk/
  • CIEMAT
  1. José Luis Velasco Garasa, Invited talk: Neoclassical Viscosity and Rotation in stellarators
14 Oct 2013 Amsterdam CHEP2013 6 Conference Programe URL: http://www.chep2013.org/
  • IFAE
  1. V. Méndez et al, Cloud flexibility using Dirac Interware
  2. J. Flix et al, Operating the Worldwide LHC Computing Grid: current and future challenges
  3. J. Flix, F. López et al, Deployment of a WLCG network monitoring infrastructure based on the perfSONAR-PS technology
  4. J. Flix et al, CMS Computing Operations During Run1
  5. A. Sedov et al, ATLAS Distributed Computing Operation Shift Teams experience during the discovery year and beginning of the Long Shutdown 1
  6. A. Perez-Calero, CMS Multicore Scheduling Strategy
  7. M. Delfino, A.Sedov et al, Lessons learned from the ATLAS performance studies of the Iberian Cloud for the first LHC running period


1.3. PUBLICATIONS

Publication title Journal / Proceedings title Journal references
Volume number
Issue

Pages from - to 		Authors
1.
2.
3.
Et al?
Cloud resources at BIFI EGI Technical Forum 2013 Conference Abstract https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417 J. Ibar et al
Running Hadoop in the cloud EGI Technical Forum 2013 Conference Abstract https://indico.egi.eu/indico/contributionDisplay.py?sessionId=11&contribId=115&confId=1417 A. Simon et al
Managing and using interoperable DCIs through a standard-based Science Gateway EGI Technical Forum 2013 Conference Abstract https://indico.egi.eu/indico/contributionDisplay.py?sessionId=1&contribId=11&confId=1662 M. Díaz et al
Standard-based Interoperability amongst HPC, Grid and Cloud Resources Distributed Worldwide with Catania Science Gateways EGI Technical Forum 2013 Conference Abstract https://indico.egi.eu/indico/contributionDisplay.py?contribId=189&confId=1417 M. Rodríguez-Pascual et al
Towards an Agile Infrastructure: IFCA experience EGI Technical Forum 2013 Conference Proceedings https://indico.egi.eu/indico/contributionDisplay.py?sessionId=27&contribId=256&confId=1417 Pablo Orviz, Alvaro Lopez
SPARKS, a dynamic power-aware approach for managing computing cluster resources 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 3-15 G. Borges et al
Towards Federated Cloud Image Management 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 33-44 A. Simon et al
Graph Database for Structured Radiology Reporting 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 61-74 I. Blanquer et al
Big data and urban mobility 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 75-88 A. Tugores et al
Analyzing File Access Patterns in Distributed File-systems 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 89-101 J. Gomes et al
Studying the improving of data locality on distributed Grid applications in bioinformatics 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 103-115 I. Blanquer et al
Platform to Ease the Deployment and Improve the Availability of TRENCADIS Infrastructure 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 133-145 M. Caballer et al
Analysis of Scientific Cloud Computing requirements 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 147-158 Alvaro Lopez et al
Easing the Structural Analysis Migration to the cloud 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 159-171 M. Caballer et al
Leveraging Hybrid Data Infrastructure for Ecological Niche Modeling: The EUBrazilOpenBio Experience 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 175-187 I. Blanquer et al
An unattended and fault-tolerant approach for the execution of distributed applications 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 189-202 Manuel Rodríguez-Pascual et al
Calculation of Two-Point Angular Correlation Function: Implementations on Many-Cores and Multicores Processors 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 203-214 M. Cárdenas et al
Performance Assessment of a Chaos-based Image Cipher on Multi-GPU 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 215-226 J. Rodríguez et al
The LHC Tier1 at PIC: experience from first LHC run and getting prepared for the next 7th Iberian Grid Infrastructure Conference Proceedings Ed.: Editorial Universitat Politècnica de València, ISBN: 978-84-9048-110-3, Pages: 241-253 J. Flix et al

2. ACTIVITY REPORT

2.1. Progress Summary

  • Research on automatic failover mechanisms for regional SAM
  • Participation in the task force on availability/reliability computation
  • Follow up and support of the SHA-2 compliant infrastructure campaign
  • Follow up and support of the Glue-validator compliant infrastructure campaign
  • Follow up with regional sites regarding
  1. EGI SVG ADVISORY [EGI-SVG-2013-5890]
  2. EGI SVG ADVISORY [EGI-SVG-2013-5266]
  3. EGI SVG ADVISORY [EGI-SVG-2013-5615]
  4. EGI SVG ADVISORY [EGI-SVG-2012-3306]
  5. EGI SVG ADVISORY [EGI-SVG-2013-5999]
  6. EGI SVG ADVISORY [EGI-SVG-2013-5138]

2.2. Main Achievements

* wms02.ncg.ingrid.pt hosted at LIP. 
* wms03.egi.cesga.es hosted at CESGA.
  • 100% availability/reliability for the topbdii.core.ibergrid.eu service during QR14
  • Sustainable integrated A/R for ibergrid sites during QR14
  1. Aug (96%/98% A/R)
  2. Sept (94%/96% A/R)

2.3. Issues and mitigation

Issue Description Mitigation Description
SAM tests seems to be failing for a couple of hours during the first hours of the 1st of each month There is already a GGUS ticket opened to track this issue because it is also affecting to other NGIS, https://ggus.eu/ws/ticket_info.php?ticket=87997 . According to the ticket, the fix was released in EMI3 update at the end of September 2013 and it will be released in EMI2 update at the end of October 2013.
Failover between backup SAM instance and main SAM instance is manual We are investigating in some mechanism to trigger the fail-over automatically
Incident with Top-BDIIs (due to a bug, some top-bdiis were publishing incomplete information, and the failover mechanism was always picking those BDIIs because they were fast to reply) Top-BDIIs with problems were fixed and the recomputation of A/R was requested for the time period: https://ggus.eu/ws/ticket_info.php?ticket=97865
Retrieved from "https://wiki.egi.eu/w/index.php?title=EGI-InSPIRE:Ibergrid-QR14&oldid=75022"