Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Agenda-2020-04-20"

From EGIWiki
Jump to navigation Jump to search
 
(8 intermediate revisions by 2 users not shown)
Line 8: Line 8:


== UMD ==
== UMD ==
* Next scheduled release is February's UMD 4.10.0: https://wiki.egi.eu/wiki/UMD_Release_Schedule
 
** delayed due to difficulties with StagedRollout communications for some products
* UMD 4.10.0 released in March http://repository.egi.eu/2020/03/26/release-umd-4-10-0/ (regular release)
* UMD 4.10.2 released in April http://repository.egi.eu/2020/04/15/release-umd-4-10-2/ (HTCondor urgent update)
* UMD 4.10.1 and 4.10.3 are fixes
* CMD 1.3.0 released in February http://repository.egi.eu/2020/02/18/release-cmd-os-1-3-0/ (cloud info provider, APEL, caso 1.4.0)
* plans on CentOS8 STARTED
* plans on CentOS8 STARTED
** https://wiki.egi.eu/wiki/Next_middleware_release
** https://wiki.egi.eu/wiki/Next_middleware_release
* integration of HTCondor-CE still finalizing
* integration of HTCondor-CE still finalizing
** HTCondor-CE released in UMD 4.9.1 http://repository.egi.eu/2019/12/04/release-umd-4-9-1/ pointing to the original documentation (the documentation is OK)
** still needed to contribute to the WN package
** still needed to contribute to the WN package
* '''Are NGIs willing to investigate among their site admins about condor/HTCondor-CE skills and contribute with available recipes or help?''' -> no feedback at last EGI Ops meeting


== CMD ==
== CMD ==
Line 24: Line 25:
** '''[[Preview 1.26.0]]''' [https://appdb.egi.eu/store/software/preview.repository/releases/1.0/1.26.0/ AppDB info] (sl6):  ARC 6.4.1, CVMFS 2.7.0, dCache 5.2.13, gfal2 2.17.1, STORM 1.11.17, xrootd 4.11.1
** '''[[Preview 1.26.0]]''' [https://appdb.egi.eu/store/software/preview.repository/releases/1.0/1.26.0/ AppDB info] (sl6):  ARC 6.4.1, CVMFS 2.7.0, dCache 5.2.13, gfal2 2.17.1, STORM 1.11.17, xrootd 4.11.1
** '''[[Preview 2.26.0]]''' [https://appdb.egi.eu/store/software/preview.repository/releases/2.0/2.26.0/ AppDB info] (CentOS 7):  ARC 6.4.1, CVMFS 2.7.0, dCache 5.2.13, gfal2 2.17.1, STORM 1.11.17, xrootd 4.11.1
** '''[[Preview 2.26.0]]''' [https://appdb.egi.eu/store/software/preview.repository/releases/2.0/2.26.0/ AppDB info] (CentOS 7):  ARC 6.4.1, CVMFS 2.7.0, dCache 5.2.13, gfal2 2.17.1, STORM 1.11.17, xrootd 4.11.1
* collecting information for the next update


= Operations  =
= Operations  =


== ARGO/SAM  ==
== ARGO/SAM  ==
* Swift probe deployed in production https://ggus.eu/index.php?mode=ticket_info&ticket_id=143069
* new cream probe under test: https://ggus.eu/index.php?mode=ticket_info&ticket_id=144554
* new cream probe under test: https://ggus.eu/index.php?mode=ticket_info&ticket_id=144554
** general failures with eu.egi.CREAMCE.WN-Softver need to be investigated
** general failures with eu.egi.CREAMCE.WN-Softver need to be investigated
Line 36: Line 39:
== FedCloud  ==
== FedCloud  ==


[https://ggus.eu/?mode=ticket_search&status=open&user=spinoso&date_type=creation+date&tf_radio=1&timeframe=any&keyword=Please%20upgrade%20to%20cASO%201.4.0&orderticketsby=REQUEST_ID&orderhow=desc&search_submit=GO cASO upgade campaign on OpenStack sites]
* [https://ggus.eu/?mode=ticket_search&status=open&user=spinoso&date_type=creation+date&tf_radio=1&timeframe=any&keyword=Please%20upgrade%20to%20cASO%201.4.0&orderticketsby=REQUEST_ID&orderhow=desc&search_submit=GO cASO upgade campaign on OpenStack sites]
* [https://indico.egi.eu/event/4775/ badging]


== Feedback from DMSU  ==
== Feedback from DMSU  ==
Line 72: Line 76:
***UA-KNU: GlueSEUniqueID wasn't published due to missing DNS back-resolving record for IPv6 address of the SE.
***UA-KNU: GlueSEUniqueID wasn't published due to missing DNS back-resolving record for IPv6 address of the SE.
**NGI_UK: https://ggus.eu/index.php?mode=ticket_info&ticket_id=146455
**NGI_UK: https://ggus.eu/index.php?mode=ticket_info&ticket_id=146455
***UKI-NORTHGRID-SHEF-HEP
***UKI-NORTHGRID-SHEF-HEP: ARC-CE failures
**ROC_CANADA: https://ggus.eu/index.php?mode=ticket_info&ticket_id=146452
**ROC_CANADA: https://ggus.eu/index.php?mode=ticket_info&ticket_id=146452
***CA-SFU-T2: SLURM problems caused failures to site-BDII freshness check due to some old jobs not properly cancelled; A/R figures are now improving
***CA-SFU-T2: SLURM problems caused failures to site-BDII freshness check due to some old jobs not properly cancelled; A/R figures are now improving
Line 81: Line 85:
== IPv6 readiness plans  ==
== IPv6 readiness plans  ==


* INFORMATION ARE 6 MONTHS OLD, '''please provide updates''' to the IPv6 assessment (ongoing) https://wiki.egi.eu/w/index.php?title=IPV6_Assessment  
* please provide updates to the IPv6 assessment (ongoing) https://wiki.egi.eu/w/index.php?title=IPV6_Assessment  
* if any relevant, information will be summarised at  OMB
* if any relevant, information will be summarised at  OMB


Line 251: Line 255:


= AOB  =
= AOB  =
* Storage accounting: http://goc-accounting.grid-support.ac.uk/storagetest/storagesitesystems.html
** several sites stopped publishing storage accounting records: it needs to investigate on and fix it


== Next meeting  ==
== Next meeting  ==
May 11th, 2020 https://indico.egi.eu/event/4899/

Latest revision as of 15:20, 20 April 2020

Main EGI.eu operations services Support Documentation Tools Activities Performance Technology Catch-all Services Resource Allocation Security


Documentation menu: Home Manuals Procedures Training Other Contact For: VO managers Administrators


Back to https://wiki.egi.eu/wiki/Operations_Meeting

General information

Middleware

UMD

CMD

Preview repository

  • released on 2020-01-21:
  • collecting information for the next update

Operations

ARGO/SAM

FedCloud

Feedback from DMSU

Monthly Availability/Reliability

  • sites suspended:

IPv6 readiness plans

LCGDM end of support and migration to / enabling of DOME

  • Deployment statistics (Apr 17th):
$ ldapsearch -x -LLL -H ldap://egee-bdii.cnaf.infn.it:2170 -b "GLUE2GroupID=grid,o=glue" '(&(objectClass=GLUE2Manager)(GLUE2ManagerProductName=DPM))' GLUE2ManagerProductVersion GLUE2ManagerID | grep GLUE2ManagerProductVersion | sort | uniq -c
     1 GLUE2ManagerProductVersion: 1.10.0
    67 GLUE2ManagerProductVersion: 1.13.0
     2 GLUE2ManagerProductVersion: 1.13.1
     8 GLUE2ManagerProductVersion: 1.13.2
     4 GLUE2ManagerProductVersion: 1.8.10
     1 GLUE2ManagerProductVersion: 1.8.8
     1 GLUE2ManagerProductVersion: 1.8.9
     4 GLUE2ManagerProductVersion: 1.9.0


Liasing with WLCG to follow-up the upgrade. Opened GGUS tickets asking the following:

  • all the sites with older DPM versions than 1.12 are suggested to upgrade to the latest DPM version , following the guide DPM upgrade (chapter 1 Upgrade to DPM 1.10.0 "Legacy Flavour" and chapter 2 Upgrade to DPM 1.10.0 "Dome Flavour")
    • DOME and the old LCGDM (srm protocol) will coexist
  • Monitoring: sites should enable the monitoring of the HTTP/WebDav and/or GridFTP endpoints
    • register the storage service endpoint as webdav and/or globus-GRIDFTP service type, with production flag disabled, providing respectively the URL field and the Extension Properties information as explained in the HOWTO21
    • check if the tests are ok
    • switch the production flag to "yes"

List of tickets


Site Ticket Notes
AEGIS03-ELEF-LEDA https://ggus.eu/index.php?mode=ticket_info&ticket_id=143152 webdav failures...
GARR-01-DIR https://ggus.eu/index.php?mode=ticket_info&ticket_id=143160
GRID-UNAM https://ggus.eu/index.php?mode=ticket_info&ticket_id=143161 scheduled a downtime in Feb for upgrade
INDIACMS-TIFR https://ggus.eu/index.php?mode=ticket_info&ticket_id=142245 upgrade delayed to to COVID-19 lockdown in Mumbai
MA-01-CNRST https://ggus.eu/index.php?mode=ticket_info&ticket_id=143166
MA-04-CNRST-ATLAS https://ggus.eu/index.php?mode=ticket_info&ticket_id=143167 SRM disabled; waiting to fix webdav and gridftp failures
OBSPM https://ggus.eu/index.php?mode=ticket_info&ticket_id=143169 they asked for quattor documentation...
TASK https://ggus.eu/index.php?mode=ticket_info&ticket_id=143174 problem with starting xrootd...
UA_ICYB_ARC https://ggus.eu/index.php?mode=ticket_info&ticket_id=143178
WCSS64 https://ggus.eu/index.php?mode=ticket_info&ticket_id=143182 they need some time to gain enough knowledge for doing the upgrade....
GR-07-UOI-HEPLAB https://ggus.eu/index.php?mode=ticket_info&ticket_id=143467 still on slc6, some problems with the upgrade; before the end of the year all the site will be migrated to CentOS 7
Hephy-Vienna https://ggus.eu/index.php?mode=ticket_info&ticket_id=143277 DPM will be replaced with EOS during Q1 2020
HK-LCG2 https://ggus.eu/index.php?mode=ticket_info&ticket_id=143471 April 2020
ICM https://ggus.eu/index.php?mode=ticket_info&ticket_id=143091 dpm in the newest version. Now we are setting quota tokens...
IN2P3-IPNL https://ggus.eu/index.php?mode=ticket_info&ticket_id=143082 migration to EOS, dpm should be dismissed by mid 2020
IN2P3-IRES https://ggus.eu/index.php?mode=ticket_info&ticket_id=143070 testing the upgrade on the test infrastructure
INFN-ROMA1 https://ggus.eu/index.php?mode=ticket_info&ticket_id=143276 to enable the webdav monitoring
NIKHEF-ELPROD https://ggus.eu/index.php?mode=ticket_info&ticket_id=143286 We won't upgrade. we plan to migrate to dCache before the end of 2019.
PSNC https://ggus.eu/index.php?mode=ticket_info&ticket_id=143474
ru-PNPI https://ggus.eu/index.php?mode=ticket_info&ticket_id=143281
UKI-SCOTGRID-DURHAM https://ggus.eu/index.php?mode=ticket_info&ticket_id=143465 migration to CentOS7, first....
UKI-SCOTGRID-ECDF https://ggus.eu/index.php?mode=ticket_info&ticket_id=143077 upgrading to CentOS7 first without DOME
UKI-SCOTGRID-GLASGOW https://ggus.eu/index.php?mode=ticket_info&ticket_id=143076 plan in progress
UKI-SOUTHGRID-BRIS-HEP https://ggus.eu/index.php?mode=ticket_info&ticket_id=143083


HTCondorCE integration

Link to procedure: https://wiki.egi.eu/wiki/PROC19

GGUS ticket: https://ggus.eu/index.php?mode=ticket_info&ticket_id=139377

Remaining steps:

SECMON failures

Several CEs are failing the job submission tests, preventing pakiti to check the vulnerabilities fixes on the WNs.

AOB

Next meeting

May 11th, 2020 https://indico.egi.eu/event/4899/