Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Agenda-09-02-2015"

From EGIWiki
Jump to navigation Jump to search
 
(6 intermediate revisions by 2 users not shown)
Line 18: Line 18:
Recent, or future planned, releases from the product teams:
Recent, or future planned, releases from the product teams:


*[http://www.eu-emi.eu/releases/emi-3-monte-bianco/updates/-/asset_publisher/5Na8/content/update-22-10-11-2014-v-3-13-0-1#APEL_Parsers_v_2_4_0_APEL_Publis APEL 1.3.1]
* APEL 1.4.0
* DPM/LFC
<code>
** DPM/LFC 1.8.9 are in EPEL-stable - [https://svnweb.cern.ch/trac/lcgdm/blog/dpm_1.8.9_relnotes Release Notes]
What’s New
* EMI-UI/WN
    Added ability to process files compressed with bzip2.
** new update under preparation - including more [https://svnweb.cern.ch/trac/lcgdm/wiki/Integration/Clients DMC dependencies]
    Added multiplier retrieval to GridEngine parser for CPU and wall-clock time.
* [http://fts3-service.web.cern.ch/documentation/releases#quicktabs-release=0 FTS3 - 3.2.30]
    Fixed integer overflow when loading normalised summaries into APEL servers.
* [https://wiki.egi.eu/wiki/Agenda-05-01-2015#Frontier-Squid Frontier-Squid v. 2.7STABLE9-21.1] - Frontier-Squid is still pending stage-rollout
    Corrected the way some logging calls were made and reduced the logging level when trying to purge a directory that isn't empty.
* Globus Toolkit 6.0, MyProxy 6.0 - in EPEL-stable
    Changed server authorization system to keep the list of DNs for a limited time if unable to update from GOCDB and updated GOCDB query URL.
** http://toolkit.globus.org/toolkit/docs/6.0/
    Added Month and Year columns to primary key of CloudSummaries table in cloud schema.
* STORM - released
</code>
** [http://italiangrid.github.io/storm/2015/01/07/storm-v.1.11.5-released.html STORM v. 1.11.5]
 
* Argus PAP v. 1.6.2:
** This release provides a fix for the following issue: https://github.com/argus-authz/argus-pap/issues/ that caused SSL authentication errors for the pap-admin client after the upgrade to the latest JRE.  
 
* Globus - in EPEL Testing:
<code>
 
EPEL5: https://admin.fedoraproject.org/updates/FEDORA-EPEL-2015-0515/
EPEL6: https://admin.fedoraproject.org/updates/FEDORA-EPEL-2015-0524/
EPEL7: https://admin.fedoraproject.org/updates/FEDORA-EPEL-2015-0499/
 
</code>
* STORM - 1.11.6
* [https://wiki.egi.eu/wiki/Agenda-05-01-2015#UNICORE UNICORE v. 7.2.0]
* [https://wiki.egi.eu/wiki/Agenda-05-01-2015#UNICORE UNICORE v. 7.2.0]
* VOMS - released
** [http://www.eu-emi.eu/releases/emi-3-monte-bianco/updates/-/asset_publisher/5Na8/content/update-22-10-11-2014-v-3-13-0-1#VOMS_clients_v_3_0_5_native_2_0 VOMS C APIs, native clients and server v. 2.0.12, VOMS Clients v. 3.0.5, VOMS API Java v. 3.0.4]
** [http://www.eu-emi.eu/releases/emi-3-monte-bianco/updates/-/asset_publisher/5Na8/content/update-22-10-11-2014-v-3-13-0-1#VOMS_server_v_2_0_12_VOMS_admin VOMS server 2.0.12 & VOMS Admin server v. 3.3.1]
* [http://www.eu-emi.eu/releases/emi-3-monte-bianco/updates/-/asset_publisher/5Na8/content/update-22-10-11-2014-v-3-13-0-1#glite_proxyrenewal_v_1_3_36 ProxyRenewal 1.3.36] & [http://www.eu-emi.eu/releases/emi-3-monte-bianco/updates/-/asset_publisher/5Na8/content/update-22-10-11-2014-v-3-13-0-1#WMS_Server_v_3_6_6_2 WMS 3.6.6-2 (ICE)]


== UMD release  ==
== UMD release  ==
Line 40: Line 48:
* '''UMD 3.10.0 released on 09.12.2014''' : http://repository.egi.eu/2014/12/09/release-umd-3-10-0/
* '''UMD 3.10.0 released on 09.12.2014''' : http://repository.egi.eu/2014/12/09/release-umd-3-10-0/
** together with [https://wiki.egi.eu/wiki/SAMUpdate23 SAM Update 23]
** together with [https://wiki.egi.eu/wiki/SAMUpdate23 SAM Update 23]
* '''UMD 3.11.0 in preparation'''


== Staged rollout updates  ==
== Staged rollout updates  ==


* voms-clients 3.0.5
* argus-ees v. 0.2.1
* voms-admin 2.0.12
* UNICORE 7.2.0 components (tsi, registry, gateway, xuudb, unicore-x)


=== In Verification ===
=== In Verification ===
* cream-ge v. 2.3.1
N/A
* dpm v. 1.8.9
* Globus 6.0.0 (Gram5, Default Security, MyProxy, GridFtp)


'''New Products'''
'''New Products'''
Line 56: Line 64:


'''Ready to be released:'''
'''Ready to be released:'''
* apel v. 1.3.1
* apel-ssm v. 2.1.5
* Blah 1.20.7
* CGSI-gSOAP v. 1.3.7
* CREAM v. 1.16.4
* cream-ge v. 2.3.0
* cream-torque v. 2.1.4
* cream-torque v. 2.1.4
* cream v. 1.16.4
* Davix v. 0.4.0
* fts3 v.3.2.30
* DMlite 0.7.2
....
* DPM 1.8.9
* F.SQUID v. 2.7.19-21
* FTS3 v. 3.2.30
* gfal2 v. 2.7.8
* gfal2-python 1.6.0.
* Globus 6.0.0 products: Gridftp, Globus-Default-Security, Gram5, MyProxy;
* px v. 1.3.36
* qcg-computing-3.4.0 (only SL6)
* qcg-notifications-3.4.0 (only SL6)
* srm-ifce v. 1.21.4
* squid v. 2.7.19
* Voms Admin v. 2.0.12
* VOMS clients v. 3.0.5/3.0.6
* wms-ice v. 3.5.4


=== UMD 3 EA ===
=== UMD 3 EA ===
Line 65: Line 92:
* '''Some sites have the contact points for the EA adopters outdated'''  so please check in table if all contacts and products are still correct and send me email if you need to add / remove some contacts (SSO account mandatory): ([https://www.egi.eu/earlyAdopters/table full site list])
* '''Some sites have the contact points for the EA adopters outdated'''  so please check in table if all contacts and products are still correct and send me email if you need to add / remove some contacts (SSO account mandatory): ([https://www.egi.eu/earlyAdopters/table full site list])


=== '''New Products''' ===
* If anyone interested please contact me or cristina to be included in the early adopter list.
 
FTS3, SQUID are to be include in UMD and it is important to have some early adopters for this components. So if you anyone interested please contact me or cristina to be included in the early adopter list.


== Next releases  ==
== Next releases  ==

Latest revision as of 14:04, 9 February 2015

Audio conference link Conference system is Adobe Connect, no password required.
Audio conference details Indico page



Middleware releases and staged rollout

News from URT

Recent, or future planned, releases from the product teams:

  • APEL 1.4.0

What’s New

   Added ability to process files compressed with bzip2.
   Added multiplier retrieval to GridEngine parser for CPU and wall-clock time.
   Fixed integer overflow when loading normalised summaries into APEL servers.
   Corrected the way some logging calls were made and reduced the logging level when trying to purge a directory that isn't empty.
   Changed server authorization system to keep the list of DNs for a limited time if unable to update from GOCDB and updated GOCDB query URL.
   Added Month and Year columns to primary key of CloudSummaries table in cloud schema.

  • Globus - in EPEL Testing:

EPEL5: https://admin.fedoraproject.org/updates/FEDORA-EPEL-2015-0515/ EPEL6: https://admin.fedoraproject.org/updates/FEDORA-EPEL-2015-0524/ EPEL7: https://admin.fedoraproject.org/updates/FEDORA-EPEL-2015-0499/

UMD release

  • UMD 3.11.0 in preparation

Staged rollout updates

  • argus-ees v. 0.2.1
  • UNICORE 7.2.0 components (tsi, registry, gateway, xuudb, unicore-x)

In Verification

N/A

New Products

  • squid v. 2.7.19
  • fts3 v. 3.2.30

Ready to be released:

  • apel v. 1.3.1
  • apel-ssm v. 2.1.5
  • Blah 1.20.7
  • CGSI-gSOAP v. 1.3.7
  • CREAM v. 1.16.4
  • cream-ge v. 2.3.0
  • cream-torque v. 2.1.4
  • Davix v. 0.4.0
  • DMlite 0.7.2
  • DPM 1.8.9
  • F.SQUID v. 2.7.19-21
  • FTS3 v. 3.2.30
  • gfal2 v. 2.7.8
  • gfal2-python 1.6.0.
  • Globus 6.0.0 products: Gridftp, Globus-Default-Security, Gram5, MyProxy;
  • px v. 1.3.36
  • qcg-computing-3.4.0 (only SL6)
  • qcg-notifications-3.4.0 (only SL6)
  • srm-ifce v. 1.21.4
  • squid v. 2.7.19
  • Voms Admin v. 2.0.12
  • VOMS clients v. 3.0.5/3.0.6
  • wms-ice v. 3.5.4

UMD 3 EA

  • Some sites have the contact points for the EA adopters outdated so please check in table if all contacts and products are still correct and send me email if you need to add / remove some contacts (SSO account mandatory): (full site list)
  • If anyone interested please contact me or cristina to be included in the early adopter list.

Next releases

  • End of Jan 2015
  • 2015 Calendar is in planning phase

Operational issues

Report from DMSU

  • FYI: Collocated CREAM and ARGUS authorization issues. There were two similar issues where CREAM's queries to ARGUS were being refused. Quoting from the solution: The issue was caused by configuration of CREAM and Argus nodes with different group sets on the same machine. This is not supported by YAIM, special care is necessary. Since this problem cropped up at least twice in very short succession, it may be worth mentioning. No special action is necessary, though.

The issue is represented like this in the CREAM log (excerpt form the NecTec site):

26 Jan 2015 03:24:54,480 INFO org.glite.ce.commonj.authz.gjaf.ServiceAuthorizationChain - User CN=Liaw SyueYi 182693, OU=GRID, O=AS, C=TW not authorized for {http://www.gridsite.org/namespaces/delegation-2}getProxyReq
26 Jan 2015 03:24:54,481 INFO org.glite.ce.commonj.authz.axis2.AuthorizationHandler - request for OPERATION={http://www.gridsite.org/namespaces/delegation-2}getProxyReq; REMOTE_REQUEST_ADDRESS=117.103.109.193; USER_DN=CN=Liaw SyueYi 182693,OU=GRID,O=AS,C=TW; NOT AUTHORIZED
26 Jan 2015 03:24:54,481 ERROR org.apache.axis2.engine.AxisEngine - Authorization error
org.apache.axis2.AxisFault: Authorization error
at org.glite.ce.cream.authz.axis2.AuthorizationHandler.getAuthorizationFault(AuthorizationHandler.java:155)
at org.glite.ce.commonj.authz.axis2.AuthorizationHandler.invoke(AuthorizationHandler.java:162)
at org.apache.axis2.engine.Phase.invokeHandler(Phase.java:340)
at org.apache.axis2.engine.Phase.invoke(Phase.java:313)
at org.apache.axis2.engine.AxisEngine.invoke(AxisEngine.java:262)
at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:168)
at org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
at org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)

APEL multicore accounting

As many EGI user communities are now exploiting multicore hardware it is important for them that accounting correctly reflects the usage made of cores and cpus. At the December Operations Management Board (OMB) it was decided to ask all sites using the APEL client to configure it to publish the number of cores used by jobs.

To enable multicore accounting, you will need to edit the configuration file for the apel parser. This is the software which parses blah logs and batch logs to produce accounting records. The configuration file is usually found at /etc/apel/parser.cfg. In the section labelled [batch], change:

parallel = false

to

parallel = true

This will enable multicore reporting for all future accounting data. Please note that this does not change historical data. Also note that republishing old data is not sufficient to show multicore information - the log files will need to be reparsed. If you wish to republish old data with multicore enabled, please open a GGUS ticket with the APEL team so that we can help you with the process.

If you use the SGE parser, please be aware that it only reports on the number of processors used in a job. It does not report the number of nodes. If you know how to get around this limitation, then please get in touch with the APEL team at apel-admins@stfc.ac.uk.

The multicore accounting data can currently be seen here: http://accounting-devel.egi.eu/show.php?

Drill down to your site and select the grouping "Show data for: Submitting Host" as a function of: "Number of Processors".

Values of 0 mean the parallel option was false when the data were published. The Submitting Host is a new feature in the accounting portal which lets a site see in more detail which CEs are publishing.

EMI-2 decommissioning

  • IMPORTANT - switched-off UMD2/EMI2 APEL service - Friday 16th January
  • ended

dCache 2.2.X decommissioning

  • finished


SAM Nagios probes re-factoring

  • no news

MySQL 5.0 EOL

2.8 SL/SLC/CentOS 5 Support Lifetime

AOB

Monthly Availability/Reliability

  • [1] - are followed up through Parent GGUS #111193 - still 10 tickets open:
  • ROC_Asia/Pacific, IDGF, NGI_BG, NGI_CHINA, NGI_GRNET, NGI_MARGI, NGI_IL, NGI_DE, NGI_FRANCE, NGI_RO


Next meetings

  • March 09, 2015

Minutes