Difference between revisions of "EGI-InSPIRE:Jra1 2013-05-14"

From EGIWiki
Jump to: navigation, search
(Application Accounting)
 
(32 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
{{Template:EGI-Inspire menubar}}
 +
[[Category:EGI-InSPIRE]]
 
[[Inspire_JRA1_weekly_reports| << JRA1 weekly reports main page]]  
 
[[Inspire_JRA1_weekly_reports| << JRA1 weekly reports main page]]  
  
Line 4: Line 6:
  
 
== 1. Progress on Milestones Deliverables  ==
 
== 1. Progress on Milestones Deliverables  ==
 +
* Periodic Report
 +
 +
JRA1 contribution sent to AMB.
 +
 +
* MS710 - Operational Tools Roadmap
 +
 +
Final version available at: https://documents.egi.eu/document/1501
 +
 +
* D7.3 - Annual Report on Operational Tool maintenance and development activity
 +
 +
Final version available at: https://documents.egi.eu/secure/ShowDocument?docid=1562
  
 
== 2. Critical Issues  ==
 
== 2. Critical Issues  ==
 +
* Nothing new to report
  
 
== 3. Major work done during the past week by task  ==
 
== 3. Major work done during the past week by task  ==
  
 
=== 3.1 TJRA1.1  ===
 
=== 3.1 TJRA1.1  ===
 +
* Periodic Report
 +
* Metrics computation
 +
* JRA1 monthly meeting
 +
* JRA1 action review
  
 
=== 3.2 TJRA1.2 TJRA1.3 TJRA1.5  ===
 
=== 3.2 TJRA1.2 TJRA1.3 TJRA1.5  ===
  
 
==== 3.2.1 SAM  ====
 
==== 3.2.1 SAM  ====
Our central instance (http://grid-monitoring.cern.ch/myegi/) has been upgraded to SAM Update-20, which has been released last week. Release notes are available at: https://tomtools.cern.ch/confluence/display/SAMDOC/Update-20
+
* Next SAM Update ongoing
 
 
At the same time, next release is ongoing.
 
  
 
==== 3.2.2 GOCDB  ====
 
==== 3.2.2 GOCDB  ====
* JRA1 meeting + prep/talks
+
* v5 developments
* Correspondence/GGUS regarding ARC-CE update request
 
* Continue with GOCDB v5 development (Doctrine/new AAI)
 
* Network issues occurring @RAL: service checks/updates
 
  
 
==== 3.2.3 GGUS  ====
 
==== 3.2.3 GGUS  ====
<!-- Helmut Dres -->
+
* New "Did you knows?": Ticket relation in GGUS, The GGUS Meaning of “waiting for reply”
* Ticket monitoring
+
* Interfaces to other systems: New NGI_CZ RT instance; Updated GGUS host certificate
* Uploaded MS710 v1.1 after minor comments from a reviewer [https://documents.egi.eu/secure/ShowDocument?docid=1501 MS710].
+
* Decomissioned VOs: vo.sixt.cern.ch, vo.gear.cern.ch, israelvo.isragrid.org.il
* Prepared slides for [http://pti.iu.edu/osgahm-2013 OSG All Hands meeting]
+
* Support Units:
* Weekly phone conference for discussing enhancements on GGUS
+
** Decomissioned: NGI_ZA, gLite Release Pages and Repository
* Preparing GGUS March release
+
** New: UI-WN Tarball
  
 
==== 3.2.4 Ops Portal  ====
 
==== 3.2.4 Ops Portal  ====
 
+
* VO A/R prototype: http://cclavoisier03.in2p3.fr:8080/lavoisier
* Preparation of meetings : JRA1
+
** New interfaces on line
* Integration of a chart library into Lavoisier for the A/R Module
+
** Different algorithms available: Or, Avg, thresholds (70, 80 and 90 %)
* Set-up of a automatic generation of all A/R for the VO on a daily basis
+
** Generation of A/R figures for April
 +
** Possibility of export in csv format
  
 
==== 3.2.5 Accounting Portal  ====
 
==== 3.2.5 Accounting Portal  ====
* Refactor of the code
+
* Security work
* Further OOP integration
+
* InterNGI developments
* Security improvements
+
* Fixes on UserDN publication SAM probe, production status
* New code for UserDN SAM probe that detects if sites have published CPU/UserDN records on the last 7 days and honors some NGI non publishing policy.
+
* Heavy Core refactoring
 +
* OOP migration
 +
* Regionalization improvements
 +
* Fixed CSV reporting
  
Meetings:
 
- Scientific discipline VT meeting on Friday.
 
 
==== 3.2.6 Metrics Portal  ====
 
==== 3.2.6 Metrics Portal  ====
* Work for QR12
+
* NGI summed metrics for NA2.
* Discussions about new project metrics view.
+
* Changes in quarterly views and Excel reports.
* Cosmetic fixes for Chrome browsers
+
* Redundant views removed.
 +
* Changes in the auth system.
 +
* Maintenance
 +
 
 +
==== 3.2.7 Accounting Repo ====
 +
* Regional APEL server code made available on github and documentation for testing sent out to sites on request. South Africa, Germany and Taiwan have requested this so far, I have asked for feedback from these sites on their progress;
  
 
=== 3.3 TJRA1.4 (Accounting for new resource types)  ===
 
=== 3.3 TJRA1.4 (Accounting for new resource types)  ===
  
==== 3.3.2 Accounting Portal ====
+
==== Accounting Repositories ====
* Cloud accounting base code
+
* SSM 2.0 and new schema installed in production to receive CAR and EMI 3 APEL Client records;
* Schema adaptations for cloud
+
* First site in production publishing using EMI 3 APEL Client;
 +
* Federated Cloud Resource Providers migrated to publishing cloud accounting data using SSM 2.0 using the new cloud accounting usage record definition;
 +
* A summary cloud accounting record has been created and data in this format provided to CESGA for work on the cloud accounting portal to progress;
 +
* Additional StAR data received from other test instances, notably the INFN implementation, so that storage records are now received in the test database from 50 sites;
  
==== Accounting Repositories ====
+
==== Accounting Portal ====
* Updated release of APEL SSM 2.0 and APEL server/lib packages to fix bugs found in testing
+
* The CESGA team have also successfully tested receiving records from the cloud accounting repository using SSM 2.0
* Detail sent out to Federated Cloud Task resource providers to implement new Cloud Accounting record and SSM 2.0
 
* Feedback to Storage Accounting client sites comparing test records received
 
  
 
==== INFN Accounting Work ====
 
==== INFN Accounting Work ====
* Work ongoing on storage accounting - Glue/Glue2/StAR comparison
+
* StAR and GLUE relationship has been documented
* Work ongoing on storage accounting - work on ldap/glue based sensor
 
* Work ongoing on cloud accounting - work on WNoDeS sensor
 
* UR 2.0 document is now in public comments.
 
  
 
==== Application Accounting ====
 
==== Application Accounting ====
* Further investigation into the integration of application accounting client into the APEL structure
+
* Continued work on the integration with APEL, definition of additional usage record fields
  
 
== 4. Next Meetings  ==
 
== 4. Next Meetings  ==
 
+
* Pay-for-use meeting: 17 May 2013
[[Category:JRA1_weekly_report]]
+
* Next JRA1 meeting: 10 June 2013

Latest revision as of 11:18, 6 January 2015

EGI Inspire Main page

<< JRA1 weekly reports main page


1. Progress on Milestones Deliverables

  • Periodic Report

JRA1 contribution sent to AMB.

  • MS710 - Operational Tools Roadmap

Final version available at: https://documents.egi.eu/document/1501

  • D7.3 - Annual Report on Operational Tool maintenance and development activity

Final version available at: https://documents.egi.eu/secure/ShowDocument?docid=1562

2. Critical Issues

  • Nothing new to report

3. Major work done during the past week by task

3.1 TJRA1.1

  • Periodic Report
  • Metrics computation
  • JRA1 monthly meeting
  • JRA1 action review

3.2 TJRA1.2 TJRA1.3 TJRA1.5

3.2.1 SAM

  • Next SAM Update ongoing

3.2.2 GOCDB

  • v5 developments

3.2.3 GGUS

  • New "Did you knows?": Ticket relation in GGUS, The GGUS Meaning of “waiting for reply”
  • Interfaces to other systems: New NGI_CZ RT instance; Updated GGUS host certificate
  • Decomissioned VOs: vo.sixt.cern.ch, vo.gear.cern.ch, israelvo.isragrid.org.il
  • Support Units:
    • Decomissioned: NGI_ZA, gLite Release Pages and Repository
    • New: UI-WN Tarball

3.2.4 Ops Portal

  • VO A/R prototype: http://cclavoisier03.in2p3.fr:8080/lavoisier
    • New interfaces on line
    • Different algorithms available: Or, Avg, thresholds (70, 80 and 90 %)
    • Generation of A/R figures for April
    • Possibility of export in csv format

3.2.5 Accounting Portal

  • Security work
  • InterNGI developments
  • Fixes on UserDN publication SAM probe, production status
  • Heavy Core refactoring
  • OOP migration
  • Regionalization improvements
  • Fixed CSV reporting

3.2.6 Metrics Portal

  • NGI summed metrics for NA2.
  • Changes in quarterly views and Excel reports.
  • Redundant views removed.
  • Changes in the auth system.
  • Maintenance

3.2.7 Accounting Repo

  • Regional APEL server code made available on github and documentation for testing sent out to sites on request. South Africa, Germany and Taiwan have requested this so far, I have asked for feedback from these sites on their progress;

3.3 TJRA1.4 (Accounting for new resource types)

Accounting Repositories

  • SSM 2.0 and new schema installed in production to receive CAR and EMI 3 APEL Client records;
  • First site in production publishing using EMI 3 APEL Client;
  • Federated Cloud Resource Providers migrated to publishing cloud accounting data using SSM 2.0 using the new cloud accounting usage record definition;
  • A summary cloud accounting record has been created and data in this format provided to CESGA for work on the cloud accounting portal to progress;
  • Additional StAR data received from other test instances, notably the INFN implementation, so that storage records are now received in the test database from 50 sites;

Accounting Portal

  • The CESGA team have also successfully tested receiving records from the cloud accounting repository using SSM 2.0

INFN Accounting Work

  • StAR and GLUE relationship has been documented

Application Accounting

  • Continued work on the integration with APEL, definition of additional usage record fields

4. Next Meetings

  • Pay-for-use meeting: 17 May 2013
  • Next JRA1 meeting: 10 June 2013