Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:Jra1 2013-05-14"

From EGIWiki
Jump to navigation Jump to search
 
(31 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{Template:EGI-Inspire menubar}}
[[Category:EGI-InSPIRE]]
[[Inspire_JRA1_weekly_reports| << JRA1 weekly reports main page]]  
[[Inspire_JRA1_weekly_reports| << JRA1 weekly reports main page]]  


Line 4: Line 6:


== 1. Progress on Milestones Deliverables  ==
== 1. Progress on Milestones Deliverables  ==
* Periodic Report
JRA1 contribution sent to AMB.
* MS710 - Operational Tools Roadmap
Final version available at: https://documents.egi.eu/document/1501
* D7.3 - Annual Report on Operational Tool maintenance and development activity
Final version available at: https://documents.egi.eu/secure/ShowDocument?docid=1562


== 2. Critical Issues  ==
== 2. Critical Issues  ==
* Nothing new to report


== 3. Major work done during the past week by task  ==
== 3. Major work done during the past week by task  ==


=== 3.1 TJRA1.1  ===
=== 3.1 TJRA1.1  ===
* Periodic Report
* Metrics computation
* JRA1 monthly meeting
* JRA1 action review


=== 3.2 TJRA1.2 TJRA1.3 TJRA1.5  ===
=== 3.2 TJRA1.2 TJRA1.3 TJRA1.5  ===


==== 3.2.1 SAM  ====
==== 3.2.1 SAM  ====
Our central instance (http://grid-monitoring.cern.ch/myegi/) has been upgraded to SAM Update-20, which has been released last week. Release notes are available at: https://tomtools.cern.ch/confluence/display/SAMDOC/Update-20
* Next SAM Update ongoing
 
At the same time, next release is ongoing.


==== 3.2.2 GOCDB  ====
==== 3.2.2 GOCDB  ====
* JRA1 meeting + prep/talks
* v5 developments
* Correspondence/GGUS regarding ARC-CE update request
* Continue with GOCDB v5 development (Doctrine/new AAI)
* Network issues occurring @RAL: service checks/updates


==== 3.2.3 GGUS  ====
==== 3.2.3 GGUS  ====
<!-- Helmut Dres -->
* New "Did you knows?": Ticket relation in GGUS, The GGUS Meaning of “waiting for reply”
* Ticket monitoring
* Interfaces to other systems: New NGI_CZ RT instance; Updated GGUS host certificate
* Uploaded MS710 v1.1 after minor comments from a reviewer [https://documents.egi.eu/secure/ShowDocument?docid=1501 MS710].
* Decomissioned VOs: vo.sixt.cern.ch, vo.gear.cern.ch, israelvo.isragrid.org.il
* Prepared slides for [http://pti.iu.edu/osgahm-2013 OSG All Hands meeting]
* Support Units:
* Weekly phone conference for discussing enhancements on GGUS
** Decomissioned: NGI_ZA, gLite Release Pages and Repository
* Preparing GGUS March release
** New: UI-WN Tarball


==== 3.2.4 Ops Portal  ====
==== 3.2.4 Ops Portal  ====
 
* VO A/R prototype: http://cclavoisier03.in2p3.fr:8080/lavoisier
* Preparation of meetings : JRA1
** New interfaces on line
* Integration of a chart library into Lavoisier for the A/R Module
** Different algorithms available: Or, Avg, thresholds (70, 80 and 90 %)
* Set-up of a automatic generation of all A/R for the VO on a daily basis
** Generation of A/R figures for April
** Possibility of export in csv format


==== 3.2.5 Accounting Portal  ====
==== 3.2.5 Accounting Portal  ====
* Refactor of the code
* Security work
* Further OOP integration
* InterNGI developments
* Security improvements
* Fixes on UserDN publication SAM probe, production status
* New code for UserDN SAM probe that detects if sites have published CPU/UserDN records on the last 7 days and honors some NGI non publishing policy.
* Heavy Core refactoring
* OOP migration
* Regionalization improvements
* Fixed CSV reporting


Meetings:
- Scientific discipline VT meeting on Friday.
==== 3.2.6 Metrics Portal  ====
==== 3.2.6 Metrics Portal  ====
* Work for QR12
* NGI summed metrics for NA2.
* Discussions about new project metrics view.
* Changes in quarterly views and Excel reports.
* Cosmetic fixes for Chrome browsers
* Redundant views removed.
* Changes in the auth system.
* Maintenance
 
==== 3.2.7 Accounting Repo ====
* Regional APEL server code made available on github and documentation for testing sent out to sites on request. South Africa, Germany and Taiwan have requested this so far, I have asked for feedback from these sites on their progress;


=== 3.3 TJRA1.4 (Accounting for new resource types)  ===
=== 3.3 TJRA1.4 (Accounting for new resource types)  ===
==== Accounting Repositories ====
* SSM 2.0 and new schema installed in production to receive CAR and EMI 3 APEL Client records;
* First site in production publishing using EMI 3 APEL Client;
* Federated Cloud Resource Providers migrated to publishing cloud accounting data using SSM 2.0 using the new cloud accounting usage record definition;
* A summary cloud accounting record has been created and data in this format provided to CESGA for work on the cloud accounting portal to progress;
* Additional StAR data received from other test instances, notably the INFN implementation, so that storage records are now received in the test database from 50 sites;


==== Accounting Portal ====
==== Accounting Portal ====
* Cloud accounting base code
* The CESGA team have also successfully tested receiving records from the cloud accounting repository using SSM 2.0
* Schema adaptations for cloud
 
==== Accounting Repositories ====
* Updated release of APEL SSM 2.0 and APEL server/lib packages to fix bugs found in testing
* Detail sent out to Federated Cloud Task resource providers to implement new Cloud Accounting record and SSM 2.0
* Feedback to Storage Accounting client sites comparing test records received


==== INFN Accounting Work ====
==== INFN Accounting Work ====
* Work ongoing on storage accounting - Glue/Glue2/StAR comparison
* StAR and GLUE relationship has been documented
* Work ongoing on storage accounting - work on ldap/glue based sensor
* Work ongoing on cloud accounting - work on WNoDeS sensor
* UR 2.0 document is now in public comments.


==== Application Accounting ====
==== Application Accounting ====
* Further investigation into the integration of application accounting client into the APEL structure
* Continued work on the integration with APEL, definition of additional usage record fields


== 4. Next Meetings  ==
== 4. Next Meetings  ==
 
* Pay-for-use meeting: 17 May 2013
[[Category:JRA1_weekly_report]]
* Next JRA1 meeting: 10 June 2013

Latest revision as of 10:18, 6 January 2015

EGI Inspire Main page

<< JRA1 weekly reports main page


1. Progress on Milestones Deliverables

  • Periodic Report

JRA1 contribution sent to AMB.

  • MS710 - Operational Tools Roadmap

Final version available at: https://documents.egi.eu/document/1501

  • D7.3 - Annual Report on Operational Tool maintenance and development activity

Final version available at: https://documents.egi.eu/secure/ShowDocument?docid=1562

2. Critical Issues

  • Nothing new to report

3. Major work done during the past week by task

3.1 TJRA1.1

  • Periodic Report
  • Metrics computation
  • JRA1 monthly meeting
  • JRA1 action review

3.2 TJRA1.2 TJRA1.3 TJRA1.5

3.2.1 SAM

  • Next SAM Update ongoing

3.2.2 GOCDB

  • v5 developments

3.2.3 GGUS

  • New "Did you knows?": Ticket relation in GGUS, The GGUS Meaning of “waiting for reply”
  • Interfaces to other systems: New NGI_CZ RT instance; Updated GGUS host certificate
  • Decomissioned VOs: vo.sixt.cern.ch, vo.gear.cern.ch, israelvo.isragrid.org.il
  • Support Units:
    • Decomissioned: NGI_ZA, gLite Release Pages and Repository
    • New: UI-WN Tarball

3.2.4 Ops Portal

  • VO A/R prototype: http://cclavoisier03.in2p3.fr:8080/lavoisier
    • New interfaces on line
    • Different algorithms available: Or, Avg, thresholds (70, 80 and 90 %)
    • Generation of A/R figures for April
    • Possibility of export in csv format

3.2.5 Accounting Portal

  • Security work
  • InterNGI developments
  • Fixes on UserDN publication SAM probe, production status
  • Heavy Core refactoring
  • OOP migration
  • Regionalization improvements
  • Fixed CSV reporting

3.2.6 Metrics Portal

  • NGI summed metrics for NA2.
  • Changes in quarterly views and Excel reports.
  • Redundant views removed.
  • Changes in the auth system.
  • Maintenance

3.2.7 Accounting Repo

  • Regional APEL server code made available on github and documentation for testing sent out to sites on request. South Africa, Germany and Taiwan have requested this so far, I have asked for feedback from these sites on their progress;

3.3 TJRA1.4 (Accounting for new resource types)

Accounting Repositories

  • SSM 2.0 and new schema installed in production to receive CAR and EMI 3 APEL Client records;
  • First site in production publishing using EMI 3 APEL Client;
  • Federated Cloud Resource Providers migrated to publishing cloud accounting data using SSM 2.0 using the new cloud accounting usage record definition;
  • A summary cloud accounting record has been created and data in this format provided to CESGA for work on the cloud accounting portal to progress;
  • Additional StAR data received from other test instances, notably the INFN implementation, so that storage records are now received in the test database from 50 sites;

Accounting Portal

  • The CESGA team have also successfully tested receiving records from the cloud accounting repository using SSM 2.0

INFN Accounting Work

  • StAR and GLUE relationship has been documented

Application Accounting

  • Continued work on the integration with APEL, definition of additional usage record fields

4. Next Meetings

  • Pay-for-use meeting: 17 May 2013
  • Next JRA1 meeting: 10 June 2013