Difference between revisions of "EGI-InSPIRE:NA3 Metrics Y2"
Jump to navigation
Jump to search
m (moved NA3 Metrics Y2 to EGI-InSPIRE:NA3 Metrics Y2) |
|||
(32 intermediate revisions by 3 users not shown) | |||
Line 1: | Line 1: | ||
{{EGI-Inspire_menubar}} | |||
{{TOC_right}} | |||
'''This page lists EGI-InSPIRE NA3 metrics for <font color=red>project year two</font> (May 2011 - April 2012)''' | '''This page lists EGI-InSPIRE NA3 metrics for <font color=red>project year two</font> (May 2011 - April 2012)''' | ||
Line 9: | Line 9: | ||
== Activity level metrics == | == Activity level metrics == | ||
The following metrics were collected by the NA3 activity for the EGI-InSPIRE Quarterly Reports every three months : | The following metrics were collected by the NA3 activity for the EGI-InSPIRE Quarterly Reports every three months : | ||
Line 17: | Line 16: | ||
! Metric ID (scope) | ! Metric ID (scope) | ||
! Metric | ! Metric | ||
! Explanation | ! Explanation | ||
! Task | ! Task | ||
! Query example (where applicable) | ! Query example (where applicable) | ||
! Q5: May-Jul 2011 (value on 1st of Aug 2011) | ! Q5: May-Jul 2011 (value on 1st of Aug 2011) | ||
! Q6: Aug-Oct 2011 (value on 1st of Nov 2011) | ! Q6: Aug-Oct 2011 (value on 1st of Nov 2011) | ||
! Q7: Nov-Jan 2011-2012 (value on 1st of Feb 2012) | ! Q7: Nov-Jan 2011-2012 (value on 1st of Feb 2012) | ||
! Q8: Feb-Apr 2012 (value on 1st of May 2012) | ! Q8: Feb-Apr 2012 (value on 1st of May 2012) | ||
|- | |- | ||
| M.NA3.1 | | M.NA3.1 | ||
| Number of GGUS tickets CREATED | | Number of GGUS tickets CREATED (grouped by submitting community – where available) | ||
| Grouping as: | | Grouping as: | ||
* User tickets: Submitted outside of Operations Portal | *User tickets: Submitted outside of Operations Portal | ||
* Operational tickets: Submitted from Operations Portal | *Operational tickets: Submitted from Operations Portal | ||
| TNA3.2/3 | | TNA3.2/3 | ||
| [https://gus.fzk.de/stat/stat.php?from_date=01+Aug+2011&to_date=31+Oct+2011&stat_type=user_sup_ticket User tickets]<br>[https://gus.fzk.de/stat/stat.php?from_date=01+Aug+2011&to_date=31+Oct+2011&stat_type=operat_ticket Op. tickets] | | [https://gus.fzk.de/stat/stat.php?from_date=01+Aug+2011&to_date=31+Oct+2011&stat_type=user_sup_ticket User tickets]<br>[https://gus.fzk.de/stat/stat.php?from_date=01+Aug+2011&to_date=31+Oct+2011&stat_type=operat_ticket Op. tickets] | ||
| user: 1971<br>operational: 795 | | user: 1971<br>operational: 795 | ||
| user: 1904<br>operational: 653 | | user: 1904<br>operational: 653 | ||
| user: 2138<br>operational: 730 | | user: 2138<br>operational: 730 | ||
| | | user: 2084<br>operational: 796 | ||
|- | |- | ||
| M.NA3.2 | | M.NA3.2 | ||
| Average and Median Solution time to resolve tickets (in days) | | Average and Median Solution time to resolve tickets (in days) | ||
| Average and median grouping methods: | | Average and median grouping methods: | ||
* Average: average of Support Unit averages | *Average: average of Support Unit averages | ||
* Median: average of Support Unit medians | *Median: average of Support Unit medians | ||
| TNA3.3 | | TNA3.3 | ||
| [https://gus.fzk.de/stat/stat.php?from_date=01+May+2010&to_date=31+Jul+2010&stat_type=solution_time&unit_check%5b%5d=NUST&unit_check%5b%5d=UCST Query example] | | [https://gus.fzk.de/stat/stat.php?from_date=01+May+2010&to_date=31+Jul+2010&stat_type=solution_time&unit_check%5b%5d=NUST&unit_check%5b%5d=UCST Query example] | ||
| average: 22.1<br>median: 16.1 | | average: 22.1<br>median: 16.1 | ||
| average: 22.7<br>median: 16.3 | | average: 22.7<br>median: 16.3 | ||
| average: 35.8<br>median: 30.2 | | average: 35.8<br>median: 30.2 | ||
| | | average: 27.4<br>median: 21.3 | ||
|- | |- | ||
| M.NA3.3 | | M.NA3.3 | ||
| Uptime of User Support websites: | | Uptime of User Support websites: | ||
*Training (migration to EGI Nagios) | *Training (migration to EGI Nagios) | ||
*Application Database (EGI Nagios) | *Application Database (EGI Nagios) | ||
*VO Support Services (migration to EGI Nagios) | *VO Support Services (migration to EGI Nagios) | ||
| by UCST after all services are migrated to EGI Nagios | |||
| by UCST after all services are migrated to EGI Nagios | |||
| TNA3.4 | | TNA3.4 | ||
| [https://ops-monitor.cern.ch/nagios EGI nagios] | | [https://ops-monitor.cern.ch/nagios EGI nagios] | ||
| training: 99%<br>AppDB: 99%<br>VO Services: | | training: 99%<br>AppDB: 99%<br>VO Services: | ||
* 85%: LIP VO SAM instance | *85%: LIP VO SAM instance | ||
* N.A: UPV VO SAM instance (lost during reinstallation) | *N.A: UPV VO SAM instance (lost during reinstallation) | ||
* 91%: VO Admin Dashboard (started on 15/05/2011) | *91%: VO Admin Dashboard (started on 15/05/2011) | ||
| | |||
training: 99% <br>AppDB: 99%<br>VO Services: | | training: 99% <br>AppDB: 99%<br>VO Services: | ||
* 99%: LIP VO SAM instance (monitored since 5th October at https://ops-monitor.cern.ch/nagios) | *99%: LIP VO SAM instance (monitored since 5th October at https://ops-monitor.cern.ch/nagios) | ||
* 99%: UPV VO SAM instance (monitored since 5th October at https://ops-monitor.cern.ch/nagios) | *99%: UPV VO SAM instance (monitored since 5th October at https://ops-monitor.cern.ch/nagios) | ||
* 99%: VO Admin Dashboard (monitored since 11th October at https://ops-monitor.cern.ch/nagios) | *99%: VO Admin Dashboard (monitored since 11th October at https://ops-monitor.cern.ch/nagios) | ||
| | |||
training: % <br>AppDB: 99%<br>VO Services: | | training: 99% <br>AppDB: 99%<br>VO Services: | ||
* %: LIP VO SAM instance | *99%: LIP VO SAM instance | ||
* %: UPV VO SAM instance | *93%: UPV VO SAM instance | ||
* 99%: VO Admin Dashboard | *99%: VO Admin Dashboard | ||
| training:99% <br>AppDB: 99%<br>VO Services: | |||
*99%: LIP VO SAM instance | |||
*99%: UPV VO SAM instance | |||
*99%: VO Admin Dashboard | |||
|- | |- | ||
| M.NA3.4 | | M.NA3.4 | ||
| Visitors to User Support websites: | | Visitors to User Support websites: | ||
* [http://www.egi.eu/user-support/training_marketplace/ Training] | *[http://www.egi.eu/user-support/training_marketplace/ Training] | ||
* [http://www.egi.eu/user-support/applications_database/ Application Database] | *[http://www.egi.eu/user-support/applications_database/ Application Database] | ||
* VO Support Services | *VO Support Services | ||
| Number of "unique visitors" from Google Analytics (UCST). "Unique views" were used in the past by | **[https://vodashboard.lip.pt VODashboard] | ||
| TNA3.4 | **[http://www.egi.eu/user-support/services/ VO services] | ||
| [http://www.google.com/analytics/ Google analytics] | |||
<!-- commented on 20120510.NF | Number of "unique visitors" from Google Analytics (UCST). "Unique views" were used in the past by VOservices webpage hosted at egi.eu --> | |||
| Number of "unique visitors" to EGI.eu webpages from Google Analytics (UCST). For VO services, unique visitors to the [https://vodashboard.lip.pt service itself] is also provided. | |||
| TNA3.4. | |||
| [http://www.google.com/analytics/ Google analytics] <!-- commented on 20120510.NF | |||
| training: 425<br>AppDB: 534<br>VO Services: | | training: 425<br>AppDB: 534<br>VO Services: | ||
* 267 ([http://www.egi.eu/ | *267 ([http://www.egi.eu/user-support/services/ unique views]) | ||
* 108 ([https://vodashboard.lip.pt unique visitors]) | *108 ([https://vodashboard.lip.pt unique visitors]) | ||
| training: 324<br>AppDB: 212<br>VO Services: | | training: 324<br>AppDB: 212<br>VO Services: | ||
* 347 ([http://www.egi.eu/ | *347 ([http://www.egi.eu/user-support/services/ unique views]) | ||
* 93 | *93 ([https://vodashboard.lip.pt unique visitors]) | ||
--> | |||
| training: 263<br>AppDB: 173<br>VO Services: | |||
*226 | |||
*108 | |||
| training: 312<br>AppDB: 212<br>VO Services: | |||
*305 | |||
*93 | |||
| training: 197<br>AppDB: 154<br>VO Services: | | training: 197<br>AppDB: 154<br>VO Services: | ||
* 172 | *172 | ||
* | *54 | ||
| training: 232<br>AppDB: 129<br>VO Services: | |||
*103 | |||
*51 | |||
|- | |- | ||
| M.NA3.5 | | M.NA3.5 | ||
Line 97: | Line 123: | ||
*Supported | *Supported | ||
*Offered as service | *Offered as service | ||
| Reported by VO Services team. Evaluation documents should be in the group's wiki page | |||
| Reported by VO Services team. Evaluation documents should be in the group's wiki page | |||
| TNA3.4 | | TNA3.4 | ||
| <br> | | <br> | ||
| | | | ||
* Evaluated: 2 (VO Admin Dashboard, LFCBrowseSE) | *Evaluated: 2 (VO Admin Dashboard, LFCBrowseSE) | ||
* Supported: 7 (GANGA, DIANE. MINIDASHBOARD, VO SAM, VBROWSER, VO Admin Dashboard, LFCBrowseSE) | *Supported: 7 (GANGA, DIANE. MINIDASHBOARD, VO SAM, VBROWSER, VO Admin Dashboard, LFCBrowseSE) | ||
* Offered as service: 3 (2 VO SAM instance at LIP and UPV, 1 VO Admin Dashboard at LIP) | *Offered as service: 3 (2 VO SAM instance at LIP and UPV, 1 VO Admin Dashboard at LIP) | ||
| | |||
*Evaluated: 2 (VO Admin Dashboard, LFCBrowseSE) | |||
*Supported: 7 (GANGA, DIANE. MINIDASHBOARD, VO SAM, VBROWSER, VO Admin Dashboard, LFCBrowseSE) | |||
*Offered as service: 4 (1 VO SAM instance at LIP and 2 at UPV; 1 VO Admin Dashboard at LIP) | |||
| | |||
*Evaluated: 0 | |||
*Supported: 7 (GANGA, DIANE. MINIDASHBOARD, VO SAM, VBROWSER, VO Admin Dashboard, LFCBrowseSE) | |||
*Offered as service: 4 (1 VO SAM instance at LIP and 2 at UPV; 1 VO Admin Dashboard at LIP) | |||
| | | | ||
* Evaluated: | *Evaluated: 0 | ||
* Supported: 7 (GANGA, DIANE. MINIDASHBOARD, VO SAM, VBROWSER, VO Admin Dashboard, LFCBrowseSE) | *Supported: 7 (GANGA, DIANE. MINIDASHBOARD, VO SAM, VBROWSER, VO Admin Dashboard, LFCBrowseSE) | ||
* Offered as service: 4 (1 VO SAM | *Offered as service: 4 (1 VO SAM instance at LIP and 2 at UPV; 1 VO Admin Dashboard at LIP) | ||
|- | |- | ||
| M.NA3.6 | | M.NA3.6 | ||
Line 116: | Line 153: | ||
*Tools | *Tools | ||
*Personal profiles | *Personal profiles | ||
| Collected by UCST using the reporting page in AppDB | |||
| Collected by UCST using the reporting page in AppDB | |||
| TNA3.4/3 | | TNA3.4/3 | ||
| <br> | | <br> | ||
| 365 <br> 36 <br> 636 | | 365 <br> 36 <br> 636 | ||
| 368 <br> 36 <br> 643 | | 368 <br> 36 <br> 643 | ||
| | | 354 <br> 39 <br> 649 | ||
| | | 366 <br> 54 <br> 669 | ||
|- | |- | ||
| M.NA3.7 | | M.NA3.7 | ||
| Number of Training Days delivered through NGI Training events | | Number of Training Days delivered through NGI Training events | ||
| UCST collects by counting the event days in Training Marketplace | | UCST collects by counting the event days in Training Marketplace | ||
| TNA3.4/3 | | TNA3.4/3 | ||
| (Training days, not trainee days!)<br>[http://egitraining.esc.rl.ac.uk/event/2011/08/1/list/ Example] | | (Training days, not trainee days!)<br>[http://egitraining.esc.rl.ac.uk/event/2011/08/1/list/ Example] | ||
| 38 | | 38 | ||
| 65 | | 65 | ||
| | | 27 | ||
| | | 19 | ||
|- | |- | ||
| M.NA3.8 | | M.NA3.8 | ||
Line 139: | Line 177: | ||
*Low/Medium/High Activity VOs | *Low/Medium/High Activity VOs | ||
*international VOs | *international VOs | ||
| * OP needs to be improved so UCST can collect this | |||
* UCST can collect this from http://accounting.egi.eu/gridsite/accounting/CESGA/vomet_view.html | | * OP needs to be improved so UCST can collect this | ||
* OP needs to be improved so UCST can collect this any time | *UCST can collect this from http://accounting.egi.eu/gridsite/accounting/CESGA/vomet_view.html | ||
*OP needs to be improved so UCST can collect this any time | |||
| TNA3.1 | | TNA3.1 | ||
| Number of new and decommissioned VOs include national VOs<br>[https://operations-portal.egi.eu/voadmin/voMetrics VO metrics] | | Number of new and decommissioned VOs include national VOs<br>[https://operations-portal.egi.eu/voadmin/voMetrics VO metrics] | ||
| 3/0<br> 10/16/26 <br> 110 | | 3/0<br> 10/16/26 <br> 110 | ||
| 2/6 <br> 8/28/27 <br> 112 | | 2/6 <br> 8/28/27 <br> 112 | ||
| | | 2/6 <br> 8/23/25 <br> 111 | ||
| | | 10/0 <br> 20/20/25 <br> 117 | ||
|- | |- | ||
| M.NA3.9 | | M.NA3.9 | ||
| Number of users (grouped by community and VO) | | Number of users (grouped by community and VO) | ||
| OP needs to be improved so UCST can collect this any time | | OP needs to be improved so UCST can collect this any time | ||
| TNA3.1 | | TNA3.1 | ||
| [https://operations-portal.in2p3.fr/vo/usersSummary Users summary] | | [https://operations-portal.in2p3.fr/vo/usersSummary Users summary] | ||
| Total : 18,793 (Jul. 28) | | Total : 18,793 (Jul. 28) | ||
*HEP : 7224 | *HEP : 7224 | ||
*Infrastructure : 3251 | *Infrastructure : 3251 | ||
*LS : 963 | *LS : 963 | ||
*CC : 529 | *CC : 529 | ||
*AA : 502 | *AA : 502 | ||
*ES : 368 | *ES : 368 | ||
*Computer Sci. and Math. : 30 | *Computer Sci. and Math. : 30 | ||
*Fusion : 86 | *Fusion : 86 | ||
*Multidisciplinary : 2618 | *Multidisciplinary : 2618 | ||
*Others : 3222 | *Others : 3222 | ||
| Total : 19,053 (Nov. 16) | |||
*HEP : 7584 | | Total : 19,053 (Nov. 16) | ||
*Infrastructure : 2772 | *HEP : 7584 | ||
*LS : 1071 | *Infrastructure : 2772 | ||
*CC : 210 | *LS : 1071 | ||
*AA : 586 | *CC : 210 | ||
*ES : 325 | *AA : 586 | ||
*Computer Sci. and Math. : 42 | *ES : 325 | ||
*Fusion : 94 | *Computer Sci. and Math. : 42 | ||
*Multidisciplinary : 2959 | *Fusion : 94 | ||
*Others : 3410 | *Multidisciplinary : 2959 | ||
| | *Others : 3410 | ||
| | |||
| Total : 21126 (Feb. 8) | |||
*HEP : 8130 | |||
*Infrastructure : 2852 | |||
*LS : 1093 | |||
*CC : 609 | |||
*AA : 615 | |||
*ES : 314 | |||
*Computer Sci. and Math. : 40 | |||
*Fusion : 95 | |||
*Multidisciplinary : 3323 | |||
*Others : 4055 | |||
| Total : 20903 (May 1) | |||
*HEP : 8194 | |||
*Infrastructure : 2596 | |||
*LS : 1172 | |||
*CC : 608 | |||
*AA : 617 | |||
*ES : 324 | |||
*Computer Sci. and Math. : 48 | |||
*Fusion : 96 | |||
*Multidisciplinary : 3190 | |||
*Others : 4058 | |||
|} | |} | ||
Line 215: | Line 279: | ||
*ES : 325 | *ES : 325 | ||
*Fusion : 94 | *Fusion : 94 | ||
| . | | Total : 10856 (Feb. 8) | ||
| | *HEP : 8130 | ||
*LS : 1093 | |||
*CC : 609 | |||
*AA : 615 | |||
*ES : 314 | |||
*Fusion : 95 | |||
| Total : 11011 (May 1) | |||
*HEP : 8194 | |||
*LS : 1172 | |||
*CC : 608 | |||
*AA : 617 | |||
*ES : 324 | |||
*Fusion : 96 | |||
|- | |- | ||
| PO4 | | PO4 | ||
Line 230: | Line 306: | ||
*Multidisciplinary : 2959 | *Multidisciplinary : 2959 | ||
*Other : 3410 | *Other : 3410 | ||
| ... | | Total : 7418 (Feb. 8) | ||
| .. | *Computer Sci. and Math. : 40 | ||
*Multidisciplinary : 3323 | |||
*Other : 4055 | |||
| Total : 7296 (May 1) | |||
*Computer Sci. and Math. : 48 | |||
*Multidisciplinary : 3190 | |||
*Other : 4058 | |||
|} | |} |
Latest revision as of 19:34, 24 December 2014
EGI Inspire Main page |
This page lists EGI-InSPIRE NA3 metrics for project year two (May 2011 - April 2012)
All NA3 metrics are available here
Activity level metrics
The following metrics were collected by the NA3 activity for the EGI-InSPIRE Quarterly Reports every three months :
Metric ID (scope) | Metric | Explanation | Task | Query example (where applicable) | Q5: May-Jul 2011 (value on 1st of Aug 2011) | Q6: Aug-Oct 2011 (value on 1st of Nov 2011) | Q7: Nov-Jan 2011-2012 (value on 1st of Feb 2012) | Q8: Feb-Apr 2012 (value on 1st of May 2012) |
---|---|---|---|---|---|---|---|---|
M.NA3.1 | Number of GGUS tickets CREATED (grouped by submitting community – where available) | Grouping as:
|
TNA3.2/3 | User tickets Op. tickets |
user: 1971 operational: 795 |
user: 1904 operational: 653 |
user: 2138 operational: 730 |
user: 2084 operational: 796 |
M.NA3.2 | Average and Median Solution time to resolve tickets (in days) | Average and median grouping methods:
|
TNA3.3 | Query example | average: 22.1 median: 16.1 |
average: 22.7 median: 16.3 |
average: 35.8 median: 30.2 |
average: 27.4 median: 21.3 |
M.NA3.3 | Uptime of User Support websites:
|
by UCST after all services are migrated to EGI Nagios | TNA3.4 | EGI nagios | training: 99% AppDB: 99% VO Services:
|
training: 99% AppDB: 99% VO Services:
|
training: 99% AppDB: 99% VO Services:
|
training:99% AppDB: 99% VO Services:
|
M.NA3.4 | Visitors to User Support websites:
|
Number of "unique visitors" to EGI.eu webpages from Google Analytics (UCST). For VO services, unique visitors to the service itself is also provided. | TNA3.4. | Google analytics | training: 263 AppDB: 173 VO Services:
|
training: 312 AppDB: 212 VO Services:
|
training: 197 AppDB: 154 VO Services:
|
training: 232 AppDB: 129 VO Services:
|
M.NA3.5 | Number of VO Support Services:
|
Reported by VO Services team. Evaluation documents should be in the group's wiki page | TNA3.4 |
|
|
|
| |
M.NA3.6 | Number of Applications in the AppDB:
|
Collected by UCST using the reporting page in AppDB | TNA3.4/3 | 365 36 636 |
368 36 643 |
354 39 649 |
366 54 669 | |
M.NA3.7 | Number of Training Days delivered through NGI Training events | UCST collects by counting the event days in Training Marketplace | TNA3.4/3 | (Training days, not trainee days!) Example |
38 | 65 | 27 | 19 |
M.NA3.8 | Number of:
|
* OP needs to be improved so UCST can collect this
|
TNA3.1 | Number of new and decommissioned VOs include national VOs VO metrics |
3/0 10/16/26 110 |
2/6 8/28/27 112 |
2/6 8/23/25 111 |
10/0 20/20/25 117 |
M.NA3.9 | Number of users (grouped by community and VO) | OP needs to be improved so UCST can collect this any time | TNA3.1 | Users summary | Total : 18,793 (Jul. 28)
|
Total : 19,053 (Nov. 16)
|
Total : 21126 (Feb. 8)
|
Total : 20903 (May 1)
|
The MS304 "User Support Metrics" milestone document provides a discussion forum on the metrics that should be captured about user support. This document is formally updated in July 2011 (MS307), July 2012 (MS310) and July 2013 (MS313).
Project level metric
The following activity (NA3) metrics are aligned against the project’s objectives.
Project Objectives |
Objective Summary |
Metric | Provider | Q5: May-Jul 2011 (captured on 1st of Aug 2011) | Q6: Aug-Oct 2011 (captured on 1st of Nov 2011) | Q7: Nov-Jan 2011-2012 (captured on 1st of Feb 2012) | Q8: Feb-Apr 2012 (captured on 1st of May 2012) |
---|---|---|---|---|---|---|---|
PO3 | Sustainable support for Heavy User Communities | Number of users from HUC VOs (M.SA1.Size.7) | Calculated from M.NA3.9 by UCST. Number includes HEP, LS, CC, AA, ES, Fusion | Total : 9,672 (Jul. 28)
|
Total : 9,870 (Nov. 16)
|
Total : 10856 (Feb. 8)
|
Total : 11011 (May 1)
|
PO4 | Addition of new User Communities | Number of users from non-HUC VOs | Calculated from M.NA3.9 by UCST | Total : 5840 (Jul. 28)
|
Total : 6411 (Nov. 16)
|
Total : 7418 (Feb. 8)
|
Total : 7296 (May 1)
|