Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "EGI-InSPIRE:SA1.5-QR9"

From EGIWiki
Jump to navigation Jump to search
m
m
Line 1: Line 1:
__NOTOC__ = 1. Task Meetings =  
<p>__NOTOC__ =  
</p>
<h1> 1. Task Meetings </h1>
<table cellpadding="5" border="1" align="center" cellspacing="0">


{| align="center" border="1" cellspacing="0" cellpadding="5"
<tr>
|-
<th style="width: 25%;"> Date (dd/mm/yyyy)
! style="width: 25%;" | Date (dd/mm/yyyy)  
</th>
! style="width: 25%;" | Url Indico Agenda  
<th style="width: 25%;"> Url Indico Agenda
! style="width: 10%;" | Title  
</th>
! style="width: 10%;" | Outcome
<th style="width: 10%;"> Title
|-
</th>
| dd/mm/yyyy
<th style="width: 10%;"> Outcome
|
</th></tr>
|
<tr>
|
<td> No formal meetings this quarter
|}
</td>
<td>
</td>
<td>
</td>
<td>
</td></tr></table>
<p><br />
</p>
<h1> 2. Main Achievements  </h1>
<h2> Repository:  </h2>
<p>Ran the production repository with no internal problems this quarter. There were a few very small network breaks which prevented the service receiving new data. This data would all have been received the next time the affected clients tried to publish.
</p><p>CERN and OSG moved their production accounting to the new SSM infrastructure. For CERN’s job records summaries are made which are then merged with the summaries from the old system for transfer to the CESGA Portal. OSG send summaries and these too are merged. The test repository continues to run all the time to receive tests from other sites developing their software against SSM the new STOMP and Python-based messaging layer which runs on the production EGI Messaging Infrastructure. All of the other existing and new accounting services have done some testing using SSM, now including SGAS and GridSafe. Tests also received from CC-IN2P3, and ARC-JURA. Planning with Grid-Safe and MAPPER. EDGI should start next quarter.
</p><p>Participated in Inter-NGI Report Virtual Team. MPI Virtual Team, and the Federated Cloud Task Force. For this latter we continue to run a test cloud accounting database. This quarter we have five Resource Providers who have successfully sent in cloud accounting records, this is from OpenNebula and Openstack cloud middleware, previously we had only OpenNebula accounting records. (Client cloud accounting scripts have been provided by CESGA for OpenNebula and IN2P3 for Openstack.)
</p>
<h2> Portal </h2>
<p>As main ahievements on PQ9 for the accounting portal, there was miscellaneous query improvement and index optimization, better HTML output, testing with several browsers, tweaks on the graph engine, and other minor changes.</font>
</p><p>There was also preliminary work prior to the implementation of new interNGI usage features.<br />&#160;
</p>
<h1> 3. Issues and Mitigation  </h1>
<table cellpadding="2" border="1" cellspacing="0">


<br> = 2. Main Achievements = Repository: Ran the production repository with no internal problems this quarter. There were a few very small network breaks which prevented the service receiving new data. This data would all have been received the next time the affected clients tried to publish.
<tr>
 
<th scope="col"> Issue Description
CERN and OSG moved their production accounting to the new SSM infrastructure. For CERN’s job records summaries are made which are then merged with the summaries from the old system for transfer to the CESGA Portal. OSG send summaries and these too are merged. The test repository continues to run all the time to receive tests from other sites developing their software against SSM the new STOMP and Python-based messaging layer which runs on the production EGI Messaging Infrastructure. All of the other existing and new accounting services have done some testing using SSM, now including SGAS and GridSafe. Tests also received from CC-IN2P3, and ARC-JURA. Planning with Grid-Safe and MAPPER. EDGI should start next quarter.
</th>
 
<th scope="col"> Mitigation Description
Participated in Inter-NGI Report Virtual Team. MPI Virtual Team, and the Federated Cloud Task Force. For this latter we continue to run a test cloud accounting database. This quarter we have five Resource Providers who have successfully sent in cloud accounting records, this is from OpenNebula and Openstack cloud middleware, previously we had only OpenNebula accounting records. (Client cloud accounting scripts have been provided by CESGA for OpenNebula and IN2P3 for Openstack.)
</th></tr>
 
<tr>
<font face="Times New Roman" size="3"></font>
<td>There was a bigger problem with a change to the EGI broker network after which APEL could not discover any brokers in the BDII. We put a manual fix in place the same day but it took some time more before the resource discovery worked. &#160;We still do not understand why this happened or how to mitigate future occurrences.
 
</td>
<font face="Consolas" size="3">As main ahievements on PQ9 for the accounting portal, there was miscellaneous query improvement and index optimization, better HTML output, testing with several browsers, tweaks on the graph engine, and other minor changes.</font>
<td> We are working with them both and hope to achieve this in the coming quarter.
 
</td></tr></table>
<font face="Times New Roman" size="3"></font>
<h1> 4. Plans for the next period </h1>
 
Migrate the SGAS and DGAS feeds to SSM then flip the database to the new schema and pipe the existing client feeds into that. Implement summary feeds for external services, with CESGA as the main one. The production infrastructure will now be ready to receive data from the EMI3 client.   
<font face="Consolas" size="3">There was also preliminary work prior to the implementation of new interNGI usage features.</font><font face="Times New Roman" size="3"></font><br>&nbsp;
There will be an accounting workshop in the Technical Forum.
 
The next version of the portal will be released and the portal will work on accepting data by messaging.
= 3. Issues and Mitigation  =
 
{| border="1" cellspacing="0" cellpadding="2"
|-
! scope="col" | Issue Description
! scope="col" | Mitigation Description
|-
| &nbsp;There was a bigger problem with a change to the EGI broker network after which APEL could not discover any brokers in the BDII. We put a manual fix in place the same day but it took some time more before the resource discovery worked.  
| &nbsp;We still do not understand why this happened or how to mitigate future occurrences.
|- There have been delays migrating SGAS and DGAS to the new infrastructure due to staff shortages.
| We are working with them both and hope to achieve this in the coming quarter.
|}
 
= 4. Plans for the next period =

Revision as of 15:45, 10 August 2012

=

1. Task Meetings

Date (dd/mm/yyyy) Url Indico Agenda Title Outcome
No formal meetings this quarter


2. Main Achievements

Repository:

Ran the production repository with no internal problems this quarter. There were a few very small network breaks which prevented the service receiving new data. This data would all have been received the next time the affected clients tried to publish.

CERN and OSG moved their production accounting to the new SSM infrastructure. For CERN’s job records summaries are made which are then merged with the summaries from the old system for transfer to the CESGA Portal. OSG send summaries and these too are merged. The test repository continues to run all the time to receive tests from other sites developing their software against SSM the new STOMP and Python-based messaging layer which runs on the production EGI Messaging Infrastructure. All of the other existing and new accounting services have done some testing using SSM, now including SGAS and GridSafe. Tests also received from CC-IN2P3, and ARC-JURA. Planning with Grid-Safe and MAPPER. EDGI should start next quarter.

Participated in Inter-NGI Report Virtual Team. MPI Virtual Team, and the Federated Cloud Task Force. For this latter we continue to run a test cloud accounting database. This quarter we have five Resource Providers who have successfully sent in cloud accounting records, this is from OpenNebula and Openstack cloud middleware, previously we had only OpenNebula accounting records. (Client cloud accounting scripts have been provided by CESGA for OpenNebula and IN2P3 for Openstack.)

Portal

As main ahievements on PQ9 for the accounting portal, there was miscellaneous query improvement and index optimization, better HTML output, testing with several browsers, tweaks on the graph engine, and other minor changes.

There was also preliminary work prior to the implementation of new interNGI usage features.
 

3. Issues and Mitigation

Issue Description Mitigation Description
There was a bigger problem with a change to the EGI broker network after which APEL could not discover any brokers in the BDII. We put a manual fix in place the same day but it took some time more before the resource discovery worked.  We still do not understand why this happened or how to mitigate future occurrences. We are working with them both and hope to achieve this in the coming quarter.

4. Plans for the next period

Migrate the SGAS and DGAS feeds to SSM then flip the database to the new schema and pipe the existing client feeds into that. Implement summary feeds for external services, with CESGA as the main one. The production infrastructure will now be ready to receive data from the EMI3 client. There will be an accounting workshop in the Technical Forum. The next version of the portal will be released and the portal will work on accepting data by messaging.