View source for EGI-Engage:TASK JRA2.4 Accelerated Computing

{{Template:EGI-Engage menubar}} {{TOC_right}} 

'''Task leader: '''Marco Verlato/INFN <BR>
'''Task leader deputy: '''Viet Tran/IISAS

'''Mailing list:'''egi-engage-wp4.4 at mailman.egi.eu

<br>
= Introduction =
Accelerated computing systems deliver energy efficient and powerful HPC capabilities. Many EGI sites are providing accelerated computing technologies to enable high performance processing such as GPGPUs or MIC co-processors. Currently these accelerated capabilities are not directly supported by the EGI platforms. To use the co-processors capabilities available at resource centre level, users must directly interact with the local provider to get information about the type of resources and software libraries available and which submission queues must be used to submit tasks of accelerated computing. 
This task will implement the support in the information system, to expose the correct information about the accelerated computing technologies available – both software and hardware – at site level, developing a common extension of the information system structure, based on OGF GLUE standard, in order to have the capabilities published uniformly by all the sites. Users will then be able to extract all the information directly from the information system without interacting with the sites, and easily use resources provided by multiple sites. The task will also extend the HTC and cloud middleware support for co-processors, where needed, in order to provide a transparent and uniform way to allocate these resources together with CPU cores efficiently to the users.

= Involved Partner =
* [http://www.infn.it INFN]
* [http://www.ui.sav.sk/index_en.php IISAS]
* [http://www.cerm.unifi.it/cirmmp-sp-2001548042 CIRMMP]

= Previous work =
* [[VT_GPGPU]] (2012)
* [[GPGPU_Working_Group]] (2013-2014)

= '''Current activity''' =
* [[GPGPU-FedCloud | '''GPGPU on Clouds''']]
* [[GPGPU-CREAM | '''GPGPU on Grids''']]

= Reports at the EGI Conferences =
* [https://indico.egi.eu/indico/event/2452/session/69/?slotId=0#20150519 EGI Conference 2015]
* [https://indico.egi.eu/indico/event/2544/session/47/?slotId=0#20151111 EGI Community Forum 2015]
* [https://indico.egi.eu/indico/event/2875/session/40/?slotId=0#20160408 EGI Conference 2016]

= '''Roadmap'''  =

{| class="wikitable"
|-
! Project month<br> 
! 
 
Work to be done 

! 
Goal&nbsp; 

(measurable) 

! 
Owner 

(reponsible person) 

! Comments
|-
! 1  
| Collection of people names and population of mailing lists 
| Communications in place 
| T. Ferrari 
| COMPLETE
|-
! 2 
| Review of available technologies for using GPUs in grid and cloud &nbsp; 
Resume of EGI-Inspire GPGPU VT <br> 

| Kick-off and GPGPU VT handover meeting 
| M.Verlato
| COMPLETE
|-
! 3  
| Review of available technologies for using GPUs in grid and cloud &nbsp; 
Analysis of requirements from user communities <br> 

| Discussion at [http://indico.egi.eu/indico/sessionDisplay.py?sessionId=69&confId=2452#20150519 GPGPU session at EGI Conference]
| M.Verlato
| COMPLETE
|-
! 4 
| End of review of available technologies for using GPUs in grid and cloud &nbsp; 
End of analysis of requirements from user communities <br> 

| Status report (to be included in Milestone 1.2 First intermediate report) and wiki pages
| M.Verlato
| COMPLETE
|-
! 7 
| Modification/configuration at site level (OS driver, hypervisor, CMF, VM images) for supporting GPUs in cloud &nbsp; 
Definition of abstract GPU-related CREAM JDL attributes to be mapped in the supported batch systems <br> 

| Cloud site with working GPU and installation manual &nbsp; 
Update of the CREAM JDL specification document <br> 

| M.Verlato<br> 
| COMPLETE<br>
|-
! 10  
| First step of integration with FedCloud (AppDB, accounting, brokering, ...) &nbsp; 
First implementation of GPU support in CREAM <br> 

| Tools and configuration manual, possible some demonstration &nbsp; 
GPU-enabled CREAM prototype released for testing <br> 

| M.Verlato<br> 
| COMPLETE<br>
|-
! 15 
| Revision of available technologies, further improvement and extension of supporting GPUs in FedCloud &nbsp; 
End of testing of GPU-enabled CREAM prototype and feedback collection <br> 

| Technical report contributing to Project Periodic Report (first period) &nbsp; 
Full GPU support put in the roadmap of the official final GPU-enabled CREAM release <br> 

| M.Verlato<br> 
| COMPLETE<br>
|}

= '''Extension'''  =

{| class="wikitable"
|-
! Project month<br> 
! 
Work to be done 

! 
Goal&nbsp; 

(measurable) 

! 
Owner 

(reponsible person) 

! Comments
|-
! 18 
| 
Collecting user experiences in using GPGPU in cloud 

Analysing new requirements and available technologies 

Preparing for extended support for GPGPU 

| Discussion at DI4R Conference 
| Viet Tran 
| -
|-
! 21 
| 
Extending support for GPGPU on new platform/CMF



| New site with GPGPU 
| Viet Tran 
| -
|-
! 24 
| 
Modifying/Updating FedCloud tools for GPGPU data



| Updated tools for generating accounting records and site BDII with GPGPU data 
| Viet Tran 
| -
|-
! 27 
| 
Full integration to EGI FedCloud



| Sites integrated 
| Viet Tran 
| -
|-
! 30 
| 
Revision of available technologies, user experiences



| Contributing to Project technical report 
| Viet Traa 
| 
|}

[[Category:EGI-Engage]]