Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "VT GPGPU/DraftSurvey"

From EGIWiki
Jump to navigation Jump to search
 
(37 intermediate revisions by one other user not shown)
Line 1: Line 1:
[[Category:Virtual Teams]]
= EGI User Community GPGPU Survey =  
= EGI User Community GPGPU Survey =  


Line 11: Line 12:
== User Profile ==
== User Profile ==


Q1 Which Scientific Discipline do you work in? '''ANS: Text'''
Q1 Which Scientific Discipline do you work in?  


'''Text Box'''


Q2 Do you currently use grid or cloud technologies? '''ANS: Yes or No'''




Q3 Do you use GPGPU based applications for your scientific computations (on a local cluster, other type of resources)? '''ANS: Yes or No'''
Q2 Do you currently use grid or cloud technologies?  


'''Yes <br>'''
'''No'''<br>


Q4 If you use GPGPU computation, what it is the speed-up achieved compared with not-parallel computing? '''ANS: Text'''
''Please provide a comment. Why Yes/No ?''  




Q5 If you are not currently using GPGPUs, do you intend to use them within the next 18 months (if possible, please indicate when: Next 3 Months, Next 6 Months, Next 12 Months etc) - '''ANS: Yes + timeframe (optional) or No '''


Q3 Do you use GPGPU based applications for your scientific computations ?


Q6 Would you like to access GPGPU based resources through the European Grid Infrastructure (EGI) ? '''ANS: Yes or No'''
'''Yes'''<br>
'''No''' <br>


''Please provide a comment. Why Yes/No ?''


Q7 Do you develop or intend to develop any GPGPU based applications? '''ANS: Yes or No'''
 
 
Q4 What is the speed-up achieved compared with not-parallel computing?
 
''Question Logic: if Q3 was Yes''
 
'''Text box'''
 
 
Q5 Do you intend to use them within the next 18 months ?
 
'''No''' (Comment why ?)<br>
'''Yes''' (Comment the time frame e.g. 3 months)<br>
 
''Please provide a comment.''
 
 
Q6 Would you like to access GPGPU based resources through the European Grid Infrastructure (EGI) ?
 
'''Yes'''<br>
'''No''' <br>
 
''Please provide a comment. Why Yes/No ?''


== Application Development ==
== Application Development ==


Please Answer this section if you have answered yes to Q5.  
Please Answer this section if you have answered yes to Q3.  
 
If you have any other use cases you would like to bring our attention, please send us an email to : vt-gpgpu_AT_egi.eu.
 
 
Q7 Do you develop or intend to develop any GPGPU based applications?
 
'''Yes'''<br>
'''No''' <br>
 
''Please provide a comment. Why Yes/No ?''
 
 
Q8 Is the code being developed or used inside an international collaboration ?
 
'''No'''<br>
'''Yes''' <br>(Comment which ones ?)
 
''Please provide a comment''
 
Q9 What do you expect from high level programming languages abstractions to write parallel programs ? Is there a need for such languages ?
 
'''Text box'''
 
 
Q10 What particular numerical methods would you like to use on GPGPUs ? (e.g. CUBLAS for linear algebra, CUSPARSE for sparse matrices, CURAND for pseudo random number generation, NPP, etc.)
 
'''Text box'''
 
 
Q11 What Application Programming Interface do/will you use? (e.g. CUDA, OpenCL, OpenACC etc.)
 
'''Text box'''
 
 
Q12 Do you intend to develop code which depends on other application frameworks (e.g MPI, BLAST etc.)
 
'''No'''<br>
'''Yes''' (Comment which ones?)
 
''Please provide a comment.''
 


Q13 Are there any particular GPGPU applications/solvers/libraries/methods you would like to have on a GPGPU cluster?


Q8 What Application Programming Interface do/will you use? (e.g. CUDA, OpenCL, OpenACC, or Other) '''ANS; Text'''
'''No'''<br>
'''Yes''' (Comment which ones?)


''Please provide a comment.''




Q9 Do you intend to develop code which depends on other application frameworks (e.g MPI, BLAST etc). If Yes, then please list an example.  '''ANS; Yes + optional text or No'''
Q14 Is there a need on the market to implement additional applications/solvers/libraries/methods?


'''No'''<br>
'''Yes'''<br>
''Please provide a comment. Why Yes/No ?''
Q15 Are you performing hybrid computations (CPU + GPU), or CPU is just used for IO, communication and computation managing ?
'''Yes'''<br>
'''No'''<br>
''Please provide a comment. Why Yes/No ?''
Q16 What is the optimal ratio between the number of GPUs and CPU cores for your application?
''Question Logic: if Q15 was Yes''
'''Text box'''
Q17: If you are utilizing all GPU resources on a node, do you expect, to be an exclusive user on this node (cost of PCI-Express and RAM bandwidth sharing, etc.)?
'''No'''<br>
'''Yes'''<br>
''Please provide a comment. Why Yes/No ?''
Q18: Do you expect any particular network topology on the cluster or utilities to exchange the data between the nodes (e.g. NVIDIA GPUDirect)?
'''No'''<br>
'''Yes'''<br>
''Please provide a comment. Why Yes/No ?''


== Resource Centres GPGPU administration ==
== Resource Centres GPGPU administration ==
Line 48: Line 154:




Q1 Does your grid site currently provide GPGPU resources or does it intend to provide GPGPU resources?
'''Yes''' (Please comment which grid sites do provide it?)<br>
'''No''' (Please comment why?)<br>
''Please provide a comment.'' 
Q2 Which LRMS ? (e.g batch system and job scheduler do you use)
'''Text box'''
Q3 How the GPU resources are seen from LRMS point of view ?:
*a) manually configured consumable resource
*b) the GPU management is natively supported by the LRMS
*c) the LRMS is not aware of GPUs (e.g. user have to request whole node to get exclusive access to GPUs)
*d) other (Please comment below)
''Please provide a comment''
Q4 Does every node has GPU or only a subset of them ?
'''No'''<br>
'''Yes'''<br>


Q10 Does your site currently provide GPGPU resources or does it intend to provide GPGPU resources?  '''ANS; Yes + optional text or No'''
''Please provide a comment. Why Yes/No ?''  




Q11 Which LRMS (i.e batch system and job scheduler do you use)


Q5 Is access to GPGPU-enabled hosts restricted to specific users or groups?


Q12. How the GPU resources are seen from LRMS point of view:
Question Logic: if Q5 was No


a) manually configured consumable resource
'''No'''<br>
'''Yes'''<br>


b) the GPU management is natively supported by the LRMS
''Please provide a comment. Why Yes/No ?''


c) the LRMS is not aware of GPUs (i.e. user have to request whole node to get exclusive access to GPUs)


d) other?


Q6 Link to hardware description ? (e.g. number of GPU nodes, type of GPU devices, number of cards per node)


Q13 Does every node has GPU or only a subset of them? ANS:YES/NO
'''Text box'''




Q14 Is access to GPGPU-enabled hosts restricted to specific users or groups?


Q7 Link to end-user documentation ? (e.g. how to submit a GPU job)


Q15: Link to hardware description (number of GPU nodes, type of GPU devices, number of cards per node). ANS:TEXT
'''Text box'''




Q16: Link to end-user documentation (i.e. how to submit a GPU job). ANS:Text


Q8 Did you implement some additional mechanism to manage access to GPU devices ? (e.g. custom prolog/epilog scripts, http://sourceforge.net/projects/cudawrapper/ etc.)


Q17: Did you implement some additional mechanism to manage access to GPU devices (e.g. custom prolog/epilog scripts,http://sourceforge.net/projects/cudawrapper/, ...)? ANS:TEXT
'''Text box'''

Latest revision as of 17:11, 19 December 2012

EGI User Community GPGPU Survey

Overview

The use of General Purpose Graphics Processing Units (GPGPUs) or accelerator devices, such as Intel's Xeon Phi co-processor, over the past few years has resulted in a huge increase in their exploitation by all the major scientific disciplines. With three of the top 10 clusters in the current June 2012 Top500 supercomputers list using NVIDIA GPGPUs, we would expect the number of GPGPU deployments at grid resource centres to grow significantly over the next few years. Moreover

The purpose of this survey is to gauge how the users currently use, or intend to use, GPGPUs or other accelerated devices in Grid or hybrid Grid/Cloud environments, or whether they shall use grids for this purpose. In particular, we would like to determine if there is a specific need from the User Communities for a more tightly integrated GPGPU capability within the grid environment. In addition, we welcome further user comments and feedback on any other aspects.

All data collected from the survey feedback will be processed anonymously.

User Profile

Q1 Which Scientific Discipline do you work in?

Text Box


Q2 Do you currently use grid or cloud technologies?

Yes
No

Please provide a comment. Why Yes/No ?


Q3 Do you use GPGPU based applications for your scientific computations ?

Yes
No

Please provide a comment. Why Yes/No ?


Q4 What is the speed-up achieved compared with not-parallel computing?

Question Logic: if Q3 was Yes

Text box


Q5 Do you intend to use them within the next 18 months ?

No (Comment why ?)
Yes (Comment the time frame e.g. 3 months)

Please provide a comment.


Q6 Would you like to access GPGPU based resources through the European Grid Infrastructure (EGI) ?

Yes
No

Please provide a comment. Why Yes/No ?

Application Development

Please Answer this section if you have answered yes to Q3.

If you have any other use cases you would like to bring our attention, please send us an email to : vt-gpgpu_AT_egi.eu.


Q7 Do you develop or intend to develop any GPGPU based applications?

Yes
No

Please provide a comment. Why Yes/No ?


Q8 Is the code being developed or used inside an international collaboration ?

No
Yes
(Comment which ones ?)

Please provide a comment

Q9 What do you expect from high level programming languages abstractions to write parallel programs ? Is there a need for such languages ?

Text box


Q10 What particular numerical methods would you like to use on GPGPUs ? (e.g. CUBLAS for linear algebra, CUSPARSE for sparse matrices, CURAND for pseudo random number generation, NPP, etc.)

Text box


Q11 What Application Programming Interface do/will you use? (e.g. CUDA, OpenCL, OpenACC etc.)

Text box


Q12 Do you intend to develop code which depends on other application frameworks (e.g MPI, BLAST etc.)

No
Yes (Comment which ones?)

Please provide a comment.


Q13 Are there any particular GPGPU applications/solvers/libraries/methods you would like to have on a GPGPU cluster?

No
Yes (Comment which ones?)

Please provide a comment.


Q14 Is there a need on the market to implement additional applications/solvers/libraries/methods?

No
Yes

Please provide a comment. Why Yes/No ?


Q15 Are you performing hybrid computations (CPU + GPU), or CPU is just used for IO, communication and computation managing ?

Yes
No

Please provide a comment. Why Yes/No ?


Q16 What is the optimal ratio between the number of GPUs and CPU cores for your application?

Question Logic: if Q15 was Yes

Text box


Q17: If you are utilizing all GPU resources on a node, do you expect, to be an exclusive user on this node (cost of PCI-Express and RAM bandwidth sharing, etc.)?

No
Yes

Please provide a comment. Why Yes/No ?


Q18: Do you expect any particular network topology on the cluster or utilities to exchange the data between the nodes (e.g. NVIDIA GPUDirect)?

No
Yes

Please provide a comment. Why Yes/No ?

Resource Centres GPGPU administration

These questions are intended to be answered by Resource Centre Administrators. The goal here is determine how widespread GPGPUs are (or will be) provided in the infrastructure; how the site administrators configure these resources in the batch system/scheduler; allocation policies; how these GPGPU are made visible on the grid infrastructure, etc.


Q1 Does your grid site currently provide GPGPU resources or does it intend to provide GPGPU resources?

Yes (Please comment which grid sites do provide it?)
No (Please comment why?)

Please provide a comment.


Q2 Which LRMS ? (e.g batch system and job scheduler do you use)

Text box


Q3 How the GPU resources are seen from LRMS point of view ?:

  • a) manually configured consumable resource
  • b) the GPU management is natively supported by the LRMS
  • c) the LRMS is not aware of GPUs (e.g. user have to request whole node to get exclusive access to GPUs)
  • d) other (Please comment below)

Please provide a comment


Q4 Does every node has GPU or only a subset of them ?

No
Yes

Please provide a comment. Why Yes/No ?


Q5 Is access to GPGPU-enabled hosts restricted to specific users or groups?

Question Logic: if Q5 was No

No
Yes

Please provide a comment. Why Yes/No ?


Q6 Link to hardware description ? (e.g. number of GPU nodes, type of GPU devices, number of cards per node)

Text box


Q7 Link to end-user documentation ? (e.g. how to submit a GPU job)

Text box


Q8 Did you implement some additional mechanism to manage access to GPU devices ? (e.g. custom prolog/epilog scripts, http://sourceforge.net/projects/cudawrapper/ etc.)

Text box