VT Promoting Desktop Grids
|Engagement overview||Community requirements||Community events||Training||EGI Webinars||Documentations|
|EGI Virtual teams:||Main •||Active Projects •||Closed Projects •||Guidelines|
General project information
Leader: Robert Lovas, NGI_HU NIL, FP7 IDGF-SP project coordinator.
- Administrative support for the VT project will be provided by Richard McLennan (User Community Support Officer, email@example.com)
- Gergely Sipos will be responsible for the delivery of technical activities from the EGI side (Technical Outreach Manager, firstname.lastname@example.org)
Mailing list: email@example.com
Status: Members can join
Start date: 1st November 2013
End date: 31. October 2014 (updated from 30. April)
Meetings: Normally as a teleconference via Webex.
- 28-11-2013 14:30 (CET): Minutes-of-the-28-11-2013-dg-vt-meeting
- 17-03-2014 13:30 (CET): Minutes-of-the-17-03-2014-dg-vt-meeting
- 24-04-2014 13:00 (CET): Minutes-of-the-24-04-2014-dg-vt-meeting
Project Initiation document: File:DG VT proposal v4.pdf
Please comment and send your feedback about the initiation document on this dedicated page as the part of Task 0.
Desktop Grids (as a middleware technology for e-Infrastructures) is available for NGIs as a result of multi-year long joint work between the EGEE-III/EGI-InSPIRE and the EDGeS/EDGI projects.
The technology enables NGIs to access the resource pool offered by volunteers or organizations worldwide.
As one of the key stakeholders in the Desktop Grid related research field, MTA SZTAKI from NGI_HU with the strong support from the International Desktop Grid Federation provides bridges between EGI VOs and Desktop Grid resources in order to seamlessly integrate them. The bridges enable the interoperability between EGI core infrastructure and Desktop Grid solutions (among others) at job management, monitoring, and accounting level read more. The remaining documentation, training, and support related integration to be continued until the start of the VT, and completed in the framework of the VT.
However, there is a gap to be filled though – promotion of the technological solution to the NGIs, ideally through the Operation Managers – who are the single point of contact to reach site managers, and the NILs who are the single point of contact to reach those who support scientific applications with e-infrastructure solutions.
“EGI-InSPIRE is ideally placed to join together the new Distributed Computing Infrastructures (DCIs) such as clouds, supercomputing networks and desktop grids, for the benefit of user communities within the European Research Area.” -- EGI-InSPIRE Project fact sheet
Despite the on-going work (see the potential value section) and the benefits of the integrated Desktop Grid DCI resources available for EGI users, only a part of the EGI community is aware of the latest Desktop Grid related achievements, and a fraction of the EGI users and infrastructure operators take their advantages in everyday practice. In order to get closer the EGI community and Desktop Grid community; a part of the targeted objectives are technical ones but there is stronger focus on the human aspects – training, networking and support activities.
Main objectives of the proposed Virtual Team:
- 1. Promote and train the Desktop Grid related technologies in the EGI communities
- 2. Utilize the available bridged Desktop Grid resources (such as EDGeS@home) by more VOs
- 3. Increase the number of heavily used EGI applications on the integrated (Desktop Grid) infrastructure with focus on widespread tools/solutions/approaches
- 4. Improve documentation including
- 5. Complete the final remaining steps for full integration concerning e.g. support tools
- 6. Find joint EGI champion(s) - IDGF ambassador(s)
Project value to EGI
According to common experiences gained in the application related workpackages of the EDGeS, EDGI, DEGISCO, and IDGF-SP projects, or recently with the joint work with (among others) the DIRAC community, a large set of EGI applications are suitable for Desktop Grid resources as well, e.g. parameter studies, master-worker type, Monte Carlo type simulations, bag-of-tasks, model refinement, etc. A generic overview about the Desktop Grid related technologies is available on the e-Science Talk website as well1. Several application examples have been made available online, e.g. EGI AppDB contains more than 20 Desktop Grid enabled applications using BOINC and similar middleware technologies as the result of three successfully completed Desktop Grid related FP7 projects (EDGeS, EDGI, DEGISCO) and the on-going [www.idgf-sp.eu IDGF-SP project].
Moreover, GBAC (Generic BOINC Application Client), clouds and further virtualization technologies related to Desktop Grids enable the execution of a class of EGI applications efficiently and natively, i.e. without modification (As a recent result, e.g. DIRAC applications have become experimentally supported.).
Concerning the infrastructure side; MTA SZTAKI operates large-scale volunteer Desktop Grids, and offers them for EGI users (through production level bridges) with more than 6000 average amount of cores available from Desktop Grid resources read more.
Since 2009 these two Desktop Grids have been already provided more than 500 million normalized CPU hours to scientists, i.e. it would mean the 5th position on the top list of VOs in terms of delivered compute power:
Concerning the benefits – Desktop Grids provides cost-efficient and large-scale DCIs because “the resource pool is self-financing, self-updating and self-maintaining; millions of citizens purchase new computers, upgrade system software, maintain their 5computers, pay their electricity bills and donate their unused capacities for scientific purposes”. Detailed description of the benefits is available in David Anderson’s article on volunteer computing3. (The campus version of Desktop Grids uses spare capacities of the PC labs.) Therefore, the NGIs and the resources centers are able to extend their capacities at a fraction of cost4 contrary to the sometimes low or not enough budget provided for equipment and operation. In this way, the VT would contribute also to the sustainability of the DCIs participating in the world-wide EGI infrastructure since it offers a low-cost, alternative, and interoperable solution. (Detailed cost analysis will be available soon on the IDGF website.) Several DCI operators have already realized these benefits, and more and more DCIs with additional Desktop Grid resources are getting available, e.g. in Russian Federation, or in Malaysia read more.
Last but not least, the VT and Desktop Grids will open up new communication channels towards citizens who donate computational time for scientific purposes. E.g. campaigns with prize drawings among the top volunteers, attractive screensavers at the client side can bring the “message” from scientists to citizens. The joint IDGF ambassador(s)/EGI champion(s) would help also the better communication.
Deadline of completing activities (defined on 30/6/2014):
- 4 July: IDGF Operations Centre: final tests (finalizing the configurations) by SZTAKI
- 11 July: MoU signed between IDGF and EGI about the Operations Centre
- 15 July: Further feedback about the leaflet from the DG VT participants
- 25 July: SZTAKI to update the document based on the feedback, integrated version to be ready
- 4 Aug: Fine tuning of leaflet with final layout
- 11 Aug: The EGI working group of the IDGF website prepared (this will be linked from the leaflet and promotion materials)
- From the beginning of September: EGI.eu sends out the leaflet through contact channels for the target groups. Promotion at EGI TF (Amsterdam), and further upcoming events: http://desktopgridfederation.org/tutorials, BOINC workshop (Budapest): http://boinc.berkeley.edu/trac/wiki/WorkShop14. Other ways of distribution also needs to be thought of, such as webinars, presentations at NIL, OMB, UCB or other regular teleconferences organised by EGI.eu from September.
|Month 2||Identification of applications and VOs to be extended, collectingrequirements, first trainings|
|Month 4||First set of new supported VOs and applications are ready|
|Month 6||Improved training/dissemination materials, selected new ambassador(s)/champion(s), final report with all supported VOs and applications|
The VT will be led by MTA SZTAKI from the Hungarian NGI. Minimum 0.5 and maximum 2 person-months are expected from each participant NGIs depending on the available skills, experts, and applications in the given NGI. Mostly the communication/dissemination channels to the enlisted stakeholders (see below in the table) are required from the EGI.eu, and reviewers/advisors for the expected deliverables.
|Required skills||Related objective(s)||Related task(s)|
|Application experts: developers and/or heavy users||3, 4||0, 3|
|Infrastructure operators: Operation managers, VO/site managers||2||0, 4|
|User support team members||3, 4||0, 2|
|Dissemination team members||1, 4, 5||0, 1|
|Task||Outcome||Means of delivery||Link to outcome||Expected time of delivery (after VT start)||Updates & comments|
|Task 0||Full definition of the project objectives, motivation, method, deliverables and timeframe.|
|Task 1||Dissemination: on-line channels, printed materials, webinar and face-to-face events with focus on the benefits of Desktop Grids. Objective 1 will be targeted with these dissemination activities.|
|Task 2||Training: improve and add training materials about integrated Desktop Grids to repositories / give trainings (on-line, on-site) on-demand. Objectives 4 will be addressed directly with these technical training/documentation activities but it also serves as base for Objective 3 (i.e. having more applications on the infrastructure).|
|Task 3||Application support: user community/ambassador identification and improve support activities. Objective 3 will be addressed directly with this support activity but it also gives output/feedbacks for Objective 4 (i.e. improve the documentation).|
|Task 4||Infrastructure integration: extend more EGI VOs with Desktop Grids (deploy new or use existing modified Computing Elements for bridging EGI VOs and Desktop Grids). Objective 2 will be targeted with these technical activities.|
Email Robert.Lovas@mta.sztaki.hu if you wish to join! An EGI SSO account is required. Setup one at www.egi.eu/sso
Project leader: Robert Lovas, NGI_HU NIL, FP7 IDGF-SP project coordinator, Secretary of Stichting IDGF
- Gergely Sipos (firstname.lastname@example.org), EGI.eu, Netherlands
- Richard McLennan (email@example.com), EGI.eu, Netherlands
Other members (already expressed their interests in participating in the VT):
- Neki Frasheri (Polytechnic University of Tirana)
- Aneta Karaivanova (Institute of Information and Communication Technologies, Bulgarian Academy of Sciences)
- Peter Kacsuk (IDGF/MTA SZTAKI)
- Jozsef Kovacs (MTA SZTAKI)
- Luciano Milanesi (ITB CNR)
- M. Farhan Sjaugi (Malaysian Academic Grid)
- Alexandre Bonvin (Utrecht University/WeNMR)
- Ad Emmen (IDGF/AlmereGrid)
- Leslie Versweyveld (IDGF/AlmereGrid)
- Erika Swiderski (IDGF)
- Antun Balaz (Institute of Physics, Belgrade)
- Dusan Vudragovic (Institute of Physics, Belgrade)
- Fermin Serrano Sanz (IBERCIVIS)
- Vicky Huang (ASGC)
- Tamas Kiss (University of Westminster)
- Visti Hannu (University of Westminster)
- John Kewley (Science and Technology Facilities Council)
- Andrei Zinchenko (Institute of Transport System and Technologies, National Academy of Science of Ukraine)