SCIENCE
EDGI demonstrates how to submit 10,000 jobs to a Volunteer Desktop Grid from within the European Grid Infrastructure
Demonstration at EGI User Forum opens new possibilities for large scale supercomputing
At the EGI User Forum, held in Vilnius, Lithuania, the EDGI project for the first time demonstrated a brand new feature. The feature is called the MetaJob mechanism by which users are enabled to submit jobs to the EDGI Desktop Grid through gLite using one single submit command in the range of thousands of jobs, tens of thousands of jobs or even more. This was being demonstrated in the EDGI booth with great success.
During the day 10,000 jobs were submitted several times to show the EGI User Forum visitors, how the jobs can easily be processed by BOINC and to show the gLite users, how MetaJob can be used through glite, without disrupting the gLite infrastructure.
From a technical point of view the solution is based on the well known Service Cluster Grid to Desktop Grid bridge, where an extra metajob description file - containing the definition of a huge number of jobs - is attached to the job as input file. This metajob input file is recognised by the 3GBridge component, which then creates the jobs and inserts them into BOINC. That is the essence of the solution. This solution also works with XtremWeb on the Desktop Grid side or ARC on the Service/Cluster Grid side without any modification. This work was performed in the framework of "Task JRA1.5: Solve Service/Cluster Grid to Desktop Grid bridge scalability issues" in the EDGI project.
Peter Kacsuk from the EDGI project stated: "This successful EDGI demonstration clearly shows that Desktop Grids can be used effortlessly for scientific day-to-day calculations. The relevance of Desktop Grids for e-Science has been proven once and for all."
The technical results and documentation are available on both the EDGI and Desktop Grid Federation websites. The International Desktop Grid Federation will take care that also other Grids can use the demonstrated technology.
How to resolve AdBlock issue?