From Gilles Fedak

Main: SpeQuloS

SpeQuloS: Quality of Service for Best-Effort Distributed Computing Infrastructures

Participants: Simon Delamare, Gilles Fedak, Derrick Kondo, Oleg Lodygensky

The SpeQuloS Software Home Page is here : http://graal.ens-lyon.fr/~sdelamar/spequlos/

The aim of the project is to provide an middleware to implement Quality of Service for unreliable DCI (e.g. Desktop Grid) by provisionning additional stable and on-demand resources (e.g. Cloud) in the scope of the European FP7 EDGI project.

The EDGI project

FP7 Support

EDGI is an FP7 European project, following the successful FP7 EDGeS project, whose goal is build a Grid infrastructure composed of "Desktop Grids", such as BOINC or XtremWeb, where computing resources are provided by Internet volunteers, and "Service Grids", where computing resources are provided by institutional Grid such as EGEE, gLite, Unicore and "Clouds systems" such as OpenNebula and Eucalyptus, where resources are provided on-demand. The goal of the EDGI project is to provide an infrastructure where Service Grids are extended with public and institutional Desktop Grids and Clouds. Our partners include SZTAKI insitute (Hungary), CIEMAT (Spain), Univ. Coimbra (Portugal), Univ Cardiff (UK), Univ Westminster (UK), AlmereGrid (NL), IN2P3 (FR) and more.

The main problem with the currentinfrastructure is that it cannot give any QoS support for running their application in the Desktop Grid part of the infrastructure. For example, a public DG system enables clients to return work-unit results in the range of weeks. Although there are EGEE applications (e.g. the fusion community’s applications) that can tolerate such a long latency most of the user communities want much smaller latency.

The SpeQuloS middleware

The INRIA leads the activities of the Work Package JRA2 : QoS support for Desktop Grids to solve this critical problem.

We define QoS concretely as a probabilistic guarantee of job makespan or throughput. Providing QoS features even in Service Grids is hard and not solved yet satisfactorily. It is even more difficult in an environment where there are no guaranteed resources. In DG systems resources can leave the system at any time for a long time or forever even after taking several work-units with the promise of computing them. Two main approaches will be investigated within EDGI and deployed in the EDGI production infrastructure.

The first approach classifies the DG clients according to their historical behavior and allocates applications with QoS needs to the more trustable and faster clients. However, even in this case it can happen that some of the work-units are not completed in time.

The second approach is based on the extension of DG systems with Cloud resources. For such critical work-units the SpeQuloS system is able to dynamically deploy fast and trustable clients from some Clouds that are available to support the EDGI DG systems. It takes the right decision about assigning the necessary number of trusted clients and Cloud clients for the QoS applications.

The SpeQuloS architecture

The Spequlos middleware is composed of 4 components: a Qos Info system, QoS credit system, QoS Oracle and a QoS Scheduler

Financial support

EDGI is supported by the FP7 Capacities Programme under grant agreement nr RI-261556.

FP7 Support
Retrieved from http://graal.ens-lyon.fr/~gfedak/pmwiki-test/pmwiki.php/Main/SpeQuloS
Page last modified on March 14, 2012, at 06:09 AM