Fine-grained workflow in heterogeneous environments

Oisín Curran, Paddy Downes, John Cunniffe, Andy Shearer

Research output: Chapter in Book or Conference Publication/ProceedingConference Publicationpeer-review

2 Citations (Scopus)

Abstract

This work details the design and analysis of a fully decentralised scientific workflow management system for the execution of real applications in heterogeneous and unpredictable computing environments. Our model is based on a novel approach to the overlay metacomputer concept, founded on a graph-oriented peer-to-peer task distribution framework. This platform provides a basis for the development of a distributed virtual machine that can be dynamically deployed over a heterogeneous resource collection to provide a useful layer of abstraction, harnessing remote independent resources and making them appear dedicated to the execution of a particular collection of tasks. This paper demonstrates the utility of our model using synthetic and real workflow applications executed in a real and heterogeneous environment, identifying the potential benefit of fine-grained workflow expressions as a method for achieving predictable task execution behaviour in unpredictable environments.

Original languageEnglish
Title of host publicationProceedings of the 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing, PDP 2008
Pages115-119
Number of pages5
DOIs
Publication statusPublished - 2008
Event16th Euromicro Conference on Parallel, Distributed and Network-Based Processing, PDP 2008 - Toulouse, France
Duration: 13 Feb 200815 Feb 2008

Publication series

NameProceedings of the 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing, PDP 2008

Conference

Conference16th Euromicro Conference on Parallel, Distributed and Network-Based Processing, PDP 2008
Country/TerritoryFrance
CityToulouse
Period13/02/0815/02/08

Fingerprint

Dive into the research topics of 'Fine-grained workflow in heterogeneous environments'. Together they form a unique fingerprint.

Cite this