TY - GEN
T1 - DIAO
T2 - 3rd International Multi-Conference on Computing in the Global Information Technology, ICCGI 2008
AU - Guo, Tongcheng
AU - Jarvis, Stephen A.
PY - 2008
Y1 - 2008
N2 - A three-tier data distribution framework is proposed for grid-enabled data analysis applications. This framework is based on existing resource reservation services: the analytical tasks which this framework serves, and their input data, are assigned by an existing performance-aware scheduling system to computational hosts termed 'calculators '. A so-called 'guider ' organizes the data delivery from the source server to the 'coordinators', and every coordinator schedules the data propagation from itself to all its calculators. This scheme, which we call DIAO, is peer-to-peer (P2P), in that after downloading a data item, a host may behave as its server. Theoretical modeling reveals that the duration of data distribution depends on the effective utilization of the bottleneck resource in the overlay, and we develop three heuristics to minimize this duration, subject to the available resources. The ability of DIAO to exploit limited resources is demonstrated through simulation.
AB - A three-tier data distribution framework is proposed for grid-enabled data analysis applications. This framework is based on existing resource reservation services: the analytical tasks which this framework serves, and their input data, are assigned by an existing performance-aware scheduling system to computational hosts termed 'calculators '. A so-called 'guider ' organizes the data delivery from the source server to the 'coordinators', and every coordinator schedules the data propagation from itself to all its calculators. This scheme, which we call DIAO, is peer-to-peer (P2P), in that after downloading a data item, a host may behave as its server. Theoretical modeling reveals that the duration of data distribution depends on the effective utilization of the bottleneck resource in the overlay, and we develop three heuristics to minimize this duration, subject to the available resources. The ability of DIAO to exploit limited resources is demonstrated through simulation.
UR - http://www.scopus.com/inward/record.url?scp=52249119188&partnerID=8YFLogxK
U2 - 10.1109/ICCGI.2008.26
DO - 10.1109/ICCGI.2008.26
M3 - Conference contribution
AN - SCOPUS:52249119188
SN - 9780769532752
T3 - Proc. - The 3rd Int. Multi-Conf. Computing in the Global Information Technology, ICCGI 2008 in Conjunction with ComP2P 2008: The 1st Int. Workshop on Computational P2P Networks: Theory and Practice
SP - 200
EP - 209
BT - Proc. - The 3rd Int. Multi-Conf. Computing in the Global Information Technology, ICCGI 2008 in Conjunction with ComP2P 2008
Y2 - 27 July 2008 through 1 August 2008
ER -