Search
 
loader loading subjects...
cover
IDP: An Innovative Data Placement Algorithm for Hadoop Systems
Chia-Wei Lee, Horng-Chyau Huang, Sun-Yuan Hsieh
49 - 58
10.3233/978-1-61499-484-8-49
Frontiers in Artificial Intelligence and Applications
Volume 274: Intelligent Systems and Applications
Abstract

In this paper, we propose a data placement strategy to deal with the imbalanced workload problem on DataNodes. Basing on computing capability of each node in a heterogeneous Hadoop cluster, the proposed strategy can balance the data that was stored in the DataNode such that the cost of data transfer time can be tremendously reduced. As a result, the Hadoop overall performance can be greatly improved. Experimental results demonstrate that the proposed data placement strategy can highly decrease the execution time and thus improves Hadoop performance in a heterogeneous cluster.

$35.00 / €27.50 / £22.00
Add PDF to cart