Format

Send to

Choose Destination
EURASIP J Wirel Commun Netw. 2016;2016:152. Epub 2016 Jun 27.

A genetic algorithm-based job scheduling model for big data analytics.

Author information

1
College of Computer and Communication Engineering, China University of Petroleum, Qingdao, China.

Abstract

Big data analytics (BDA) applications are a new category of software applications that process large amounts of data using scalable parallel processing infrastructure to obtain hidden value. Hadoop is the most mature open-source big data analytics framework, which implements the MapReduce programming model to process big data with MapReduce jobs. Big data analytics jobs are often continuous and not mutually separated. The existing work mainly focuses on executing jobs in sequence, which are often inefficient and consume high energy. In this paper, we propose a genetic algorithm-based job scheduling model for big data analytics applications to improve the efficiency of big data analytics. To implement the job scheduling model, we leverage an estimation module to predict the performance of clusters when executing analytics jobs. We have evaluated the proposed job scheduling model in terms of feasibility and accuracy.

KEYWORDS:

Big data; Genetic algorithm; Hadoop; Job scheduling; MapReduce

Supplemental Content

Full text links

Icon for PubMed Central
Loading ...
Support Center