Big Data Processing Systems: State-of-the-Art and Open Challenges

Fuad Bajaber, Sherif Sakr, Omar Batarfi, Abdulrahman Altalhi, Radwa Elshawi, Ahmed Barnawi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

The growing demand for large-scale data processing and data analysis applications spurred the development of novel solutions from both the industry and academia. In the last decade, the MapReduce framework has emerged as a highly successful framework that has created a lot of momentum in both the research and industrial communities such that it has become the defacto standard of big data processing platforms. In particular, the MapReduce framework has been introduced to provide a simple but powerful programming model and runtime environment that eases the job of developing scalable parallel applications to process vast amounts of data on large clusters of commodity machines. However, recently, academia and industry have started to recognize the limitations of the Hadoop framework in several application domains such as large scale processing of structured data, graph data and streaming data. Thus, in recent years, we have witnessed an unprecedented interest to tackle these challenges which constitutes a new wave of domain-specific optimized big data processing platforms. To better understand the latest ongoing developments in the world of big data processing systems, in this paper, we provide a detailed overview and analysis of the state-of-the-art in this domain. In addition, we identify a set of the current open research challenges and discuss some promising directions for future research.

Original languageEnglish
Title of host publication2015 International Conference on Cloud Computing, ICCC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467366175
DOIs
Publication statusPublished - 1 Jan 2015
Event1st International Conference on Cloud Computing, ICCC 2015 - Riyadh, Saudi Arabia
Duration: 26 Apr 201529 Apr 2015

Other

Other1st International Conference on Cloud Computing, ICCC 2015
CountrySaudi Arabia
CityRiyadh
Period26/04/1529/04/15

Fingerprint

Industry
Momentum
Big data
Processing

Cite this

Bajaber, F., Sakr, S., Batarfi, O., Altalhi, A., Elshawi, R., & Barnawi, A. (2015). Big Data Processing Systems: State-of-the-Art and Open Challenges. In 2015 International Conference on Cloud Computing, ICCC 2015 [7149633] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CLOUDCOMP.2015.7149633
Bajaber, Fuad ; Sakr, Sherif ; Batarfi, Omar ; Altalhi, Abdulrahman ; Elshawi, Radwa ; Barnawi, Ahmed. / Big Data Processing Systems : State-of-the-Art and Open Challenges. 2015 International Conference on Cloud Computing, ICCC 2015. Institute of Electrical and Electronics Engineers Inc., 2015.
@inproceedings{94c4b62eafed454aa2b49213f82703c2,
title = "Big Data Processing Systems: State-of-the-Art and Open Challenges",
abstract = "The growing demand for large-scale data processing and data analysis applications spurred the development of novel solutions from both the industry and academia. In the last decade, the MapReduce framework has emerged as a highly successful framework that has created a lot of momentum in both the research and industrial communities such that it has become the defacto standard of big data processing platforms. In particular, the MapReduce framework has been introduced to provide a simple but powerful programming model and runtime environment that eases the job of developing scalable parallel applications to process vast amounts of data on large clusters of commodity machines. However, recently, academia and industry have started to recognize the limitations of the Hadoop framework in several application domains such as large scale processing of structured data, graph data and streaming data. Thus, in recent years, we have witnessed an unprecedented interest to tackle these challenges which constitutes a new wave of domain-specific optimized big data processing platforms. To better understand the latest ongoing developments in the world of big data processing systems, in this paper, we provide a detailed overview and analysis of the state-of-the-art in this domain. In addition, we identify a set of the current open research challenges and discuss some promising directions for future research.",
author = "Fuad Bajaber and Sherif Sakr and Omar Batarfi and Abdulrahman Altalhi and Radwa Elshawi and Ahmed Barnawi",
year = "2015",
month = "1",
day = "1",
doi = "10.1109/CLOUDCOMP.2015.7149633",
language = "English",
booktitle = "2015 International Conference on Cloud Computing, ICCC 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Bajaber, F, Sakr, S, Batarfi, O, Altalhi, A, Elshawi, R & Barnawi, A 2015, Big Data Processing Systems: State-of-the-Art and Open Challenges. in 2015 International Conference on Cloud Computing, ICCC 2015., 7149633, Institute of Electrical and Electronics Engineers Inc., 1st International Conference on Cloud Computing, ICCC 2015, Riyadh, Saudi Arabia, 26/04/15. https://doi.org/10.1109/CLOUDCOMP.2015.7149633

Big Data Processing Systems : State-of-the-Art and Open Challenges. / Bajaber, Fuad; Sakr, Sherif; Batarfi, Omar; Altalhi, Abdulrahman; Elshawi, Radwa; Barnawi, Ahmed.

2015 International Conference on Cloud Computing, ICCC 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7149633.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Big Data Processing Systems

T2 - State-of-the-Art and Open Challenges

AU - Bajaber, Fuad

AU - Sakr, Sherif

AU - Batarfi, Omar

AU - Altalhi, Abdulrahman

AU - Elshawi, Radwa

AU - Barnawi, Ahmed

PY - 2015/1/1

Y1 - 2015/1/1

N2 - The growing demand for large-scale data processing and data analysis applications spurred the development of novel solutions from both the industry and academia. In the last decade, the MapReduce framework has emerged as a highly successful framework that has created a lot of momentum in both the research and industrial communities such that it has become the defacto standard of big data processing platforms. In particular, the MapReduce framework has been introduced to provide a simple but powerful programming model and runtime environment that eases the job of developing scalable parallel applications to process vast amounts of data on large clusters of commodity machines. However, recently, academia and industry have started to recognize the limitations of the Hadoop framework in several application domains such as large scale processing of structured data, graph data and streaming data. Thus, in recent years, we have witnessed an unprecedented interest to tackle these challenges which constitutes a new wave of domain-specific optimized big data processing platforms. To better understand the latest ongoing developments in the world of big data processing systems, in this paper, we provide a detailed overview and analysis of the state-of-the-art in this domain. In addition, we identify a set of the current open research challenges and discuss some promising directions for future research.

AB - The growing demand for large-scale data processing and data analysis applications spurred the development of novel solutions from both the industry and academia. In the last decade, the MapReduce framework has emerged as a highly successful framework that has created a lot of momentum in both the research and industrial communities such that it has become the defacto standard of big data processing platforms. In particular, the MapReduce framework has been introduced to provide a simple but powerful programming model and runtime environment that eases the job of developing scalable parallel applications to process vast amounts of data on large clusters of commodity machines. However, recently, academia and industry have started to recognize the limitations of the Hadoop framework in several application domains such as large scale processing of structured data, graph data and streaming data. Thus, in recent years, we have witnessed an unprecedented interest to tackle these challenges which constitutes a new wave of domain-specific optimized big data processing platforms. To better understand the latest ongoing developments in the world of big data processing systems, in this paper, we provide a detailed overview and analysis of the state-of-the-art in this domain. In addition, we identify a set of the current open research challenges and discuss some promising directions for future research.

UR - http://www.scopus.com/inward/record.url?scp=84941115182&partnerID=8YFLogxK

U2 - 10.1109/CLOUDCOMP.2015.7149633

DO - 10.1109/CLOUDCOMP.2015.7149633

M3 - Conference contribution

AN - SCOPUS:84941115182

BT - 2015 International Conference on Cloud Computing, ICCC 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Bajaber F, Sakr S, Batarfi O, Altalhi A, Elshawi R, Barnawi A. Big Data Processing Systems: State-of-the-Art and Open Challenges. In 2015 International Conference on Cloud Computing, ICCC 2015. Institute of Electrical and Electronics Engineers Inc. 2015. 7149633 https://doi.org/10.1109/CLOUDCOMP.2015.7149633