A Comparison of Stream Processing Frameworks

Date

2017

Authors

Journal Title

Journal ISSN

Volume Title

Publisher

Institute of Electrical and Electronics Engineers Inc.

Open Access Color

Green Open Access

No

OpenAIRE Downloads

OpenAIRE Views

Publicly Funded

No
Impulse
Top 10%
Influence
Top 10%
Popularity
Top 10%

relationships.isProjectOf

relationships.isJournalIssueOf

Abstract

This study compares the performance of Big Data Stream Processing frameworks including Apache Spark, Flink, and Storm. Also, it measures the resource usage and performance scalability of the frameworks against a varying number of cluster sizes. It has been observed that, Flink outperforms both Spark and Storm under equal constraints. However, Spark can be optimized to provide the higher throughput than Flink with the cost of higher latency. © 2017 IEEE.

Description

ORCID
Alayyoub, Mohammed ORCID logo
Karakaya, Ziya ORCID logo

Keywords

Big Data, Flink, Spark, Storm, Stream Processing Framework

Fields of Science

0202 electrical engineering, electronic engineering, information engineering, 02 engineering and technology

Citation

WoS Q

Scopus Q

OpenCitations Logo
OpenCitations Citation Count
18

Source

2017 International Conference on Computer and Applications, ICCA 2017 -- 2017 International Conference on Computer and Applications, ICCA 2017 -- 6 September 2017 through 7 September 2017 -- Doha -- 131502

Volume

Issue

Start Page

1

End Page

12

URI

https://doi.org/10.1109/COMAPP.2017.8079733
 https://hdl.handle.net/20.500.14411/3849

Collections

Scopus
WoS
PlumX Metrics
Citations

Scopus : 25

Captures

Mendeley Readers : 27

Google Scholar Logo
Google Scholar™
Check
OpenAlex Logo
OpenAlex FWCI
3.39

Sustainable Development Goals