Skip to main navigation Skip to search Skip to main content

Performance analysis of MapReduce-based distributed systems for iterative data processing applications

  • Min Yoon
  • , Hyeong Il Kim
  • , Dong Hoon Choi
  • , Heeseung Jo
  • , Jae Woo Chang*
  • *Corresponding author for this work
    • Jeonbuk National University
    • Korea Institute of Science and Technology Information

    Research output: Contribution to conferenceConference paperpeer-review

    Abstract

    Recently, research on big data has been actively made because big data are generated in various scientific applications, such as biology and astronomy. Therefore, distributed data processing techniques have been studied to manage the big data in large number servers. Meanwhile, some scientific applications like genome data analysis require loop control in analyzing big data using a MapReduce framework. In this paper, we first describe the existing MapReduce-based distributed systems which support iterative data processing. In addition, we do the performance analysis of the existing distributed systems in terms of execution time for various scientific applications which require iterative data processing. Finally, based on the performance analysis, we discuss some requirements for a new MapReduce-based distributed system which supports iterative data processing efficiently.

    Original languageEnglish
    Title of host publicationMobile, Ubiquitous, and Intelligent Computing, MUSIC 2013
    PublisherSpringer Verlag
    Pages293-299
    Number of pages7
    ISBN (Print)9783642406744
    DOIs
    StatePublished - 2014
    Event4th International Conference on Mobile, Ubiquitous, and Intelligent Computing, MUSIC 2013 - Gwangju, Korea, Republic of
    Duration: 2013.09.42013.09.6

    Publication series

    NameLecture Notes in Electrical Engineering
    Volume274 LNEE
    ISSN (Print)1876-1100
    ISSN (Electronic)1876-1119

    Conference

    Conference4th International Conference on Mobile, Ubiquitous, and Intelligent Computing, MUSIC 2013
    Country/TerritoryKorea, Republic of
    CityGwangju
    Period13.09.413.09.6

    Keywords

    • Big data
    • iterative data processing
    • MapReduce-based distributed systems

    Quacquarelli Symonds(QS) Subject Topics

    • Engineering - Mechanical

    Fingerprint

    Dive into the research topics of 'Performance analysis of MapReduce-based distributed systems for iterative data processing applications'. Together they form a unique fingerprint.

    Cite this