Study on programming frameworks for big data analytics

Pao Yue-kong Library Electronic Theses Database

Study on programming frameworks for big data analytics

 

Author: Wong, Chun Ho
Title: Study on programming frameworks for big data analytics
Degree: M.Sc.
Year: 2015
Subject: Big data.
Programming (Mathematics)
Business intelligence.
Hong Kong Polytechnic University -- Dissertations
Department: Dept. of Computing
Pages: vii, 57 pages : illustrations (some color)
Language: English
InnoPac Record: http://library.polyu.edu.hk/record=b2825203
URI: http://theses.lib.polyu.edu.hk/handle/200/8183
Abstract: The phenomenon of explosion of data caused by the latest technology movements in recent years introduces the "Big Data" challenge, which means normal technology is not sufficient enough for users to obtain timely, cost-effective, and quality answers to data-driven questions. In order to properly address this challenge, specific infrastructures for data storage and management, and also programming framework for data analytics and knowledge discovery have been developed. The aim of this dissertation is to study there common open-source programming framework, namely Apache Hadoop MapReduce, Apache Giraph, and Apache GraphX for their working mechanisms. The PageRank experiment is conducted by executing the three programs implemented based on the three frameworks for calculating PageRank results for the selected Wikipedia articles. This experiment can examine the ability effectiveness of the three frameworks, specifically under the condition of extremely insufficient hardware resources. Discussions are to be made based on the performance of the three programs, and also the coding effort.

Files in this item

Files Size Format
b28252032.pdf 1.460Mb PDF
Copyright Undertaking
As a bona fide Library user, I declare that:
  1. I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
  2. I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
  3. I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.

     

Quick Search

Browse

More Information