| Author: | Wong, Chun Ho |
| Title: | Study on programming frameworks for big data analytics |
| Advisors: | Lo, Chi-lik Eric (COMP) |
| Degree: | M.Sc. |
| Year: | 2015 |
| Subject: | Big data. Programming (Mathematics) Business intelligence. Hong Kong Polytechnic University -- Dissertations |
| Department: | Department of Computing |
| Pages: | vii, 57 pages : illustrations (some color) |
| Language: | English |
| Abstract: | The phenomenon of explosion of data caused by the latest technology movements in recent years introduces the "Big Data" challenge, which means normal technology is not sufficient enough for users to obtain timely, cost-effective, and quality answers to data-driven questions. In order to properly address this challenge, specific infrastructures for data storage and management, and also programming framework for data analytics and knowledge discovery have been developed. The aim of this dissertation is to study there common open-source programming framework, namely Apache Hadoop MapReduce, Apache Giraph, and Apache GraphX for their working mechanisms. The PageRank experiment is conducted by executing the three programs implemented based on the three frameworks for calculating PageRank results for the selected Wikipedia articles. This experiment can examine the ability effectiveness of the three frameworks, specifically under the condition of extremely insufficient hardware resources. Discussions are to be made based on the performance of the three programs, and also the coding effort. |
| Rights: | All rights reserved |
| Access: | restricted access |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| b28252032.pdf | For All Users (off-campus access for PolyU Staff & Students only) | 1.43 MB | Adobe PDF | View/Open |
Copyright Undertaking
As a bona fide Library user, I declare that:
- I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
- I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
- I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.
Please use this identifier to cite or link to this item:
https://theses.lib.polyu.edu.hk/handle/200/8183