An Approach to Designing Clusters for Large Data Processing

Simple item page
dc.contributor.advisorLitoiu, Marin
dc.creatorSandel, Roni
dc.date.accessioned2015-08-28T15:08:05Z
dc.date.available2015-08-28T15:08:05Z
dc.date.copyright2014-12-02
dc.date.issued2015-08-28
dc.date.updated2015-08-28T15:08:05Z
dc.degree.disciplineInformation Systems and Technology
dc.degree.levelMaster's
dc.degree.nameMA - Master of Arts
dc.description.abstractCloud computing is increasingly being adopted due to its cost savings and abilities to scale. As data continues to grow rapidly, an increasing amount of institutions are adopting non standard SQL clusters to address the storage and processing demands of large data. However, evaluating and modelling non SQL clusters presents many challenges. In order to address some of these challenges, this thesis proposes a methodology for designing and modelling large scale processing configurations that respond to the end user requirements. Firstly, goals are established for the big data cluster. In this thesis, we use performance and cost as our goals. Secondly, the data is transformed from relational data schema to an appropriate HBase schema. In the third step, we iteratively deploy different clusters. We then model the clusters and evaluate different topologies (size of instances, number of instances, number of clusters, etc.). We use HBase as the large data processing cluster and we evaluate our methodology on traffic data from a large city and on a distributed community cloud infrastructure.
dc.identifier.urihttp://hdl.handle.net/10315/29952
dc.language.isoen
dc.rightsAuthor owns copyright, except where explicitly noted. Please contact the author directly with licensing requests.
dc.subject.keywordsCloud
dc.subject.keywordsBig data
dc.subject.keywordsHbase
dc.titleAn Approach to Designing Clusters for Large Data Processing
dc.typeElectronic Thesis or Dissertationen_US

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Sandel_Roni_2014_MA.pdf
Size:
1.46 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
license.txt
Size:
1.83 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
YorkU_ETDlicense.txt
Size:
3.38 KB
Format:
Plain Text
Description:
Download

Collections

Information Systems and Technology

All items in the YorkSpace institutional repository are protected by copyright, with all rights reserved except where explicitly noted.