ByteSlice : pushing the envelop of main memory data processing with a new storage layout

Pao Yue-kong Library Electronic Theses Database

ByteSlice : pushing the envelop of main memory data processing with a new storage layout

 

Author: Feng, Ziqiang
Title: ByteSlice : pushing the envelop of main memory data processing with a new storage layout
Degree: M.Phil.
Year: 2016
Subject: Memory management (Computer science)
Database management.
Hong Kong Polytechnic University -- Dissertations
Department: Dept. of Computing
Pages: xiv, 66 pages : illustrations
Language: English
InnoPac Record: http://library.polyu.edu.hk/record=b2894540
URI: http://theses.lib.polyu.edu.hk/handle/200/8500
Abstract: Scan and lookup are two core operations in main memory column stores. A scan operation scans a column and returns a result bit vector that indicates which records satisfy a filter. Once a column scan is completed, the result bit vector is converted into a list of record numbers, which is then used to look up values from other columns of interest for a query. Recently there are several in-memory data layout proposals that aim to improve the performance of in-memory data processing. However, these solutions all stand at either end of a trade-off each is either good in lookup performance or good in scan performance, but not both. This thesis presents ByteSlice, a new main memory storage layout that supports both highly efficient scans and lookups. ByteSlice is a byte-level columnar layout that fully leverages SIMD data-parallelism. Micro-benchmark experiments show that ByteSlice achieves a data scan speed at less than 0.5 processor cycle per column value a new limit of main memory data scan, without sacrificing lookup performance. Experiments on TPC-H data and real data show that ByteSlice offers significant performance improvement over all state-of-the-art approaches.

Files in this item

Files Size Format
b28945402.pdf 2.342Mb PDF
Copyright Undertaking
As a bona fide Library user, I declare that:
  1. I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
  2. I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
  3. I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.

     

Quick Search

Browse

More Information