Optimizing Bitmap Index Encoding for High Performance Queries
No Thumbnail Available
Date
2021
Journal Title
Journal ISSN
Volume Title
Publisher
Wiley
Open Access Color
OpenAIRE Downloads
OpenAIRE Views
Abstract
Many sources such as historical archives, sensor readings, health systems, and machine records produce ever-increasing but often unchanging data. These accumulating data create a need for faster processing. Bitmap index, which can take advantage of multi-core and multiprocessor systems, is designed to process data that increase over time but do not change frequently. It has a well-known advantage, especially in queries on data with low cardinality. However, bitmap index can handle high cardinality data efficiently because it can use its own compression algorithm. Bitmap index has many encoding schemes that affect query processing time. In this study, we developed an algorithm that improves query performance by using optimal encoding among bitmap encodings. With this optimization algorithm, we witnessed up to 40% performance increase in queries made with bitmap indexes created with different encodings. Furthermore, in comparison with a commonly used relational database, we found significant improvements in the number of query operations per second performed on optimized encoded bitmap indexes generated by the introduced algorithm.
Description
YILDIZ, Beytullah/0000-0001-7664-5145
ORCID
Keywords
bitmap encoding, bitmap index, data retrieval, multicore, parallel query, query optimization
Turkish CoHE Thesis Center URL
Fields of Science
Citation
WoS Q
Q3
Scopus Q
Q2
Source
Volume
33
Issue
18