Elastic Object Store System for Complex Data

Chao LAN,Yong ZHANG,Chunxiao XING
DOI: https://doi.org/10.3778/j.issn.1673-9418.1306050
2014-01-01
Abstract:This paper studies the problem of efficient object store and index in digital library and proposes a data repository system called PuntTable. PuntTable uses a schema-free way to store and get the objects and builds indices to support querying the fields inside the objects. In order to achieve a high throughput and low latency, PuntTable is designed by using multiple content storage engine and index storage engine through two interfaces, PuntStore and PuntIndex. PuntStore and PuntIndex are designed as the storage layer of PuntTable. Both the objects content and their indices can choose the most suitable storage layer for a specific data set. PuntTable is tested and evaluated for the performance of processing object data and index store combination by using varies of data sets with different sin-gle record sizes. These data sets are picked from digital library to simulate the real application scenarios. The result reveals that the proper configuration of storage layer for a particular data set can significantly improve the through-put and drop the latency.
What problem does this paper attempt to address?