Toward a distributed terabyte text retrieval system in China-US million book digital library.

Bin Liu,Wen Gao,Ling Zhang,Tiejun Huang,Xiao-Ming Zhang,Jun Cheng
DOI: https://doi.org/10.1145/544220.544302
2002-01-01
Abstract:ABSTRACTIn China-US Million Book Digital Library, output of the digitalization process is more than one terabyte of text in OEB and PDF format. To access these data quickly and accurately, we are developing a distributed terabyte text retrieval system. With the query cache, system can search less data while maintaining acceptable retrieval accuracy. From the OEB package, we get its metadata and structural information to implement multi-scale indexing and retrieval. We are to explore some new retrieval models and text clustering approaches in the Digital Library.
What problem does this paper attempt to address?