FDSS:HDFS Based Massive Music Feature Data Storage System

Fan Yuanchao,Xu Chen,Yu Zheng,Zhou Minqi,Wang Xiaoling
2011-01-01
Journal of Computer Research and Development
Abstract:With the rapid increasement of music data on the Internet,the traditional centralized and distributed data processing technology is difficult to satisfy the need of massive unstructured music feature data.Hadoop Distributed File System(HDFS) provides a useful platform for massive data management because of its scalability high availability and fault tolerance.This paper designs and implements a music feature data storage system called FDSS.Firstly,based on HDFS and MapReduce,we design a new data structure for massive music feature data storage and access.Secondly,we build index for music feature data using GrayCode which optimizes data placement and provides quick data access.Thirdly,Memcached are introduced as the distributed cache in order to access data efficiently.This demo system is to show the distributed storage for massive music feature data and the quick access for specified music feature data.
What problem does this paper attempt to address?