Distributed file system metadata prefetching method based on data relevance

Xu Yinlong,Chen Youxu,Li Cheng,Li Yongkun,Lyu Min
2018-01-01
Abstract:The invention discloses a distributed file system metadata prefetching method based on data relevance. The method is characterized by comprising the steps of adoption of an extraction method and storage structure of the designed data relevance, prefetching of metadata of relevant files, dynamic feedback of the data relevance and dynamic updating of the data relevance; compared with a traditional distributed file system metadata access method, the method has the advantages that a lightweight grammatical analysis method for the data relevance is provided, a file system metadata structure is expanded to support the data relevance, the metadata of the relevant files is cached to a client-side local in advance in a prefetching mode, and therefore the frequency of cross-network interaction between a client side and a metadata server is reduced; meanwhile, in combination with a dynamic feedback mechanism of the client side, the closeness of the relevant files is dynamically adjusted accordingto a file access mode, the prefetching accuracy is further improved by threshold value control, the occupied cache space of the client side is reduced, the access response delay of the metadata of the relevant files is reduced, and the service performance of the metadata is improved.
What problem does this paper attempt to address?