Abstract:Conventional prefetching methods that look at access correlations operate under the presumption that two files that were previously viewed often and in close proximity will probably be accessed together shortly. Access correlation detection techniques primarily use frequent sequence mining to find recurrent access patterns. Since establishing patterns of access might have a substantial impact on the accuracy of future access predictions, it might be exceedingly challenging. Thus, it is important to choose values for confidence, gap, and lowest level support carefully in order to exclude low-quality access correlations. This work presents a novel DFS model using dynamic prefetching, which consists of four processes: (i) popular file identification (ii) improved support value estimation, (iii) extraction of frequent block access patterns (FBAP), and (iv) matching algorithm, Essentially, a new threshold computation is used to determine the most common input file sizes. New threshold-based FBAPs are extracted in the next phase after the support value has been calculated. Lastly, weight-optimized Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM) based on Upgraded Shark Smell with Opposition Solution (USS-OS) are employed for matching. For the best case scenario, the proposed method achieves higher value of (~ 0.98) as compared to the existing models such as HC + Arithmetic Optimization Algorithm (AOA) (~ 0.96), HC + Bald Eagle Search (BES) (~ 0.97), HC + Shark Smell Algorithm (SSA) (0.97), HC + Hunger Games Search (HGS) (0.97), and HC + Harris Hawks Optimization (HHO) (~ 0.95) respectively. Finally, the studies are conducted to analyze the developed model.

A Novel Approach To Record File Correlation And Reduce Mapping Frequency On Hdfs Based On Extendhdfs

Correlation Based File Prefetching Approach for Hadoop

Hadoop Massive Small File Merging Technology Based on Visiting Hot-Spot and Associated File Optimization

Efficient File Accessing Techniques on Hadoop Distributed File Systems.

A Novel Scalable Architecture of Cloud Storage System for Small Files Based on P2P

A practical approach for scalable record linkage on hadoop

RCFile: A Fast and Space-Efficient Data Placement Structure in MapReduce-based Warehouse Systems

SQL-DFS: A Massive Small File Storage System Based on HDFS

A Novel Approach For Efficient Accessing Of Small Files In Hdfs: Tlb-Mapfile

LHF: A New Archive Based Approach to Accelerate Massive Small Files Access Performance in HDFS.

An Optimized Approach for Storing and Accessing Small Files on Cloud Storage

A Method to Improve the Performance for Storing Massive Small Files in Hadoop

Research on Small Files Optimized Storage Strategy in Hadoop System

Optimization strategy of Hadoop small file storage for big data in healthcare

A Novel Approach for Improving Security and Storage Efficiency on HDFS

A Novel Approach to Improving the Efficiency of Storing and Accessing Small Files on Hadoop: A Case Study by PowerPoint Files

File fetching in distributed file system via optimization assisted hybrid deep learning model

Cumulus: A Distributed File System Based on Network Coding

Small Files Problem Resolution via Hierarchical Clustering Algorithm

Storage Optimization Method of Small Files Based on Hadoop

An Effective Strategy for Improving Small File Problem in Distributed File System