Abstract:Tencent, one of the biggest Internet companies in China, contains billions of users and over 600-PB data, and leverages thousands of SSDs in the storage system to improve system performance and obtain energy savings. Existing commercial SSDs however fail to meet the needs of the ultra largescale applications due to not matching the service patterns. In order to address this problem and deliver high performance, we propose an application-aware and software-defined SSD scheme for Tencent applications, called TSSD. TSSD explores and exploits the business characteristics of Tencent, which facilitates the efficient use of SSDs. TSSD is software-defined by packaging each flash chip as a fully independent and concurrent storage unit. Each concurrent unit can be mounted as a character device, which allows the application layer to manage the flash chips in a more efficient manner, while optimizing the data layout. TSSD further employs a host-target FTL (TFTL) that uses a dedicated interface in the application layer, which efficiently connects the application layer with flash chips. Application layer hence becomes more accurately by using the flash memory chip-level information from TFTL, including the storage utilization, the degree of wear, etc. Moreover, TFTL is a programmable FTL and provides a programmable interface to the application layer. According to the running states of SSDs and workload information, TSSD makes use of the programmable interface to efficiently improve the performance of the FTL, wear leveling, and garbage collection for the specified applications. Extensive experiments use the real-world datasets from the commercial storage systems of Tencent. The results demonstrate that TSSD significantly improves the storage system performance and meets the needs of the Tencents large-scale business applications.

Storage Device Performance Prediction With Selective Bagging Classification And Regression Tree

An interactive model based on regression tree and K-nearest neighbor for storage device performance prediction

Storage Device Performance Prediction with Hybrid Regression Models

A hybrid approach based on regression tree and radial-based function network for dynamic storage device performance prediction

A PERFORMANCE PREDICTION METHOD BASED ON NAIVE BAYES CLASSIFICATION

Predicting Web Page Performance Level Based on Web Page Characteristics

Towards Learned Predictability of Storage Systems

Adaptive Cache Management for Complex Storage Systems Using CNN-LSTM-Based Spatiotemporal Prediction

A Failure Prediction Approach Based on BiLSTM and Deep Feature Extractor for Hard Disk Drives.

Prediction of Critical Filling of a Storage Area Network by Machine Learning Methods

A STATISTICAL REGRESSION-BASED APPROACH FOR PERFORMANCE PREDICTION IN MULTI-TIER APPLICATIONS

Hard drive failure prediction using Decision Trees

Exploit Both SMART Attributes and NAND Flash Wear Characteristics to Effectively Forecast SSD-based Storage Failures in Clusters.

Optimizing Efficiency of Machine Learning Based Hard Disk Failure Prediction by Two-Layer Classification-Based Feature Selection

Classification Based Hard Disk Drive Failure Prediction: Methodologies, Performance Evaluation and Comparison.

Classification and Regression Tree Model to Predict the Probability of a Product being Backordered in Supply Chain

Segmentation of Time Series Based on Kinetic Characteristics for Storage Consumption Prediction

Short-term Traffic Volume Prediction Using Classification and Regression Trees.

Bagged stepwise cluster analysis for probabilistic river flow prediction

Automatic Selection and Parameter Configuration of Big Data Software Core Components Based on Retention Pattern

Application-Aware and Software-Defined SSD Scheme for Tencent Large-Scale Storage System.