Abstract:With the explosive growth of data amount, it has become a key issue to reduce the storage space that mass data occupies and the bandwidth consumption during network transmission. Experimental investigation shows that a large amount of redundant data exists in each part of the information processing and storage. Therefore, the issues concerning how to eliminate the redundant information during the backup process are of crucial importance for saving disk space and network bandwidth. This paper adopts the data de-duplication technology to solve the problem of redundant data in the course of backup by designing and implementing a backup system with intelligent data de-duplication named Backup Ded up which includes four de-duplication strategies, that is, SIS, FSP, CDC and SW. Backup Ded up supports the online source-side de-duplication and is capable of selecting different de-duplication algorithms according to the corresponding data types. Meanwhile, it offers the data reliability and security in the backup process. The experimental test results show that Backup Ded up employs multi de-duplication strategies simultaneously to substantially eliminate redundant data in the backup process so as to reach the goal of effectively saving storage space and network bandwidth.

Design and Realization of the Cloud Data Backup System Based on HDFS.

HDFS Based Cloud Data Backup System

QDFS: A Quality-Aware Distributed File Storage Service Based on HDFS

QoSC: A QoS-Aware Storage Cloud Based on HDFS

Backup and Disaster Recovery System for HDFS

Cloud Storage System for Small File Based on P2P

Qos-Aware Indiscriminate Volume Storage Cloud

Fast Off-Site Backup and Recovery System for HDFS

Design of Cloud Backup System Architecture Supporting Continuous Data Protection

The Design and Implementation of Integrated Backup System for EMS Base on the Cloud Computing Technology

Research of Data Backup/Recovery Technology Based on Heterogeneous Disk Array

DESIGN AND IMPLEMENTATION OF JUNK DATA RETRIEVE IN LOG-STRUCTURED FILE SYSTEM OF CLOUD STORAGE

DHFS: A High-Throughput Heterogeneous File System Based on Mainframe for Cloud Storage

Cloud Storage of Massive Remote Sensing Data Based on Distributed File System

Study on Cloud Storage System Based on Distributed Storage Systems

An Intelligent Data De-duplication Based Backup System

A Cloud Storage System Based On Network Virtual Disk

Research and implementation of large file storage based on RAMCloud

A distributed storage method of remote sensing data based on image blocks organization

DeDu: Building a Deduplication Storage System over Cloud Computing.

Yurubackup: A Space-Efficient and Highly Scalable Incremental Backup System in the Cloud