Abstract:In many distributed applications such as the Internet of Things (IoT), large amounts of data are being generated that require robust storage solutions. Traditional cloud solutions, although efficient, often lack trust and transparency because of centralized management. To address these issues, we present Robust-DSN, a distributed storage network leveraging the hybrid distributed replication and encoding network (HYDREN) and the distributed swarm workflow scheduler (DSWS) as its main components. Our system uses an interplanetary file system (IPFS) as an underlay storage network and segments it into multiple regions to distribute the failure domain and improve the data's proximity to users. HYDREN incorporates Reed–Solomon encoding and distributed replication to improve file availability, while DSWS optimizes resource allocation across the network. The uploaded file is encoded into chunks and distributed across distinct optimal nodes leveraging lightweight multithreading. Additionally, Robust-DSN verifies the integrity of all chunks by preserving the hashes when uploading and validating each chunk while downloading. The proposed system provides a comprehensive solution for resilient distributed data storage, focusing on the key challenges of data availability, integrity, and performance. The results reveal that compared with a state-of-the-art system, the proposed system improves file recovery by 15%, even with a 50% peer failure rate. Furthermore, with replication factor 4 and the same failure resilience as IPFS, it saves 50% storage and enhances file recovery by 8%. Robust-DSN acts as a distributed storage platform for emerging technologies, expanding storage system capabilities in a wide range of distributed applications.

Robust Data Location Infrastructure In Distributed Collaborative Environment

RDLM: A Resilient Mechanism for Data Location in a Distributed Collaborative Environment

Engineering a Distributed Infrastructure for Large-Scale Cost-Effective Content Dissemination over Urban Vehicular Networks

Leveraging Distance Table to Accelerate Data Location in Large-Scaled Data Intensive Grid Environment*

RIFFLE: A Distributed Network Operating System with Re-configurability for Multiple Domains

Rendezvous Regions: A Scalable Architecture for Resource Discovery and Service Location in Large-Scale Mobile Networks

Robust Distributed Data Retrieval in Data Intensive Grid Environments

Distributed Shortest Path Query Processing on Dynamic Road Networks

An Approach for Robust Distributed Data Retrieval in Data Intensive Grid Environments

Effective Data Distribution And Reallocation Strategies For Fast Query Response In Distributed Query-Intensive Data Environments

Robust-DSN: A Hybrid Distributed Replication and Encoding Network Grouped with a Distributed Swarm Workflow Scheduler

Scalable RDMA RPC on Reliable Connection with Efficient Resource Sharing

Scalable and Reliable RDMA.

RDMA Load Balancing via Data Partition

Robust Data Dissemination For Wireless Sensor Networks In Hostile Environments

Efficient Data Retrieving in Distributed Data-Streaming Environments

A scalable and reliable multiple home regions based location service in mobile ad hoc networks

Diverse Mobile System for Location-Based Mobile Data

Reliable Multicast in Data Center Networks

A scalable location service for geographic ad hoc routing

Content replication and placement in mobile networks