Abstract:As solid-state drives (SSDs) with sufficient computing power have recently become the dominant devices in modern computer systems, in-storage processing (ISP), which processes data within the storage without transferring it to the host memory, is being utilized in various emerging applications. The main challenge of ISP is to deliver storage data to the offloaded workload. This is difficult because of the information gap between the host and storage, the data consistency problem between the host and offloaded workloads, and SSD-specific hardware limitations. Moreover, because the offloaded workloads use internal SSD resources, host I/O performance might be degraded due to resource conflicts. Although several ISP frameworks have been proposed, existing ISP approaches that do not deeply consider the internal SSD behavior are often insufficient to support efficient ISP workload offloading with high programmability. In this paper, we propose an ISP agent, a lightweight ISP workload offloading framework for SSD devices. The ISP agent provides I/O and memory interfaces that allow users to run existing function codes on SSDs without major code modifications, and separates the resources for the offloaded workloads from the existing SSD firmware to minimize interference with host I/O processing. The ISP agent also provides further optimization opportunities for the offloaded workload by considering SSD architectures. We have implemented the ISP agent on the OpenSSD Cosmos+ board and evaluated its performance using synthetic benchmarks and a real-world ISP-assisted database checkpointing application. The experimental results demonstrate that the ISP agent enhances host application performance while increasing ISP programmability, and that the optimization opportunities provided by the ISP agent can significantly improve ISP-side performance without compromising host I/O processing.

JAS: JVM-Based Active Storage Framework for Object-based Storage Systems

Oasa: an Active Storage Architecture for Object-based Storage System.

MBSA: a Lightweight and Flexible Storage Architecture for Virtual Machines

SA-LSM

<i>SA-LSM</i>: Optimize Data Layout for LSM-tree Based Storage using Survival Analysis

Teleport: Load Balancing with Dynamic Adjustment Strategy Based on OSD Storage System

Implementation and Performance Evaluation of an Object-Based Storage Device

Employing Intelligence in Object-Based Storage Devices to Provide Attribute-Based File Access

Multi-dimensional storage qos guarantees for an object-based storage system

TH-VSS: an asymmetric storage virtualization system for the SAN environment

A novel non-volatile memory storage system for I/O-intensive applications

Japs: an Automatic Parallelizing System Based on Java

Employing Object-Based Storage Devices to Embed File Access Control in Storage.

An Object-Oriented Data Storage System on Network-Attached Object Devices

OCVM: Optimizing the Isolation of Virtual Machines with Open-Channel SSDs

OCStore: Accelerating Distributed Object Storage with Open-Channel SSDs

Client-side Straggler-Aware I/O Scheduler for Object-based Parallel File Systems

Opca: Enabling Optimistic Concurrent Access for Multiple Users in Oblivious Data Storage

CSFS: a Java Enabled Network File Storage System

ISP Agent: A Generalized In-Storage-Processing Workload Offloading Framework by Providing Multiple Optimization Opportunities

Design of an Object-Based Storage Device Based on I/O Processor