FAST '27 Spring Accepted Papers

FAST '27 has two submission deadlines. Prepublication versions of the spring accepted papers and their abstracts are available below.

Flash-Level Asynchronous Execution for In-Storage LSM-Tree Operations

Jaehoon Shim, Hyungjoon Kwon, Hyungsoo Jung, and Jin-Soo Kim, Seoul National University

Available Media

Computational storage devices (CSDs) promise to reduce host--storage data movement by executing computation inside the storage device. This is especially appealing for LSM-tree-based key--value stores, whose reads and background maintenance move large amounts of data through the host. In practice, however, in-storage LSM-tree operations often fail to deliver their full benefit. Existing CSDs largely follow a host-managed, copy-then-execute model that drives in-storage operators through synchronous or weakly overlapped I/O paths. This serializes compute-flash interactions, underutilizes device-side compute resources, and forces host storage software to handle complex coordination logic. As a result, the expected benefits of in-storage processing are often limited or even negated on realistic workloads.

We argue that the missing abstraction is asynchronous execution with device-resident dependency management. We present FLAX, a computational storage architecture that makes asynchronous, overlapped in-device I/O execution a first-class design goal for LSM-tree operations. FLAX tracks fine-grained dependencies inside the device, allowing the host to issue large batches of work while the CSD schedules and executes commands asynchronously. To further improve utilization, FLAX combines adaptive data loading with dynamic on-device buffer management, enabling higher concurrency under limited device resources. We integrate FLAX into RocksDB and offload both compaction and reads. FLAX improves throughput by up to 3.1× over host-only execution and 1.8× over a host-managed CSD baseline.

Nexus: A Data Management Mesh for Tiered Data Streams

Raúl Gracia-Tinedo and Hossam Elghamry, Dell Technologies

Available Media

Modern event streaming systems (e.g., Apache Kafka, Apache Pulsar) provide support for storage tiering: the ability to move cold stream data to an external storage service (e.g., AWS S3). In this paper, we identify that there is an opportunity for exploiting advanced data management on data streams during the storage tiering process. To this end, we present Nexus: a data management mesh that transparently mediates storage operations between streaming systems and external storage. The main abstraction in Nexus is the streamlet: a data management function —e.g., processing, routing, caching— executed inline on a chunk of tiered stream data. Administrators can deploy streamlets across heterogeneous infrastructures and orchestrate them via policies. We demonstrate Nexus via stateless and stateful streamlets. We show that Nexus achieves up to 3.9× higher data reduction than built-in compression in streaming systems, supports privacy-aware data routing (reducing metadata reads by 98%), and allows for complex health-related data management pipelines. All this is achieved transparently across multiple streaming systems (Kafka, Pulsar, Pravega) and incurring low interception overhead (< 5%).

ByteTier: A Cloud-Scale Pool-Based Tiering System for Heterogeneous Cloud Storage

Xiuqi Huang, Zhejiang University; Qingsong Zhu, Yaohua Tang, Honghao Wang, Xin Wei, Jinxin Liu, Guanyu Liu, Zongjia Chen, Tianyue Lan, Yunlong Wang, Hang Zhang, Rusong Jiao, Yuanwang Yue, Jie Ding, Xiaodong Luo, Zijin Han, Huan Sun, and Maoyin Liu, ByteDance Inc.; Wei Chen, Zhejiang University; Chengyu Dong and Rui Shi, ByteDance Inc.

Deployed-Systems Paper
Available Media

Heterogeneous cloud storage relies on tiering to balance performance and cost. However, intra- and inter-node tiering face three major challenges: limited flexibility in redundancy and scaling; excessive disk and network traffic amplification; inefficiency in handling small I/Os. We propose ByteTier, a pool-based tiering system. Based on decoupled performance and capacity pools, ByteTier designs a cross-pool two-phase write mechanism: writes are cached and stored in the performance pool in the foreground, and re-encoded from the cache to the capacity pool in the background, providing flexibility and reducing disk and network overhead. Within this mechanism, ByteTier performs a workload-aware I/O aggregation method, adaptively merging small writes and batching them into device-friendly patterns to enhance throughput and reduce latency. ByteTier has been deployed in production at ByteDance for three years, serving diverse workloads. Evaluation shows that it significantly reduces both average and P99 write latency while improving write and read throughput.

MINOS: Towards a Theoretical WAF = 1 in Log-Structured Storage

Xiaojun Guo, Huazhong University of Science an Technology; Guangjie Xing, Hua Wang, and Ke Zhou, Huazhong University of Science and Technology (HUST); Min Fu, Ming Xie, Fenqiang Yang, and Guangchao Yang, Tencent Technology (Shenzhen) Co., Ltd.; Jingyu Tang and Jinhui Xu, Huazhong University of Science and Technology (HUST)

Available Media

Separating data by invalidation time is critical for mitigating garbage collection (GC) overhead in log-structured storage. In this paper, we establish a formal model and derive an OP-Minimized Oracle that optimizes separation thresholds for a theoretical Write Amplification Factor (WAF) of 1 under limited physical streams. Guided by this Oracle, we then design MINOS (MINimized Over-provisioning Separation), a practical online approximation that classifies writes into fine-grained virtual streams, tracks their invalidation behaviors, and adaptively clusters them into limited physical streams. Across 170 workloads totaling 500 TiB of writes, MINOS reduces GC writes by 15.0%--40.5% and improves throughput by up to 14.2% over state-of-the-art approaches, while incurring negligible CPU and memory overhead.

Labeling the Invisible: A Scalable Framework for Labeling Fail-Slow Failures in Cloud Storage Systems

Yongxin Zhao, Yuxin Sun, and Shenglin Zhang, Nankai University; Xiang Liu, Huawei Cloud; Jiaqi Luan, Runzhou Wang, Wenwei Gu, Yongqian Sun, and Yidan Li, Nankai University; Dan Pei, Tsinghua University

Deployed-Systems Paper
Available Media

Fail-slow failures, characterized by prolonged performance degradation without complete system crashes, pose a significant threat to the reliability of large-scale cloud storage systems. However, the scarcity of high-quality labeled datasets limits the development of effective detection and diagnosis techniques, while manual labeling at cloud scale is labor-intensive and error-prone. In this paper, we present SlowSight, a novel tool designed to enable efficient and accurate labeling of fail-slow failures in cloud environments. SlowSight employs a multi-view framework that jointly models temporal deviations of individual components and behavioral divergence among peer components. To reduce spurious detections, a knowledge-driven filtering module removes anomaly candidates inconsistent with fail-slow meanings. Furthermore, SlowSight adopts pattern-centric aggregation to capture multi-metric degradation patterns and propagate consistent labels across similar anomaly instances, improving labeling accuracy and consistency. We deploy and evaluate SlowSight at Huawei Cloud on two production-scale disk fail-slow datasets, achieving F1-scores of 0.851 and 0.903, and on a fail-slow dataset generated via failure injection with an F1-score of 0.945, demonstrating its effectiveness and generalizability. To the best of our knowledge, SlowSight is the first framework designed for scalable fail-slow failure labeling in cloud storage systems. Additionally, we have publicly made the code available to facilitate further research.

Kratos: A Robust and Comprehensive Pipeline for Detecting Various Patterns of Disk Fail-Slow Behaviors at Scale

Ruidan Li, University of Chicago; Erci Xu, Shanghai Jiao Tong University; Xikang Song, University of Chicago; Kiran Srinivasan, NetApp; Haryadi S. Gunawi, University of Chicago

Available Media

This paper presents a comprehensive study of fail-slow behaviors using the largest dataset available to date. We identified five fail-slow patterns, four of which were previously unexamined, and found that all state-of-the-art approaches fail to capture them fully. Hence, we build KRATOS, a comprehensive, robust, and practical detection method that accurately identifies all patterns, remains effective across diverse environments without fine-tuning, and operates efficiently at scale. On multiple RAID and non-RAID datasets (including SSDs and HDDs), KRATOS detects 32.8-50% more cases, achieves over 95% accuracy across a broad threshold range, and runs 3-128× faster than existing methods.

PipeBWrite: Shortening the Buffered Write Critical Path with Deferred Non-Critical Steps

Luofan Chen, Jiyang Wang, Guoyu Wang, and Chongzhuo Yang, University of Science and Technology of China; Sam H. Noh, Virginia Tech; Kang Chen, Tsinghua University; Cheng Li, University of Science and Technology of China; Institute of Artificial Intelligence, Hefei Comprehensive National Science Center

Available Media

Buffered I/O is the dominant storage interface, but its synchronous and monolithic write path limits performance for write-intensive applications. Prior work either applies narrow optimizations to individual steps of the write path or adopts asynchronous designs that require application changes.

In this paper, we present PipeBWrite, a transparent buffered write scheme that retains the synchronous interface while extracting the performance benefits of asynchronous execution. Based on data dependency analysis, PipeBWrite decomposes buffered writes into a two-stage pipeline: the foreground thread performs only the critical data copy needed for immediate user-buffer reuse, while non-critical kernel bookkeeping is offloaded to background threads. To ensure correctness, PipeBWrite introduces a lightweight inter-request visibility tracker that preserves POSIX semantics despite decoupled execution. It also employs holistic optimizations, including adaptive allocation, inline zeroing, and request batching, to minimize coordination overhead. PipeBWrite is implemented in the Linux Virtual File System layer and requires no application changes. Across four applications with the ext4 and XFS filesystems, PipeBWrite improves throughput by up to 25% for RocksDB and 21% for Kafka over vanilla Linux and StreamCache. For FIO synthetic workloads, it achieves up to 2.34× higher throughput and reduces write latency by up to 58%.

Kelvin: Approaching Absolute Zero-Copy Single-Machine Data Pipelines

Yifan Dai, University of Wisconsin—Madison; Jacopo Tagliabue, Bauplan Labs; Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, and Tyler R. Caraza-Harter, University of Wisconsin—Madison

Available Media

We present Kelvin, a DAG execution engine for single-machine data pipelines that approaches absolute zero-copy by enabling containerized stages to directly share physical memory through the in-memory file system. At the core of Kelvin is DeAnon, a lightweight Linux kernel module that converts anonymous memory pages into file-backed pages in place, allowing data produced by unmodified applications to become referable across processes without copying. Building on this capability, Kelvin extends Arrow-based communication to preserve sharing across pipeline transformations and incorporates runtime support to reuse deserialized inputs and manage shared memory across containers. Experiments show that Kelvin eliminates most intermediate copying, enabling pipeline stages to directly share physical memory; as a result, Kelvin improves pipeline throughput by up to 28× while reducing memory consumption and swapping.

Taking a Bigger Byte: Wide Hashless Chunking for Data Deduplication

Sreeharsha Udayashankar, Abdelrahman Baba, and Samer Al-Kiswany, University of Waterloo

Available Media

Content-defined Chunking (CDC) algorithms are critical to data deduplication and can be categorized into two families: hash-based and hashless. Hashless chunking algorithms are faster than their hash-based counterparts, especially when accelerated using the Single Instruction Multiple Data (SIMD) capabilities of modern CPUs. However, they achieve lower deduplication space savings on certain datasets.

We present WideCDC, a technique to improve the deduplication efficiency of hashless CDC algorithms by using wide regions of multiple bytes to determine chunk boundaries instead of individual bytes. Existing SIMD acceleration techniques for hashless CDC miss chunk boundaries when using wide regions, as they do not account for overlaps. To address this while preserving performance, WideCDC uses novel Accumulated Extreme Byte Searches and Gated Range Scans. By evaluating WideCDC on real-world datasets, we show that it improves the deduplication ratios of hashless chunking algorithms up to 2.95× while achieving 2.04× higher chunking throughput than existing vector-accelerated techniques.

Lost in Translation: Giving SMR Drives the Second Chance They Deserve!

Surbhi Palande and Puneet Mehrotra, University of British Columbia; Alexandra (Sasha) Fedorova, University of British Columbia and MongoDB; Margo Seltzer, University of British Columbia

Available Media

Shingled Magnetic Recording (SMR) drives offer higher density and lower cost than Conventional Magnetic Recording (CMR) drives but are limited to sequential writes. To support random I/O, SMR drives require a Shingled Translation Layer (STL) located either in the device firmware (Device-Managed) or the host OS (Host-Managed). While anecdotal evidence suggests Device-Managed SMR drives exhibit unacceptable performance, leading to the misconception that the shingled medium is inherently inferior, we show that the root cause is the resource-constrained design of on-device STLs. We demonstrate that moving the STL to the host OS makes SMR drives competitive with CMR without requiring application or filesystem changes. Our host-based STL improves 99th+ percentile tail latency by ~40× compared to on-device implementations. In RAID reconstruction workloads previously cited as evidence of SMR failure, our solution achieves a 1.4× performance gain over CMR drives and a ~11× improvement over Device-Managed SMR.

Lessons from Operating a Large-Scale Distributed Database with a Replicated Key-Value Engine

Jung-Sang Ahn, Navaneetha Krishnan Thanka Nadar, and Sami Ben-Romdhane, eBay Inc.

Deployed-Systems Paper
Available Media

Modern distributed databases frequently rely on key-value storage engines as durable backends for replicated state machines. While prior work extensively studies storage engine internals, far less attention has been given to the system-level constraints that arise when such engines are deployed at scale under strict resource limits. In production, storage design directly impacts tail latency, availability, recovery time, and multi-tenant stability.

This paper presents operational insights from running a log-structured merge-tree (LSM-tree)-derived key-value engine as the storage foundation of eBay's cloud-native distributed database, which serves trillions of requests per day. We describe practical challenges and operational responses in snapshot binding and installation, scan overhead caused by visibility checks and predicate evaluation, CPU-constrained compaction, write amplification and noisy-neighbor effects in multi-tenant environments, and programmable compaction for unified maintenance. These experiences show that when the storage layer underpins a distributed database, priorities shift from peak throughput to latency stability, predictable recovery, and bounded background work. Some mechanisms in our system rely on properties of our storage engine, but the underlying integration lessons are more broadly applicable to replicated database deployments.

CloverRec: Cost-Efficient Disaggregated Processing-in-Memory Systems for Deep Recommendation Inference

Menglei Chen, Yu Hua, Zhijun Yang, Yixiao Wang, and Xumin Chen, Huazhong University of Science and Technology

Available Media

Deep recommendation systems enhance user experiences by providing fast, high-quality personalized recommendations, which requires large-capacity and high-speed memory. While memory disaggregation offers a cost-efficient solution for handling large-scale embedding vectors (EVs), it suffers from significant network overheads. Processing-in-memory (PIM) technology restructures the data access path by offloading bandwidth-intensive embedding operations to remote PIM pools, hence minimizing data movement and alleviating network transfer costs. However, fully exploiting the bandwidth potential of disaggregated PIM pools is hindered by sub-optimal intra-unit parallelism, cross-unit load imbalance, and granularity mismatch in the host-device data transfer. To tackle these challenges, we propose CloverRec, a cost-efficient and high-performance recommendation inference system that offloads embedding operations to a disaggregated PIM pool. CloverRec employs a fine-grained dimension-partitioned data layout to achieve synchronization-free parallelism, introduces a dynamic data placement mechanism to mitigate hot-spot skewness across thousands of PIM units, and orchestrates hierarchy-aware data transfer at rank granularity to suppress transfer amplification and saturate the host-device bandwidth. Evaluations on a real UPMEM PIM system show that CloverRec outperforms state-of-the-art embedding schemes by up to 8.18x.

CakeMask: Enabling Fresh-Data HTAP Databases with High Performance and Low Memory Overhead

Baoyue Yan, Jianying Wang, Hao Chen, Xinjun Yang, and Feifei Li, Alibaba Cloud Computing

Available Media

HTAP systems increasingly need to support analytics over fresh transactional data. In row-columnar HTAP architectures, this raises a visibility-management problem: analytical queries must observe the latest updates. Addressing this, existing designs struggle with a three-way tradeoff among transactional update throughput, analytical scan efficiency, and memory overhead.

This paper presents CakeMask, a visibility-management design for fresh-data HTAP. To balance performance and memory overhead, CakeMask preserves bitmap as the compact, scan-efficient base visibility representation, while moving recent visibility changes into a delta visibility layer to avoid concurrent update overhead on the bitmap. It further combines an LSM-inspired delta structure, an optimized concurrent B+ tree with non-blocking scans, optimized bitmap–delta merging via vectorization, parallelism, and caching, and dynamic consolidation to bound long-term scan overhead. We implement CakeMask in a commercial cloud HTAP database and evaluate it on diverse workloads. The results show that CakeMask delivers scan performance comparable to in-memory version array at 1.6% of its memory usage, and outperforms existing on-disk visibility-management solutions up to 79× in write throughput. CakeMask has been deployed in production in a commercial HTAP system and has been validated on real-world workloads over three years.

GEM: GPU Erasure-Coded Memory for Fast Training Recovery

Ronglong Wu, Xiamen University and Fujian Engineering Research Center of High-Performance Intelligent Computing Systems; Huayu Zeng, Xiamen University; Xinbin Hu, Shuyue Zhou, and Zhirong Shen, Xiamen University and Fujian Engineering Research Center of High-Performance Intelligent Computing Systems; Kunlin Yang, Independent Researcher; Jiwu Shu, Xiamen University; Yiming Zhang, Shanghai Jiao Tong University and Xiamen University

Available Media

Training large deep learning models typically requires a massive number of GPUs operating continuously for weeks or even months. Unfortunately, GPU memory failures are not uncommon in such long-running jobs. When these failures occur, existing solutions reload the latest checkpoint from CPU memory or remote persistent storage to resume training, incurring substantial storage overheads and expensive network transfers.

This paper presents GEM, a lightweight fault-tolerant mechanism that introduces GPU Erasure-coded Memory for fast recovery from GPU memory failures. GEM first employs selective erasure coding (EC) to protect critical model states instead of relying on periodic checkpointing. Our insight is that these critical states (including parameters and optimizer states) are updated infrequently, allowing them to be protected with EC in a computation-/storage-efficient manner. GEM adopts a wide-stripe EC design to minimize recovery redundancy, enabling redundancy to reside entirely in GPU memory and avoiding additional data transfers. Furthermore, GEM incorporates a mixed-granularity retry mechanism to recover the remaining frequently updated data. We conduct extensive experiments on NVIDIA GPUs with real-world deep learning models and show that GEM reduces wasted time caused by GPU memory failures by an average of 96.6%, while incurring only 0.3% additional GPU memory overhead.

PromTCS: An Efficient Two-Dimensional Metadata Management and Tailored Hybrid Storage Architecture for Performance Monitoring Time Series

Tao Kong, Hui Li, and Yuxuan Zhao, Xidian University; Quanqing Xu, OceanBase; Liping Li and Qian Wang, Xidian University

Available Media

Time series databases (TSDBs) are crucial for performance monitoring in Internet applications and infrastructure. As the scale of time series grows, the storage overhead of metadata (labels) and data points (samples) increases significantly. In spite of prior efforts in hybrid storage to reduce storage costs, they still require large-capacity, expensive, high-bandwidth storage devices to deliver superior performance.

We propose PromTCS, which introduces two novel techniques: (1) Two-dimensional metadata management. We propose a two-dimensional metadata model and a suite of indexes to reduce metadata overhead while ensuring high performance. (2) Tailored hybrid storage architecture. We place hot data on DRAM and NVMe SSDs and cold data on HDDs, and present three optimizations: (i) a compaction-free time series storage engine for NVMe SSDs, TreeSeries, to reduce write amplification (WA) and optimize performance; (ii) hardware-aware write strategies, early migration and lazy flushing, to mitigate the adverse impact of bandwidth cross-tier bandwidth gaps; and (iii) a metadata-driven parallel write-ahead logging (WAL) on SSD, to reduce thread contention during writes and shorten crash recovery time. We implement a PromTCS prototype and evaluate it on synthetic and real-world datasets using both benchmark and production workloads. Compared with advanced TSDBs on pure NVMe SSDs, PromTCS achieves comparable performance at much lower deployment cost. Under the same hybrid storage, it delivers 3.2--5.9× higher insertion throughput and 38.1%--82.1% lower query latency than the advanced TSDBs.

zcIO: Enabling Transparent Zero-copy for NVMe/TCP

Junghan Yoon, SeungYeon Shin, and Jonghyeon Park, Seoul National University; Jaehyun Hwang, Sungkyunkwan University; KyoungSoo Park, Seoul National University

Available Media

NVMe-over-Fabrics via TCP (NVMe/TCP) has become a datacenter standard for disaggregated storage, yet it remains severely CPU-bound in high-speed environments. While zero-copy I/Os could alleviate the load, traditional zero-copy TCP stacks often fail to meet the strict page-alignment requirements necessary for efficient hardware-to-software handoffs.

We present zcIO, a novel Linux NVMe/TCP stack that achieves seamless zero-copy I/Os through record-aware networking. By aligning TCP payloads with the NVMe PDU formats and leveraging large MTUs with header-data split capabilities, zcIO ensures that incoming DMA transfers are perfectly aligned with memory page boundaries. This precise alignment allows zcIO to replace expensive memory copies with low-overhead virtual memory page remapping. zcIO provides a transparent zero-copy data path requiring no application modifications and ensures safe page reclamation. Our evaluation shows that zcIO improves remote storage performance by up to 2.3×, reaching throughput of up to 67.6 GB/s (540.8 Gbps) with 15 CPU cores.

TreePass: Lightweight Tree-Guided Cache Management for B+-tree Key-Value Stores

Jin Yang, Hyeonseok Oh, and Young-ri Choi, UNIST

Available Media

With the rise of NVMe SSDs, the performance gap between random and sequential I/O has narrowed, renewing interest in B+-tree-based key-value stores (KVSs) for modern data systems. In larger-than-memory B+-tree KVSs, performance critically depends on cache eviction decisions. However, existing page-cache eviction policies treat each page independently using only its own access history. As a result, they fail to exploit subtree-level hotness arising from key-range locality or preserve accumulated history across out-of-place updates, causing pages in hot subtrees to be misclassified and prematurely evicted. We observe that B+-tree operations naturally expose lightweight, address-independent signals for subtree hotness and future page invalidation. Based on these insights, we propose TreePass, a lightweight caching system that augments CLOCK eviction with per-pivot counters embedded in the B+-tree. With these counters, TreePass performs early eviction of cold-subtree pages and differentiated reference-counter initialization for newly created pages, suppressing unnecessary writebacks without additional metadata. We implement TreePass in SplinterDB and evaluate it across YCSB and real-world workloads. Across all evaluated workloads, TreePass achieves up to 101% higher throughput, 70% fewer page writes, and 15% lower P99 tail latency than state-of-the-art caching policies.