Skip to main content
Other
AMP: An Affinity-based Metadata Prefetching Scheme in Large-Scale Distributed Storage Systems
CSE Technical reports
  • Lin Li, University of Nebraska-Lincoln
  • Xuemin Li, Chongqing University, Chongqing, China
  • Hong Jiang, University of Nebraska-Lincoln
  • Yifeng Zhu, University of Maine Orono, ME
Date of this Version
11-19-2007
Disciplines
Comments
University of Nebraska–Lincoln, Computer Science and Engineering
Technical Report TR-UNL-CSE-2007-0024
Issued Nov. 19, 2007
Abstract

Prefetching is an effective technique for improving file access performance, which can reduce access latency for I/O systems. In distributed storage system, prefetching for metadata files is critical for the overall system performance. In this paper, an Affinity-based Metadata Prefetching (APM) scheme is proposed for metadata servers in large-scale distributed storage systems to provide aggressive metadata prefetching. Through mining useful information about metadata assesses from past history, AMP can discover metadata file affinities accurately and intelligently for prefetching. Compared with LRU and some of the latest file prefetching algorithms such as NEXUS and C-miner, trace-driven simulations show that AMP can improve the hit rates by up to 12%, 4.5% and 4%, respectively, while reduce the average response time by up to 60%, 12% and 8%, respectively.

Citation Information
Lin Li, Xuemin Li, Hong Jiang and Yifeng Zhu. "AMP: An Affinity-based Metadata Prefetching Scheme in Large-Scale Distributed Storage Systems" (2007)
Available at: http://works.bepress.com/yifeng_zhu/4/