eMRC: Efficient Miss Ratio Approximation for Multi-Tier Caching

Many storage cache allocation methods use the (MRC) to improve cache efficiency. However, they have focused only on single-tier cache architectures and require the whole MRC as input for cache management, while modern datacenters embrace hierarchical caching architectures to maximize resource utilization. Generating the MRC for multi-tier caches—we call it the —is far more challenging due to different eviction policies and capacities in each cache tier. We introduce MRC, a multi-dimensional miss ratio approximation technique, to enable efficient MRC generation for multi-tier caching. Our approach uses a novel multi-dimensional performance cliff removal method and convex hull approximation technique to efficiently generate a multi-dimensional MRC without cliffs using a small number of sampling points. To demonstrate the benefits of MRC, we designed ORCA, a multi-tier cache management framework that orchestrates caches residing in different hierarchies through MRC and provides efficient multi-tier cache configurations to cloud tenants with diverse service level objectives. We evaluate the performance of our MRC approximation technique and ORCA with real-world datacenter traces.