Implement configurable cache eviction policies in chunk cache - #820

Open

yingDev wants to merge 10 commits into

huggingface:mainfrom

yingDev:feat-lru-lfu

Commits on Apr 26, 2026

Implement configurable cache eviction policies (LRU, LFU, Random) in chunk cache
xx
committed
ffa2a8d

Commits on Apr 27, 2026

Merge branch 'huggingface:main' into feat-lru-lfu
yingDev
authored
4e07c92
Potential fix for pull request finding

yingDev
and
Copilot
authored
a684e0c
refactor: simplify cache access statistics management in CacheState

xx
and
Copilot
committed
1ac874e
refactor: separate CacheAccessState from CacheState and enhance eviction logic

xx
and
Copilot
committed
8bad58c

Commits on Apr 28, 2026

refactor: enhance CacheAccessState with LRU eviction logic and item indexing
xx
committed
972ea5e
refactor: Random eviction now skips CacheAccessState entirely

xx
and
Copilot
committed
44f1a88
refactor: remove LFU eviction policy and simplify cache access logic

xx
and
Copilot
committed
9f6c7c7

Commits on May 2, 2026

feat(chunk_cache): add access update interval configuration and benchmarking

xx
and
Copilot
committed
a9188fd
feat(bench): add --nproc

xx
and
Copilot
committed
5b7a2e9