Actions
Feature #20318
openGo SDK supports local filesystem-backed data cache
Status:
In Progress
Priority:
Normal
Assigned To:
Category:
Keep
Target version:
Start date:
Due date:
% Done:
0%
Estimated time:
(Total: 0.00 h)
Story points:
-
Description
Add option to store cached blocks in local filesystem rather than RAM in order to take advantage of better performance of (typically SSD-backed) local disk relative to backend, and let the kernel decide what to cache in RAM.
Where reasonable, implement the same behavior as the Python SDK in laying out and managing the cache directory containing the files for each cached block.
Caller should be able to read a partial block before the entire block is received from upstream, allowing for streaming block content. Can base this on AsyncBuf but uses a file or mmap as the backing store instead of a plain slice.
Related issues
Updated by Peter Amstutz 5 months ago
- Related to Story #17001: Arvados uses WB2 by default added
Updated by Peter Amstutz 5 months ago
- Related to deleted (Story #17001: Arvados uses WB2 by default)
Updated by Peter Amstutz 5 months ago
- Related to Story #18342: Keep performance optimization added
Updated by Peter Amstutz 2 months ago
- Target version changed from To be groomed to Development 2023-11-08 sprint
Updated by Peter Amstutz 2 months ago
- Target version changed from Development 2023-11-08 sprint to Development 2023-11-29 sprint
Updated by Peter Amstutz 2 months ago
- Target version changed from Development 2023-11-29 sprint to Development 2024-01-03 sprint
Updated by Peter Amstutz 2 months ago
- Target version changed from Development 2024-01-03 sprint to Development 2023-11-29 sprint
Updated by Peter Amstutz about 2 months ago
- Target version changed from Development 2023-11-29 sprint to Development 2023-10-25 sprint
Updated by Peter Amstutz about 1 month ago
- Target version changed from Development 2023-10-25 sprint to Development 2023-11-08 sprint
Updated by Peter Amstutz about 1 month ago
- Target version changed from Development 2023-11-08 sprint to Development 2023-11-29 sprint
Updated by Peter Amstutz 15 days ago
- Related to Feature #21196: implement keepclient API on top of block cache with pluggable backend added
Updated by Peter Amstutz 1 day ago
- Target version changed from Development 2023-11-29 sprint to Development 2024-01-03 sprint
Actions