Feature #16745
[keep-web] Improve performance of S3 APIs using server-side cache
Start date:
Due date:
% Done:
0%
Estimated time:
Story points:
-
Description
Currently, when handling a series of S3 API calls, keep-web builds a new filesystem object for each call. In some common workflows (reading several small files from a large collection / deep in a project tree), this will be very inefficient.
Initial implementation may be a map[apitoken]sitefs
, using a single sitefs to serve many read-only requests until reaching a configured TTL or performing a write operation with the same token. This should be relatively simple, and although write operations would still be inefficient, sequences of read operations would be much faster.
Related issues
History
#1
Updated by Tom Clegg 5 months ago
- Related to Story #16360: Keep-web supports S3 compatible interface added
#2
Updated by Peter Amstutz about 1 month ago
- Related to Story #16516: Keep performance added
#3
Updated by Peter Amstutz about 1 month ago
- Related to deleted (Story #16360: Keep-web supports S3 compatible interface)