Idea #20693
closed
Design for server side coordination of multiple writers to a collection
Added by Peter Amstutz over 1 year ago.
Updated 4 months ago.
Description
Background:
Multiple Arvados services (multiple instances of keep-web, arvados-client mount, arv-mount, etc) are trying to write files to the same collection at the same time.
Assume they are adding/removing/changing multiple files but not making changes that directly conflict/contradict one another.
Requirements:
- If a file is created or modified it won't disappear as a result of an update from another service that didn't know about that file
- If there is a single writer, performance impact should be minimal
- If there are multiple writers, it is acceptable that one of them may have to wait to avoid conflicts
- Can use pessimistic locking to ensure only one client can have a write lock at a time, attempting to open a file for writing that is locked by another should return an error on open
- Support WebDAV lock protocol
Proposal: Concurrent writes to a single collection
- Status changed from New to In Progress
- Status changed from In Progress to New
- Tracker changed from Bug to Feature
- Description updated (diff)
- Related to Idea #18342: Keep performance optimization added
- Target version changed from Future to Development 2024-01-17 sprint
- Target version changed from Development 2024-01-17 sprint to Development 2024-01-03 sprint
- Target version changed from Development 2024-01-03 sprint to Development 2024-01-17 sprint
- Target version changed from Development 2024-01-17 sprint to Development 2024-02-14 sprint
- Target version changed from Development 2024-02-14 sprint to Development 2024-02-28 sprint
- Target version changed from Development 2024-02-28 sprint to Development 2024-03-13 sprint
- Target version changed from Development 2024-03-13 sprint to Development 2024-03-27 sprint
- Target version changed from Development 2024-03-27 sprint to Development 2024-04-10 sprint
- Subject changed from Server side coordination of multiple writers to a collection to Design for server side coordination of multiple writers to a collection
- Tracker changed from Feature to Idea
- Assigned To set to Tom Clegg
- Target version changed from Development 2024-04-10 sprint to Development 2024-04-24 sprint
- Status changed from New to In Progress
- Description updated (diff)
- Target version changed from Development 2024-04-24 sprint to Development 2024-05-08 sprint
- Target version changed from Development 2024-05-08 sprint to Development 2024-05-22 sprint
- Target version changed from Development 2024-05-22 sprint to Development 2024-06-05 sprint
- Target version changed from Development 2024-06-05 sprint to Development 2024-06-19 sprint
- Target version changed from Development 2024-06-19 sprint to Development 2024-07-03 sprint
- Target version changed from Development 2024-07-03 sprint to Development 2024-07-24 sprint
- Status changed from In Progress to Resolved
Also available in: Atom
PDF