Project

General

Profile

Actions

Idea #17849

open

FUSE driver v2

Added by Peter Amstutz over 2 years ago. Updated 21 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

Background:

Python+llfuse was expedient and has done lots of good work for us, but it's not promising as a long term (fast+reliable+maintainable) solution.

Implementation: TBD:
  • Approach for handling websocket "update" events
  • Selectable mechanisms/options for syncing to server (fflush, fsync, close) (on a shell node, flush-on-close, flush-periodically, or flush-after-idle-time might be best; in crunch-run, flush-on-exit might be best)
  • Desired behavior when updates conflict (write error? clobber? create "oops,clobbered" file?)
Other current bugs/limitations:
  • Old keep block signatures don't get refreshed, so reading a collection that's been cached for too long returns an I/O error
  • Not command-line compatible with arv-mount
  • Logging is not great
  • No docs
  • No way to control overall cache size (currently collectionfs can use lots of RAM in certain non-sequential write scenarios; we need the ability to trade speed for space efficiency in memory-constrained environments)
  • No warnings given when cache is thrashing
  • No application level instrumentation (just optional Go pprof)
  • Special .arvados#collection file is incomplete (has manifest_text but not uuid, pdh)
  • No automatic flush on sigint/sigterm
  • No warning given when trying to exit but filesystem can't be unmounted yet (filehandle is open, or a process's cwd is in the mount)
  • Mac port has a race bug (see notes below)
  • Windows port is untested
  • Cross-compiling recipe for Mac/Windows ports is fragile
  • chmod is a no-op (chmod 0700 succeeds, but the file mode will still be 0755)

Related issues

Related to Arvados - Bug #16727: [FUSE] [cgofuse] Refresh signatures / reload collection instead of using expired blob signaturesResolvedTom Clegg01/27/2022Actions
Related to Arvados - Idea #12308: [FUSE] Golang-based fuse driverResolvedTom CleggActions
Related to Arvados - Feature #18960: Config option to make crunch-run use Go FUSE driver when all mounts are read-onlyNewActions
Related to Arvados - Feature #18961: Go FileSystem / FUSE mount supports block prefetchClosedTom CleggActions
Related to Arvados - Feature #21578: Add debug logging option to arvados-client mountResolvedTom CleggActions
Actions

Also available in: Atom PDF