Storing and Organizing Data¶

Rough demo outline

1. Automatic ingest from a POSIX directory to Keep
   • Datasets get into my workspace (sftp upload e.g. from sequencing provider to a special staging directory + API call to {something? ingestor app? arvados?}).
2. My data gets into the right project as specified by the uploader (API call)
3. Subscribe to notifications (by email and/or Workbench dashboard): when files start/finish uploading; when files are shared with customer; when files are downloaded by third party
4. Move/copy collections between projects (Project RX1234, or Customer X’s files), tag them in destination project with the appropriate string (e.g., sample ID) -- defaulting to existing tag used in source project (e.g., provided at time of upload).
5. “Anyone with this secret link can view/download” mode. Enable, disable, change magic link. Use cases: browser + “wget -r”.
6. See log/overview of who has accessed your shared data (incl. “anonymous user” if using secret-link-to-share); when shared/unshared; when each upload started/finished -- for a single project, and across all projects