Project

General

Profile

Actions
Copy link

Feature #8570

open

[Crunch2] Impure access to object store

Added by Peter Amstutz over 8 years ago. Updated 9 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Future
Story points:
-
Release:
Postponed
Release relationship:
Auto

Description

As a transitional feature for deploying Crunch v2 into existing cloud environments, support staging files by downloading/uploading from/to object store such as S3 (alternately, use something like https://github.com/s3fs-fuse/s3fs-fuse). Will make container impure (not reusable/reproducible) since contents of files are not guaranteed to remain the same.

Related issues

Related to Arvados - Bug #10216: [Crunch2] [API] Allow container request to bypass reuse (ensure a new container is created)ResolvedLucas Di Pentima10/10/2016Actions
Related to Arvados Epics - Idea #15960: Computing on external dataNew08/01/202403/31/2025Actions
Actions
Copy link
 #1

Updated by Peter Amstutz over 8 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by Peter Amstutz over 8 years ago

  • Subject changed from [Crunch2] Impure staging files from object store to [Crunch2] Impure access to object store
Actions
Copy link
 #3

Updated by Peter Amstutz over 8 years ago

  • Description updated (diff)
Actions
Copy link
 #4

Updated by Peter Amstutz over 8 years ago

  • Description updated (diff)
Actions
Copy link
 #5

Updated by Tom Morris over 6 years ago

  • Release deleted (11)
Actions
Copy link
 #6

Updated by Peter Amstutz almost 5 years ago

  • Related to Idea #15960: Computing on external data added
Actions
Copy link
 #7

Updated by Peter Amstutz almost 2 years ago

  • Release set to 60
Actions
Copy link
 #8

Updated by Peter Amstutz 9 months ago

  • Target version set to Future
Actions
Copy link

Also available in: Atom PDF