Project

General

Profile

Actions

Feature #19272

open

Support creating buckets & access by name in the S3 API

Added by Peter Amstutz almost 2 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Keep
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

Context: experimenting with a 3rd party workflow engine, which supports S3 for storing files in between workflow steps.

One of the things it wants to do is create an S3 bucket for staging files.

It would be neat if we supported creating S3 buckets. I think the main question is how to manage the namespace.

Proposal:

  • Create an Arvados project owned by the system called "S3 Buckets"
  • A "create bucket" API call creates a subproject under "S3 Buckets" with the appropriate name, and adds a can_manage link for the requesting user
  • Subsequent S3 API requests that don't match the PDH or UUID pattern are looked up by name under "S3 Buckets"
Actions #1

Updated by Peter Amstutz almost 2 years ago

  • Description updated (diff)
Actions #2

Updated by Peter Amstutz almost 2 years ago

  • Subject changed from Support creating buckets in the S3 API to Support creating buckets & access by name in the S3 API
Actions #3

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #4

Updated by Peter Amstutz about 2 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF