To Be Groomed

Due in over 2 years (01/01/2021) (Sprint start date 12/31/2019)

A fake sprint to hold stories to be groomed


128 issues   (0 closed — 128 open)

To Be Groomed

Arvados Contributor Wiki

This wiki has information related to the open source project. It's a work in progress, so come back often for updates and feel free to become a contributor.

Platform Overview

Release Notes

Please see our blog

Key Components

Using Arvados

Contributing and hacking



Issues by










Related issues
# Subject Story Points
Feature #12958 [Federation] Workbench login chooser
Feature #14573 [API] Fully functional filename search
Bug #14488 [keepstore] Do not try to trash blocks that were already trashed in previous sweep
Bug #14540 [API] Limit number of container lock/unlock cycles
Story #14484 [API Server] Return collection size and number of files in collection record
Feature #14457 [api] send e-mail notification to user when their arvados account is activated
Bug #14428 [api] after deleting a container object, it is impossible to fix/delete the corresponding container request
Bug #14414 [keepstore] ManagementToken is not documented in the --help output
Bug #14405 [API] Avoid long-running transactions when sweeping trashed objects
Story #13218 Support browsing of projects shared with me in WebDAV
Story #14151 Extend vocabulary support for properties to support strong identifiers and multiple labels
Feature #14325 [crunch-dispatch-cloud] Dispatch containers to cloud VMs directly, without slurm or nodemanager
Feature #14257 [controller] refresh manifest API
Feature #14200 [API] Reduce privilege exposure via API tokens in multi-cluster workflows
Story #13937 [keepstore] Move legacy metrics to prometheus /metrics endpoint
Feature #11442 [CWL] Resolve symbolic names to collections
Feature #14168 [Running a workflow] Input presets
Feature #14030 [CWL] Use streamable flag as a hint to use keep output
Feature #14021 [crunch-dispatch-slurm] option to set job priority directly instead of using nice values
Feature #14018 [CWL] arvados-cwl-runner should support tagging container requests using properties
Feature #14016 [API] Container request can provide existing collection UUID that will accept CR output
Story #14004 [Controller] Keep database in tune
Story #14001 [Spike] [Controller] Port "update workflow" API to controller
Bug #13998 [keepstore] Cached block fetch for federation
Story #13997 [Controller] Port "collection update" API from Rails
Story #13996 [API] [Controller] Move API configs from Rails config file to cluster config file
Story #13995 [Controller] Port "collection update" functional tests from Rails API to controller test suite
Bug #13991 crunch-dispatch-slurm does not warn when slurm MaxJobCount reached
Bug #13982 crunch-dispatch-slurm / Go SDK Dispatcher not able to "let go" of deleted containers
Bug #13981 Make keep-web documentation available on
Bug #13972 Listing collections by PDH and name can be very slow
Story #13954 [API server] Implement request throttling
Story #13925 Default keep cache scales with machine size
Bug #13916 Discovery document inconsistencies
Feature #13913 Crunchstat-summary graphs tmpdir usage
Story #13792 Document strategies on how to use existing resources to save user preferences
Story #13790 Add metrics endpoint to API server
Bug #13813 [CLI] arv traceback on simple timeout
Bug #13804 [Node manager] shutting down nodes when there is a wishlist for same size nodes
Story #13794 Build Docker images without requiring Docker on client
Story #13908 Replace SLURM for cloud job scheduling/dispatching
Bug #13763 [API] groups#contents response should obey caller-provided order (not sort on type first)
Bug #13956 [keep-web] (webdav) Support COPY and MOVE between collections
Story #13384 [Workbench] Search users by email address and shell account
Story #13760 Provide more information to SLURM to make scheduling decisions on HPC
Support #13716 [CWL] Developer docs for arvados-cwl-runner
Feature #13651 Ability to merge a local account into a remote (federated) account
Bug #13644 [STORAGE-CLASES] Report the storage classes used by a pipeline
Bug #13636 crunch-run takes a very long time for CWL steps with large numbers of File inputs - could use a new kind of mounts entry to address this
Feature #6865 [Documentation] Higher Level Python SDK Reference Page
Bug #13418 Python SDK must have docstrings for all public interfaces
Bug #12684 [Python SDK] Retry on HTTP 5xx errors
Bug #13607 [arv-mount] avoid excessive memory consumption of idle arv-mounts
Bug #13593 [API] Sequence of "create group" requests runs slowly, and can crash API server
Bug #13565 [cwl] a-c-r should log useful information on failure even with --quiet
Bug #13542 No timeout is specified in A.C.R or as a default in the python sdk
Story #13494 [Workbench2] View/copy/expunge previous versions of a collection
Story #13508 Fix postgres search for filenames
Story #13390 Document API in API discovery document
Story #12703 [Workbench] Self serve account merge
Feature #13389 [Epic] Easy cluster install
Feature #13388 [Epic] Zero-downtime upgrade
Bug #13368 [API] Add "authorizations" table
Story #12666 --ignore-docker-for-reuse not passed to crunch v2 jobs started via --submit --no-wait
Story #13326 As a data provider, I would like the ability to provide metered access to my data on Arvados, including start/end dates, bandwidth caps, and % of file accessed
Story #13325 As a CWL learner, I would like to be able to run CWL workflows easily on
Feature #13272 [keep-web] read/write support for /by_id and /users
Story #12961 Support Bitbucket git repo access from Composer
Story #13306 arvados-cwl-runner supports Python 3
Story #13110 [WebDAV] Cleanup writable WebDAV loose ends
Story #9653 [keepstore] Limit entire process to configured amount or % of system memory (replace -max-buffers=X)
Bug #13162 [SDKs] Remove arvadosclient and keepclient libraries
Bug #13144 [SDKs] Wean all components off old arvadosclient and keepclient libraries
Bug #13102 containers are not reused unless runtime constraints (including RAM) match exactly
Bug #13094 Fix misleading crunch file upload messages
Feature #13062 [SDK] Reduce collection class memory footprint
Bug #13005 [Crunch2] All stdout gets the same timestamp and other logging problems
Bug #11625 [Workbench] Ensure that running processes are visible on the dashboard
Feature #12517 [Workbench] page with a view of all the top level container requests
Feature #13126 [keep] Investigate using signed URLs to delegate access to cloud buckets
Bug #12854 [crunchstat-summary] broken option for skip child jobs?
Bug #12794 [Node Manager] Behave smarter in environments where scratch space can be arbitrarily sized, like GCP and AWS
Bug #12791 [API] fix race between arrival of trash time and next sweep
Support #12696 install docs for keepproxy are out of date
Feature #12692 [keep-web] Accept /t=token/c=collection/path (currently only /c=collection/t=token/path)
Story #12571 arv-mount by_tag directory support for properties
Story #12288 Status endpoint aggregator
Bug #12178 Activating an account (setting is_active from false to true) does not email the new user
Story #11770 [Python SDK] Implement support for universal newline mode in Collections API
Story #11748 Standard convention for Nagios-compatible health check scripts kept alongside source for services
Story #11724 Pull Docker images without requiring Docker on client
Feature #11183 [Deployment] Use consul to report health of services/components
Feature #10767 [API] [arvados-ws] remove all websockets and puma related code from the api server codebase
Story #10525 Integrate CI::Reporter to provide Ruby test output in JUnit XML format
Bug #10298 [Crunch2] [API] Accept collection UUID or PDH as container_image in a container request
Story #9425 [API?/Workbench] Search for a link tag value returns linked objects
Bug #7479 [Node Manager] Aggressively throttles node creation requests when the cloud region is full
Bug #12198 Copying a project with a docker image doesn't copy the docker metadata
Feature #5214 [SDKs] Use sphinx to render for Python SDK docs
Story #14467 [SDK] Merge Go ArvadosClient and arvados.Client and migrate to arvados.Client