Crunch v2


Sprints

Release Backlog

# Tracker Subject Story Points
9703 Bug [Crunch2] CWL workflow failed with Crunch2, but passed with Crunch1
9900 Bug [Crunch2] [API] Add ephemeral "run token" for running containers
8312 Story [Crunch2] [Spike] Prototype using SLURM's linear scheduler, node sharing
8304 Story [Crunch2] [Spike] SLURM plug-in to boot Arvados compute nodes in a cloud
9668 Story [Crunch2] [Workbench] Select a Javascript client framework for future development
9620 Story [Crunch2] [API] Default ram value to fill in for ContainerRequests
9619 Story [Crunch2] [API] Default vcpus value to fill in for ContainerRequests
11064 Feature [Crunch2] crunch-run expires output collection immediately 0.5
10683 Feature [Crunch2] Separate service to poll sinfo and update nodes table 2.0
2.5

Closed Sprints

2016-01-20 Sprint

01/20/2016

# Tracker Subject Story Points
8028 Feature [Crunch2] Dispatch containers locally 2.0
7816 Feature [Crunch2] Execute minimal container spec with logging 1.0
3.0

2016-03-02 sprint

03/02/2016

# Tracker Subject Story Points
8015 Feature [Crunch2] Keep-backed mount points: tmp/output dir, read-only collection, read-only by-id dir 0.5
0.5

2016-03-16 sprint

03/16/2016

# Tracker Subject Story Points
6518 Feature [Crunch] [Crunch2] Dispatch containers via slurm 1.0
8079 Bug [API] Add uuid property to ApiClientAuthorization 0.5
1.5

2016-05-11 sprint

05/11/2016

# Tracker Subject Story Points
8128 Feature [Crunch2] API support for crunch-dispatch 1.0
8017 Feature [Crunch2] support runtime constraints 1.0
8464 Feature [Crunch2] Support stdout redirection 0.5
2.5

2016-06-08 sprint

06/08/2016

# Tracker Subject Story Points
9272 Feature [Crunch2] Pass container auth token (not dispatch token) to arv-mount, and (if requested) into the container itself 1.0
1.0

2016-06-22 sprint

06/22/2016

# Tracker Subject Story Points
8442 Feature [Crunch2] arvados-cwl-runner submits to crunch2 containers API 1.0
8259 Feature [Crunch2] Integration testing for crunch2 1.0
9359 Story [Crunch2] Document crunch2 deployment 1.0
9403 Story [Crunch2][Workbench] "Add a new container request" button in /container_requests page not working. 
9274 Feature [Crunch2] API recognizes container token to fill in requesting_container_uuid 0.5
3.5

2016-07-06 sprint

07/06/2016

# Tracker Subject Story Points
8016 Feature [Crunch2] Report statistics 1.0
9498 Story [Workbench] Show top-level container_requests in project jobs&pipelines tab and omit jobs from this tab. 1.0
9407 Story [Workbench] Implement container log viewer (live + saved) using work unit model 1.0
8470 Feature [Crunch2] [API] Use exact values for runtime_constraints and mounts in Container records 1.0
4.0

2016-08-03 sprint

08/03/2016

# Tracker Subject Story Points
9617 Story [Crunch2] [API] Reject ContainerRequests that don't specify valid vcpus constraint 0.5
9618 Story [Crunch2] [API] Reject ContainerRequests that don't specify valid ram constraint 0.5
9581 Story [Crunch2] SLURM dispatcher supports arbitrary arguments to sbatch 1.0
2.0

2016-08-17 sprint

08/17/2016

# Tracker Subject Story Points
9678 Bug [Crunch2] [Workbench] container_request log tab is empty, even when the container log tab shows information 1.0
9658 Story [Crunch2] arvados-cwl-runner --api=containers returns a container uuid. It should return a container_request uuid. 0.5
9595 Feature [Crunch2] Support "json" mount type in crunch-run 0.5
9406 Feature [Crunch2] Crunch-run supports using existing cgroup to apply resource allocation 1.0
3.0

2016-08-31 sprint

08/31/2016

# Tracker Subject Story Points
9824 Story [Crunch2][Workbench] Include workflows in the Pipeline Templates tab in project#show page 0.5
9767 Story [Crunch2][Workbench] Extend pipeline template chooser to browse CWL workflows 3.0
9687 Bug [Workbench] A container_request should not be displayed as "successful" if the container exited non-zero. 0.5
9043 Story [Crunch2] [Workbench] Render CWL input selection forms 4.0
8.0

2016-09-14 sprint

09/14/2016

# Tracker Subject Story Points
9766 Feature [Crunch2] Submit to workflows table 1.0
9623 Story [Crunch2] [API] Reuses Containers to satisfy ContainerRequests 2.0
9970 Bug [Crunch2][API] ContainerRequest#Create passing with illegal requesting_container_uuid value(s). 0.5
9836 Story [Crunch2][Documentation] Add workflows to API Reference -> API Methods 1.0
9835 Story [Crunch2][Documentation] Add containers and container_requests to API Reference -> API Methods 1.0
9679 Bug [Crunch2] Provide feedback when a container is submitted to slurm but does not run 1.0
10005 Story [Crunch2][API] Rename "workflow" attribute in a workflow object as "definition"
9898 Bug [Crunch2] [API] Add explicit container lock/unlock APIs to prevent dispatch races 2.0
9888 Story [API] Refactor job reuse code to be in the Job model instead of buried in JobsController 0.5
9799 Bug [Crunch2] Ensure live logs for containers are accessible to non-admin users 0.5
9.5

2016-09-28 sprint

09/28/2016

# Tracker Subject Story Points
9884 Story [Crunch2] Load test Crunch2 with large CWL workflow 0.5
9514 Story [API] [Workbench] Delete old container log messages once saved in Keep
10036 Bug [Crunch2] Cancelled container Queued in workbench
10037 Bug [Crunch2/Workbench] Non-running container requests show a useless progress bar on dashboard 0.5
1.0

2016-10-12 sprint

10/12/2016

# Tracker Subject Story Points
10186 Bug [Crunch2] Support dispatching to multiple SLURM partitions 1.0
8018 Feature [Crunch2] Identify container failure and retry 1.0
10026 Story [Crunch2] Review Docker security setup for Roche 1.0
9307 Feature [CWL] Arvados specific hint to use writable keep mount 0.5
3.5

2016-10-26 sprint

10/26/2016

# Tracker Subject Story Points
10291 Feature [Crunch2] Config to remove APIs from the discovery document -- use this in cwl-runner to choose between containers/jobs 1.0
10216 Bug [Crunch2] [API] Allow container request to bypass reuse (ensure a new container is created) 0.5
9848 Bug [Crunch2] [API] Ensure saved logs and outputs from containers are accessible to non-admin users 1.0
2.5

2016-11-09 sprint

11/09/2016

# Tracker Subject Story Points
10231 Feature [Crunch2] Support setting keep_cache in runtime_constraints 0.5
0.5

2016-11-23 sprint

11/23/2016

# Tracker Subject Story Points
10524 Story [Crunch2] In Crunch2-only environments, workbench should use "processes" instead of "pipelines and processes" and "workflows" instead of "pipeline templates" as is used in a mixed environment.
0.0

2016-12-14 sprint

12/14/2016

# Tracker Subject Story Points
10478 Bug [Crunch2] CWL workflow in 9tee4 failed while setting output in the end 1.0
10293 Story [Crunch2] Add output_uuid field to container_request 0.5
10113 Feature [Crunch2] Run cwl tests on crunch2 automatically, on 9tee4, as part of the deploy pipeline 0.5
2.0

2017-01-04 sprint

01/04/2017

# Tracker Subject Story Points
10114 Bug [OPS] Auto deploy builds to 9tee4
10684 Feature [Crunch2] crunch-run adding certificates to container 1.0
10677 Feature [Workbench] Copy and re-run container request 0.5
1.5

2017-01-18 sprint

01/18/2017

# Tracker Subject Story Points
10223 Feature [Crunch2] Add ability to set name of output collection 0.5
0.5

2017-02-01 sprint

02/01/2017

# Tracker Subject Story Points
10241 Story [Crunch2][Tests] Add a diagnostic test to run a container_request based test 0.5
10703 Bug [Crunch2] crunch-dispatch-slurm deadlocks instead of graceful shutdown
10704 Bug [Crunch2] sbatch submit failures not reported to use, loop forever
10702 Bug [Crunch2] crunch-dispatch-slurm buggy error handling
10700 Bug [Crunch2] crunch-dispatch-slurm pileup
0.5

2017-02-15 sprint

02/15/2017

# Tracker Subject Story Points
10701 Bug [Crunch2] crunch-dispatch-slurm leaks file descriptors
9397 Story [Crunch2] Support prepopulating the output directory - CWL InitialWorkDirRequirement 1.0
1.0

2017-03-01 sprint

03/01/2017

# Tracker Subject Story Points
6520 Feature [Node Manager] [Crunch2] Take queued containers into account when computing how many nodes should be up 0.5
10777 Bug [Crunch2] crunch-run: stop the container and fail if arv-mount dies before the container finishes
9277 Story [Crunch2] System-owned container outputs should be garbage-collected 0.5
1.0

2017-03-29 sprint

03/29/2017

# Tracker Subject Story Points
11252 Bug Pinning rules in Debian/Ubuntu broken by puppet
10218 Feature [Crunch2] Gather and record cloud/physical node information for each container 1.0
1.0

2017-04-12 sprint

04/12/2017

# Tracker Subject Story Points
8465 Feature [Crunch2] Support stdin/stderr redirection 1.0
9132 Story [Crunch2] crunch-run uses official docker client library 1.0
2.0

2017-05-10 sprint

05/10/2017

# Tracker Subject Story Points
10112 Story [Crunch2][Workbench]workflow#show page (similar to pipeline_template#show page) 1.0
1.0

2017-05-24 sprint

05/24/2017

# Tracker Subject Story Points
10111 Story [Workbench][Crunch2] Provenance graph for Container Request 2.0
2.0