Project

General

Profile

Actions

Feature #16462

open

Expand arvados-controller to expose forecast features

Added by Nico César almost 4 years ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
API
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

Arvados-controller forecast endpoints should be created based on the work done in git.arvados.org:arvados-forecaster.git


Files

timeline.html (8.34 KB) timeline.html Nico César, 06/03/2020 11:01 PM
report.html (2.81 MB) report.html Nico César, 06/03/2020 11:01 PM
su92l-xvhdp-3gri0mi1vtakaf4_intermediate_graph.pdf (26.7 KB) su92l-xvhdp-3gri0mi1vtakaf4_intermediate_graph.pdf Nico César, 06/06/2020 01:43 PM
su92l-xvhdp-3gri0mi1vtakaf4_just_circles.dot (8.1 KB) su92l-xvhdp-3gri0mi1vtakaf4_just_circles.dot sourcecode for the pdf Nico César, 06/06/2020 01:43 PM
su92l-xvhdp-3gri0mi1vtakaf4.png (810 KB) su92l-xvhdp-3gri0mi1vtakaf4.png Nico César, 06/06/2020 01:43 PM

Subtasks 1 (1 open0 closed)

Task #16546: ReviewNewTom CleggActions

Related issues

Related to Arvados Epics - Idea #16517: Workflow resource usage, runtime, and cost visibility and forecastingIn Progress12/31/202307/30/2024Actions
Related to Arvados - Idea #16534: [controller] facilitate database access by localdb API methodsResolvedTom Clegg06/26/2020Actions
Blocked by Arvados - Feature #17014: Add Container Requests endpoint to controllerResolvedNico César11/10/2020Actions
Actions #1

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-06-03 Sprint to 2020-06-17 Sprint

**

Actions #2

Updated by Nico César almost 4 years ago

As a reference this is what nextflow has as a report

https://www.nextflow.io/docs/latest/tracing.html

Actions #3

Updated by Nico César almost 4 years ago

In order to determine dependencies I added a "<workflow>-start" and "<workflow>-end" in the intermediate graph you can see this in: su92l-xvhdp-3gri0mi1vtakaf4_intermediate_graph.pdf

Output.Source and Input.Source have been a source of trouble to connect the dots to make dependencies work.

Actions #4

Updated by Nico César almost 4 years ago

Longest running haplotypecaller: 1d21h49m:
https://workbench.su92l.arvadosapi.com/container_requests/su92l-xvhdp-iqy6soi7sz4runm (Notice that the command doesn't have the -L)

While most of the other ones are 2h to 4h range, as an example haplotypecaller_9:

https://workbench.su92l.arvadosapi.com/container_requests/su92l-xvhdp-cpoakbi81qqsbke

As we discussed before, we can't take just the name of the step to do the bookkeeping of the metrics (running time in this case, but more to come),
Currently we use: "duration:<checkpoint>#<containerUUID>" as the key where checkpoint is "haplotypecaller" and anything after "#" is ignored on summarizing results.

Here the strategies are several:
  1. get the parent container request that has a workflow.json to compare to "the family of workflows" and use that as part of the key when storing the
  2. make some kind of signature of the command used for that Container, this will take into account the command line, but also get a little more creative and have input parsing and having some extra metrics comparing input sizes for example.
  3. a mix of 1 and 2, starting with one and try to get a sense of the clustering happens for all data
Actions #5

Updated by Nico César almost 4 years ago

added branch 16462-go-sdk-patch 3e8a3101cb9191813f3c8ed557d6f189d3e42063

Actions #7

Updated by Nico César almost 4 years ago

  • Related to Idea #16517: Workflow resource usage, runtime, and cost visibility and forecasting added
Actions #8

Updated by Nico César almost 4 years ago

  • Target version changed from 2020-06-17 Sprint to 2020-07-01 Sprint

After talking to Lucas and Tom this is the WIP: https://dev.arvados.org/projects/arvados/wiki/API_HistoricalForcasting_data_for_CR

(for later review)

Actions #9

Updated by Tom Clegg almost 4 years ago

  • Related to Idea #16534: [controller] facilitate database access by localdb API methods added
Actions #10

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-07-01 Sprint to 2020-07-15
Actions #11

Updated by Nico César over 3 years ago

  • Target version changed from 2020-07-15 to 2020-08-12 Sprint
Actions #12

Updated by Nico César over 3 years ago

  • Status changed from New to In Progress
Actions #13

Updated by Nico César over 3 years ago

  • Target version changed from 2020-08-12 Sprint to 2020-08-26 Sprint
Actions #14

Updated by Nico César over 3 years ago

  • Target version changed from 2020-08-26 Sprint to 2020-09-09 Sprint
Actions #15

Updated by Nico César over 3 years ago

  • Target version changed from 2020-09-09 Sprint to 2020-09-23 Sprint
Actions #16

Updated by Nico César over 3 years ago

  • Target version changed from 2020-09-23 Sprint to 2020-10-07 Sprint
Actions #17

Updated by Nico César over 3 years ago

9cce9619f3438011a42e5d10ca6c8584f0788381 (branch 16462-forecast-wip ) has the initial version of database tests

Actions #18

Updated by Nico César over 3 years ago

Note to future self/reviewer : make sure GET https://&lt;API&gt;/arvados/v1/container_requests/ works as expected

Actions #19

Updated by Peter Amstutz over 3 years ago

  • Release set to 25
Actions #20

Updated by Peter Amstutz over 3 years ago

  • Release deleted (25)
Actions #21

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2020-10-07 Sprint to 2020-10-21 Sprint
Actions #22

Updated by Nico César over 3 years ago

16462-forecast-wip2 (f6ccc08c3f6b1ad42f2c827b19df0300f2c3c3db) can be reviewed now, This is unfinished work but might be useful to know if I'm heading in the right direction.

I see that some of my changes broke federation:
developer-run-tests-remainder: #2227 /console

Actions #23

Updated by Nico César over 3 years ago

  • Blocked by Feature #17014: Add Container Requests endpoint to controller added
Actions #24

Updated by Nico César over 3 years ago

  • Target version changed from 2020-10-21 Sprint to 2020-11-18
Actions #25

Updated by Nico César over 3 years ago

Actions #26

Updated by Nico César over 3 years ago

  • Target version changed from 2020-11-18 to 2020-12-02 Sprint
Actions #27

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2020-12-02 Sprint to 2020-12-16 Sprint
Actions #28

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2020-12-16 Sprint to 2021-01-06 Sprint
Actions #30

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2021-01-06 Sprint to 2021-01-20 Sprint
Actions #31

Updated by Nico César about 3 years ago

  • Target version changed from 2021-01-20 Sprint to To Be Groomed
Actions #32

Updated by Nico César about 3 years ago

  • Status changed from In Progress to New
Actions #33

Updated by Peter Amstutz almost 3 years ago

  • Related to deleted (Feature #17054: Custom naming for scatter steps)
Actions #34

Updated by Peter Amstutz almost 3 years ago

  • Target version deleted (To Be Groomed)
Actions #35

Updated by Nico César almost 3 years ago

  • Assigned To deleted (Nico César)
Actions #36

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #37

Updated by Peter Amstutz about 1 month ago

  • Target version set to Future
Actions

Also available in: Atom PDF