Activity

From 10/16/2014 to 11/14/2014

11/14/2014

11:07 pm Revision 6de0a4ab (arvados): Relax activesupport dependency to accommodate 4.x. refs #4388
Tom Clegg
10:55 pm Feature #4533: [API] [Tests] Add remote API for resetting database to test fixtures, for use by i...
https://github.com/DatabaseCleaner/database_cleaner Tom Clegg
07:06 pm Feature #4533 (Resolved): [API] [Tests] Add remote API for resetting database to test fixtures, f...
This should only work if @RAILS_ENV=test@ _and_ the feature is specifically enabled in the config file. Test cases sh... Tom Clegg
10:26 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
updated report from Sally:
- running this pipeline on 9tee4 works fine.
- re-running on qr1hi showed the same iss...
Ward Vandewege
03:48 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
Sally reports that re-running this pipeline appears to be producing the expected results, so I recommend that we tabl... Tim Pierce
09:16 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
I think the problem being reported is that you can't tell which jobs/outputs are part of pipeline A and which are par... Tom Clegg
09:12 pm Bug #4476 (In Progress): [Workbench] Search dialog infinite scrolling issue: second page and onwa...
Tom Clegg
08:56 pm Bug #4476: [Workbench] Search dialog infinite scrolling issue: second page and onwards do not fil...
This is likely a duplicate of a bug noticed and fixed in #4024. Tom Clegg
09:10 pm Bug #4493 (Resolved): [Crunch] job fails with Docker error "Engine is shutdown"
This looks like the node was shutting down while the job was running. This kind of thing is probably going to be fixe... Ward Vandewege
09:05 pm Bug #4464: [Workbench] Collections tab loads forever on a specific project
Eventually times out and shows Retry button. Browser console log shows "timeout" error message sent by Workbench. Tom Clegg
09:03 pm Bug #4482 (Resolved): [Crunch] Diagnostics failure "user not found on host"
Ward Vandewege
09:03 pm Bug #4522 (Rejected): [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError ...
Tom Clegg
08:51 pm Bug #4522: [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError error conne...
Todo: check the workbench and api server logs for when this happened. Ward Vandewege
04:38 pm Bug #4522: [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError error conne...
https://workbench.qr1hi.arvadosapi.com/collections is currently working for me. Is it working for you too?
That s...
Tim Pierce
01:37 am Bug #4522 (Rejected): [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError ...
Radhika Chippada
08:50 pm Bug #4474 (Resolved): [Node Manager] Node manager shut down node in middle of job
Ward Vandewege
04:47 pm Bug #4474: [Node Manager] Node manager shut down node in middle of job
Just to check our assumptions on this one: the log indicates that the node was shut down while a job was running, not... Tim Pierce
08:46 pm Feature #4539 (New): [Workbench] Job detail page should show the job status when the job is not r...
On the pipeline instance #show page, each job has a {progress bar or status badge}. On the job #show page, the markup... Ward Vandewege
08:38 pm Bug #4538: [SDKs] pipeline created by arv copy fails Commit.find_commit_range
Pipeline instance 9tee4-d1hrv-wapjyzr70sqqa06 generates the following errors when run, at https://workbench.9tee4.arv... Tim Pierce
08:36 pm Bug #4538 (Closed): [SDKs] pipeline created by arv copy fails Commit.find_commit_range
Tim Pierce
08:32 pm Revision f5113828 (arvados): 4194: rename RESTRouterWrapper
Radhika Chippada
08:23 pm Task #4537 (Resolved): Review 4535-configure-api-host-url
Peter Amstutz
08:22 pm Feature #4194: [Keep] consistent logging for keepstore requests
Capturing the informal review we just did face-to-face at commit:d4224bfe:
* The @WrapRESTRouter@ code could wrap ...
Tim Pierce
08:10 pm Bug #4523 (In Progress): [Workbench] Search dialog giving error when searching in "All projects" ...
Tom Clegg
01:40 am Bug #4523 (Resolved): [Workbench] Search dialog giving error when searching in "All projects" in ...
To reproduce:
Go to https://workbench.qr1hi.arvadosapi.com/, enter any term into the search box (I used "hash") an...
Radhika Chippada
08:08 pm Revision 97cd8d60 (arvados): 4194: remove some more old log statements
Radhika Chippada
08:06 pm Bug #4536 (Resolved): [SDKs] arv tag is broken
Ward Vandewege
08:04 pm Bug #4470: [Crunch] tmpdir not writable running jobs in Docker
On further research, this is a general problem, the data volume shows up as being owned by root inside the container,... Peter Amstutz
07:50 pm Revision 84b6c8f2 (arvados): 4194: since LoggingResponseWriter is doing the logging, remove some ...
Radhika Chippada
07:38 pm Revision 2070784e (arvados): 4535: Change default to false because ~ indicates "must be filled in".
Peter Amstutz
07:33 pm Revision 59f750a1 (arvados): 4535: Add default_url_options to application controller that consults
Rails.configuration. Added entry with documentation to
application.yml.default.
Peter Amstutz
07:28 pm Bug #4535 (Resolved): [API] Configuration option to set advertised hostname
In development mode, the default root_url of rails is 'localhost'. This gets advertised in the discovery document. ... Peter Amstutz
07:22 pm Feature #4534 (Resolved): [Tests] run-tests.sh should bring up API and Keep services for the dura...
Tom Clegg
07:14 pm Bug #4488: [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
I don't see how that works in the case of a federated environment, where a client may find itself talking to disks in... Tim Pierce
06:31 pm Bug #4488: [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
In a given scenario the SDK should either connect only to proxies, or only to disks -- so this shouldn't be an issue.... Tom Clegg
07:07 pm Revision 8b7ed36f (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
06:58 pm Task #4532 (Resolved): Review 4027-sdk-constraint-reuse-wip
Brett Smith
06:57 pm Revision 2f69408f (arvados): 4027: API server considers arvados_sdk_version for Job reuse.
* Extend "in git" and "not in git" filters to the arvados_sdk_version
column.
* When no filters are specified, if t...
Brett Smith
06:40 pm Feature #4531 (New): [Documentation] Set of introductory tutorials each focused on accomplishing ...
Tom Clegg
06:40 pm Feature #4530 (New): [Workbench] Show more (earlier) log entries for a running job
The "tail" shown in the web gui is nice, but I often want to see the early part of the job log while the job is runni... Sarah Guthrie
06:29 pm Bug #4529 (Closed): [SDKs] Ensure Python and Go SDKs in a given situation always choose either pr...
Tom Clegg
05:00 pm Feature #4528 (New): [Crunch] Dynamic task allocation based on job size determined at runtime
This doesn't work with tasks because I run out of memory often and need to parallelize between nodes instead of cores... Bryan Cosca
05:00 pm Story #4527 (Rejected): [Keep] DataManager automatically adds cloud storage when utilization is o...
Similar to NodeManager automatically spinning up compute nodes, DataManager could automatically allocate new storage ... Peter Amstutz
04:03 pm Revision d4224bfe (arvados): 4194: improve logging when large block is retrieved.
Radhika Chippada
03:56 pm Bug #4524: [Workbench] Error running pipeline with File input data type.
The URL makes this look like the problem could be excessive URL-encoding. Is this a problem specific to Clippy? If ... Tim Pierce
01:44 am Bug #4524: [Workbench] Error running pipeline with File input data type.
Run pipeline with File input (pipeline_templates/qr1hi-p5p6p-xt9iw6rmhvm93q5) -> Select a file (selected into a clipp... Radhika Chippada
01:43 am Bug #4524 (Closed): [Workbench] Error running pipeline with File input data type.
Run pipeline with File input (pipeline_templates/qr1hi-p5p6p-xt9iw6rmhvm93q5) -> Select a file (selected into a clipp... Radhika Chippada
03:31 pm Feature #4526 (New): [SDKs] run-command stream create pipes to stream stdin/stdout directly from/...
When redirecting stdin or stdout, run-command currently either opens a file on the FUSE mount (stdin) or writes a sta... Peter Amstutz
02:50 pm Revision 35c53e25 (arvados): 4194: Add LoggingResponseWriter and RESTRouter wrapper. Update keeps...
Radhika Chippada
02:41 pm Task #4498 (Resolved): Fix double-load after fwd/back
Tom Clegg
02:31 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
In order to support common workflow language tool descriptions, it will essential to be able to take Docker images co... Peter Amstutz
01:41 pm Story #4299: [Node Manager] Support a configurable throttle for creating cloud nodes
This is going to take a little more rearchitecting of Node Manager than I originally thought.
Imagine the case whe...
Brett Smith
06:16 am Revision f5a1a921 (arvados): 4024: Use filterable-control input values (if any) when first loadin...
Tom Clegg
02:47 am Revision 9100a3b1 (arvados): 4024: Use filterable-control input values (if any) when first loadin...
Tom Clegg
02:40 am Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
* Peter, thanks for the review feedback. I updated to use left padding of 0 when preview panel is used for selection,... Radhika Chippada
02:35 am Story #3177 (Resolved): [Workbench] File chooser dialog (replace remaining use of clippy)
Applied in changeset arvados|commit:3a31350c6265cb1135d3d4d40af436aae91a9894. Radhika Chippada
02:36 am Story #4525: [Workbench] Remove stale clippy code.
Since clippy is now retired (#3177), we can update the script tag in collection show_files partial.... Radhika Chippada
02:33 am Story #4525 (Resolved): [Workbench] Remove stale clippy code.
examples
* views/collections/_show_files.html.erb (see "note-1"://arvados.org/issues/4525#note-1 below)
* a good ch...
Radhika Chippada
02:30 am Task #4445 (Resolved): Review branch: 3177-collection-choose-files
Radhika Chippada
02:29 am Revision 3a31350c (arvados): closes #3177
Merge branch '3177-collection-choose-files' Radhika Chippada
02:12 am Revision c805714d (arvados): 3177: use no left padding when collection files preview panel is use...
Radhika Chippada
01:45 am Revision 9325dabc (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada

11/13/2014

11:43 pm Bug #4520 (Resolved): [SDKs] arv copy should respect --project-uuid when saving destination Colle...
arv copy --src settings --dst 9tee4 --project-uuid 9tee4-j7d0g-f75lcwo78ifvnl2 qr1hi-4zz18-85b713kdm9kle3r
(where se...
Sarah Guthrie
11:29 pm Revision 75759abc (arvados): 4024: Use filterable-control input values (if any) when first loadin...
Tom Clegg
11:02 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
Tom Clegg wrote:
> At commit:e8dd6d9
Okay, so, I'm glad to have some clarity around the encoding of manifests, bu...
Brett Smith
08:35 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
At commit:e8dd6d9
Notes
* NUL bytes in filenames are now prohibited by CollectionWriter (this seemed more reasona...
Tom Clegg
10:27 pm Revision 95323ba3 (arvados): 4024: Add test for double-load bug.
Tom Clegg
10:12 pm Revision 67e6092c (arvados): 4035: Looks for "tooldescription" in the component, if found, proces...
Peter Amstutz
09:30 pm Task #4517 (In Progress): Review 4363-less-filename-munging
Brett Smith
07:57 pm Task #4517 (Resolved): Review 4363-less-filename-munging
Tom Clegg
09:25 pm Task #4519 (Resolved): Review 4380-node-manager-slurm-drain-wip
Brett Smith
09:24 pm Revision 7e9c860f (arvados): 4380: Node Manager shutdown actor is more robust.
ComputeNodeShutdownActor now checks that destroying the cloud node
succeeds. Before retrying, it will check if the n...
Brett Smith
09:24 pm Revision 31adfc80 (arvados): 4380: Add SLURM dispatcher to Node Manager.
Brett Smith
09:24 pm Revision ce4d36c4 (arvados): 4380: Fix retry scheduling for Node Manager change methods.
Brett Smith
09:21 pm Revision eb185aab (arvados): 4024: Remove unused /pipeline_instances/?search=x support.
Tom Clegg
08:48 pm Revision e8dd6d95 (arvados): 4363: Merge branch 'master' into 4363-less-filename-munging
Tom Clegg
08:47 pm Task #4498 (In Progress): Fix double-load after fwd/back
Tom Clegg
08:43 pm Bug #4518 (Resolved): [Documentation] typo in arv-run documentation
The first line says: The arv-run command enables you create Arvados pipelines at the command line that fan out to mul... Bryan Cosca
08:20 pm Revision 97bb0767 (arvados): 4363: Make _NameAttribute a unicode instead of a str. Avoid encoding...
Tom Clegg
08:06 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
Also (as we discussed) the files have some unnecessary left margin or padding (possibly due to the hidden checkboxes?). Peter Amstutz
07:59 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
There is a script tag in show_files that seems relevant:... Peter Amstutz
04:44 am Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
* Updated to allow selection of the row, instead of the checkbox.
* I did not introduce a new partial. The update ...
Radhika Chippada
07:57 pm Task #4510 (Resolved): Test some utf8 characters
Tom Clegg
04:48 pm Task #4510 (Resolved): Test some utf8 characters
Tom Clegg
07:54 pm Revision 34a73d54 (arvados): 4363: Remove redundant test.
Tom Clegg
07:45 pm Revision 1aa68382 (arvados): 4363: Compare unicode strings (ignore utf-8 encoding differences). B...
Tom Clegg
07:28 pm Revision f78caf95 (arvados): 4363: Do not blow up when manifests contain utf-8 characters.
Tom Clegg
07:11 pm Feature #4516 (New): [Workbench] Don't show empty projects/collections when using the chooser dia...
In the chooser dialog, it is unhelpful to show the user projects with no relevant contents, such as projects with no ... Peter Amstutz
07:06 pm Bug #4515 (Resolved): [Workbench] Oops when selecting empty project in chooser
Go to dashboard. Click on "Run pipeline". Under "Projects", select a project that is empty. The chooser will show ... Peter Amstutz
07:03 pm Bug #4514 (New): [Workbench] Pipelines that are in New or Ready state should show up somewhere on...
Peter Amstutz
06:14 pm Task #4513 (In Progress): Conformance test framework
Peter Amstutz
06:14 pm Task #4513 (Resolved): Conformance test framework
Peter Amstutz
06:14 pm Task #4512 (In Progress): Implement support in arv-run-pipeline-instance
Peter Amstutz
06:13 pm Task #4512 (Resolved): Implement support in arv-run-pipeline-instance
Peter Amstutz
06:13 pm Task #4511 (In Progress): Work on reference implementation
Peter Amstutz
06:13 pm Task #4511 (Resolved): Work on reference implementation
Peter Amstutz
06:13 pm Task #4382 (Resolved): Decide what to do
Peter Amstutz
04:54 pm Revision 069b22b2 (arvados): 4363: Test edge cases as directory names, too.
Tom Clegg
04:49 pm Task #4375 (Resolved): Add tests
Tom Clegg
04:49 pm Task #4365 (Resolved): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
04:42 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
4821022082141e6f5b79266ec6acf139+87/qr1hi-8i9sb-k3s82jjrvwqr1oq.log.txt
Hopefully this is the one! :)
Bryan Cosca
04:27 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Heres one that switches from 1-8
718372dd89ec3873df80ffd7dff00768+89/qr1hi-8i9sb-gctmuofg58gkt3k.log.txt
Bryan Cosca
04:16 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Here are a couple from 9tee4 for me:
539086fd4061f946361b858d58ed487f+89/9tee4-8i9sb-fiqxbkp5j4mydb8.log.txt
0bb6...
Abram Connelly
04:05 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Here are a couple examples:
41c21fe24f7e861f61af30a52e3ae3ef+87/qr1hi-8i9sb-xca86qu6z460no8.log.txt
682b61f380d30...
Bryan Cosca
02:26 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Phil Hodgson wrote:
> There's a y-axis problem here, because not all the sum(Dx) are measured in seconds, so there a...
Tom Clegg
01:06 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
There's a y-axis problem here, because not all the sum(Dx) are measured in seconds, so there are differing units of m... Phil Hodgson
04:42 pm Revision 4d01f18d (arvados): 4363: Test that munged filenames show up in os.listdir().
Tom Clegg
04:40 pm Revision e363a797 (arvados): 4363: Reject NUL characters in filenames in CollectionWriter.
Tom Clegg
04:39 pm Story #4509 (New): [Workbench] Better pipeline management
Right now, managing your pipelines from workbench is a bit difficult. From the dashboard recently finished pipeline ... Abram Connelly
03:33 pm Revision 23cebe86 (arvados): 4233: (naive) first iteration at graphing job log stats
- does not update, but graphs the story so far
- does not do scaling
- has no error checking
Phil Hodgson
03:20 pm Task #4495 (Resolved): Review 2853-rendezvous
Tom Clegg
02:50 pm Story #2853 (Resolved): [Keep] Use rendezvous hashing to assign blocks to servers in Go and Pytho...
Applied in changeset arvados|commit:06e402b11ad4d503feb5fa45845cb27c93478cfc. Anonymous
02:15 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
Tom Clegg wrote:
> Brett Smith wrote:
> > * Go's sort is not guaranteed to be stable. Python's is. Does this matt...
Brett Smith
02:47 pm Revision 06e402b1 (arvados): Merge branch '2853-rendezvous' closes #2853
Tom Clegg
02:47 pm Revision 4a84c449 (arvados): 4380: Node Manager monitors respond to shutdown_eligible message.
Brett Smith
02:27 pm Revision afdab872 (arvados): 2853: Merge branch 'master' into 2853-rendezvous
Tom Clegg
02:00 pm Task #4489 (Resolved): Review 4027-api-sdk-version-wip
Applied in changeset arvados|commit:809b122ee02d566b3bddb26df928e57efa39ed87. Brett Smith
01:57 pm Revision 809b122e (arvados): Merge branch '4027-api-sdk-version-wip'
Refs #4027. Closes #4489. Brett Smith
01:56 pm Revision f5c574f4 (arvados): 4027: Add arvados_sdk_version runtime constraint to API server.
Crunch will use this information to provide a specific SDK version in
the runtime environment.
Brett Smith
02:49 am Revision f81483a3 (arvados): 3177: update test to select row in preview panel
Radhika Chippada
02:19 am Revision 1ac0e3da (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
02:19 am Revision dff161c1 (arvados): 3177: file selection
Radhika Chippada

11/12/2014

11:21 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Brett Smith wrote:
> Don't read too much into it. At one point, I had trouble rolling back the short form migration...
Tom Clegg
10:13 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Tom Clegg wrote:
> At commit:db8f547...
>
> The only complaint I can find is that the arvados repository fixture ...
Brett Smith
06:37 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
At commit:db8f547...
The only complaint I can find is that the arvados repository fixture ("owned by All Users gro...
Tom Clegg
11:11 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
> Now at commit:9ef386f with todo: Rearrange KeepRendezvousWeightTestCase mock.
Tests are refactored at commit:cf1...
Tom Clegg
10:35 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
Brett Smith wrote:
> * Go's sort is not guaranteed to be stable. Python's is. Does this matter? It will only come...
Tom Clegg
09:13 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
h2. Compatibility
* Go's sort is not guaranteed to be stable. Python's is. Does this matter? It will only come ...
Brett Smith
02:22 pm Story #2853 (In Progress): [Keep] Use rendezvous hashing to assign blocks to servers in Go and Py...
Tom Clegg
11:10 pm Revision cf1db398 (arvados): 2853: Use mock from KeepClientServiceTestCase for rendezvous tests
instead of intruding on KeepClient's private instance variables. Tom Clegg
10:22 pm Revision 3894b788 (arvados): Update arv-tag --help text in arv subcommands documentation.
refs #4486 Ward Vandewege
10:20 pm Revision 5be66e86 (arvados): Make arv-tag print usage when --help is given. Also, fix typo in usa...
No issue # Ward Vandewege
10:19 pm Revision fd207a0e (arvados): Remove some redundant lines from sdk/bin/arv
No issue # Ward Vandewege
10:10 pm Revision be3c438f (arvados): 4027: Fixup arvados repo fixture to make it more realistic.
Brett Smith
09:57 pm Revision 9ef386f6 (arvados): 2853: Avoid using reserved word "hash" as a variable name.
Tom Clegg
09:57 pm Revision d833a286 (arvados): 2853: Fix reference to reference set.
Tom Clegg
09:57 pm Revision 754ff84a (arvados): 2853: Use Md5String() in getWeight().
Tom Clegg
09:55 pm Revision 53192c32 (arvados): 4363: Fix filename munging. Add tests.
Tom Clegg
09:52 pm Revision 1a001045 (arvados): 2853: Remove redundant test case.
Tom Clegg
09:41 pm Feature #4508 (New): [Documentation] Best practices for getting the most out of job re-use
Not sure how to name this, but I ran into the situation where:
I have 10 jobs running in a pipeline, and 9 complet...
Bryan Cosca
09:35 pm Bug #4507 (Duplicate): [SDKs] arv ws should exit on ctrl-c
At least, in log table polling mode, it takes ctrl-c the first few seconds after it starts, and then just ignores it. Ward Vandewege
09:35 pm Revision 99668934 (arvados): Merge branch '3609-run-command-bugfix'
Refs #3609. Tim Pierce
09:07 pm Revision ac21f0d4 (arvados): 3609: fix "NameError: name 'rcode' is not defined"
If run-command raises an exception in the main 'try' loop before any
subprocesses have run, rcode will not be defined...
Tim Pierce
09:04 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
more examples: qr1hi-8i9sb-kryvvban6b7hj74 qr1hi-8i9sb-wdv358fgjhh8fsa
This is starting to be a small annoyance of...
Bryan Cosca
08:49 pm Feature #4505 (Duplicate): [SDKs] "arv get {uuid}" outputs JSON representation of given object
Tom Clegg
08:47 pm Revision a0e70cf1 (arvados): Merge branch 'master' into 3177-collection-choose-files
Conflicts:
apps/workbench/app/views/collections/_choose_rows.html.erb
Radhika Chippada
08:43 pm Task #4364 (Resolved): Ensure posix-allowed filenames are not altered by arv-mount (add tests)
Tom Clegg
08:43 pm Task #4365 (In Progress): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
08:43 pm Task #4365 (Resolved): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
08:43 pm Task #4375 (In Progress): Add tests
Tom Clegg
08:43 pm Feature #4503 (New): [SDKs] Option to watch logs (instead of exiting) when queuing a job or pipel...
Much like the @-c@ in @xen create guestname -c@.
Adding this to @arv job create@ should be fairly straightforward:...
Tom Clegg
08:35 pm Revision c28b9b91 (arvados): 3177: in file chooser mode, allow row selection
Radhika Chippada
08:33 pm Feature #4502 (New): [SDKs] "arv recent [objectType]" lists recently modified objects
The API call for this is @groups.contents@ with no @uuid@ given, and @order="modified_at desc"@.
Defaulting to a @...
Tom Clegg
08:30 pm Bug #4501 (Resolved): [FUSE] arv-mount --by-id should expose the /by_id directory as well as (not...
Tom Clegg
08:25 pm Bug #4500 (New): [OPS] Improve and automate non-shared VM configuration
Todo:
* install docker on all VMs
* automate adding users to the docker and sudo groups on those nodes that are no...
Ward Vandewege
08:24 pm Feature #4486 (Resolved): [Documentation] document the arv cli tool
Ward Vandewege
08:00 pm Task #4430 (Resolved): review 4383-easy-install
Tom Clegg
08:00 pm Task #4441 (Resolved): Review 3400-workbench-all-items
Tom Clegg
08:00 pm Task #4435 (Resolved): Review 4434-collation
Tom Clegg
07:59 pm Bug #4363 (In Progress): [Keep] arv-mount should not munge filenames unless required by POSIX
Tom Clegg
07:58 pm Revision d3f844f1 (arvados-dev): Export vars provided on command line, e.g., ARVADOS_DEBUG=1. No ...
Tom Clegg
07:58 pm Revision d3f844f1 (arvados): Export vars provided on command line, e.g., ARVADOS_DEBUG=1. No issue #
Tom Clegg
07:50 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
It's interesting to me that this collection is kind of degenerate: each of the output files are produced from thousan... Tim Pierce
07:10 pm Bug #4499 (Resolved): [SDKs] one_task_per_input_file should call normalize() before getting its l...
sguthrie reports that "qr1hi-d1hrv-3n1gezo6gondyrv":http://crvr.se/qr1hi-d1hrv-3n1gezo6gondyrv, despite running with ... Tim Pierce
07:02 pm Revision 2d0d55e7 (arvados): 2853: Remove historical artifact: check for None instead of catching...
Tom Clegg
07:00 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
Tim Pierce wrote:
> Looks good. Only minor comment: launcher.py still imports ComputeNodeSetupActor, ComputeNodeShu...
Brett Smith
06:45 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
Reviewing 4380-node-manager-computenode-reorg-wip at commit:0d49d9d0a
Looks good. Only minor comment: launcher.py...
Tim Pierce
07:00 pm Task #4496 (Resolved): Review 4380-node-manager-computenode-reorg-wip
Applied in changeset arvados|commit:8f9f0dece977ccf5a778f3b3bd2379375e723c18. Brett Smith
06:59 pm Revision e158f485 (arvados): 2853: Merge branch 'master' into 2853-rendezvous
Conflicts:
sdk/python/arvados/keep.py
Tom Clegg
06:59 pm Revision 8f9f0dec (arvados): Merge branch '4380-node-manager-computenode-reorg-wip'
Refs #4380. Closes #4496. Brett Smith
06:59 pm Revision b626a85e (arvados): 4380: Reorganize arvnodeman.computenode.
This makes the hierarchy a little richer:
* arvnodeman.computenode.driver has all the cloud driver wrappers.
* arvno...
Brett Smith
06:50 pm Bug #4434 (Resolved): [API] Test suite should not depend on a particular database collation config.
Applied in changeset arvados|commit:5141c3ee23e89696773e227a93236ef2a51543c2. Anonymous
05:18 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
Tom, in that case, I am ok with what the test is doing. Please go ahead and merge. Thanks. Radhika Chippada
06:45 pm Bug #3400 (Resolved): [Workbench] Rails client library should offer an "all pages" mode for queri...
Applied in changeset arvados|commit:45bfc1104dd30fb97a586de5ff96d6b739f7bb2b. Anonymous
06:41 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
LGTM, thanks! Tom Clegg
06:12 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Tom Clegg wrote:
> > I added a 'get limited items more than default page size' test, but right now the API server ...
Peter Amstutz
05:16 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
At commit:91f0b18...
Peter Amstutz wrote:
> Well, I'm fairly certain that the 'get all items by default' is going...
Tom Clegg
03:59 pm Bug #3400 (New): [Workbench] Rails client library should offer an "all pages" mode for queries th...
Tom Clegg wrote:
> Looking at commit:0f9bca4...
>
> Peter Amstutz wrote:
> > I handled this on the client side b...
Peter Amstutz
06:42 pm Revision 5141c3ee (arvados): Merge branch '4434-collation' closes #4434
Tom Clegg
06:42 pm Revision 45bfc110 (arvados): Merge branch '3400-workbench-all-items' closes #3400
Peter Amstutz
06:28 pm Task #4495 (In Progress): Review 2853-rendezvous
Brett Smith
06:14 pm Revision 6bcb827b (arvados): Merge branch 'master' into 3400-workbench-all-items
Peter Amstutz
06:13 pm Revision 093cebc3 (arvados): 3400: test limit between server maxpagesize and 2x server maxpagesize.
Conflicts:
apps/workbench/test/unit/arvados_resource_list_test.rb
Tom Clegg
06:05 pm Task #4489 (In Progress): Review 4027-api-sdk-version-wip
Tom Clegg
06:02 pm Task #4498 (Resolved): Fix double-load after fwd/back
Tom Clegg
05:39 pm Revision 76c9a858 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
05:37 pm Revision 708772bc (arvados): 4233: correction: the 'text' in the properties hash when simulating ...
Phil Hodgson
05:08 pm Revision 53381c90 (arvados): Bugfix bad exception name in PySDK util.is_hex.
No issue #. Brett Smith
05:00 pm Revision 0536d6d6 (arvados-dev): Refs #3857: Build modern requests package for PySDK.
Brett Smith
05:00 pm Revision 0536d6d6 (arvados): Refs #3857: Build modern requests package for PySDK.
Brett Smith
04:53 pm Revision bc4992f9 (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
04:52 pm Revision 39e39add (arvados): 4024: move the search box to the top
Radhika Chippada
04:43 pm Revision 333fbec9 (arvados): Merge branch '4024-pipeline-instances-scroll' of git.curoverse.com:a...
Radhika Chippada
04:39 pm Revision 91f0b180 (arvados): 3400: Stub out obsolete #links_for and remove result_links and relat...
Set @result_limit and @result_offset to nil unless @fetch_multiple_pages ==
false. Add test for limit > default page...
Peter Amstutz
04:17 pm Revision a844af57 (arvados): Merge branch '3857-python-sdk-timeout-bugfix'
Fixes #3857. Tim Pierce
04:13 pm Revision d1cdd7ed (arvados): 3857: fix python-requests dependency
Multiple timeout support in python-requests is only supported in
versions 2.4.0 or later.
Tim Pierce
03:02 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
Peter Amstutz wrote:
> Even better would be to get rid of the checkboxes entirely and allow the user to click anywhe...
Tom Clegg
03:00 pm Story #4316 (Resolved): Review 3603-pysdk-file-api-wip
Applied in changeset arvados|commit:26aa2f1a1c8c9883beac1538c318279190f91c8a. Brett Smith
02:36 pm Story #4316: Review 3603-pysdk-file-api-wip
LGTM Peter Amstutz
02:57 pm Revision 26aa2f1a (arvados): Merge branch '3603-pysdk-file-api-wip'
Refs #3603. Closes #4316. Brett Smith
02:42 pm Revision 7bf8f6c7 (arvados): 3603: PySDK Collection objects support file-like APIs.
This commit adds an open() method to CollectionReader and
CollectionWriter. They mimic the built-in open(), returnin...
Brett Smith
02:38 pm Revision 7924077e (arvados): 3603: Clean up PySDK imports.
Sort; remove unused imports. Brett Smith
02:37 pm Revision c1d9150d (arvados): 3603: Fix context methods for PySDK Collection objects.
Brett Smith
02:32 pm Task #4497 (In Progress): Graph logged crunchstat intervals in job log tab
Phil Hodgson
12:41 pm Task #4497 (Resolved): Graph logged crunchstat intervals in job log tab
Phil Hodgson
02:02 pm Revision b2610e06 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
12:40 pm Task #4407 (Resolved): Provide a test helper that replays crunch job logs
Phil Hodgson
09:43 am Task #4407 (In Progress): Provide a test helper that replays crunch job logs
Phil Hodgson
12:40 pm Revision 73c02220 (arvados): 4233: "helper" method for replaying a job log from a specified file,...
Phil Hodgson
06:27 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Radhika Chippada wrote:
> Tom, addressed all your feedback. Also, search works with scrolling now for this page. Tha...
Tom Clegg
06:19 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Radhika Chippada wrote:
> Does the "compare" form defined at line 2 work?
This seems to have been broken by the t...
Tom Clegg
06:16 am Revision 6c7bfabc (arvados): 4024: Fix "compare pipelines" button.
Tom Clegg
02:30 am Progress, progress, progress
!>/attachments/download/413/forest_of_cranes.jpg!
It has been a while since we've blogged about our development prog...
Ward Vandewege
02:23 am Revision ee3e8585 (arvados): Fix broken doc link.
refs #4486 Ward Vandewege
01:36 am Revision c89f70e3 (arvados): Merge branch '4486-document-arv'
refs #4486 Ward Vandewege
01:35 am Revision f34bf1aa (arvados): Remove trailing whitespace.
refs #4486 Ward Vandewege
01:34 am Revision 0dbc7a34 (arvados): Merge branch 'master' into 4486-document-arv
refs #4486 Ward Vandewege

11/11/2014

11:27 pm Revision 2471e184 (arvados-dev): (minor) delete extra line in test 0
Sitaram Chamarty
11:10 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Looking at commit:0f9bca4...
Peter Amstutz wrote:
> I handled this on the client side by adjusting the limit to b...
Tom Clegg
10:26 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
4380-node-manager-computenode-reorg-wip is up for review. See the commit message in commit:0d49d9d for rationale. I... Brett Smith
10:25 pm Task #4496 (In Progress): Review 4380-node-manager-computenode-reorg-wip
Tim Pierce
10:25 pm Task #4496 (Resolved): Review 4380-node-manager-computenode-reorg-wip
Brett Smith
10:23 pm Revision 0d49d9d0 (arvados): 4380: Reorganize arvnodeman.computenode.
This makes the hierarchy a little richer:
* arvnodeman.computenode.driver has all the cloud driver wrappers.
* arvno...
Brett Smith
10:22 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
2853-rendezvous @ commit:c7b7e4d
Notes
* Chose MD5. Faster hash functions are out there (e.g., blake2) but it see...
Tom Clegg
10:21 pm Revision f4ceb0aa (arvados): Add TCPKeepAlive and ServerAliveInterval ssh options to the .ssh/config
snippet that Workbench suggests.
no issue #
Ward Vandewege
10:11 pm Task #4495 (Resolved): Review 2853-rendezvous
Tom Clegg
10:10 pm Task #4491 (Resolved): Replace shuffling in Go SDK
Tom Clegg
09:32 pm Task #4491 (In Progress): Replace shuffling in Go SDK
Tom Clegg
09:31 pm Task #4491 (Resolved): Replace shuffling in Go SDK
Tom Clegg
10:10 pm Task #4492 (Resolved): Fix tests that expect old probe order
Tom Clegg
09:32 pm Task #4492 (In Progress): Fix tests that expect old probe order
Tom Clegg
09:32 pm Task #4492 (Resolved): Fix tests that expect old probe order
Tom Clegg
10:06 pm Bug #4494 (New): [Crunch] Do more error-checking and show more diagnostic info when installing a ...
Job "qr1hi-8i9sb-vx84guvzp3xvwgz":http://crvr.se/qr1hi-8i9sb-vx84guvzp3xvwgz failed with this diagnostic output:
<...
Tim Pierce
09:53 pm Revision 204419e1 (arvados): Add some basic documentation for the arv subcommands.
refs #4486 Ward Vandewege
09:51 pm Bug #4493 (Resolved): [Crunch] job fails with Docker error "Engine is shutdown"
Job "qr1hi-8i9sb-z8jwujrvgcvmr9h":http://crvr.se/qr1hi-8i9sb-z8jwujrvgcvmr9h failed with this in its error log:
<p...
Tim Pierce
09:42 pm Revision c7b7e4d4 (arvados): 2853: Remove shuffledServiceRoots() wrapper.
Tom Clegg
09:35 pm Story #4294 (Resolved): [Node Manager] Add support for min_nodes configuration value
Applied in changeset arvados|commit:e82cddfdbd763db27df889a6e316623df7b9c2a8. Tim Pierce
09:30 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
commit:7e8b0267 is good to merge, thanks. Brett Smith
09:08 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Brett Smith wrote:
> Sorry, unclear language on my part. Imagine a horribly buggy implementation that unconditional...
Tim Pierce
08:46 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Tim Pierce wrote:
> Brett Smith wrote:
> > Reviewing commit:3ee90fd
> >
> > * I know the story doesn't spec this...
Brett Smith
08:40 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Brett Smith wrote:
> Reviewing commit:3ee90fd
>
> * I know the story doesn't spec this, but it occurred to me rel...
Tim Pierce
03:13 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Reviewing commit:3ee90fd
* I know the story doesn't spec this, but it occurred to me relatively late: the daemon s...
Brett Smith
09:35 pm Bug #3857 (Resolved): [SDKs] Python KeepClient should use different timeouts for different operat...
Applied in changeset arvados|commit:ec75fda0fc2c86a77d831dcd7962ece7a2d6ae6d. Tim Pierce
09:14 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Reviewing commit:a98086e, and just one small technicality about the comments you added KeepClientRetryTestMixin. TES... Brett Smith
08:23 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> I'm confused -- I didn't reorder the import modules.
>
> (I'd like to adopt a convention of p...
Tim Pierce
08:19 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
All of these changes adopted at commit:6959469
Brett Smith wrote:
> Reviewing commit:1fa1006. I like this branch...
Tim Pierce
02:56 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Brett Smith wrote:
> * I feel like test_proxy_timeout better fits under KeepClientServiceTestCase than KeepClientRet...
Brett Smith
02:43 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Reviewing commit:1fa1006. I like this branch a lot. Thanks. This is all small potatoes stuff.
* The story says ...
Brett Smith
09:33 pm Task #4444 (Resolved): Review 3857-python-sdk-timeouts
Tim Pierce
02:06 pm Task #4444: Review 3857-python-sdk-timeouts
I understand from standup that Tom doesn't feel like he has to be the one to review this, so stealing it. Brett Smith
09:32 pm Task #4483 (Resolved): Review 4294-node-manager-min-nodes
Tim Pierce
02:58 pm Task #4483 (In Progress): Review 4294-node-manager-min-nodes
Brett Smith
09:32 pm Revision e82cddfd (arvados): Merge branch '4294-node-manager-min-nodes'
Fixes #4294. Tim Pierce
09:32 pm Task #4490 (Resolved): Replace shuffling in Python SDK
Tom Clegg
09:31 pm Task #4490 (Resolved): Replace shuffling in Python SDK
Tom Clegg
09:30 pm Revision e61de9ad (arvados): 2853: Add comment.
Tom Clegg
09:30 pm Revision ec75fda0 (arvados): Merge branch '3857-python-sdk-timeouts'
Fixes #3857. Tim Pierce
09:29 pm Revision d9d7af20 (arvados): 3857: fixed comment
Tim Pierce
09:20 pm Revision 1237511f (arvados): 2853: Use the same keep_service UUIDs so tests behave reliably.
Tom Clegg
09:05 pm Revision 7e8b0267 (arvados): 4294: additional unit tests
test_server_calc_returns_min_nodes_for_one_job
* Ensures that the @ServerCalculator@ still returns a wishlist with
_m...
Tim Pierce
08:41 pm Support #4348 (In Progress): [Support] fix bugs and write tests (second half)
Tim Pierce
08:41 pm Task #4352 (In Progress): fix bugs, write tests
Tim Pierce
08:39 pm Revision ca136c57 (arvados): 4294: code review feedback
* Added min_nodes to sample config files
* Renamed idle_nodes to needed_nodes
Tim Pierce
08:39 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
4027-api-sdk-version-wip is up for review. It implements the API server changes necessary to make it go. Once it's ... Brett Smith
08:37 pm Task #4489 (Resolved): Review 4027-api-sdk-version-wip
Brett Smith
08:37 pm Task #4208 (Resolved): jobs.create and jobs.update resolve runtime_constraints['arvados_sdk_versi...
Brett Smith
08:33 pm Revision db8f5472 (arvados): 4027: Add arvados_sdk_version runtime constraint to API server.
Crunch will use this information to provide a specific SDK version in
the runtime environment.
Brett Smith
08:23 pm Revision a98086e0 (arvados): 3857: fixed import order. d'oh
Tim Pierce
08:18 pm Revision 69594694 (arvados): 3857: code review feedback
* Set default timeouts to (20, 300) for proxies and (2, 300) for all
else.
* KeepService:
** Removed unused 'timeou...
Tim Pierce
08:17 pm Bug #4488 (Closed): [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
As it currently stands, if a KeepClient finds that any one of its back end is a proxy, it @KeepClient@ assumes that a... Tim Pierce
08:02 pm Revision fa3e996e (arvados): 2853: Update tests to survive ServiceRoots being a map[string]string.
Tom Clegg
07:49 pm Bug #4487 (Resolved): [Workbench] Users shouldn't have the option to "Remove selected" when they ...
!bug_remove_collections_in_shared.png!
Bryan Cosca
07:31 pm Revision 1304e044 (arvados): 2853: Add tests for reference set and some edge cases.
Tom Clegg
06:57 pm Revision 47b0cb35 (arvados): 2853: Add "reference set" test to check probe order agreement betwee...
Tom Clegg
05:51 pm Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
Thank you, Bryan. That will be useful I'm sure: for me it takes almost 20 seconds to load those jobs'n'pipes! Phil Hodgson
05:44 pm Revision e02ef893 (arvados): 2853: Fix instance ID in test fixture hostnames. Clean up brittle te...
Tom Clegg
05:24 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
bq. It's possible that wss://X works if you visit https://X first and force it to accept the certificate, though.
...
Phil Hodgson
05:11 pm Revision 9405b5f2 (arvados): 2853: Use rendezvous hashing to select probe order in Python library.
Tom Clegg
04:22 pm Feature #4486 (Resolved): [Documentation] document the arv cli tool
Ward Vandewege
03:17 pm Task #4485 (Resolved): Review 3382
Branch: 3382-always-show-inputs Phil Hodgson
03:17 pm Task #4484 (Resolved): Correct conditions for whether input parameters should be displayed
Phil Hodgson
02:32 pm Task #4484 (In Progress): Correct conditions for whether input parameters should be displayed
Phil Hodgson
02:32 pm Task #4484 (Resolved): Correct conditions for whether input parameters should be displayed
Phil Hodgson
03:16 pm Revision eee66a4f (arvados): 3382: always show input parameters, whether value is present or not
Phil Hodgson
02:03 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
Reviewing commit:d3cb946
The checkbox behavior is a little strange if there are two files in a collection.
# Th...
Peter Amstutz
01:47 pm Revision b7579d92 (arvados): 3603: Make CollectionWriter file flush test stricter.
Brett Smith
01:37 pm Revision 38ebd6d6 (arvados): 3603: Fixup last commit.
Brett Smith
10:14 am Revision a4b55a80 (arvados): 2853: Use rendezvous hashing to select probe order.
Tom Clegg
02:06 am Story #4035 (In Progress): [Sample pipelines] Proof-of-concept support for common-workflow-langua...
Peter Amstutz

11/10/2014

10:31 pm Story #4316: Review 3603-pysdk-file-api-wip
Peter Amstutz wrote:
> * As discussed briefly in IRC, consider having slightly different behavior for StreamFileRead...
Brett Smith
10:29 pm Revision 409a1a9c (arvados): 3603: Improve PySDK file API compatibility.
Per code review. Brett Smith
10:16 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
Radhika Chippada wrote:
> Review feedback:
>
> * If I had more than one collection starting with the same letter,...
Tom Clegg
04:11 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
Review feedback:
* If I had more than one collection starting with the same letter, for example if I were to add o...
Radhika Chippada
09:50 pm Revision 0198b493 (arvados): 4434: use select! instead of &= to preserve duplicates.
Tom Clegg
09:32 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Ready for review at commit:3ee90fd
Because of the way the job queue is implemented, the min_nodes constraint is en...
Tim Pierce
07:18 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
The tricky part with this feature is that it puts NodeManager in the position of needing to spin up new nodes without... Tim Pierce
09:29 pm Task #4354 (Resolved): decline node shutdown if it brings the number of nodes lower than min_nodes
Tim Pierce
09:29 pm Task #4355 (Resolved): min_nodes tests
Tim Pierce
09:29 pm Task #4353 (Resolved): spin up a new node if node list is less than min_nodes
Tim Pierce
09:29 pm Task #4483 (Resolved): Review 4294-node-manager-min-nodes
Tim Pierce
09:28 pm Revision 3ee90fd5 (arvados): 4294: added min_nodes config parameter
Added min_nodes configuration setting. The job queue will return a
wishlist with at least min_nodes elements in it, ...
Tim Pierce
08:55 pm Feature #4194: [Keep] consistent logging for keepstore requests
ResponseWriter doesn't let you read the response status code later, but you could wrap it with a LoggingResponseWrite... Tom Clegg
07:20 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
There wasn't a lot of love for my last suggestion. We have all this locking and state tracking code for a reason, to... Brett Smith
03:31 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
The fix for this is not simple.
Node allocation is handled by crunch-dispatch. It has all the logic to figure out...
Brett Smith
06:39 pm Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
This project is probably going to be the most help: qr1hi-j7d0g-6fum19pfbaxyy9x. Theres ~1000 jobs and pipelines in t... Bryan Cosca
06:21 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Phil Hodgson wrote:
> I am psyched to work on this, but my websockets server doesn't work in my dev environment. I'v...
Tom Clegg
06:18 pm Revision 89007272 (arvados): Expand websocket config comments. refs #4233
Tom Clegg
05:46 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
Phil Hodgson wrote:
> Or, in the case of required parameters, the @and not pvalue_spec[:value]@ clause could be remo...
Tom Clegg
04:32 pm Revision cac035d7 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
04:15 pm Revision 5cfa1aab (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
03:16 pm Revision 5add3acf (arvados): Explicitly list the URL that get.arvados.org redirects to, for those
folks who would like to read the install script before executing it.
No issue #
Ward Vandewege
03:07 pm Bug #4478 (Resolved): Keep write error
This was resolved late last week; we ran out of space. Ward Vandewege
03:03 pm Revision c0c04546 (arvados): Python run_test_server runs websockets separately non-SSL for compat...
with default application.yml.default. refs #4084 Peter Amstutz
02:41 pm Bug #4482 (Resolved): [Crunch] Diagnostics failure "user not found on host"
This diagnostics job failed over the weekend: qr1hi-d1hrv-zu37v9z50imo6a9.
Looks like a node that didn't come up ...
Peter Amstutz
01:56 pm Support #4347 (Resolved): [Support] fix bugs and write tests (first half)
Brett Smith
03:21 am Revision e7752fc7 (arvados-dev): (minor) README fixup
Sitaram Chamarty
03:19 am Revision e3f3c267 (arvados-dev): (minor) another test fixup
why was I doing this manually till now? Sitaram Chamarty
03:19 am Revision d73f5443 (arvados-dev): (minor) fixup due to some (fedora??) path change
Sitaram Chamarty
03:11 am Revision b5649570 (arvados-dev): v3.6.2
Sitaram Chamarty
01:49 am Revision 3bad56be (arvados-dev): disallow ../ everywhere
This should have been done as soon as I rolled in support for "ua"
(unrestricted arguments; see comments in src/comma...
Sitaram Chamarty

11/09/2014

04:44 pm Feature #4481 (Resolved): [Documentation] (recurring) Refresh user documentation
Go through the *user* documentation on doc.arvados.org, and make sure that it is up to date. If not, bring it up to d... Ward Vandewege
04:43 pm Task #4480 (Resolved): write blog post
Ward Vandewege
04:43 pm Feature #4479 (Resolved): [Documentation] (recurring) Write blog post *in first three days of spr...
Each blog post, when published, should also be e-mailed verbatim to the arvados user list. Ward Vandewege
11:24 am Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
I am psyched to work on this, but my websockets server doesn't work in my dev environment. I've tried a series of dif... Phil Hodgson
11:19 am Task #4407 (New): Provide a test helper that replays crunch job logs
Phil Hodgson
11:18 am Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
Please define this further... How many is many and how quick is quickly? When I try this with a whole bunch of compon... Phil Hodgson
11:18 am Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
It seems to come down to a very simple line of code that decides whether to show an input parameter or not. In @pipel... Phil Hodgson
07:02 am Revision 1577e06b (arvados-dev): VREF/NAME_NC -- like VREF/NAME but for "new commits" only
Sitaram Chamarty

11/08/2014

05:23 pm Bug #4478 (Resolved): Keep write error
from: qr1hi-d1hrv-ooaz68wsp1gm7wx#Log from job qr1hi-8i9sb-i4pplxizsmn0ign but I cannot see the log from that job (b... Bryan Cosca
05:20 pm Bug #4477 (Resolved): [Workbench] Log tab not available
I get a blank box with a reload tab. jobs/qr1hi-8i9sb-i4pplxizsmn0ign#Log Bryan Cosca
02:37 pm Bug #4476 (Resolved): [Workbench] Search dialog infinite scrolling issue: second page and onwards...
Radhika Chippada
02:34 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Tom, question about apps/workbench/app/views/pipeline_instances/index.html.erb :
Does the "compare" form defined ...
Radhika Chippada
04:12 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Tom, addressed all your feedback. Also, search works with scrolling now for this page. Thanks. Radhika Chippada
04:15 am Task #4466 (Resolved): Scrolling when search filter is used
Radhika Chippada
04:15 am Task #4463 (Resolved): Add search filter to pipeline_instances page
Radhika Chippada
04:14 am Task #4331 (Resolved): Add infinite scrolling to pipeline_instances page.
Radhika Chippada
04:00 am Bug #4474 (Resolved): [Node Manager] Node manager shut down node in middle of job
See the log for qr1hi-8i9sb-fqi09pwnf36x3qe.
This may be fixed once 4380 is merged.
Ward Vandewege
03:50 am Revision 61f8ceeb (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
03:49 am Revision 8e209b3c (arvados): 4024: simplify search box
Radhika Chippada
12:33 am Revision e993707e (arvados): 4024: rearrange partial handling
Radhika Chippada
12:14 am Revision 2d10f584 (arvados): 4024: scrolling + search works now that filters are included in next...
Radhika Chippada

11/07/2014

11:47 pm Bug #4471: [Crunch] srun: error: Application launch failed: Communication connection failure
also occurred here:
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-7xe4y6klftdf2gw#Log
Fri...
Nancy Ouyang
11:43 pm Bug #4471 (Resolved): [Crunch] srun: error: Application launch failed: Communication connection f...
$ arv run /bin/bash createtwofiles.sh
======
Upload local files: "createtwofiles.sh"
Uploaded to qr1hi-4zz18-ezu...
Nancy Ouyang
10:36 pm Revision 16527c12 (arvados): 4024: Test that items_available takes filters into account.
Tom Clegg
10:32 pm Revision cba83883 (arvados): 4024: comment out code that disables scrolling when search is used.
Radhika Chippada
10:31 pm Task #4386 (In Progress): Review branch: 4024-pipeline-instances-scroll
Tom Clegg
02:28 pm Task #4386 (New): Review branch: 4024-pipeline-instances-scroll
Radhika Chippada
10:31 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
At commit:7b4fc9f...
The data-infinite-scroller attribute should be a jQuery selector string resolving to the elem...
Tom Clegg
02:30 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Discussed this feature with Tom some more. We agreed that instead of adding infinite scrolling to the dashboard panel... Radhika Chippada
10:08 pm Revision 4ec7d62e (arvados): Tweak uuid of test fixture so it doesn't match other tests unintenti...
Peter Amstutz
09:54 pm Bug #4470 (Resolved): [Crunch] tmpdir not writable running jobs in Docker
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-e3jx9on6hkp9c8o#Components
$ arv run --local...
Nancy Ouyang
09:12 pm Task #4445 (In Progress): Review branch: 3177-collection-choose-files
Peter Amstutz
09:01 pm Revision 0db5d13d (arvados): PySDK CollectionReader can get empty collection.
Fixing a regression from refs #3706. Brett Smith
08:56 pm Bug #4468 (Closed): Fiddlesticks when creating new collection from selected collections
174 collections in a project: https://workbench.qr1hi.arvadosapi.com/projects/qr1hi-j7d0g-u69wosye1ycpjmk
https://...
Nancy Ouyang
08:55 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
4434-collation at commit:fbd2326 Tom Clegg
08:55 pm Task #4435 (In Progress): Review 4434-collation
Tom Clegg
08:55 pm Revision fbd23268 (arvados): 4434: Assume only that if a<b are lowercase ascii, aX<bY for any X, ...
Tom Clegg
08:55 pm Bug #4084 (Resolved): [Workbench] Pipeline instance Log pane should not get refreshed (it already...
Applied in changeset arvados|commit:370df5a95b6b143885fa4d96be90c51f25f8ad14. Anonymous
08:18 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
At commit:a7256de... too bad about the copy & paste, but w/e. Let's merge this Tom Clegg
08:50 pm Revision 370df5a9 (arvados): Merge branch '4084-log-pane-refresh' closes #4084
Peter Amstutz
08:48 pm Revision 0f9bca45 (arvados): 3400: ArvadosResourceList retains api token that is active when it i...
Tweaked fetch-multiple-pages loop. Made #each_page protected. _paging sets
fetch_multiple_pages(false).
Peter Amstutz
08:42 pm Feature #4467: [Workbench] Add "select all" button to project content panes
for example, what if we want to merge x collections within a project. If regex search functionality also worked, that... Bryan Cosca
08:36 pm Feature #4467 (Resolved): [Workbench] Add "select all" button to project content panes
("If we can do it inside of a data collection, can we do it inside of a project?") Bryan Cosca
08:42 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
commit:1fa1006 adds a _proxy_timeout_ configuration setting. The default _timeout_ value is now (3, 30) and the defa... Tim Pierce
03:53 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> This certainly should be testable, and some clever use of mocks should allow us to test the time...
Brett Smith
03:37 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
On the other hand, the more I think about it, the more it seems like the test we're talking about is just that @reque... Tim Pierce
02:48 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
This certainly should be testable, and some clever use of mocks should allow us to test the timeouts without actually... Tim Pierce
06:26 am Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
I can't say I've given this a _thorough_ look but I've noticed a couple of things:
I think it would be valuable to...
Tom Clegg
08:41 pm Revision 3bbb9887 (arvados): 4434: Merge branch 'master' into 4434-collation
Tom Clegg
08:38 pm Revision 1fa1006e (arvados): 3857: implement proxy_timeout
Add proxy_timeout argument to KeepClient.
Default timeouts are:
* timeout = (3, 30)
* proxy_timeout = (20, 60)
Adde...
Tim Pierce
08:36 pm Task #4466: Scrolling when search filter is used
Make it to display only matching rows when scrolled. Radhika Chippada
08:27 pm Task #4466 (Resolved): Scrolling when search filter is used
Radhika Chippada
08:27 pm Story #4442: [API] [Workbench] Site-wide regex searching
Currently the search box is a "LIKE" query, so foo%baz will find foobarbaz site-wide.
It seems like it would be ea...
Tom Clegg
08:25 pm Revision 7b4fc9f1 (arvados): 4024: disable scrolling when search filter is used; otherwise, non-m...
Radhika Chippada
08:18 pm Task #4290 (Resolved): Review 4084-log-pane-refresh
Tom Clegg
02:48 pm Task #4290 (In Progress): Review 4084-log-pane-refresh
Peter Amstutz
08:06 pm Bug #3698 (New): [Crunch] Pipeline runner should detect when "output_of" refers to a non-existent...
This needs another look. This logic should've detected qr1hi-d1hrv-i1d1jffl9nd5ylv, but apparently didn't—right now ... Brett Smith
07:43 pm Story #2990 (Resolved): Make lobstr pipeline template
Peter Amstutz
07:04 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Tom Clegg wrote:
> Reviewing commit:2361a1b
>
> Instead of @assert a < 201@, say @assert_operator a, :<, 201@ -- ...
Peter Amstutz
05:44 am Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Reviewing commit:2361a1b
Instead of @assert a < 201@, say @assert_operator a, :<, 201@ -- that way, when the asser...
Tom Clegg
07:01 pm Feature #4465 (Resolved): [Workbench] Link "apiserver version" to a redmine or github revision hi...
Link "Workbench version" to:... Tom Clegg
06:51 pm Revision 9547602d (arvados): 4024: trailing white space
Radhika Chippada
06:50 pm Revision 911c97b0 (arvados): 4024: a few more test cases for search filter in pipeline instances ...
Radhika Chippada
06:43 pm Bug #4464 (Resolved): [Workbench] Collections tab loads forever on a specific project
Namely, qr1hi-j7d0g-bfrqj767vpdk3dh Brett Smith
06:40 pm Bug #4402 (Closed): [SDKs] CollectionWriter.write_directory_tree(...,max_manifest_depth=0) should...
Tom filed this bug while working on #3706. Further testing revealed that there was never a bug to begin with, so thi... Brett Smith
04:47 pm Revision 7c76d921 (arvados): 4024: add tests for search filter in pipelin_instances page.
Radhika Chippada
04:39 pm Task #4463 (Resolved): Add search filter to pipeline_instances page
Radhika Chippada
04:26 pm Revision f628e383 (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
04:25 pm Revision 7d197c6f (arvados): 4024: add search filter to pipeline instances page.
Radhika Chippada
03:22 pm Revision a7256deb (arvados): 4084: Add 'arv-log-refresh-control' div to job log pane. Log scroll...
Peter Amstutz
03:12 pm Revision 008cec91 (arvados): 4024: add integration tests for pipeline_instances page infinite scr...
Radhika Chippada
02:48 pm Task #4428 (Resolved): Review 4084-log-pane-refresh-TC
Peter Amstutz
02:48 pm Task #4373 (In Progress): Diagnose and fix
Peter Amstutz
02:46 pm Bug #4451: [Workbench] Fiddlesticks when rerunning pipeline with edited template
Workbench may not be able to run the pipeline in these cases, but it should say that explicitly rather than crashing. Brett Smith
02:43 pm Bug #4461 (Resolved): [OPS] Replace dnsmasq with unbound
Ward Vandewege
02:41 pm Bug #4460 (New): [Workbench] Sortable column headings (filename, size) in collections#show
Now that the Python SDK doesn't normalize manifests by default (#3706), viewing the output of Crunch scripts in Workb... Brett Smith
02:30 pm Task #4450 (Resolved): Review 4334-idle-star-is-down
Peter Amstutz
02:30 pm Task #4459 (Resolved): Review 4310-lock-before-fail
Peter Amstutz
02:19 pm Task #4459 (In Progress): Review 4310-lock-before-fail
Tom Clegg
01:54 pm Task #4459 (Resolved): Review 4310-lock-before-fail
Peter Amstutz
02:30 pm Bug #4334 (Resolved): [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* SLU...
Applied in changeset arvados|commit:1bb7352bf1425dc9acf028f863eaff1e5c207571. Anonymous
02:30 pm Bug #4310 (Resolved): [Crunch] crunch-dispatch --jobs locking is broken
Applied in changeset arvados|commit:04c1723357282d0ef2890e570cfab84d35b99da4. Anonymous
02:19 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
At commit:3e1ef3e
LGTM, except that it'll never work until you call it @ArvadosModel::AlreadyLockedError@. :)
Tom Clegg
02:28 pm Revision 1bb7352b (arvados): Merge branch '4334-idle-star-is-down' closes #4334
Peter Amstutz
02:28 pm Revision 04c17233 (arvados): Merge branch '4310-lock-before-fail' closes #4310 (again)
Peter Amstutz
02:23 pm Bug #4410 (In Progress): [Crunch] crunch-job should exit tempfail when a SLURM node fails
Brett Smith
02:22 pm Revision b5ed27eb (arvados): 4310: Qualify namespace of AlreadyLockedError
Peter Amstutz
02:06 pm Revision b917e8a2 (arvados): 4024: add infinite scrolling to pipeline_instances page.
Radhika Chippada
01:53 pm Revision 3e1ef3eb (arvados): 4310: Lock job before changing its state to failed.
Peter Amstutz
06:02 am Task #4444 (In Progress): Review 3857-python-sdk-timeouts
Tom Clegg
03:52 am Revision bf63e93a (arvados): 3400: test limit between server maxpagesize and 2x server maxpagesize.
Tom Clegg
03:28 am Revision 83369774 (arvados): 3400: Remove ArvadosResourceList#all
Tom Clegg
02:31 am Bug #4458 (Resolved): [Workbench] Replace e-mail address in menu bar with user icon and make sure...
not a huge deal, but happens whenever I split my laptop screen (1600x900) in half vertically and was a little disconc... Nancy Ouyang
02:25 am Bug #4452: [Workbench] Report a Problem" menu item does not like being opened in a new tab/window.
I like a new tab a lot better, because I can't accidentally hit escape and lose everything I wrote in the bug report.... Nancy Ouyang
01:59 am Revision d3cb9460 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada

11/06/2014

11:01 pm Task #4441 (In Progress): Review 3400-workbench-all-items
Tom Clegg
10:23 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
It seems it's not quite that easy to make the Rails application agree that @"abc" <= "BCD"@ in the same cases where t... Tom Clegg
10:21 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
I spent some time looking at the recent jobs on qr1hi to see if I could piece together a cause. Nothing definitive y... Brett Smith
03:16 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
Here is a job that crashed because of compute3:
qr1hi-8i9sb-v6drlfmnikkkatu
Bryan Cosca
10:13 pm Bug #4310 (In Progress): [Crunch] crunch-dispatch --jobs locking is broken
commit:f3b3935 fixes a bug but it doesn't explain/address the problem at hand, i.e., "state invalid change from Faile... Tom Clegg
06:20 pm Bug #4310 (Resolved): [Crunch] crunch-dispatch --jobs locking is broken
Applied in changeset arvados|commit:a324727d478feb278ab35300c5b96e2349e23f3d. Anonymous
06:16 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
LGTM @ commit:f3b3935, thanks! Tom Clegg
06:11 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
Tom Clegg wrote:
> At commit:7d6454e
>
> Now that it's normal (during a race) for the "git tag" command to fail, ...
Peter Amstutz
05:53 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
At commit:7d6454e
Now that it's normal (during a race) for the "git tag" command to fail, but "git rev-list" failu...
Tom Clegg
04:43 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
The bug is not in the actual locking code, the bug is in crunch-dispatch's handling of setting the git tags for locki... Peter Amstutz
04:24 pm Bug #4310 (In Progress): [Crunch] crunch-dispatch --jobs locking is broken
Peter Amstutz
10:12 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
Some additional sluthing shows that qr1hi-8i9sb-vt7mb676a4htd6k changed from "Running" to "Failed" at 2014-10-24T19:5... Peter Amstutz
09:59 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
4314-crunch-token-expire looks good to merge, but it doesn't explain the failures reported here, does it? Tom Clegg
09:52 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
The timing here makes the #4310 explanation less than 100% convincing. What would make crunch-dispatch take any inter... Tom Clegg
06:31 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
There's two different errors here.
* qr1hi-8i9sb-vt7mb676a4htd6k dies because of "Job state unexpectedly changed t...
Peter Amstutz
10:02 pm Revision a0ff0429 (arvados): Merge branch '4314-crunch-token-expire' refs #4314 refs #4310
Peter Amstutz
10:00 pm Task #4457 (Resolved): Review 4314-crunch-token-expire
Tom Clegg
09:54 pm Task #4457 (Resolved): Review 4314-crunch-token-expire
Peter Amstutz
09:51 pm Revision b19b2bc9 (arvados): 4314: Don't expire the token if the job is still in queued state.
Peter Amstutz
09:43 pm Feature #4456: [Workbench] Provide more feedback about when a queued job is likely to start.
Well, just pulling out to the Workbench homepage "there are N jobs ahead" would be a great start, I didn't think to l... Nancy Ouyang
09:30 pm Feature #4456 (New): [Workbench] Provide more feedback about when a queued job is likely to start.
From discussion in IRC, users often feel like the time their jobs start is effectively random. It would help to prov... Brett Smith
09:18 pm Biting Off More Than You Can Chew
!>oops_key.jpg!
Recently, a scientist in Denmark reported an "interesting issue":http://lists.gnu.org/archive/html/c...
Tim Pierce
09:05 pm Support #4013 (Closed): [SDKs] Pipeline instance logging emits misleading warning: API server did...
lgtm Sarah Guthrie
08:55 pm Bug #4408 (Resolved): [Workbench] Anonymous collection download links should not redirect to logi...
Applied in changeset arvados|commit:1d3987356d0ab60c4f6c80cbd11852b4209137f4. Brett Smith
08:33 pm Bug #4408: [Workbench] Anonymous collection download links should not redirect to login path.
LGTM Radhika Chippada
08:49 pm Revision 1d398735 (arvados): Merge branch '4408-collection-sharing-login-fix-wip'
Closes #4408. Brett Smith
08:32 pm Task #4448 (Resolved): Review 4408-collection-sharing-login-fix-wip
Radhika Chippada
08:32 pm Task #4448 (In Progress): Review 4408-collection-sharing-login-fix-wip
Radhika Chippada
05:00 pm Task #4448 (Resolved): Review 4408-collection-sharing-login-fix-wip
Brett Smith
08:31 pm Revision c53b0474 (arvados): 4408: Workbench Collection sharing allows file downloads again.
Earlier we refactored our API token loading code to load User.current
to check that it was valid. This approach does...
Brett Smith
07:48 pm Task #4353 (In Progress): spin up a new node if node list is less than min_nodes
Tim Pierce
07:48 pm Story #4294 (In Progress): [Node Manager] Add support for min_nodes configuration value
Tim Pierce
07:40 pm Feature #4088 (Resolved): [Workbench] On collections#show page, filter displayed files by filenam...
Applied in changeset arvados|commit:308a6da1a9fd716f3957b116110a932c08aefafe. Tim Pierce
06:29 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Tim Pierce wrote:
> The styling is definitely kind of weird here -- I think it's a consequence of having three butto...
Brett Smith
04:04 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Brett Smith wrote:
> Reviewing commit:50efff3
>
> * It looks like the Selection pulldown, Select all button, and ...
Tim Pierce
07:39 pm Bug #4452 (New): [Workbench] Report a Problem" menu item does not like being opened in a new tab/...
Oh... fiddlesticks.
Sorry, I had some trouble handling your request.
Missing template actions/report_issue_...
Ward Vandewege
07:37 pm Task #4384 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
07:31 pm Bug #4451: [Workbench] Fiddlesticks when rerunning pipeline with edited template
Also happens if you click "re-run options" and "run now".
But probably the root issue is I updated the pipeline tem...
Nancy Ouyang
07:25 pm Bug #4451 (Closed): [Workbench] Fiddlesticks when rerunning pipeline with edited template
Well, I paused a pipeline instance, then cancelled both running jobs while they were still queued, made some changes ... Nancy Ouyang
07:23 pm Task #4376 (Resolved): Diagnose and fix
Peter Amstutz
07:06 pm Task #4376 (In Progress): Diagnose and fix
Peter Amstutz
07:23 pm Task #4450 (Resolved): Review 4334-idle-star-is-down
Peter Amstutz
07:22 pm Revision 02351700 (arvados): 4334: Convert "idle*" state to "down"
Peter Amstutz
07:14 pm Revision 308a6da1 (arvados): Merge branch '4088-collection-show-files-filter'
Fixes #4088. Tim Pierce
07:06 pm Bug #4334 (In Progress): [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* ...
Peter Amstutz
06:56 pm Revision 00767fe5 (arvados): Go to next job after fail_job when there is a tag mismatch. refs #4310
Peter Amstutz
06:26 pm Task #4447 (Resolved): Review 4310-git-tag-race
Peter Amstutz
05:24 pm Task #4447 (In Progress): Review 4310-git-tag-race
Tom Clegg
04:44 pm Task #4447 (Resolved): Review 4310-git-tag-race
Peter Amstutz
06:23 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
@views/pipeline_instances/_show_log.html.erb@ also needs to be updated, it (ironically) has the same bug that the sto... Peter Amstutz
04:18 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> ...start_with?('Running')...
Ah, good catch. Fixed in commit:270b1fc
Tom Clegg
04:10 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Comments on commit:52083e6 4084-log-pane-refresh-TC
>
> * @views/jobs/_show_status.html.er...
Tom Clegg
03:18 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Also:
@views/pipeline_instances/_show_components.html.erb@...
Peter Amstutz
06:18 pm Revision a324727d (arvados): Merge branch '4310-git-tag-race' closes #4310
Peter Amstutz
06:11 pm Revision f3b39353 (arvados): 4310: Remove stderr redirect from git rev-list, add it to git tag. ...
output with "dispatch: ". Tweak error message if rev-list fails. Peter Amstutz
06:05 pm Feature #4383 (Resolved): [Docker] upload all docker containers to docker repository, and then ad...
Applied in changeset arvados|commit:5acdc268c662f452de81d2d00766a879c73f8c08. Ward Vandewege
05:20 pm Feature #4383: [Docker] upload all docker containers to docker repository, and then add a script ...
At commit:7ff4966
LGTM.
This shouldn't hold up the merge, but one more thing worth noting in the docs: The "qui...
Tom Clegg
04:31 pm Feature #4383: [Docker] upload all docker containers to docker repository, and then add a script ...
Thanks for the review - I've added the extra tests (that thought had crossed my mind, too). I've also stopped arvdock... Ward Vandewege
06:00 pm Revision 70f3e36e (arvados): Merge branch '4383-easy-install'
refs #4383 Ward Vandewege
06:00 pm Revision 0f3d2c5a (arvados): Merge branch 'master' into 4383-easy-install
refs #4383 Ward Vandewege
05:59 pm Revision 5acdc268 (arvados): Another documentation tweak based on review feedback.
closes #4383 Ward Vandewege
05:10 pm Revision 1491cdd6 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
05:05 pm Revision 29e012f7 (arvados): 3177: String != 'String'
Radhika Chippada
04:59 pm Revision 7ba3707a (arvados): 4408: Workbench Collection sharing allows file downloads again.
Earlier we refactored our API token loading code to load User.current
to check that it was valid. This approach does...
Brett Smith
04:44 pm Task #4374 (Resolved): Diagnose and fix
Peter Amstutz
04:44 pm Task #4374 (In Progress): Diagnose and fix
Peter Amstutz
04:37 pm Revision 7d6454e0 (arvados): 4310: Fix race condition between testing for tag and setting tag by ...
order of operations: try to set the tag, and only test for it if there is an
error.
Peter Amstutz
04:35 pm Bug #4389 (Resolved): [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Applied in changeset arvados|commit:72cf9a5814e52adb2b6c2f349cbef3de069722bb. Anonymous
04:09 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg wrote:
> Added test in commit:ed7369d
LGTM. Thanks very much.
Tim Pierce
04:33 pm Revision 72cf9a58 (arvados): Merge branch '4389-breadcrumbs-infinite-loop' closes #4389
Tom Clegg
04:30 pm Revision 7ff49661 (arvados): Install instructions: be a bit more explicit that arvdock is downloaded
and saved in the current working directory.
refs #4383
Ward Vandewege
04:12 pm Revision 270b1fc3 (arvados): 4084: Fix wrong state name: jobs are Running, pipelines are RunningO...
Tom Clegg
04:09 pm Task #4390 (Resolved): Review 4389-breadcrumbs-infinite-loop
Tim Pierce
04:09 pm Revision 3db43f17 (arvados): Merge branch 'master' into 4383-easy-install
refs #4383 Ward Vandewege
04:04 pm Revision 2c2212b5 (arvados): Only try to install .config/arvados/settings.conf if we have a token to
put in there.
refs #4383
Ward Vandewege
04:02 pm Revision 5b5c9a43 (arvados): 4088: code review feedback
* Modified styling for "Select all" and "Unselect all"
* "filename filter" -> "filename regex"
* Changed refutations ...
Tim Pierce
03:55 pm Revision 60c177af (arvados): 4389: Merge branch 'master' into 4389-breadcrumbs-infinite-loop
Tom Clegg
03:54 pm Feature #4446 (New): [Workbench] Provide feedback on dashboard to indicate that NodeManager is bo...
Peter Amstutz
03:53 pm Revision f9a218aa (arvados): 4084: Update views that were still using pane-anchor.
Tom Clegg
03:42 pm Revision a5b4a7e8 (arvados): 3177: try to partition input selection only if it is a string
Radhika Chippada
03:26 pm Revision bbfe0f05 (arvados): add 'arv-run' to setup.py refs #3609
Peter Amstutz
03:25 pm Revision abc28ee2 (arvados): Add more tests so that we cover all possible combinations of the
auto_admin_first_user and auto_admin_user configuration settings.
refs #4383
Ward Vandewege
03:23 pm Revision d20968af (arvados): Update the behavior of the auto_admin_user configuration field a bit to
make it more intuitive: the first user created with an e-mail address
that matches auto_admin_user will now become ad...
Ward Vandewege
03:17 pm Bug #4409: [Workbench] Want to remove projects from Home
From discussion with Tom:
* We should actually delete empty projects.
* Ideally, we don't render the delete butto...
Brett Smith
02:58 pm Story #3177 (In Progress): [Workbench] File chooser dialog (replace remaining use of clippy)
Radhika Chippada
02:54 pm Revision 723afcb8 (arvados): 3177: trailing white space
Radhika Chippada
02:54 pm Task #4445 (Resolved): Review branch: 3177-collection-choose-files
Radhika Chippada
02:53 pm Story #4316: Review 3603-pysdk-file-api-wip
* As discussed briefly in IRC, consider having slightly different behavior for StreamFileReader() based on how it is ... Peter Amstutz
02:49 pm Revision cffe9566 (arvados): 3177: add tests for a template that uses dataclass = File
Radhika Chippada
01:01 pm Revision 88d79325 (arvados): 3177: store input pdh value even when input dataclass is File. Updat...
Radhika Chippada
04:33 am Revision 1c0e350a (arvados): 3177: restrict only one file selection in collection chooser; remove...
Radhika Chippada
03:57 am Revision 81bfa2fd (arvados): 3177: propagate checkbox selection param when dataclass is File.
Radhika Chippada

11/05/2014

11:13 pm Task #4444 (Resolved): Review 3857-python-sdk-timeouts
Available for review at commit:3993ba4
Some notes:
* This change replaces httplib2 with the requests module in ...
Tim Pierce
11:13 pm Task #3916 (Resolved): Testing
Tim Pierce
11:12 pm Task #3915 (Resolved): Implement timeout configuration settings
Tim Pierce
11:12 pm Revision 3993ba46 (arvados): 3857: replaced httplib2 with 'requests'
Replaced httplib2 with the 'requests' library in modules that use it to
call Keep:
* arvados.collection
* arvados.kee...
Tim Pierce
11:07 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
Mmm, the link I provided in the bug is definitely prettier, but doesn't seem to actually be comparing... Can Bryan te... Jonathan Sheffi
08:31 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
Jonathan,
The fix for #4088 is deployed, which I hope will resolve your issues. Can you please compare a couple o...
Brett Smith
10:55 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Added test in commit:ed7369d Tom Clegg
07:29 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
OK, this makes sense. Is there an easy way we could construct a test for this? Could we add test fixtures for a circ... Tim Pierce
10:48 pm Revision ed7369d4 (arvados): 4389: Add test.
Tom Clegg
09:48 pm Story #4443 (Closed): [DRAFT] [Workbench] Tour Guide Dax follows you around for a while, showing ...
Tom Clegg
09:48 pm Story #4442 (Resolved): [API] [Workbench] Site-wide regex searching
Why stop at collections when we can search the entire curoverse using regex? Bryan Cosca
09:33 pm Bug #4408 (In Progress): [Workbench] Anonymous collection download links should not redirect to l...
Brett Smith
09:28 pm Bug #3400 (In Progress): [Workbench] Rails client library should offer an "all pages" mode for qu...
Peter Amstutz
09:27 pm Task #4441 (Resolved): Review 3400-workbench-all-items
Peter Amstutz
09:27 pm Task #4417 (Resolved): ArvadosResourceList returns exactly @limit items unless there are fewer th...
Peter Amstutz
02:45 am Task #4417 (Resolved): ArvadosResourceList returns exactly @limit items unless there are fewer th...
Peter Amstutz
09:27 pm Task #4418 (Resolved): Write tests
Peter Amstutz
02:52 am Task #4418 (Resolved): Write tests
Peter Amstutz
09:27 pm Task #4381 (Resolved): ArvadosResourceList returns all items unless @limit is non-nil
Peter Amstutz
09:26 pm Revision 2361a1b4 (arvados): 3400: Too much code that assumes it can call .first over and over wi...
incurring an API call each time (silly). Peter Amstutz
09:20 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Reviewing commit:50efff3
* It looks like the Selection pulldown, Select all button, and Deselect all button are su...
Brett Smith
08:57 pm Revision 47530892 (arvados): 3400: ArvadosResourceList returns all items (paging as necessary) un...
* ArvadosResourceList#each returns results incrementally. ArvadosResourceList#all (or ArvadosResourceList#results) p... Peter Amstutz
08:50 pm Story #3609 (Resolved): [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Applied in changeset arvados|commit:788ecdf8085f5e69cd3dc960f510b49f11432cb3. Anonymous
06:58 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
This LGTM enough to merge, thanks. The documentation makes me more confident that a new and unfamiliar user (i.e. me... Tim Pierce
02:33 am Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Tim Pierce wrote:
> Comments at commit:51de3bf2
>
> @doc/user/topics/run-command.html.textile.liquid@
> * The do...
Peter Amstutz
08:46 pm Revision 6ac59725 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
08:44 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Review feedback: Given the size of the update for 4084, I limited my review to learn about this feature update and un... Radhika Chippada
08:21 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Comments on commit:52083e6 4084-log-pane-refresh-TC
* @views/jobs/_show_status.html.erb@ and @views/pipeline_insta...
Peter Amstutz
02:13 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
4084-log-pane-refresh-TC @ commit:52083e6
* All state goes on $pane. Reload events are sent to $pane. (The only time...
Tom Clegg
08:44 pm Revision 788ecdf8 (arvados): Merge branch 'origin-3609-arv-run' into master closes #3609
Conflicts:
sdk/cli/bin/arv
Peter Amstutz
08:40 pm Task #4428 (In Progress): Review 4084-log-pane-refresh-TC
Peter Amstutz
02:14 pm Task #4428 (Resolved): Review 4084-log-pane-refresh-TC
Tom Clegg
08:34 pm Support #4013: [SDKs] Pipeline instance logging emits misleading warning: API server did not retu...
Sally,
We've fixed this issue in the Python SDK. If you upgrade the SDK in your Docker images, and make sure it's...
Brett Smith
08:12 pm Feature #4383: [Docker] upload all docker containers to docker repository, and then add a script ...
At commit:611a332...
A more complete set of tests could be worthwhile to verify the interaction between the two au...
Tom Clegg
07:49 pm Story #2992: [Workbench] Support "display_order" (integer) key for pipeline template components. ...
I'm not sure lexical ordering is what our users want. Pipeline templates often have their components ordered by the ... Brett Smith
07:44 pm Bug #4432 (Closed): [SDKs] When copying pipeline instances using arv-copy, the component jobs get...
Brett Smith
07:44 pm Bug #4432 (Resolved): [SDKs] When copying pipeline instances using arv-copy, the component jobs g...
Bryan,
Turns out we already had an issue for this. Please watch #2992 if you're interested in following the devel...
Brett Smith
06:21 pm Bug #4432: [SDKs] When copying pipeline instances using arv-copy, the component jobs get re-arranged
This happens because Ruby hashes retain the order of keys, but Python dictionaries do not. As long as the pipeline i... Brett Smith
04:36 pm Bug #4432 (Closed): [SDKs] When copying pipeline instances using arv-copy, the component jobs get...
for example: qr1hi-d1hrv-k46opnhr3hovt7g, i expected BWA first and Haplotype caller last. Bryan Cosca
07:35 pm Task #4430 (In Progress): review 4383-easy-install
Tom Clegg
03:22 pm Task #4430 (Resolved): review 4383-easy-install
Ward Vandewege
07:35 pm Bug #4440 (Closed): [Documentation] "Writing a Crunch script" is mysterious
IN [[http://doc.arvados.org/user/tutorials/tutorial-firstscript.html]]
Everything after
"Next, create a submission ...
Nancy Ouyang
07:35 pm Bug #4185 (Resolved): [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Tom Clegg
07:34 pm Task #4372 (Resolved): Find out whether current stats make sense to users
Tom Clegg
07:30 pm Task #4370 (Resolved): Review 4357-node-manager-busy-nodes-wip
Applied in changeset arvados|commit:8ad92bb9e7950e0bf758716b40764d26ee33802c. Brett Smith
07:30 pm Bug #4357 (Resolved): [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes ar...
Applied in changeset arvados|commit:8ad92bb9e7950e0bf758716b40764d26ee33802c. Brett Smith
04:47 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Yup, this is easier to follow. LGTM. Tom Clegg
07:29 pm Revision 8ad92bb9 (arvados): Merge branch '4357-node-manager-busy-nodes-wip'
Closes #4357, #4370. Brett Smith
07:27 pm Revision 2c693ee5 (arvados): 4357: Node Manager boots new nodes when up nodes are busy.
The key part of this commit is the change to _nodes_wanted.
Everything else provides the information to make that cal...
Brett Smith
07:23 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
At commit:50517f3...
Rather than adding a new route we could use the @/?tab_pane=finished_pipelines (and name the ...
Tom Clegg
06:58 pm Task #4241 (Resolved): Review 3609-arv-run
Tim Pierce
06:57 pm Revision 974ad63f (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
06:57 pm Revision 87567c94 (arvados): 3177: look for checked persistent selections on submit.
Radhika Chippada
06:49 pm Task #4386 (In Progress): Review branch: 4024-pipeline-instances-scroll
Tom Clegg
06:34 pm Story #4439 (New): [SDKs] Ensure each SDK and clients use a single codebase parse keep locators, ...
Peter Amstutz
06:33 pm Bug #4438 (New): [DRAFT] [SDKs] arv-keepdocker should be smarter about caching the image to upload
As of this writing, when arv-keepdocker uploads an image to Keep, it saves the image to disk first, under @~/.cache/a... Brett Smith
05:31 pm Bug #4409: [Workbench] Want to remove projects from Home
Ah, I just wanted the Projects to go away completely so they dont clutter. I'll use the workaround, thanks! Bryan Cosca
03:43 pm Bug #4409: [Workbench] Want to remove projects from Home
Bryan,
Remember that Arvados generally wants to keep data _somewhere_, for reproducibility. Normally, when you de...
Brett Smith
05:22 pm Revision e34d6859 (arvados): 4389: Merge branch 'master' into 4389-breadcrumbs-infinite-loop
Tom Clegg
05:19 pm Task #4435 (Resolved): Review 4434-collation
Tom Clegg
05:17 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
4434-collation @ commit:c1f7fd8
Also consolidated the two nearly-identical tests into a loop.
Tom Clegg
05:00 pm Bug #4434 (In Progress): [API] Test suite should not depend on a particular database collation co...
Tom Clegg
05:00 pm Bug #4434 (Resolved): [API] Test suite should not depend on a particular database collation config.
Tom Clegg
05:15 pm Revision c1f7fd8a (arvados): 4434: Test whether sort order matches application locale, instead of...
Tom Clegg
04:35 pm Task #4385 (Resolved): Review 4303-crunch-retry-logging-wip
Applied in changeset arvados|commit:f91dff0f2f49a83047e31b1a56dbddd85be6926a. Brett Smith
04:35 pm Bug #4303 (Resolved): [Crunch] Output of job gets stuck at collate step
Applied in changeset arvados|commit:f91dff0f2f49a83047e31b1a56dbddd85be6926a. Brett Smith
04:20 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
@$retry_msg@ should be @$next_retry_at@ here:... Peter Amstutz
02:52 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
commit:d5e7371a strips out the Perl line information, adds retry time information, and normalizes the whitespace. Re... Brett Smith
04:32 pm Revision f91dff0f (arvados): Merge branch '4303-crunch-retry-logging-wip'
Closes #4303, #4385. Brett Smith
04:31 pm Revision 16327d17 (arvados): 4303: crunch-job logs when it retries API calls.
Brett Smith
04:27 pm Revision bac6a080 (arvados): Fix `arv keep copy` → `arv copy` wrapper.
No issue #. Brett Smith
04:22 pm Bug #4431 (New): [SDKs] arv-copy should not require --dst-git-repo when copying on the same cluster
... Bryan Cosca
04:03 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> Alternatively, Brett points out that the Python "requests":http://docs.python-requests.org/en/la...
Tim Pierce
03:59 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> Alternatively, Brett points out that the Python "requests":http://docs.python-requests.org/en/la...
Brett Smith
03:57 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Alternatively, Brett points out that the Python "requests":http://docs.python-requests.org/en/latest/ module might be... Tim Pierce
03:55 pm Task #4384 (In Progress): Review 4088-collection-show-files-filter
Brett Smith
03:22 pm Task #4405 (Resolved): add a feature to auto-admin the first user who signs in for a new installa...
Ward Vandewege
03:21 pm Revision 611a3323 (arvados): Merge branch 'master' into 4383-easy-install
Conflicts:
docker/api/application.yml.in
refs #4383
Ward Vandewege
03:18 pm Revision 18e63e25 (arvados): Add unit tests for new auto_admin_first_user configuration setting.
refs #4383 Ward Vandewege
03:06 pm Bug #4406 (Resolved): [Docker] Default arvdock doesn't start sso server container, but also assum...
This was already fixed in commits commit:a6606b79fb6496e43eef6b2e8b04d5c1061f5635 and commit:3978e8ae9c1b5bbc07c63fd0... Ward Vandewege
02:49 pm Revision d5e7371a (arvados): 4303: Improve error message display per code review.
Brett Smith
02:48 pm Revision 50517f39 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
02:27 pm Task #4429 (Resolved): Document authentication dance between Workbench, API, SSO and external ide...
Peter Amstutz
02:15 pm Task #4367 (Resolved): Review 3706-keep-warning
Tom Clegg
02:14 pm Task #4290 (Resolved): Review 4084-log-pane-refresh
Tom Clegg
02:14 pm Task #4413 (Resolved): Compress tab panes back to a single level
Tom Clegg
02:03 pm Revision 39af5239 (arvados): 4357: Restore "no state == no states match" behavior.
Brett Smith
02:02 pm Bug #4427 (New): [Workbench] Each active job/pipeline on the dashboard should show how many worke...
"Local jobs" will be easy to spot: they will have no worker nodes are allocated.
This answers the question "are th...
Ward Vandewege
01:53 pm Bug #4426 (Resolved): [Documentation] Support searching documentation
Brett Smith
08:52 am Revision 52083e6a (arvados): 4084: Add comment.
Tom Clegg
08:17 am Revision 84cfa525 (arvados): 4084: Fix dashboard refresh.
Tom Clegg
08:17 am Revision 1c410099 (arvados): 4084: Update comments.
Tom Clegg
08:17 am Revision 3981c82b (arvados): 4084: Remove excess loaded class.
Tom Clegg
08:17 am Revision 6862544e (arvados): 4084: Ignore bubbling arv-log-event events, just process each once a...
Tom Clegg
07:17 am Revision 36e465cf (arvados): 4084: Update comments.
Tom Clegg
07:14 am Revision eeb0021e (arvados): 4084: Ignore bubbling arv-log-event events, just process each once a...
Tom Clegg
04:28 am Revision 95d1231a (arvados): 4084: Merge branch 'master' into 4084-log-pane-refresh-TC
Conflicts:
services/api/test/fixtures/jobs.yml
Tom Clegg
04:20 am Revision f075cec9 (arvados): 4084: Use assert_text, not assert page_has_text?, to make tests reli...
Tom Clegg
03:54 am Revision 0f834e80 (arvados): 4084: Skip the "inactive pane" optimization when the div is not a ta...
Content divs that are _not_ tabbed panes no longer need to remember to
add an "active" flag.
Tom Clegg
03:40 am Revision 24d3d682 (arvados): 4084: Fix up whitespace (4-space indent, like the other *.js)
Tom Clegg
03:30 am Story #4424 (Closed): [Keep] [DRAFT] Use stronger hash algorithm (such as SHA-2) for Keep blocks
The md5 algorithm is well known to be insecure. Attackers can force hash collisions on arbitrary data, for example h... Peter Amstutz
03:00 am Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
Here is some more proof if needed:
qr1hi-8i9sb-b9bslx6nhjb0eff
qr1hi-8i9sb-ziako4ux0xc82ay
Bryan Cosca
02:57 am Task #4421 (Resolved): API server can migrate users from OpenID to OpenID Connect
Peter Amstutz
02:57 am Task #4420 (Resolved): Support user+pass database managed locally by SSO server
Peter Amstutz
02:56 am Task #4419 (Resolved): Support OpenID Connect for new log ins
Peter Amstutz
02:56 am Task #4379 (In Progress): Talk to Ward about what this involves
Peter Amstutz
02:28 am Revision 294d3c8d (arvados): 3609: Simplify "group" example a bit more.
Peter Amstutz
02:05 am Revision d5b8652f (arvados): 3609: Further improve documentation and code comments.
Peter Amstutz
12:25 am Revision 5257d993 (arvados): 4084: Move all pane state into $pane, flatten panes with multiple en...
Tom Clegg

11/04/2014

10:28 pm Revision a487f2c9 (arvados): 4357: Restore "any non-idle node is busy" behavior.
Brett Smith
10:11 pm Bug #3857 (In Progress): [SDKs] Python KeepClient should use different timeouts for different ope...
Tim Pierce
10:07 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
There doesn't appear to be a trivial fix to this one. httplib2 is built on Python's httplib, which takes a single _t... Tim Pierce
10:08 pm Task #3914 (Resolved): Study httplib2 and other docs
Tim Pierce
09:58 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Tom Clegg wrote:
> I was worried that this created a subtle dependency on "time for a requested node to boot up and ...
Brett Smith
07:51 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Brett Smith wrote:
> The code is correct. The rationale here is that if it's a new unpaired node, then it's most li...
Tom Clegg
07:12 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Tom Clegg wrote:
> Looking at commit:b0e6de3, just a few suspicious characters:
>
> ComputeNodeMonitorActor's sta...
Brett Smith
04:32 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Looking at commit:b0e6de3, just a few suspicious characters:
ComputeNodeMonitorActor's state() method looks like i...
Tom Clegg
09:54 pm Revision 596d4488 (arvados): 4357: Eschew node monitor state() for in_state().
Brett Smith
09:28 pm Revision 2fe1e71c (arvados): 3609: Documentation improvements. More error checking on run-comman...
Peter Amstutz
09:16 pm Bug #4416 (Closed): [Workbench] "Manage" permission should be sufficient to edit project's name/d...
I was given manage access on a project shaed with me and I am not able to edit the name or the description.
!manag...
Bryan Cosca
09:04 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tim Pierce wrote:
> Review at commit:e4db374
>
> I think I'm getting more confused with each new commit!
Me to...
Tom Clegg
08:14 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Review at commit:e4db374
I think I'm getting more confused with each new commit!...
Tim Pierce
06:42 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg wrote:
> Indeed, and there's actually a whole lot more name_link cruft still sitting around that isn't nee...
Tim Pierce
06:28 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tim Pierce wrote:
> Review at commit:8e7d4e83
>
> If we're now ignoring @@name_link@ entirely when producing brea...
Tom Clegg
05:48 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Review at commit:8e7d4e83
If we're now ignoring @@name_link@ entirely when producing breadcrumbs, then this code i...
Tim Pierce
09:01 pm Revision f662e62c (arvados): 4389: Add debugging tools to dev bundle.
Tom Clegg
09:01 pm Revision 23aea08b (arvados): 4389: Fix infinite loop when ownership trail terminates at a self-ow...
Tom Clegg
08:09 pm Bug #4414 (Resolved): [Workbench] "Add new project" button missing from projects dropdown.
Currently no "Add new project" button is rendering on the "Projects" dropdown menu, even though the following code sn... Peter Amstutz
07:56 pm Revision e4db3740 (arvados): 4389: Fix missing first step of breadcrumb trail.
Tom Clegg
07:11 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Here's a mini log excerpt.... Tom Clegg
06:51 pm Revision be60ff5c (arvados): 4357: Fixups from code review.
Brett Smith
06:45 pm Task #4413 (Resolved): Compress tab panes back to a single level
Peter Amstutz
06:25 pm Revision 2663cf43 (arvados): 4389: Put back @name_link to avoid the slippery slope of feature creep.
Tom Clegg
06:24 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
As it happens, I was able (by accident) to get an error that triggered the retry, the way it gets printed out is a li... Peter Amstutz
05:48 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
Peter Amstutz wrote:
> After fixing the mode, I get this error:
Both fixed in commit:625ac982 and ready for anoth...
Brett Smith
04:42 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
The +x bits got removed:... Peter Amstutz
06:20 pm Task #4390 (In Progress): Review 4389-breadcrumbs-infinite-loop
Tom Clegg
05:47 pm Revision 625ac982 (arvados): 4303: Fixup syntax issue in crunch-job.
Brett Smith
05:38 pm Revision d5cf000e (arvados): 4412: Remaining Ruby clients use :body_object for API requests.
A follow-up from the last commit. Refs #4412. Brett Smith
05:35 pm Bug #4412 (Resolved): [SDKs] arv edit fails under Ruby 2.1.4
Applied in changeset arvados|commit:cbb6e930023aeffdd03332894c85bc156316c72f. Brett Smith
05:29 pm Bug #4412 (In Progress): [SDKs] arv edit fails under Ruby 2.1.4
Brett Smith
05:22 pm Bug #4412 (Resolved): [SDKs] arv edit fails under Ruby 2.1.4
When you run arv edit under Ruby 2.1.4, doing normal edit work, there's an exception when it calls the Arvados API up... Brett Smith
05:31 pm Revision cbb6e930 (arvados): 4412: arv edit consistently uses :body_object in API requests.
Fixes #4412. Brett Smith
04:43 pm Task #4333 (Resolved): Review 4031-fix-graph-connections
Peter Amstutz
04:32 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Comments at commit:51de3bf2
@doc/user/topics/run-command.html.textile.liquid@
* The documentation for list expans...
Tim Pierce
04:26 pm Bug #4410 (Resolved): [Crunch] crunch-job should exit tempfail when a SLURM node fails
h2. Change to implement
(Draft) approach to the "retry" vs. "state machine" problem:
* crunch-job exits EX_RETRY_...
Brett Smith
04:24 pm Task #4385 (In Progress): Review 4303-crunch-retry-logging-wip
Peter Amstutz
04:14 pm Revision 0528a6d4 (arvados): Small tweaks: fix example for running one API test in run-tests.sh;
capitalize Arvados in easy-docker-install.sh
no issue #
Ward Vandewege
04:14 pm Revision 0528a6d4 (arvados-dev): Small tweaks: fix example for running one API test in run-tests.sh;
capitalize Arvados in easy-docker-install.sh
no issue #
Ward Vandewege
04:14 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
* Tom Clegg wrote:
> "anchor-and-pane" is an element that serves as a $pane in the reload function when the user h...
Peter Amstutz
03:45 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Tom Clegg wrote:
>
> > I understand the anchor/pane distinction, I'm just resisting the an...
Tom Clegg
03:23 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> I understand the anchor/pane distinction, I'm just resisting the anchor/anchor-and-pane/pane di...
Peter Amstutz
04:00 pm Bug #4031 (Resolved): [Workbench] Nodes should be connected via input=output in provenance/used b...
Applied in changeset arvados|commit:d65b1921a9aeffd6906b95aa927a07a48f013b32. Anonymous
03:16 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Brett Smith wrote:
> Reviewing commit:b798b32
>
> * The new test fixtures upset other Workbench tests:
> [...]...
Peter Amstutz
03:57 pm Revision d65b1921 (arvados): Merge branch '4031-fix-graph-connections' closes #4031
Peter Amstutz
03:48 pm Bug #4409 (New): [Workbench] Want to remove projects from Home
In my qr1hi-tpzed-rv6f0l8lbvdzkog#Subprojects, I'm trying to delete New Project and New project (2). When I use eithe... Bryan Cosca
03:35 pm Revision f809f3ed (arvados): 4084: Remove "no-auto-reload" css class hint, tabs no longer reload ...
default so it is not necessary to have a class to suppress that behavior. Peter Amstutz
03:20 pm Feature #3618 (Resolved): [Workbench] In project view, sort results in the collections (and other...
Applied in changeset arvados|commit:c54353188145d882218997a4d746c8b091a070e7. Anonymous
02:39 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Phil Hodgson wrote:
> No problem! This now uses the same run-times as before.
Perfect, thanks. commit:db2411a5 i...
Brett Smith
02:00 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
No problem! This now uses the same run-times as before. Phil Hodgson
01:45 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Phil Hodgson wrote:
> pipeline_instances_test.rb now works with the new fixture indexing. Thanks!
But you did it ...
Brett Smith
11:33 am Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
pipeline_instances_test.rb now works with the new fixture indexing. Thanks! Phil Hodgson
03:17 pm Task #4173 (Resolved): Review 3618
Phil Hodgson
03:16 pm Revision c5435318 (arvados): Merge branch '3618-column-ordering' closes #3618
Phil Hodgson
03:15 pm Revision 94e9d86f (arvados): 4031: Fix tests. Move RequestDuck to test_helper.rb so as not to du...
Peter Amstutz
03:02 pm Task #4370 (In Progress): Review 4357-node-manager-busy-nodes-wip
Tom Clegg
02:48 pm Revision e0a85f87 (arvados): Update version dependency to ensure CollectionReader has a normalize...
Tom Clegg
02:47 pm Revision 850bc55e (arvados): Merge branch 'master' into 3618-column-ordering
Phil Hodgson
02:09 pm Revision 038b1bc4 (arvados): 3603: PySDK Collection objects support file-like APIs.
This commit adds an open() method to CollectionReader and
CollectionWriter. They mimic the built-in open(), returnin...
Brett Smith
02:08 pm Bug #4408 (Resolved): [Workbench] Anonymous collection download links should not redirect to logi...
To reproduce:
# Visit collection page.
# Click "Create sharing link".
# Open the resulting link in a new/incognito...
Tom Clegg
01:58 pm Revision db2411a5 (arvados): 3618: accommodate new fixture indexing in pipeline_instance tests (i...
Phil Hodgson
01:47 pm Revision 52a2fc66 (arvados): 3603: Fix context methods for PySDK Collection objects.
Brett Smith
01:47 pm Revision 9166af7c (arvados): 3603: Clean up PySDK imports.
Sort; remove unused imports. Brett Smith
11:36 am Task #4407 (In Progress): Provide a test helper that replays crunch job logs
Phil Hodgson
11:36 am Task #4407 (Resolved): Provide a test helper that replays crunch job logs
Phil Hodgson
11:32 am Revision 963f0bf8 (arvados): 3618: accommodate new fixture indexing in pipeline_instance tests
Phil Hodgson
04:55 am Bug #4406 (Resolved): [Docker] Default arvdock doesn't start sso server container, but also assum...
Hi all. I hope this is helpful. My apologies in advance if I'm doing something wrong.
A naive user would usualy at...
Robert Syme

11/03/2014

10:45 pm Story #3706 (Resolved): [SDKs] Remove fallback-to-keep warning from python SDK if block hash has ...
Applied in changeset arvados|commit:68dae835a2f8bebd5664211a60fc76d50e5ecc23. Anonymous
09:05 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
I recanted on IRC. For posterity: I think _work_trees needs to say: @max_depth = (None if max_manifest_depth < 0 els... Brett Smith
08:25 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Tom Clegg wrote:
> Brett Smith wrote:
> > * This branch removes the line @self.mock_get_collection(client, 404, Non...
Brett Smith
07:56 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Brett Smith wrote:
> Great, thanks. One small thing: in _populate, please prefer @is None@ over @== None@ and @is n...
Tom Clegg
02:15 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Reviewing commit:ce2362b
Tom Clegg wrote:
> Brett Smith wrote:
> > * Would it make more sense to move the popula...
Brett Smith
10:32 pm Revision f05771f1 (arvados): When auto_admin_first_user is set to true (default false), the first
user to sign in on a new installation will be an admin.
refs #4383
Ward Vandewege
10:32 pm Task #4405 (In Progress): add a feature to auto-admin the first user who signs in for a new insta...
Ward Vandewege
10:31 pm Task #4405 (Resolved): add a feature to auto-admin the first user who signs in for a new installa...
Ward Vandewege
10:30 pm Revision 68dae835 (arvados): Merge branch '3706-keep-warning' closes #3706
Tom Clegg
10:29 pm Feature #4404 (New): [API] [SDKs] Include provenance information for uploaded Collections
This could include:
- Who uploaded
- Date
- IP of source machine where data was uploaded
- Maybe information ...
Adam Berrey
10:27 pm Revision 3e5e8972 (arvados): 3706: Oops, the test was broken, the feature works fine.
Tom Clegg
10:13 pm Revision a70e6990 (arvados): 3706: Add (skipped) test for broken max_manifest_depth=0 feature.
Tom Clegg
10:11 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Reviewing commit:b798b32
* The new test fixtures upset other Workbench tests:
...
Brett Smith
09:07 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Brett Smith wrote:
> Reviewing commit:4d257ed
>
> * I think the regexps that search for Collection UUIDs and port...
Peter Amstutz
10:10 pm Bug #4402 (Closed): [SDKs] CollectionWriter.write_directory_tree(...,max_manifest_depth=0) should...
Tom Clegg
09:30 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Tom Clegg wrote:
> > I think this is way too complicated and hard to follow. Why is the extr...
Tom Clegg
08:35 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> Peter Amstutz wrote:
> > > Yes -- I'd still like to know why/when we disagree with bootstrap abo...
Peter Amstutz
09:15 pm Revision b17d41c1 (arvados): 4084: Only load tab on switch if it doesn't have "pane-loaded" class...
default throttle to 15 sec instead of 3 (but refresh panels can set their own
throttle time.)
Peter Amstutz
09:08 pm Task #4143 (Resolved): Write tests
Peter Amstutz
09:08 pm Task #4142 (Resolved): Diagnose and fix
Peter Amstutz
09:00 pm Revision b798b325 (arvados): 4031: Add owner_uuid to graph_test_collection fixtures.
Peter Amstutz
08:39 pm Bug #4369 (Closed): [Crunch] Unexpected backward incompatibility in run-command
Brett Smith
08:37 pm Bug #4369: [Crunch] Unexpected backward incompatibility in run-command
The job seems to be running fine here: qr1hi-8i9sb-yfj9negdn8zqemy. I think everything is OK and nothing needs to be ... Bryan Cosca
06:26 pm Bug #4369: [Crunch] Unexpected backward incompatibility in run-command
I'm sorry, I thought I had I kept the input the same, but I guess I didn't. I'll test this again. I have this job: qr... Bryan Cosca
06:17 pm Bug #4369 (In Progress): [Crunch] Unexpected backward incompatibility in run-command
Brett Smith
06:17 pm Bug #4369: [Crunch] Unexpected backward incompatibility in run-command
Bryan,
The error message here seems to come from Rmake itself, after run-command starts it. The bug could still b...
Brett Smith
08:27 pm Revision b7ec3833 (arvados): 3706: Merge branch 'master' into 3706-keep-warning
Tom Clegg
08:07 pm Revision 5dd7bd8a (arvados): Merge remote-tracking branch 'origin/master' into 4031-fix-graph-con...
Conflicts:
services/api/test/fixtures/collections.yml
Peter Amstutz
08:06 pm Revision 15dbb311 (arvados): 4031: Improve provenance graph tests for readability, use fixtures i...
hardcoded hashes. Improve efficiency of matching collections in search_edges.
Remove spurious debug code.
Peter Amstutz
07:33 pm Revision 411305d8 (arvados): 3706: Remove superfluous conditional.
Tom Clegg
06:33 pm Revision 47c349ca (arvados): 3706: Add back "collections.get => 404" to "fallback to Keep" test.
Tom Clegg
06:31 pm Revision 3978e8ae (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested (part 2).
refs #4383
Ward Vandewege
06:31 pm Revision c5c8c883 (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested (part 2).
refs #4383
Ward Vandewege
06:28 pm Bug #4401 (Resolved): [Docker] Check dependencies at top of build.sh
* test for docker version - exclude version 1.2.0 (but allow 1.2.0-dev) because of known bug
* test for presence o...
Ward Vandewege
06:26 pm Bug #4400: [SDKs] Python package install should not print misleading message "fatal: Not a git re...
Perhaps check whether SETUP_DIR/../../.git exists in sdk/python/setup.py before trying to get a version date from git... Tom Clegg
06:22 pm Bug #4400 (Resolved): [SDKs] Python package install should not print misleading message "fatal: N...
Installing the @arvados_fuse@ and @arvados-python-client@ packages produces the following output:... Peter Amstutz
06:21 pm Bug #4391 (Closed): [Workbench] Selection clip does not show list of selected items in drop down
I'm closing this bug, because we're going to "fix" it by getting rid of the selection clip entirely. The main use of... Brett Smith
01:12 am Bug #4391 (Closed): [Workbench] Selection clip does not show list of selected items in drop down
when I select items, the selection clippy in the upper right shows the number of items selected, but when I click on ... Adam Berrey
04:35 pm Bug #4388 (Resolved): [SDKs] Manifest#each_line should not crash when encountering a blank line i...
Applied in changeset arvados|commit:ae96829cc088d18c7aaf438eacb75830c7a40662. Brett Smith
03:57 pm Bug #4388 (In Progress): [SDKs] Manifest#each_line should not crash when encountering a blank lin...
Brett Smith
04:32 pm Bug #4399 (Resolved): [Tests] Fix whatever sometimes causes Jenkins tests to fail with ECONNREFUSED
The workbench tests sometimes fail catastrophically on Jenkins with many errors similar to the following:... Peter Amstutz
04:29 pm Revision ab3b9556 (arvados): 3706: Prefer "is None" and "is not None" to "== None" and "!= None".
Tom Clegg
04:29 pm Revision 3b408ec4 (arvados): 3706: Mutating normalize() does not return self.
Tom Clegg
04:29 pm Revision 6c7e0599 (arvados): 3706: Process directory trees in sorted() order, instead of the order
returned by os.listdir().
This causes write_directory_tree() to produce a manifest that is
normalized to the greates...
Tom Clegg
04:26 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
Ward says that if the node's shutdown window closes while the node is draining, Node Manager should cancel the shutdo... Brett Smith
04:25 pm Revision ae96829c (arvados): 4388: Ruby Keep::Manifest skips blank lines in manifests.
Closes #4388. Brett Smith
03:51 pm Task #4397 (Resolved): add validation
Tim Pierce
03:34 pm Revision a6606b79 (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested.
refs #4383
Ward Vandewege
03:33 pm Revision f8002c59 (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested.
refs #4383
Ward Vandewege
03:13 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thanks Phil, I like all the changes as of commit:2a48239. Just one more thing: changing the test fixture indices has... Brett Smith
03:00 pm Story #4316: Review 3603-pysdk-file-api-wip
Taking this back because I'm going to have to resolve some merge conflicts with a branch Tom is working on. Brett Smith
11:23 am Bug #4395 (Resolved): [SDKs] sdk/go/keepclient race condition

From https://ci.curoverse.com/job/arvados-api-server/1040/console
----------------------------------------------...
Ward Vandewege
04:40 am Revision 31407b1e (arvados): system_user and anonymous_user should be excluded from
auto_setup_new_user, always.
refs #4383
Ward Vandewege
04:39 am Revision 4498d813 (arvados): system_user and anonymous_user should be excluded from
auto_setup_new_user, always.
refs #4383
Ward Vandewege
02:05 am Revision 28053f8a (arvados): Enable auto_setup_new_users in the docker API server image.
refs #4383 Ward Vandewege
02:03 am Revision 234f7303 (arvados): Enable auto_setup_new_users in the docker API server image.
refs #4383 Ward Vandewege
01:36 am Bug #4394 (New): [Workbench] Make duplicate name error message more user-friendly
When I tried to use the same collection name twice, the error message (the uniqueness constraint violation exception ... Adam Berrey
01:34 am Feature #4393 (New): [Workbench] Display portable data hash, parent project, file count in Collec...
Let's say I've created a Collection "Gemini data" and copied it into a variety of different projects. Then I created ... Adam Berrey
01:08 am Revision a383999f (arvados): Add instructions for 'binary' docker installation.
refs #4383 Ward Vandewege

11/02/2014

02:41 am Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> > Yes -- I'd still like to know why/when we disagree with bootstrap about which elements shou...
Tom Clegg
12:48 am Revision 076ba4ed (arvados-dev): Rename easy installation script. Update comments at the top of t...
refs #4383 Ward Vandewege
12:48 am Revision 076ba4ed (arvados): Rename easy installation script. Update comments at the top of the s...
refs #4383 Ward Vandewege
12:41 am Revision 7ae95cd8 (arvados): Add first version of the easy-evaluation script.
refs #4383 Ward Vandewege
12:41 am Revision 7ae95cd8 (arvados-dev): Add first version of the easy-evaluation script.
refs #4383 Ward Vandewege

11/01/2014

07:46 pm Task #4390 (Resolved): Review 4389-breadcrumbs-infinite-loop
Tom Clegg
07:46 pm Bug #4389 (In Progress): [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg
07:46 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
4389-breadcrumbs-infinite-loop
* commit:ebd8e5c fixes bug.
* commit:8e7d4e8 adds debugger to bundle.
Tom Clegg
07:41 pm Bug #4389 (Resolved): [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg
07:45 pm Revision 8e7d4e83 (arvados): 4389: Add debugging tools to dev bundle.
Tom Clegg
07:44 pm Revision ebd8e5cd (arvados): 4389: Fix infinite loop when ownership trail terminates at a self-ow...
Tom Clegg
07:10 pm Revision 1b9ca54a (arvados): Make run-docker-tests.sh a bit smarter about detecting common failures.
No issue # Ward Vandewege
07:10 pm Revision 1b9ca54a (arvados-dev): Make run-docker-tests.sh a bit smarter about detecting common fa...
No issue # Ward Vandewege
06:32 pm Bug #4388 (Resolved): [SDKs] Manifest#each_line should not crash when encountering a blank line i...
While displaying the collections tab on "show Home project":... Tom Clegg
06:28 pm Revision a434d701 (arvados): 4084: Do not reload up-to-date panes when switching tabs.
Tom Clegg
06:25 pm Revision e0b4da87 (arvados): 4084: Bootstrap manages the "active" class on tabs, not us.
Tom Clegg
02:28 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thanks again for the great feedback Brett. I've addressed all of the points you've raised. The refactoring of the scr... Phil Hodgson
02:22 pm Revision 2a482395 (arvados): 3618: refactor scroll tests to share code
Phil Hodgson
12:42 am Feature #4383 (In Progress): [Docker] upload all docker containers to docker repository, and then...
Ward Vandewege
12:40 am Revision e9db1de8 (arvados): Make sure all executables we package are executable.
No issue # Ward Vandewege
12:40 am Revision e9db1de8 (arvados-dev): Make sure all executables we package are executable.
No issue # Ward Vandewege
12:35 am Revision 7b3296a9 (arvados-dev): Upload our docker images to the docker.io registry.
refs #4383 Ward Vandewege
12:35 am Revision 7b3296a9 (arvados): Upload our docker images to the docker.io registry.
refs #4383 Ward Vandewege

10/31/2014

11:47 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Brett Smith wrote:
> First, mea culpa on the bad tests for max_manifest_depth. I wrote those when I was adding retr...
Tom Clegg
08:10 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
First, mea culpa on the bad tests for max_manifest_depth. I wrote those when I was adding retry support to arv-put, ... Brett Smith
11:46 pm Revision ce2362b3 (arvados): 3706: Clarify test case.
Tom Clegg
11:43 pm Revision 09aa8bc2 (arvados): 3706: Clarify test case.
Tom Clegg
11:36 pm Revision 55a0e060 (arvados): 3706: Prefer join() to many string concatenations.
Tom Clegg
11:20 pm Revision e753cd61 (arvados): 3706: Prefer join() to many string concatenations.
Tom Clegg
10:58 pm Revision 83acfa97 (arvados): 3706: Prefer "if x" to "if len(x) > 0".
Tom Clegg
10:56 pm Revision 017587d7 (arvados): 3706: Two blank lines after class definition.
Tom Clegg
09:21 pm Revision f9328bf5 (arvados): 3706: Really make the API server return the wrong data, instead of j...
Tom Clegg
09:17 pm Bug #4380 (In Progress): [Node Manager] Should drain nodes via SLURM before terminating them
Brett Smith
09:15 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
To start draining a node:
@scontrol update NodeName=computeNN State=DRAIN@
To check current node state:
@sin...
Brett Smith
06:10 pm Bug #4380 (Resolved): [Node Manager] Should drain nodes via SLURM before terminating them
Brett Smith
08:58 pm Revision d2519d36 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Conflicts:
services/api/test/fixtures/api_client_authorizations.yml
services/api/test/fixtures/users.yml
Radhika Chippada
08:55 pm Bug #4040 (Resolved): [Tests] FUSE mount test suite should not fail just because new collection f...
Applied in changeset arvados|commit:313f5fedd4214d077e2b5c7c26bab4df3895c44a. Tim Pierce
08:40 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
With that said (#4387), LGTM Radhika Chippada
08:29 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
Added #4387 to track some of the tests suggested in this ticket. Tim Pierce
08:23 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
New revision at commit:f39bdf8
Radhika Chippada wrote:
> Review feedback. Some of the items I listed below may be...
Tim Pierce
08:54 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
How do we want to prevent page refresh on the dashboard refreshing the recently finished pipelines panel when the use... Radhika Chippada
08:48 pm Revision 7505be2b (arvados): 3706: Put --normalize and --max-manifest-depth arguments in a mutual...
Tom Clegg
08:46 pm Revision c57a72b3 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
08:45 pm Revision 313f5fed (arvados): Merge branch '4040-fuse-tests'
Fixes #4040. Tim Pierce
08:45 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Summary of everything that's happened in the last couple of days:
Updated this branch at commit:50efff371 with cha...
Tim Pierce
08:44 pm Revision fad87116 (arvados): 3706: normalize() returns None instead of self. Add equally convenie...
Tom Clegg
08:40 pm Task #4351 (Resolved): Review 4040-fuse-tests
Radhika Chippada
08:37 pm Revision 51de3bf2 (arvados): 3609: Correctly recognize and rewrite directory names in collections.
Peter Amstutz
08:36 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Tim Pierce wrote:
> Review @ commit:0edcc26f:
>
> @sdk/python/arvados/commands/run.py@
> * The @slots@ stuff was...
Peter Amstutz
08:36 pm Story #4387: [Tests] additional FUSE tests
It would also help tremendously if the variables such as d1, d2, d3 etc in the "test_mount.py" are given self explana... Radhika Chippada
08:29 pm Story #4387 (Resolved): [Tests] additional FUSE tests
Additional tests of the FUSE driver that would be useful. Discussed in #4040.
* Authenticate as the @fuse@ user (r...
Tim Pierce
08:30 pm Revision 3f9d8b5c (arvados): 3706: Catch and return exceptions in _populate_* methods to dry up _...
Tom Clegg
08:23 pm Revision f39bdf87 (arvados): 4040: code review feedback
* Renamed
** collection_owned_by_fuse_1 -> collection_1_owned_by_fuse
** collection_owned_by_fuse_2 -> collection_2_o...
Tim Pierce
08:13 pm Revision 102582e4 (arvados): Fix broken link in docs. Duh.
refs #4186 Ward Vandewege
08:09 pm Revision 78343b45 (arvados): 4024: update fixture to set state to Complete for some of the finish...
Radhika Chippada
07:36 pm Task #4386 (Resolved): Review branch: 4024-pipeline-instances-scroll
This branch addresses adding infinite scrolling to recently finished pipelines panel in the dashboard. Radhika Chippada
07:33 pm Revision c00109a6 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
07:32 pm Revision bdd31f24 (arvados): 4024: add integration tests to dashboard finished pipelines panel.
Radhika Chippada
07:26 pm Revision 0812bc1c (arvados): 3609: Inherit --retries from _util. Be more specific about error be...
Peter Amstutz
07:00 pm Task #4367 (In Progress): Review 3706-keep-warning
Brett Smith
06:57 pm Task #4385 (Resolved): Review 4303-crunch-retry-logging-wip
Brett Smith
06:57 pm Bug #4303 (In Progress): [Crunch] Output of job gets stuck at collate step
4303-crunch-retry-logging-wip is up for review, to handle the quick fix suggested above, until we port to Python. Brett Smith
06:54 pm Revision d688971e (arvados): 4303: crunch-job logs when it starts retrying API calls.
Brett Smith
06:51 pm Task #4384 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
06:49 pm Task #4205 (Resolved): Add "select all" / "deselect all" buttons to app/views/collections/_show_f...
Tim Pierce
06:45 pm Feature #4302: [Crunch] Pipelines should not fail immediately after one job failure, but continue...
arv-run-pipeline-instance has (had?) this option, but there has never been a way in Workbench to specify whether you ... Tom Clegg
06:37 pm Revision 50efff37 (arvados): 4088: use filterable.js to filter on client side
Implemented client-side filtering via filterable.js:
* Designated filename rows as "filterable"
* Designated filename...
Tim Pierce
06:21 pm Feature #4383 (Resolved): [Docker] upload all docker containers to docker repository, and then ad...
Ward Vandewege
06:19 pm Task #4382 (Resolved): Decide what to do
Peter Amstutz
06:12 pm Bug #4368: [Crunch] Improve node failure detection and job retry logic
Made lower priority in favor of #4380. Brett Smith
01:39 pm Bug #4368 (Closed): [Crunch] Improve node failure detection and job retry logic
One of Crunch's ideal responsibilities is that it's supposed to detect when a job fails because a node failed, and re... Brett Smith
06:10 pm Task #4381 (Resolved): ArvadosResourceList returns all items unless @limit is non-nil
Peter Amstutz
06:09 pm Task #4379 (Resolved): Talk to Ward about what this involves
Peter Amstutz
06:09 pm Task #4377 (Resolved): Diagnose
Peter Amstutz
06:08 pm Task #4376 (Resolved): Diagnose and fix
Peter Amstutz
06:08 pm Task #4375 (Resolved): Add tests
Tom Clegg
06:08 pm Task #4374 (Resolved): Diagnose and fix
Peter Amstutz
06:08 pm Task #4373 (Resolved): Diagnose and fix
Peter Amstutz
06:06 pm Task #4372 (Resolved): Find out whether current stats make sense to users
Tom Clegg
06:01 pm Task #4370 (Resolved): Review 4357-node-manager-busy-nodes-wip
Brett Smith
05:59 pm Revision b0e6de37 (arvados): 4357: Node Manager boots new nodes when up nodes are busy.
The key part of this commit is the change to _nodes_wanted.
Everything else provides the information to make that cal...
Brett Smith
05:28 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> Punted to #4339.
Thanks.
> > > Evidently this is worth testing, since it's apparently eas...
Peter Amstutz
05:28 pm Revision 1693dc61 (arvados): 4084: Change $(this) to this and add comments. Refactor @pidfile in...
Peter Amstutz
03:55 pm Bug #4369 (Closed): [Crunch] Unexpected backward incompatibility in run-command
in job: qr1hi-8i9sb-fm7d28agolgd6fs, im running run-command: 83a9390a05bbffc2e4ea95dd693af3ab3547fa12, a pretty rece... Bryan Cosca
03:47 pm Revision e6d161cc (arvados): 4084: Fix workbench tests.
Peter Amstutz
03:44 pm Task #4325 (Resolved): Review 3824-crunch-container-setup
Tom Clegg
03:04 pm Revision 27b534dd (arvados): Merge branch '4186-install-doc-improvements-2'
refs #4186 Ward Vandewege
03:03 pm Revision 4978c1e7 (arvados): Clean up the installation overview pages a bit more.
refs #4186 Ward Vandewege
02:52 pm Revision 9ac37f36 (arvados): Merge branch 'master' into 4186-install-doc-improvements-2
Ward Vandewege
02:51 pm Revision afc70738 (arvados): Add keepstore installation page.
refs #4186 Ward Vandewege
02:50 pm Revision 28ac1f93 (arvados): Workbench: Change from yui to uglifier to compress javascript in
config/environments/production.rb.example
No issue #
Ward Vandewege
02:42 pm Revision 7c3f2671 (arvados): Fix typo.
refs #4186 Ward Vandewege
02:42 pm Revision d14c0c81 (arvados): Keepproxy just needs an anonymous token.
refs #4186 Ward Vandewege
02:42 pm Revision ed4105d0 (arvados): Batch of improvements for the manual installation documentation:
* add prerequisites section
* add shell server section
* add keepproxy section
* many other updates throughout
refs ...
Ward Vandewege
02:00 pm Bug #4357 (In Progress): [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes...
Brett Smith
01:44 pm Task #4326 (Resolved): Review branch: 4091-test-infinite-scrolling
Tom Clegg
01:26 pm Task #4362 (Resolved): Review 4359-project-paging
Tom Clegg
01:04 pm Revision 9fa70c84 (arvados): 3618: improve api security for sorting to make sure each column we s...
Phil Hodgson
01:04 pm Revision 4d195ee9 (arvados): 3618: make sure something happens if the order param is actually det...
Phil Hodgson
01:03 pm Revision b28531cd (arvados): 3618: bug fix: was confusing the "desc" meaning a "descending sort" ...
Phil Hodgson
12:56 pm Revision e3e54264 (arvados): Merge branch 'master' into 3618-column-ordering
Conflicts (all resolved including fixes):
apps/workbench/app/controllers/projects_controller.rb
apps/workbench/app/...
Phil Hodgson
02:07 am Revision 930198d1 (arvados): Fix typo.
refs #4186 Ward Vandewege
01:47 am Revision 3042c000 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
01:28 am Revision a4b6e0ad (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
01:26 am Revision 2db7fce3 (arvados): 4024: add inifinite scrollling to dashboard.
Radhika Chippada

10/30/2014

09:23 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
Two things happened here:
* The Docker image used has an older Python SDK that does not record Keep's authorizatio...
Brett Smith
09:15 pm Bug #3824 (Resolved): [Crunch] crunch-job should create task execution environment inside docker ...
Applied in changeset arvados|commit:c6a03a7abff947dc8242e8be18b4b5e6920a3e4a. Anonymous
09:11 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> Reviewing commit:c199c0c, and my only concern is the TASK_KEEPMOUNT comment. Looking at it aga...
Tom Clegg
08:36 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Reviewing commit:c199c0c, and my only concern is the TASK_KEEPMOUNT comment. Looking at it again, I feel more strong... Brett Smith
06:51 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Tom Clegg wrote:
> Brett Smith wrote:
> > And then some longer-standing issues in the Dockerfiles. I'm okay with s...
Tom Clegg
06:11 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> And then some longer-standing issues in the Dockerfiles. I'm okay with seeing these addressed ...
Tom Clegg
05:58 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Using Data::Dumper, the log message now looks like this:... Tom Clegg
09:13 pm Revision c6a03a7a (arvados): Merge branch '3824-crunch-container-setup' closes #3824
Tom Clegg
09:13 pm Revision 4cbb3944 (arvados): 3824: Merge branch 'master' into 3824-crunch-container-setup
Tom Clegg
09:05 pm Revision b39e2b4e (arvados): 3824: Fix comment to state that tasks must not assume $TASK_KEEPMOUN...
Tom Clegg
09:00 pm Story #4359 (Resolved): [Workbench] Clean up project paging after #4091 bug fixes
Applied in changeset arvados|commit:92822dd390f4b3efeb183452b7ddf866c41bda17. Anonymous
08:20 pm Story #4359: [Workbench] Clean up project paging after #4091 bug fixes
Review feedback: Code updates look good. All tests passed and also manual verification passed. Pointed to staging and... Radhika Chippada
08:33 pm Revision 6dabd04b (arvados): Fix google-api-client version deps. No issue #
Tom Clegg
08:30 pm Revision 92822dd3 (arvados): Merge branch '4359-project-paging' closes #4359
Tom Clegg
08:29 pm Bug #4307 (Resolved): [Workbench] Pipeline instance name text should be editable after the instan...
Brett Smith
08:28 pm Bug #4307 (New): [Workbench] Pipeline instance name text should be editable after the instance st...
Brett Smith
05:50 pm Bug #4307 (Resolved): [Workbench] Pipeline instance name text should be editable after the instan...
Applied in changeset arvados|commit:fd0ca9211847806adb2e97c0ae78e9312ef89ca1. Brett Smith
08:16 pm Task #4362 (In Progress): Review 4359-project-paging
Radhika Chippada
08:13 pm Revision a95a8120 (arvados): Merge branch '4088-filterable-docs' refs #4088
Tom Clegg
08:12 pm Revision 540680b2 (arvados): 4088: Add usage docs to filterable.js
Tom Clegg
08:06 pm Task #4367 (Resolved): Review 3706-keep-warning
Tom Clegg
08:06 pm Task #4346 (Resolved): Write tests
Tom Clegg
05:52 pm Task #4346 (In Progress): Write tests
Tom Clegg
08:06 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Along the way I noticed a few things were being broken by CollectionReader and CollectionWriter automatically applyin... Tom Clegg
07:59 pm Revision 0e8d9b4c (arvados): 3706: Use normalize() in arv-mount.
Tom Clegg
06:48 pm Revision c199c0cf (arvados): 3824: Import GPG key needed for RVM installation.
Tom Clegg
06:27 pm Revision ce6f044c (arvados): 3824: Remove redundant "apt-get update", standardize on "apt-get upd...
Tom Clegg
06:04 pm Revision 1bcfc05d (arvados): 3824: Set mode on /etc/fuse.conf in compute image.
Tom Clegg
05:53 pm Task #4283 (Resolved): Make test case
Tom Clegg
05:52 pm Task #4365 (Resolved): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
05:51 pm Task #4364 (Resolved): Ensure posix-allowed filenames are not altered by arv-mount (add tests)
Tom Clegg
05:45 pm Revision fd0ca921 (arvados): 4307: Workbench: only pipeline components are not editable after start.
This fixes a regression from d7fdbbab. Closes #4307. Brett Smith
05:43 pm Revision 9b959a51 (arvados): 4088: Add usage docs to filterable.js
Tom Clegg
05:11 pm Bug #4044 (Resolved): [Crunch] job spawns tasks but never runs them, gets stuck waiting for first...
Tom Clegg
05:05 pm Revision da6674e4 (arvados): 3824: Bring back $! in error message, in case it's helpful.
Tom Clegg
05:02 pm Revision 51e79a3b (arvados): 3824: Merge branch 'master' into 3824-crunch-container-setup
Tom Clegg
05:00 pm Revision 1bcf9398 (arvados): 3824: Use Data::Dumper instead of custom quoting to show srun/task e...
Tom Clegg
03:59 pm Task #4173 (In Progress): Review 3618
Brett Smith
03:38 pm Bug #4363 (Resolved): [Keep] arv-mount should not munge filenames unless required by POSIX
One particularly unfortunate outcome of the current "strip characters we think you shouldn't use" code is:... Tom Clegg
02:55 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Reviewing commit:c10b68e
* There seems to be a bug in the history handling for the Description column. Steps to r...
Brett Smith
01:50 pm Task #4351 (In Progress): Review 4040-fuse-tests
Radhika Chippada
01:46 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
Review feedback. Some of the items I listed below may be out of scope / too hard to do / do not add much value; pleas... Radhika Chippada
12:54 pm Feature #4343: [SDKs] arv create needs --project-uuid and --name parameters for appropriate classes
I'm going to put this in Future sprints because there's a workaround: when you're writing the object JSON, you can se... Brett Smith
12:52 pm Feature #4349: [SDKs] When editing a template in arv-edit and faced with a parse error, when tryi...
This sounds pretty cool but I'm not sure it's going to be possible. Because arv edit uses your preferred editor, som... Brett Smith
12:50 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
#4088 might resolve this when it gets merged soon. Let's double-check after that and see if there are any outstandin... Brett Smith

10/29/2014

09:10 pm Task #4362 (Resolved): Review 4359-project-paging
Tom Clegg
09:10 pm Task #4361 (Resolved): Remove overlapping uuids using filters
Tom Clegg
09:10 pm Task #4361 (Resolved): Remove overlapping uuids using filters
Tom Clegg
09:10 pm Task #4360 (Resolved): Use inequality operators instead of adding/subtracting 1 second from times...
Tom Clegg
09:09 pm Task #4360 (Resolved): Use inequality operators instead of adding/subtracting 1 second from times...
Tom Clegg
09:08 pm Story #4359 (Resolved): [Workbench] Clean up project paging after #4091 bug fixes
Tom Clegg
09:06 pm Revision 1d2cdef7 (arvados): 4091: Use <=N instead of <N+1. Pass "uuid not in" filter to API inst...
Tom Clegg
08:43 pm Bug #4358 (New): [Tests] When comparing pipelines, the graph should highlight the differences by ...
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/compare?uuids%5B%5D=qr1hi-d1hrv-pep5f13gwh50paf&uuids%5B%5D... Jonathan Sheffi
08:26 pm Task #4351: Review 4040-fuse-tests
Per our discussion, revision commit:5214183 includes more descriptive variable names in the @FuseSharedTest@. Tim Pierce
07:35 pm Task #4351 (Resolved): Review 4040-fuse-tests
Tim Pierce
08:24 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
Per discussion in the office: commit:5214183 has been updated to use more descriptive variable names in the test, to ... Tim Pierce
08:23 pm Revision 52141835 (arvados): 4040: clarify variable names
Per code review: give d1, d2, d3 more descriptive variable names. Tim Pierce
08:17 pm Bug #4357 (Resolved): [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes ar...
Consider the following scenario:
* 2 nodes are currently up.
* A job that needs two nodes is created, assigned to...
Brett Smith
08:07 pm Task #4356 (Resolved): write blog post
Tim Pierce
08:07 pm Task #4355 (Resolved): min_nodes tests
Tim Pierce
08:07 pm Task #4354 (Resolved): decline node shutdown if it brings the number of nodes lower than min_nodes
Tim Pierce
08:06 pm Task #4353 (Resolved): spin up a new node if node list is less than min_nodes
Tim Pierce
08:05 pm Task #4352 (Resolved): fix bugs, write tests
Tim Pierce
07:40 pm Story #4293: [Node Manager] Write off cloud nodes that spend too long in booted state
Fixing this effectively requires fixing #4322, which was originally filed separately. Adjusting this story to accoun... Brett Smith
07:35 pm Task #4207 (Resolved): Add fixtures exclusively for testing FUSE mounts
Tim Pierce
07:25 pm Story #4091 (Resolved): [Workbench] Add tests for undertested parts of Workbench, including infin...
Applied in changeset arvados|commit:e2fe6c0e5c1c62a37e03519590c04a5186a2cc9b. Radhika Chippada
07:23 pm Revision e2fe6c0e (arvados): closes #4091
Merge branch '4091-test-infinite-scrolling' Radhika Chippada
07:23 pm Revision c105f356 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
07:21 pm Revision 78fc6d80 (arvados): 4091: set the limit size to 50 for "Jobs and pipelines" tab.
Radhika Chippada
07:19 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Proposed implementation. After the normal Docker image install, use @docker run@ to install the exact specified vers... Brett Smith
07:13 pm Revision ddc1f6b0 (arvados): 4040: update FUSE driver tests with stable fixtures
Added test fixtures specifically for FUSE driver tests. Tim Pierce
07:13 pm Story #4350 (New): [Workbench] Order by Collections "Name" column puts "folders" (collections con...
Phil Hodgson
07:09 pm Task #4330 (New): Review branch: 4291-collection-sharing-link-refresh-issue
Radhika Chippada
07:09 pm Bug #4291 (New): [Workbench] Create sharing link for a collection is broken
Radhika Chippada
06:58 pm Revision 7d8d1b78 (arvados): Fix Node Manager test bug introduced by last commit.
Bad Brett, only running specific tests. No issue #. Brett Smith
06:56 pm Feature #4349 (New): [SDKs] When editing a template in arv-edit and faced with a parse error, whe...
it would make editing templates faster Bryan Cosca
06:47 pm Bug #4297 (Resolved): [Crunch] crunch-dispatch eats way too much cpu
Tom Clegg
06:32 pm Support #4348 (Resolved): [Support] fix bugs and write tests (second half)
Ward Vandewege
06:32 pm Support #4347 (Resolved): [Support] fix bugs and write tests (first half)
Ward Vandewege
06:22 pm Revision 9ee4a125 (arvados): Fix race condition in Node Manager shutdown tests.
ComputeNodeMonitorActor considers a shutdown when it's initialized.
Blocking on the subscription we send ensures that...
Brett Smith
06:16 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
Could be a duplicate of #4310 Tom Clegg
05:53 pm Support #4134 (Resolved): [Support] fix bugs and write tests (second half)
Ward Vandewege
04:53 pm Revision 5560cdf3 (arvados): Fix the goldang consarned FUSE tests again.
No issue #, dammit Tim Pierce
04:43 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Brett Smith wrote:
> Tim Pierce wrote:
> > Rewriting the tab that way would involve a substantial rewrite of the _s...
Tom Clegg
03:35 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Tim Pierce wrote:
> It seems like the distinction will be clear in practice, when the user's search for "a[b" turns ...
Brett Smith
03:26 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Brett Smith wrote:
> Tim Pierce wrote:
> > > * For consistency with our other search fields, I think the filter but...
Tim Pierce
01:31 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Tim Pierce wrote:
> New revision at commit:f549c9f
>
> Rewriting the tab that way would involve a substantial rewr...
Brett Smith
04:27 pm Revision b09dddc9 (arvados): Keepproxy just needs an anonymous token.
refs #4186 Ward Vandewege
04:26 pm Task #4345 (Resolved): Do not warn unless both methods fail
Tom Clegg
04:25 pm Task #4345 (Resolved): Do not warn unless both methods fail
Tom Clegg
04:26 pm Task #4346 (Resolved): Write tests
Tom Clegg
04:07 pm Task #4205 (In Progress): Add "select all" / "deselect all" buttons to app/views/collections/_sho...
Tim Pierce
04:07 pm Task #4332 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
04:07 pm Task #4206 (Resolved): write workbench tests
Tim Pierce
04:07 pm Task #4204 (Resolved): Add regex box and filter to app/views/collections/_show_files.html.erb
Tim Pierce
04:07 pm Revision c19bb2a3 (arvados): Merge branch '4088-collection-show-files-filter'
Refs #4088. Tim Pierce
04:05 pm Bug #4344 (Resolved): [SDK] can't make an anonymous token from the cli
Trying to make an anonymous token:
$ arv api_client_authorization create --api-client-authorization='{"scopes":["G...
Ward Vandewege
03:49 pm Feature #4343 (New): [SDKs] arv create needs --project-uuid and --name parameters for appropriate...
this way, we wouldn't have to go through home, find the template and put it into the project.
We can run arv creat...
Bryan Cosca
03:45 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Tom Clegg wrote:
> > The first thing I did was "all jobs" &rarr; a job &rarr; clicked on a f...
Tom Clegg
03:44 pm Revision 9d5b7d2e (arvados): Batch of improvements for the manual installation documentation:
* add prerequisites section
* add shell server section
* add keepproxy section
* many other updates throughout
refs ...
Ward Vandewege
03:43 pm Revision 92860ee8 (arvados): Merge branch 'master' into 4186-install-doc-improvements
Ward Vandewege
03:40 pm Revision 1edad4ad (arvados): 4088: filter only on files
Only apply the regex filter to files; continue to process subdirectories
as normal in order to keep the appropriate f...
Tim Pierce
03:39 pm Revision c10b68e9 (arvados): 3618: Make tests pass: bugs were revealed in "Other objects" tab rel...
Phil Hodgson
03:37 pm Support #4186 (In Progress): [Documentation] Install documentation improvements
Ward Vandewege
03:31 pm Task #4320 (Resolved): Remember sort order when switching tabs
Phil Hodgson
03:30 pm Task #4341 (In Progress): Make the manual installation documentation more complete.
Ward Vandewege
03:29 pm Task #4341 (Resolved): Make the manual installation documentation more complete.
Ward Vandewege
03:19 pm Revision 55099743 (arvados): 4088: fix alignment for right-floating input field
Tim Pierce
03:02 pm Bug #4334: [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* SLURM state
Last night, we encountered on an issue on qr1hi where SLURM was reporting nodes as idle* when they were actually down... Brett Smith
02:52 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Reviewing commit:4d257ed
* I think the regexps that search for Collection UUIDs and portable data hashes should be...
Brett Smith
02:24 pm Bug #4339 (Resolved): [Workbench] Add test for "error while loading tab" iframe. See #4084
Tom Clegg
11:21 am Revision 9f37a732 (arvados): Merge branch 'master' into 3618-column-ordering
Phil Hodgson
11:20 am Revision 9ad6d61c (arvados): 3618: store in the browser history state the current sort settings f...
Phil Hodgson
03:12 am Revision d06e68ae (arvados): Workbench: Change from yui to uglifier to compress javascript in
config/environments/production.rb.example
No issue #
Ward Vandewege
02:27 am Revision 89ba1124 (arvados): Improve config/application.yml.example for the API server and workbe...
* API server: define prefix_uuid in development mode
* workbench: add a production section
No issue #
Ward Vandewege

10/28/2014

09:29 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
New revision at commit:f549c9f
Brett Smith wrote:
> Reviewing commit:e34135f677
>
> * I know the story specifi...
Tim Pierce
07:23 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Reviewing commit:e34135f677
* I know the story specifies this, so it's not on you, but I'll throw it out there: I'...
Brett Smith
02:45 pm Feature #4088 (In Progress): [Workbench] On collections#show page, filter displayed files by file...
Tim Pierce
09:26 pm Revision f549c9f0 (arvados): 4088: code review feedback
* Filter files by regex before .take(10000)
* Added "regular expression" placeholder in the filter input box
* Issue ...
Tim Pierce
09:16 pm Bug #4336 (Resolved): [Documentation] Improve the 'Upload data to Keep' documentation page at htt...

* Update screenshot
* Update arv-put output (it returns a collection now)
* Remove the bit about downloading a fi...
Ward Vandewege
09:03 pm Bug #4335 (Closed): [Crunch] Improve node startup speed. 15 min is too slow.
It can take up to 15 minutes for a node to appear when a new job is queued. See if we can reduce that. Some of this t... Ward Vandewege
08:05 pm Revision c4aefe62 (arvados): 4031: Test for collection provenance/used_by
Peter Amstutz
08:02 pm Task #4333 (In Progress): Review 4031-fix-graph-connections
Brett Smith
06:21 pm Task #4333 (Resolved): Review 4031-fix-graph-connections
Peter Amstutz
07:49 pm Bug #4334 (Resolved): [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* SLU...
In SLURM, "state*" means "the node was last known to be in state, but I haven't heard from it in a while." Currently... Brett Smith
07:41 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> The first thing I did was "all jobs" &rarr; a job &rarr; clicked on a few tabs, and the Provenanc...
Peter Amstutz
06:10 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
The first thing I did was "all jobs" &rarr; a job &rarr; clicked on a few tabs, and the Provenance page showed a "rel... Tom Clegg
07:36 pm Revision 31e1d10e (arvados): Merge remote-tracking branch 'origin/master' into 4084-log-pane-refresh
Peter Amstutz
07:36 pm Revision ab874e9d (arvados): 4084: Split out behavior of updating job subscribe list to
arv-log-event-subscribe-to-pipeline-job-uuids. Fix arv:pane:reload
setTimeout() that was missing a timeout. Rename ...
Peter Amstutz
07:09 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
This one got away from me a little bit. The code had bit rotted pretty badly and was broken in a number of ways, so ... Peter Amstutz
06:21 pm Task #4143 (In Progress): Write tests
Peter Amstutz
06:21 pm Task #4142 (In Progress): Diagnose and fix
Peter Amstutz
06:18 pm Revision 4d257edd (arvados): 4031: Find for collection dependencies even in the middle of script ...
fields. Server side collections with same PDH into a single entry with a
special name. Fix node descriptions, hyper...
Peter Amstutz
05:50 pm Task #4332 (In Progress): Review 4088-collection-show-files-filter
Brett Smith
03:18 pm Task #4332 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
05:32 pm Revision 2d244def (arvados): Fix off-by-one error in Node Manager server calculations.
This bug prevented Node Manager from starting nodes for a job that
requested a number of nodes equal to the daemon's ...
Brett Smith
05:28 pm Task #4326: Review branch: 4091-test-infinite-scrolling
Updated per your feedback. Please take another look. Thanks. Radhika Chippada
01:47 pm Task #4326 (In Progress): Review branch: 4091-test-infinite-scrolling
Tom Clegg
05:21 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
I got the hash job to run correctly inside a Docker container inside my Docker cluster. That's pretty awesome. Than... Brett Smith
02:01 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Tom Clegg wrote:
> Brett Smith wrote:
> > * If you want to elucidate the comment about TASK_KEEPMOUNT: you may want...
Brett Smith
05:51 am Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> When I click the log in button, I land on a page at https://172.17.0.117/auth/joshid/callback?r...
Tom Clegg
05:44 am Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> I'm working on building all the Docker infrastructure necessary to test this, but while I do, I...
Tom Clegg
05:16 pm Revision fb2ee403 (arvados): 4091: update jobs fixture to set same created_at timestamp for some ...
Radhika Chippada
04:18 pm Revision cbc29982 (arvados): 4091: enhance code to handle the case where there are more than one ...
Also, handle the case where the entire next page has the same created_at time as the previous page's last item; to ke... Radhika Chippada
03:16 pm Revision e34135f6 (arvados): 4088: filter collection file view by regex
Added a "Filter" field for supplying a regular expression to filter
filenames. Updated integration tests.
Tim Pierce
02:59 pm Revision 81bb05b5 (arvados): 3824: Remove redundant addition of arvados package repo and key.
Tom Clegg
02:44 pm Task #4206 (In Progress): write workbench tests
Tim Pierce
02:44 pm Task #4204 (In Progress): Add regex box and filter to app/views/collections/_show_files.html.erb
Tim Pierce
02:35 pm Revision f78b6578 (arvados): 3824: Add sources.list file missing from commit:0f9aaf1
Tom Clegg
02:24 pm Story #4091: [Workbench] Add tests for undertested parts of Workbench, including infinite scroll.
At commit:97f3db9
I think the approach is correct here: if the sort key isn't always unique, get an overlapping pa...
Tom Clegg
01:52 pm Revision 6e2ba4de (arvados): Merge branch '4291-collection-sharing-link-refresh-issue' of git.cur...
Radhika Chippada
01:50 pm Bug #4297 (Feedback): [Crunch] crunch-dispatch eats way too much cpu
Tom Clegg
01:50 pm Revision 36195687 (arvados): 4291: update to address the refrsh issue as suggested in this Stack ...
http://stackoverflow.com/questions/6560592/rails-3-ajax-update-partial-doesnt-work-without-page-refresh Radhika Chippada
01:44 pm Task #4330 (In Progress): Review branch: 4291-collection-sharing-link-refresh-issue
Tom Clegg
01:26 pm Task #4330 (Closed): Review branch: 4291-collection-sharing-link-refresh-issue
Just one line change. Radhika Chippada
01:44 pm Bug #4291: [Workbench] Create sharing link for a collection is broken
commit:5bd0cf6 doesn't look very convincing to me. If the trouble were excess quoting, would this really cause "fail ... Tom Clegg
01:25 pm Bug #4291 (In Progress): [Workbench] Create sharing link for a collection is broken
Radhika Chippada
01:30 pm Task #4331 (Resolved): Add infinite scrolling to pipeline_instances page.
Radhika Chippada
01:28 pm Feature #4024 (In Progress): [Workbench] PipelineInstances#index should scroll down to show older...
Radhika Chippada
01:24 pm Task #4329 (Resolved): Sort order created_at being ignored by the server
Radhika Chippada
01:20 pm Task #4328 (Resolved): Data collections tab for a project displaying all object types.
Radhika Chippada
01:09 pm Task #4328 (Resolved): Data collections tab for a project displaying all object types.
It would be easiest to see this in action in bcosc's Home project. Radhika Chippada
01:03 pm Task #4320 (In Progress): Remember sort order when switching tabs
Phil Hodgson
12:56 pm Revision 5bd0cf6c (arvados): 4291: update to address the refrsh issue
Radhika Chippada
10:54 am Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thanks for the great feedback.
* The "raw" rendering of database columns: apologies for wasting our energy; this w...
Phil Hodgson
10:48 am Revision d0e60c70 (arvados): 3618: remove unnecessary "raw" directive for the sort columns table ...
Phil Hodgson
05:06 am Revision fb1bf9fd (arvados): 3824: Fix up logging messages.
Tom Clegg
03:13 am Task #4304 (Resolved): Review 4015-collection-chooser-portable-data-hash
Tim Pierce
02:24 am Revision 2b6948ff (arvados): 3706: Merge branch 'master' into 3706-keep-warning
Tom Clegg
02:20 am Revision 8323e56e (arvados): 3706: Remove automatic normalization. Add --normalize option to
arv-put. Add normalize() and stripped_manifest() methods to
CollectionReader. Clean up normalize code.
Tom Clegg
02:12 am Revision 112d6ce9 (arvados): 3706: Consolidate more regular expressions into util package.
Tom Clegg
02:08 am Revision d9e2eb19 (arvados): 3706: Do not leave zero-length file segment at end of stream after f...
Tom Clegg
02:04 am Revision 6817b34d (arvados): 3706: In CollectionReader, try fetching manifests before/after API
server when the ID is a Keep locator with/without a permission hint
respectively. Do not display a warning if the man...
Tom Clegg

10/27/2014

09:29 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> I'm working on building all the Docker infrastructure necessary to test this, but while I do, I...
Brett Smith
07:44 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
I'm working on building all the Docker infrastructure necessary to test this, but while I do, I wanted to provide my ... Brett Smith
04:42 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
3824-crunch-container-setup @ commit:30bdc9b
* JOB_WORK and TASK_WORK are docker data volumes, instead of bind mou...
Tom Clegg
09:04 pm Revision 6d23c296 (arvados): 4031: Refresh provenance helper graph generation to fix bugs and mak...
use of available human readable names such as collections and components. Added tests. Peter Amstutz
08:45 pm Task #4326 (Resolved): Review branch: 4091-test-infinite-scrolling
I think infinite scrolling is working now. Radhika Chippada
08:44 pm Story #4091: [Workbench] Add tests for undertested parts of Workbench, including infinite scroll.
Updated API server groups_controller to order on created_at time instead of uuid. This seems to have helped with the ... Radhika Chippada
08:38 pm Revision 97f3db9c (arvados): 4091: retain filters in project contents collections and similar tabs.
Radhika Chippada
08:24 pm Revision e1020f4a (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
08:23 pm Revision 337a0bdb (arvados): 4091: change project contents order from uuid to created_at.
Radhika Chippada
08:15 pm Bug #4015 (Resolved): [Workbench] Collection chooser should be filling in portable_data_hash as w...
Applied in changeset arvados|commit:846ac5d419862e2b0051ec0843e71c601b35da44. Tim Pierce
07:51 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
Tim, thanks for updating. The tests are much better and feel like they are doing it all in a flow now. Thanks. Radhika Chippada
07:41 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
Followup question from Radhika:
> I could be wrong, but I could not find anything special in the new collection and ...
Tim Pierce
06:05 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
Radhika Chippada wrote:
> I only have some comments about the tests.
>
> * pipeline_instances_test.rb
>
> Plea...
Tim Pierce
05:38 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
I only have some comments about the tests.
* pipeline_instances_test.rb
Please remove “from” in “Create a pipel...
Radhika Chippada
08:13 pm Revision 846ac5d4 (arvados): Merge branch '4015-collection-chooser-portable-data-hash'
Fixes #4015. Tim Pierce
07:49 pm Revision f923effe (arvados): 4015: update FUSE mount tests (again)
Tim Pierce
07:37 pm Revision fff7228b (arvados): 4015: simplify integration tests
Responding to code review in #4015-8:
We can (and should) test that the collection portable_data_hash is
recorded in...
Tim Pierce
05:46 pm Revision c330d589 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
05:39 pm Task #4304 (In Progress): Review 4015-collection-chooser-portable-data-hash
Radhika Chippada
05:36 pm Story #3706 (In Progress): [SDKs] Remove fallback-to-keep warning from python SDK if block hash h...
Tom Clegg
05:36 pm Task #4323 (Resolved): Review 4297-dispatch-load
Tom Clegg
03:05 pm Task #4323 (In Progress): Review 4297-dispatch-load
Brett Smith
02:38 pm Task #4323 (Resolved): Review 4297-dispatch-load
Tom Clegg
05:35 pm Revision e68bf42e (arvados): Merge branch '4297-dispatch-load' refs #4297
Tom Clegg
05:35 pm Revision 47853db9 (arvados): 3706: Silence fallback-to-keep warning, show both errors (API and Ke...
Tom Clegg
05:32 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
Tom Clegg wrote:
> Brett Smith wrote:
> > Now, more philosophically: these changes make crunch-dispatch more respon...
Brett Smith
05:19 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
Brett Smith wrote:
> Reviewing commit:789e479
>
> On the code itself:
>
> * @fail_job@ uses @rescue@ to detect...
Tom Clegg
04:15 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
Reviewing commit:789e479
On the code itself:
* @fail_job@ uses @rescue@ to detect when Log creation fails, but ...
Brett Smith
05:00 pm Task #4325 (In Progress): Review 3824-crunch-container-setup
Brett Smith
04:43 pm Task #4325 (Resolved): Review 3824-crunch-container-setup
Tom Clegg
04:54 pm Revision 8c492b39 (arvados): 4297: Merge branch 'master' into 4297-dispatch-load
Tom Clegg
04:53 pm Revision af2ca91d (arvados): 4297: Rename @have_tags -> @job_tags, @have_commits -> @fetched_comm...
Tom Clegg
04:52 pm Revision 2776ad1b (arvados): 4297: Use save! instead of save to ensure failures get logged.
Tom Clegg
04:13 pm Revision 30bdc9b4 (arvados): 3824: Use keep volumes big enough to store the arvados/jobs docker i...
Tom Clegg
04:13 pm Revision c79874f4 (arvados): 3824: Do not say "There are jobs in the queue ahead of this one" if...
Tom Clegg
04:13 pm Revision c0943b24 (arvados): 3824: Add dnsmasq to compute images, to make docker-in-docker work. ...
Tom Clegg
04:13 pm Revision 0f9aaf18 (arvados): 3824: Use a docker volume for TASK_WORK, clean up env var and tmp di...
Tom Clegg
04:02 pm Bug #4324 (New): [Docker] Fix supervisor.conf to supervise services instead of running init.d sta...
Tom Clegg
03:44 pm Bug #4249 (Resolved): [Workbench] Can't view/download files that are retrievable from arv-get
Resolved by #4285 Radhika Chippada
03:40 pm Bug #4285 (Resolved): [Workbench] Not found error when the view or download icons are clicked for...
Applied in changeset arvados|commit:a3db87c5a23f3a1e72ea82304d24db8c1757c095. Radhika Chippada
03:39 pm Bug #4285: [Workbench] Not found error when the view or download icons are clicked for a file in ...
Thanks Brett. I updated accordingly. Radhika Chippada
03:04 pm Bug #4285: [Workbench] Not found error when the view or download icons are clicked for a file in ...
Reviewing commit:f1eb092
I suggest writing the main fix as...
Brett Smith
03:39 pm Task #4319 (Resolved): Review branch: 4285-view-download-collection-subdir-files
Radhika Chippada
02:50 pm Task #4319 (In Progress): Review branch: 4285-view-download-collection-subdir-files
Brett Smith
03:38 pm Revision a3db87c5 (arvados): closes #4285
Merge branch '4285-view-download-collection-subdir-files' Radhika Chippada
03:36 pm Bug #3978: [SDKs] Pipelines started from the CLI should set status to "Paused" when aborted
This looks like commit:8dea7244cf5e50b9fa70bec15b1db3fd2cdd03bf should have already implemented this.
If it is sti...
Tim Pierce
03:28 pm Revision 6ed15992 (arvados): 4285: use regexp to prepent ./ to file path
Radhika Chippada
03:02 pm Revision 68402362 (arvados): 3824: Use keep volumes big enough to store the arvados/jobs docker i...
Tom Clegg
03:02 pm Revision e7489357 (arvados): 3824: Do not say "There are jobs in the queue ahead of this one" if...
Tom Clegg
03:02 pm Revision 3569bc7d (arvados): 3824: Add dnsmasq to compute images, to make docker-in-docker work. ...
Tom Clegg
03:02 pm Revision 66bf1aa3 (arvados): 3824: Use a docker volume for TASK_WORK, clean up env var and tmp di...
Tom Clegg
02:41 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Phil Hodgson wrote:
> * Switching tabs causes refresh: this is true and I tend to agree, but the problem is not due ...
Brett Smith
02:37 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Review @ commit:0edcc26f:
@sdk/python/arvados/commands/run.py@
* The @slots@ stuff was really confusing to me, an...
Tim Pierce
02:31 pm Bug #4291: [Workbench] Create sharing link for a collection is broken
Tried this using bcosc's account. The sharing link IS created and the link works as well. However, the the page does ... Radhika Chippada
02:16 pm Task #4263 (Resolved): Review 4058-workbench-collection-redirect
Peter Amstutz
02:15 pm Task #4301 (Resolved): Review 4295-efficient-websockets
Peter Amstutz
02:10 pm Task #4322 (Resolved): [Node Manager] Should not pair cloud and Arvados nodes immediately after b...
The development of Node Manager went like this:
* First, it immediately paired cloud and Arvados nodes when bootin...
Brett Smith
02:02 pm Task #4321 (New): [SDK] PySDK should arrange exit(111) when a temporary failure exception is unca...
By default, Python exits 1 when there's any uncaught exception. We should introspect these for exceptions that repre... Brett Smith
01:30 pm Revision d5caf622 (arvados): 3603: Improve StreamFileReader.readline() readability.
Brett Smith
01:23 pm Revision 55a92a21 (arvados): 3603: Improve Collection.open signatures and document.
Brett Smith
01:04 pm Revision aec1913f (arvados): 3603: Remove duplicate stream tests from test_collections.
Brett Smith
01:01 pm Revision deeb84da (arvados): 3603: Style improvements.
* Rename util.splitstream to stream.split, and make the signature more
like os.path.split.
* NameAttribute becomes ...
Brett Smith

10/26/2014

12:32 pm Task #4173 (New): Review 3618
Phil Hodgson
12:31 pm Task #4320 (Resolved): Remember sort order when switching tabs
Or, I would propose, at least when using the Browser back (as in #3634), using URL rewriting that would include the s... Phil Hodgson
12:29 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
The "description" columns in the various Project tabs, I'm discovering, are a bit strange, in that they do not seem t... Phil Hodgson
12:25 pm Revision 6bfa1307 (arvados): 3618: best guesses about which database columns could be used for so...
Phil Hodgson
12:24 pm Revision 37b76527 (arvados): 3618: When changing to sorting on a different column, make sure the ...
Phil Hodgson

10/25/2014

06:57 pm Revision 6ad6190f (arvados): 3618: Add Workbench integration test for sorting data collections
Phil Hodgson
06:56 pm Revision fd1613bf (arvados): 3618: correctly propagate the ordering parameters when scrolling
Phil Hodgson
02:09 pm Task #4319 (Resolved): Review branch: 4285-view-download-collection-subdir-files
Radhika Chippada
02:01 pm Revision f1eb092c (arvados): 4285: prepend './' to file path being retrieved when it is in a subd...
Radhika Chippada
08:18 am Revision f7a0b413 (arvados): 3618: Add some basic API server tests for the sort feature
Phil Hodgson
08:17 am Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thinking further about the @sortable_columns@ hash in Workbench, I wonder if we shouldn't more strongly consider havi... Phil Hodgson
02:04 am Bug #4313 (Resolved): [Tests] remove stale *.pyc files between Jenkins tests
Ward Vandewege
02:01 am Revision e71be835 (arvados): Clean up *.pyc files between tests.
closes #4313 Ward Vandewege
02:01 am Revision e71be835 (arvados-dev): Clean up *.pyc files between tests.
closes #4313 Ward Vandewege
01:01 am Revision 35ae6cc3 (arvados): 3603: Use endswith since I'm changing these lines anyway.
Brett Smith

10/24/2014

11:17 pm Revision 42beb8f6 (arvados): 3603: Fixup cruft I added during development.
Brett Smith
10:09 pm Revision 6527508b (arvados): 3603: Fix up duplicate readlines() in StreamFileReader.
Brett Smith
09:38 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
3603-pysdk-file-api-wip is up for review. It adds open() methods to CollectionReader and CollectionWriter that act l... Brett Smith
09:37 pm Story #4316 (Resolved): Review 3603-pysdk-file-api-wip
Brett Smith
09:24 pm Revision 824b37d6 (arvados): 3603: Fix context methods for PySDK Collection objects.
Brett Smith
09:24 pm Revision 2fcc2134 (arvados): 3603: Clean up PySDK imports.
Sort; remove unused imports. Brett Smith
09:24 pm Revision 5fa3808d (arvados): 3603: PySDK Collection objects support file-like APIs.
This commit adds an open() method to CollectionReader and
CollectionWriter. They mimic the built-in open(), returnin...
Brett Smith
08:27 pm Bug #4314 (Resolved): [Crunch] Figure out why this job was marked Failed unexpectedly
examples: qr1hi-8i9sb-cha7spydhjauvvq qr1hi-8i9sb-w5hjmuq7vicng11 qr1hi-8i9sb-vt7mb676a4htd6k
They seemed to have ...
Bryan Cosca
08:06 pm Revision 32aa86dd (arvados-dev): Clean up *.pyc files between tests.
closes #4313 Ward Vandewege
07:01 pm Revision 3a47eb91 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
07:00 pm Revision 4e148ec9 (arvados): 4091: add offset to next page url
Radhika Chippada
06:45 pm Revision ffea5372 (arvados-dev): 4313: remove stale *.pyc files
Tim Pierce
06:44 pm Bug #4313 (Resolved): [Tests] remove stale *.pyc files between Jenkins tests
Before a Jenkins test or install of the Python SDK, remove any leftover *.pyc files from a previous build. Tim Pierce
06:29 pm Story #4312 (Resolved): [Crunch] crunch-job should report current Python SDK version at start of ...
In the epic command line crunch-job uses to start each task, add something like... Tom Clegg
06:26 pm Bug #3486: [DRAFT] [Crunch] Cannot have script parameter value of "false" because arv-run-pipelin...
Check whether this can be resolved like so:... Tom Clegg
06:09 pm Bug #4015 (In Progress): [Workbench] Collection chooser should be filling in portable_data_hash a...
Ward Vandewege
06:08 pm Support #4134 (In Progress): [Support] fix bugs and write tests (second half)
Ward Vandewege
06:08 pm Bug #4031 (In Progress): [Workbench] Nodes should be connected via input=output in provenance/use...
Peter Amstutz
05:58 pm Revision ef56ac56 (arvados): Merge branch '3699-arv-copy'
Refs #3699. Tim Pierce
05:57 pm Revision fb01e304 (arvados): 3699: fix namespace clash: rename module to arv_copy
Prevents confusion with the Python 'copy' module.
No issue # (bug fix)
Tim Pierce
05:54 pm Bug #4185 (Feedback): [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Tom Clegg
05:53 pm Bug #4185: [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Added "swap" to crunchstat memory stats, to help expose low-memory conditions. ("pgmajfault" was also added, in #3826... Tom Clegg
05:51 pm Bug #4185 (In Progress): [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Tom Clegg
05:43 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
* Switching tabs causes refresh: this is true and I tend to agree, but the problem is not due to this feature additio... Phil Hodgson
05:40 pm Revision c5f31bd6 (arvados): 3618: replace js use of == and != with the more predictable === and !==
Phil Hodgson
05:33 pm Bug #4310 (Resolved): [Crunch] crunch-dispatch --jobs locking is broken
[Crunch] qr1hi-d1hrv-xg61rrhrxctnjrb failed with 'state invalid change from Failed to Complete'
We have 2 crunch-d...
Ward Vandewege
05:29 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
I transferred an entire pipeline instance from qr1hi and it ran on my workstation with no changes. Merge this thing! Peter Amstutz
05:25 pm Story #3699 (Resolved): [SDKs] Copy a pipeline instance, along with its input and output data, fr...
Applied in changeset arvados|commit:35ade8a042094a27e2ca5cfd5e9754aa3513410c. Tim Pierce
03:41 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Peter Amstutz wrote:
> When you're copying a pipeline instance that's been run already, the docker image will have b...
Tim Pierce
03:10 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
When you're copying a pipeline instance that's been run already, the docker image will have been resolved into an exp... Peter Amstutz
05:25 pm Task #3838 (Resolved): Review 3699-arv-copy
Tim Pierce
05:21 pm Bug #4309 (New): [SDK] arv-copy collection copy performance
Originally https://arvados.org/issues/3699#note-43
I'm copying a pipeline with a 5990M collection. I noticed this...
Peter Amstutz
05:20 pm Bug #4249 (In Progress): [Workbench] Can't view/download files that are retrievable from arv-get
Tom Clegg
05:20 pm Revision 35ade8a0 (arvados): Merge branch '3699-arv-copy'
Closes #3699. Tim Pierce
05:19 pm Bug #4285 (In Progress): [Workbench] Not found error when the view or download icons are clicked ...
Tom Clegg
05:11 pm Bug #4297 (In Progress): [Crunch] crunch-dispatch eats way too much cpu
Ward Vandewege
03:30 pm Story #4305: [Node Manager] Investigate and try to address RAM use
Another idea that occurred to me: arvnodeman.computenode.ec2 loads information about node sizes, images, security gro... Brett Smith
03:19 pm Story #4308 (Closed): [API] [SDKs] Enable API versioning
Increasingly we're running into the problem where the SDK is written against an older version of the API that turns o... Peter Amstutz
02:19 pm Revision 2c16f4fb (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
02:17 pm Revision c1efd42b (arvados): 4091: adjust the test fixture to use less data to match the limit si...
Radhika Chippada
02:13 pm Revision 0862d720 (arvados): Increase the timeout on "lots of events" websocket test. refs #4295
Peter Amstutz
01:57 pm Bug #4307 (Resolved): [Workbench] Pipeline instance name text should be editable after the instan...
I thought this used to be able to work but now I can't edit it? For example: pipeline_instances/qr1hi-d1hrv-b8ubha43x... Bryan Cosca
01:56 pm Task #4306 (Resolved): [API] "All users" group needs group_class: role
The instructions for adding the "All users" class should include specifying "group_class":"role", otherwise the "all ... Peter Amstutz
01:35 pm Feature #4051 (Rejected): [Workbench] Pipeline component display order should be controlled by so...
Duplicate. Moved over to #2992 Peter Amstutz
01:18 pm Bug #3824 (In Progress): [Crunch] crunch-job should create task execution environment inside dock...
Tom Clegg
01:18 pm Task #4225 (Resolved): Review 3826-crunchstat-netstats -- esp for language issues
Tom Clegg
01:05 pm Bug #4295 (Resolved): [API] Improve websocket efficiency
Applied in changeset arvados|commit:cf1097ef1225c05eb4431093a4971739a3ee5a37. Anonymous
01:03 pm Revision cf1097ef (arvados): Merge branch '4295-efficient-websockets' closes #4295
Peter Amstutz
01:02 pm Revision 563b588d (arvados): 4295: Use EventMachine::schedule when there is potentially more even...
Peter Amstutz
12:47 pm Revision e3fe23ff (arvados): 4295: Fix typo in comment
Peter Amstutz
12:06 pm Revision 66c13b60 (arvados): Merge branch 'master' into 3618-column-ordering
Phil Hodgson
10:10 am Revision 1bde97d8 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada

10/23/2014

10:49 pm Task #4210 (Resolved): populate portable_data_hash in the collection chooser
Tim Pierce
10:35 pm Revision 87b2e5da (arvados): Merge branch 'master' into 4015-collection-chooser-portable-data-hash
Tim Pierce
10:34 pm Revision 7086db26 (arvados): 4015: fix pipeline instance tests
Tim Pierce
10:05 pm Bug #4195 (Resolved): [Documentation] Fix Workbench pipeline tutorial
Applied in changeset arvados|commit:587fcc936d7b5b0b8c16220a5932cf9441e02ab0. Radhika Chippada
05:11 pm Bug #4195: [Documentation] Fix Workbench pipeline tutorial
* The screenshot on user/getting_started/workbench.html is out of date
* (step 9) Finished jobs are now labeled "com...
Peter Amstutz
10:02 pm Task #4280 (Resolved): Review branch: 4195-pipeline-tutorial
Radhika Chippada
04:59 pm Task #4280 (In Progress): Review branch: 4195-pipeline-tutorial
Peter Amstutz
10:01 pm Revision 587fcc93 (arvados): closes #4195
Merge branch '4195-pipeline-tutorial' Radhika Chippada
10:00 pm Revision 6a406787 (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
09:59 pm Revision 35804515 (arvados): 4195: update workbench dashboard pic
Radhika Chippada
09:44 pm Bug #4295: [API] Improve websocket efficiency
Reviewing commit:de3bb6c. There's a small typo in your comments for @push_events@ where it says "it may nil" (missin... Brett Smith
07:53 pm Bug #4295 (In Progress): [API] Improve websocket efficiency
Peter Amstutz
06:11 pm Bug #4295: [API] Improve websocket efficiency
puma also shouldn't recover from out of memory conditions, it should just die. That way runit will restart it.
<pr...
Ward Vandewege
05:54 pm Bug #4295 (Resolved): [API] Improve websocket efficiency
* "logs.id > ?" condition is open ended. This should have a limit and schedule more work if necessary.
* Should loo...
Peter Amstutz
09:32 pm Revision 016ecd4c (arvados): Merge branch '4186-install-doc-improvements'
refs #4186 Ward Vandewege
09:31 pm Revision 091d56d4 (arvados): Merge branch 'master' into 4186-install-doc-improvements
Ward Vandewege
09:25 pm Bug #4228 (Resolved): [Workbench (probably)] Cannot create new collection with selected files in ...
Applied in changeset arvados|commit:fcfd4428e2889ceb847b64b0819207c421de1abd. Radhika Chippada
08:46 pm Bug #4228: [Workbench (probably)] Cannot create new collection with selected files in shared pipe...
Do we want to add a test? Otherwise this looks good to me. Peter Amstutz
02:00 pm Bug #4228 (In Progress): [Workbench (probably)] Cannot create new collection with selected files ...
Radhika Chippada
09:24 pm Revision 22db612b (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
09:24 pm Task #4287 (Resolved): Review branch: 4228-collection-subdir-files
Radhika Chippada
05:14 pm Task #4287 (In Progress): Review branch: 4228-collection-subdir-files
Peter Amstutz
09:23 pm Revision fcfd4428 (arvados): closes #4228
Merge branch '4228-collection-subdir-files' Radhika Chippada
09:16 pm Task #4301 (In Progress): Review 4295-efficient-websockets
Brett Smith
07:52 pm Task #4301 (Resolved): Review 4295-efficient-websockets
Peter Amstutz
09:09 pm Story #4305 (Closed): [Node Manager] Investigate and try to address RAM use
Node Manager uses ~1GiB of RAM on our production clusters. Investigate why it's so large, and try to bring it down.
...
Brett Smith
09:05 pm Task #4304 (Resolved): Review 4015-collection-chooser-portable-data-hash
Ready for review @ commit:87b2e5d, including tests and updated fixtures. Tim Pierce
09:03 pm Revision ae4948ee (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
09:02 pm Revision 140012f1 (arvados): 4015: test recording collection hashes for pipeline inputs
Tim Pierce
09:02 pm Revision 4a774fdb (arvados): 4015: use portable_data_hash to populate chooser
Tim Pierce
09:00 pm Bug #4256: [API] Jobs that sit in the front of the queue for a long time without running should b...
The fiddlesticks error is covered in #4273. This ticket is now specifically about jobs sitting in the queue for a lo... Peter Amstutz
08:58 pm Revision 95b0d814 (arvados): Add install dependencies for the SSO server.
refs #4186 Ward Vandewege
08:52 pm Revision 7149ee5d (arvados): Merge branch 'master' into 4228-collection-subdir-files
Conflicts:
apps/workbench/test/integration/collections_test.rb
Radhika Chippada
08:36 pm Revision 1ed38089 (arvados): refs #4227
Merge branch '4227-test-fix' Radhika Chippada
08:30 pm Bug #4303 (Resolved): [Crunch] Output of job gets stuck at collate step
This job (qr1hi-8i9sb-56vgstlp2wk56vn) ran for ~6h and while watching the logs it seemed to have stalled towards its ... Bryan Cosca
08:29 pm Revision 0311a59f (arvados): Explain the Keepstore's -permission-key-file argument and API server's
blob_signing_key configuration value.
refs #4186
Ward Vandewege
08:29 pm Revision 34471863 (arvados): no issue #
Radhika Chippada
08:26 pm Feature #4302 (New): [Crunch] Pipelines should not fail immediately after one job failure, but co...
The current pipeline running model very linear:
If A > B > C > D (the output of a is needed to run b, etc). if B fai...
Bryan Cosca
08:26 pm Revision 1a20f5f5 (arvados): no issue #
Merge branch 'master' of git.curoverse.com:arvados Radhika Chippada
08:22 pm Revision 4265a54a (arvados): refs #4227 - update strptime format for parsing pipeline start and f...
Radhika Chippada
08:22 pm Revision de3bb6cb (arvados): 4295: Abort on NoMemoryError
Peter Amstutz
07:59 pm Revision 93ffb7c3 (arvados): First set of improvements:
* Suggest skipping SSO server installation for now, until we upgrade that codebase
* Be more explicit about the desi...
Ward Vandewege
07:55 pm Bug #4266 (Resolved): [Crunch] crunch-dispatch should process logs efficiently, particularly whil...
Tom Clegg
07:55 pm Task #4272 (Resolved): Review 4266-log-performance
Tom Clegg
07:54 pm Task #4283 (In Progress): Make test case
Tom Clegg
07:54 pm Task #4282 (Resolved): Create/setup task temp dirs at runtime
Tom Clegg
07:52 pm Revision fdaaff31 (arvados): 4295: Add test that large numbers of events are handled efficiently ...
Peter Amstutz
07:45 pm Revision 9feeea12 (arvados): Merge branch '4139-clean-api-node-cruft-wip'
Refs #4139, #4274. Closes #4276. Brett Smith
07:44 pm Revision 91738b3c (arvados): 4139: Remove cloud node setup code from API server.
This code has never been used in production, and its functionality has
officially been assumed by Node Manager.
Brett Smith
07:44 pm Revision 351895cf (arvados): 4139: Node create API requires a node parameter.
This makes it more consistent with other API create methods. Brett Smith
07:41 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
4297-dispatch-load @ commit:789e479
* Don't refresh node status more than once per second
* Cache api tokens, don...
Tom Clegg
06:32 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
crunch-dispatch in --jobs mode eats way to much cpu. The ps output below has 2 ruby processess owned by root. Those a... Ward Vandewege
06:20 pm Bug #4297 (Resolved): [Crunch] crunch-dispatch eats way too much cpu
Ward Vandewege
07:39 pm Revision 789e4799 (arvados): 4297: Cache results of git-fetch-pack, git-tag, and API token
creation. Fail jobs on git repo/version failures instead of retrying
forever.
Tom Clegg
07:37 pm Revision ea80735a (arvados): refs #4227 - rescue from any error in parsing pipeline start and fin...
Radhika Chippada
07:36 pm Revision a3ba50fd (arvados): 4139: Node create API requires a node parameter.
This makes it more consistent with other API create methods. Brett Smith
07:29 pm Revision 21ccdae7 (arvados): 4295: Fixed tests
Peter Amstutz
07:22 pm Revision 74e7f636 (arvados): 4295: First pass at more efficient database utilization. A few test...
Peter Amstutz
07:05 pm Story #4299 (Rejected): [Node Manager] Support a configurable throttle for creating cloud nodes
You should be able to specify that the daemon should not create more than N cloud nodes in T duration of time. The d... Brett Smith
06:58 pm Bug #4298 (Resolved): [Workbench] Admin user should see cpu/ram/scratch capacity after clicking a...
The values are blank. I verified that the node records do have the correct information. Ward Vandewege
06:53 pm Revision 21d67203 (arvados): 4297: Do not update_node_status more than once per second.
Tom Clegg
05:55 pm Bug #4296 (Resolved): [SSO] 500 from a fresh login
Steps to reproduce:
# Start with a new browser session. No cookies, etc.
# Visit workbench.qr1hi.
# Click "Log ...
Brett Smith
05:53 pm Revision 2def2025 (arvados): Increase limit for collections controller querying same portable_dat...
workaround to fix tests, refs #4058, but really needs a proper fix, refs #3400 Peter Amstutz
05:46 pm Story #4294 (Resolved): [Node Manager] Add support for min_nodes configuration value
When the daemon gets a new list of cloud nodes, if the total count of nodes is less than min_nodes, it should start o... Brett Smith
05:43 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Okay: at commit:e845145 this code uses @arvados.commands.keepdocker.list_images_in_arv@ to identify which docker imag... Tim Pierce
05:43 pm Story #4293 (Resolved): [Node Manager] Write off cloud nodes that spend too long in booted state
If the cloud has an internal error starting a node, Node Manager won't shut it down until the normal shutdown window ... Brett Smith
05:36 pm Revision e8451457 (arvados): 3699: figure out correct docker image to fetch
Use arvados.commands.keepdocker.list_images_in_arv to figure out which
Docker image is represented by a given image n...
Tim Pierce
05:31 pm Bug #4291 (Resolved): [Workbench] Create sharing link for a collection is broken
It gives me a Not Found message. i.e. collections/qr1hi-4zz18-ntyi7uygpyep0sx under sharing and permissions button. (... Bryan Cosca
05:19 pm Revision 22c51cdf (arvados): 3824: Use a docker volume for TASK_WORK, clean up env var and tmp di...
Tom Clegg
03:52 pm Task #4290 (In Progress): Review 4084-log-pane-refresh
Tom Clegg
03:17 pm Task #4290 (Resolved): Review 4084-log-pane-refresh
Peter Amstutz
03:38 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
This story experienced some scope creep due to the need to rework websocket based refreshing to really solve the prob... Peter Amstutz
03:20 pm Bug #4058 (Resolved): [Workbench] "Show portable data hash" page should show the kind of content ...
Applied in changeset arvados|commit:11085f87c952c7e46a15c88e144190cac32b95a8. Anonymous
02:27 pm Bug #4058: [Workbench] "Show portable data hash" page should show the kind of content that relate...
Peter Amstutz wrote:
> Done.
commit:81cb0b6a still says "collection have." Make "collections" plural and this is...
Brett Smith
01:39 pm Bug #4058: [Workbench] "Show portable data hash" page should show the kind of content that relate...
Brett Smith wrote:
> Reviewing commit:d599adb
>
> The code is good. A couple of things about the view. First, t...
Peter Amstutz
03:18 pm Revision 11085f87 (arvados): Merge branch '4058-workbench-collection-redirect' closes #4058
Peter Amstutz
03:18 pm Revision 34a9171f (arvados): 4058: Typo fix "collection" -> "collections"
Peter Amstutz
03:17 pm Task #4155 (Resolved): Write tests
Peter Amstutz
01:40 pm Task #4155 (In Progress): Write tests
Peter Amstutz
01:39 pm Task #4155 (Resolved): Write tests
Peter Amstutz
03:12 pm Revision d8c4d51e (arvados): 4084: Added tests for auto-refresh of pipeline instance, job, and da...
Peter Amstutz
03:03 pm Bug #4289: [Workbench] Job view should include the relevant component name(s) from each pipeline ...
When having this job !8555b7122bea802f5570203e89669e2f.png! and clicking on the uuid to bring up the job page, the na... Bryan Cosca
03:03 pm Bug #4289 (New): [Workbench] Job view should include the relevant component name(s) from each pip...
There is a list of pipelines that used the job, but they don't show the name of the relevant component.
It's proba...
Bryan Cosca
02:29 pm Bug #4288: [API] api server docker_images endpoint
Clients should be able to ask the API server for the UUID and/or content hash of a collection that a given docker ima... Tim Pierce
02:25 pm Bug #4288 (New): [API] api server docker_images endpoint
Tim Pierce
01:40 pm Task #4154 (Resolved): Investigate
Peter Amstutz
01:38 pm Revision 81cb0b6a (arvados): 4058: Tweaked presentation per review feedback
Peter Amstutz
01:37 pm Revision f8dab157 (arvados): 4091: pass limit parameter from project tabs.
Radhika Chippada
01:31 pm Story #4091 (In Progress): [Workbench] Add tests for undertested parts of Workbench, including in...
* Reopening it for the following reason:
The test with "2 pipelines and 200 jobs" is failing more than occasionall...
Radhika Chippada
02:30 am Bug #4026 (Resolved): [Workbench] "Move to project..." button should be displayed to an admin use...
Applied in changeset arvados|commit:c6056f6f1bb99fa10bc2046266accc4a85f66aad. Radhika Chippada
02:28 am Bug #4026 (In Progress): [Workbench] "Move to project..." button should be displayed to an admin ...
Radhika Chippada
02:26 am Task #4261 (Resolved): Review branch: 4026-project-move-admin
Radhika Chippada
02:25 am Revision c6056f6f (arvados): closes #4026
Merge branch '4026-project-move-admin' Radhika Chippada
02:24 am Revision a008743d (arvados): 4026: simplify writable check
Radhika Chippada
12:10 am Revision 789e1eb8 (arvados): Merge branch 'master' into 4026-project-move-admin
Radhika Chippada

10/22/2014

11:38 pm Revision a124a535 (arvados): Merge branch 'master' into 4228-collection-subdir-files
Radhika Chippada
11:12 pm Revision 3ca013ae (arvados): 4228: add test for combining files from a collection subdir.
Radhika Chippada
09:36 pm Task #4287 (Resolved): Review branch: 4228-collection-subdir-files
Radhika Chippada
09:32 pm Bug #4286 (Rejected): Files in subdirectories of collection should be viewable/downloadable
Duplicate of #4285 Radhika Chippada
09:30 pm Bug #4286 (Rejected): Files in subdirectories of collection should be viewable/downloadable
For example, collections/qr1hi-4zz18-74ikz4mn29q3i34 Bryan Cosca
09:29 pm Bug #4285: [Workbench] Not found error when the view or download icons are clicked for a file in ...
Observed this issue while testing 4228:
Not only are we getting empty collections when combining files that are in...
Radhika Chippada
09:28 pm Bug #4285 (Resolved): [Workbench] Not found error when the view or download icons are clicked for...
Radhika Chippada
09:18 pm Revision 3bf2514d (arvados): 4228: fix arv_normalize input when a file in a subdir of a collectio...
Radhika Chippada
09:04 pm Revision f4bc3892 (arvados): 4084: Remove stray debugging statement
Peter Amstutz
08:44 pm Revision f7aa5c8d (arvados): 4084: Missing files.
Peter Amstutz
08:40 pm Revision 222ce293 (arvados): 4084: Job display, log and buttons refresh using same mechanism as p...
* Job cancel button is now an AJAX call instead of a page reload.
* Remove "cancel job" button from tab line buttons ...
Peter Amstutz
08:38 pm Bug #4026: [Workbench] "Move to project..." button should be displayed to an admin user even if t...
Reviewing commit:2556bf9
It's possible to simplify this condition by saying ...
Brett Smith
08:36 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Peter Amstutz wrote:
> Boo! It needs to either create docker_image_repo+tag links for the Docker image, or rewrite ...
Tim Pierce
05:19 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Peter Amstutz wrote:
> See attached image, there's a very clear falloff between blocks -- doing this sequentially is...
Tim Pierce
08:28 pm Revision d3dbc2c0 (arvados): 3699: copy docker image links
copy_docker_images and copy_docker_image copy any docker image
collections and add 'docker_image_repo+tag' and 'docke...
Tim Pierce
08:17 pm Revision f2ba19f9 (arvados): 4228: fix arv_normalize input when a file in a subdir of a collectio...
Radhika Chippada
08:07 pm Task #4261 (In Progress): Review branch: 4026-project-move-admin
Brett Smith
08:06 pm Bug #4058: [Workbench] "Show portable data hash" page should show the kind of content that relate...
Reviewing commit:d599adb
The code is good. A couple of things about the view. First, there's a typo: "collection...
Brett Smith
07:30 pm Revision 47221ee0 (arvados): 4084: Rework refresh event handling:
* Tabs no longer refresh on log events by default
* Added explicit 'arv-refresh-on-log-event' class to refresh panes
...
Peter Amstutz
07:30 pm Task #4263 (In Progress): Review 4058-workbench-collection-redirect
Brett Smith
07:13 pm Revision a8b3df3d (arvados): 4137: Fix bad state reference in Node Manager daemon.
Refs #4137. Brett Smith
07:00 pm Bug #4227 (Resolved): [Workbench] Pipeline elapsed time is misformatted
Applied in changeset arvados|commit:6eaaae29a7af005e417673d79e0951122065e685. Radhika Chippada
06:47 pm Bug #4227: [Workbench] Pipeline elapsed time is misformatted
Thanks for following through on this. commit:99ad159 is good to merge, thanks. Brett Smith
03:34 pm Bug #4227: [Workbench] Pipeline elapsed time is misformatted
Reviewing commit:e102efba. The fix is good, but I'm surprised at how involved the test code is.
* I'm not sure I ...
Brett Smith
06:58 pm Task #4277 (Resolved): Review branch: 4227-date-display
Radhika Chippada
05:22 pm Task #4277: Review branch: 4227-date-display
Ready for another look. Radhika Chippada
03:05 pm Task #4277 (In Progress): Review branch: 4227-date-display
Brett Smith
06:57 pm Revision 6eaaae29 (arvados): closes #4227
Merge branch '4227-date-display' Radhika Chippada
06:55 pm Revision ff36aa7e (arvados): Merge branch 'master' into 4227-date-display
Conflicts:
apps/workbench/test/integration/projects_test.rb
Radhika Chippada
06:46 pm Revision 83fc1e7b (arvados): refs #4091 - comment out the test that is failing intermittently in ...
Radhika Chippada
06:29 pm Revision 58ead50f (arvados): 4139: Fix race condition in Node Manager tests.
Get a reference to the monitor mock earlier, before the daemon starts
working with it. Otherwise, we might get incon...
Brett Smith
06:01 pm Revision 5870334b (arvados): Report "swap" memory statistic if kernel provides it. refs #4185
Tom Clegg
05:25 pm Bug #4185: [Crunch] crunchstat memory reports seem suspect for multithreaded programs
OTOH maybe I was looking at the wrong task above, because now top says... Tom Clegg
03:39 pm Bug #4185: [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Watching a java program on compute0.q (qr1hi-8i9sb-brduspenge0fw63)... Tom Clegg
05:12 pm Revision 99ad159b (arvados): 4227: much simplified date display test
Radhika Chippada
03:55 pm Revision e6359fe1 (arvados): Merge branch 'master' into 4227-date-display
Radhika Chippada
03:05 pm Story #3826 (Resolved): [Crunch] Display network activity in crunchstat
Applied in changeset arvados|commit:89f38df7ce6e3af8e6119a111cdf985de6e0a0e9. Anonymous
02:56 pm Story #3826: [Crunch] Display network activity in crunchstat
Tim Pierce wrote:
> That's ok. Mostly I'm calling this out to find out if we are still seeing edge cases where crun...
Tom Clegg
02:37 pm Story #3826: [Crunch] Display network activity in crunchstat
Reviewing @ commit:41887dd:
Thanks for making these changes! LGTM.
Tom Clegg wrote:
> Tim Pierce wrote:
> > ...
Tim Pierce
03:03 pm Revision a522b584 (arvados): Add services/crunchstat to test suite. refs #3826
Tom Clegg
03:03 pm Revision a522b584 (arvados-dev): Add services/crunchstat to test suite. refs #3826
Tom Clegg
03:01 pm Revision 89f38df7 (arvados): Merge branch '3826-crunchstat-netstats' closes #3826
Tom Clegg
02:57 pm Revision fe5ee2e3 (arvados): 3826: Merge branch 'master' into 3826-crunchstat-netstats
Tom Clegg
02:43 pm Revision d501ef45 (arvados): 3824: Show stdout/stderr if shell cmd fails in install script.
Tom Clegg
02:38 pm Story #4284 (Closed): [Crunch] Add unit and functional tests to crunchstat test suite
Tim Pierce
02:35 pm Revision 1aabac3c (arvados): Merge branch '4139-node-manager-race-fix-wip'
Refs #4139, #4275. Brett Smith
02:35 pm Task #4283 (Resolved): Make test case
Tom Clegg
02:34 pm Revision 8d263952 (arvados): 4139: Node Manager more closely tracks nodes it boots.
When using Node Manager on EC2, we saw a race condition where a node
would finish setting up, but would not be return...
Brett Smith
02:32 pm Task #4282 (In Progress): Create/setup task temp dirs at runtime
Tom Clegg
02:32 pm Task #4282 (Resolved): Create/setup task temp dirs at runtime
Tom Clegg
02:13 pm Task #4198 (Resolved): Review 3826-crunchstat-netstats
Tom Clegg
02:02 pm Revision ca1ddb91 (arvados): 4139: Node Manager supports subscribing to shutdown events.
This is necessary to fix a race condition. The daemon needs to be
able to track nodes that it has booted even if the...
Brett Smith
01:35 pm Revision 1c44466e (arvados-dev): Make run-deploy.sh a bit smarter about which compute nodes are a...
up.
Note: there are still race conditions to be addressed here. Or maybe
better, we probably just shouldn't care abo...
Ward Vandewege
01:35 pm Revision 1c44466e (arvados): Make run-deploy.sh a bit smarter about which compute nodes are actually
up.
Note: there are still race conditions to be addressed here. Or maybe
better, we probably just shouldn't care abo...
Ward Vandewege

10/21/2014

10:17 pm Task #4280 (Resolved): Review branch: 4195-pipeline-tutorial
Branch ready for review. The tutorial needed update to match the latest dashboard, where "Add new project" button is ... Radhika Chippada
10:12 pm Revision 3ff1b002 (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
10:11 pm Revision a15315b9 (arvados): 4195: fix the tutorial to match the latest dashboard ui.
Radhika Chippada
09:29 pm Revision 06686c47 (arvados): Merge branch '4266-log-performance' refs #4266
Tom Clegg
09:12 pm Revision 7d6bf718 (arvados): 4266: Merge branch 'master' into 4266-log-performance
Tom Clegg
09:10 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Tom Clegg wrote:
> Looping with @each_line@ is certainly better than constructing an array. I also used @$/@ instead...
Brett Smith
09:05 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Brett Smith wrote:
> Thanks. Looking at the short-circuit condition again, is it possible we'll double-count some @...
Tom Clegg
07:27 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Reviewing commit:de79b73
Tom Clegg wrote:
> Brett Smith wrote:
> > * There's a lot of code cleanup here, which p...
Brett Smith
05:34 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Brett Smith wrote:
> Reviewing commit:2e76e6a. I mostly have questions.
>
> * There's a lot of code cleanup here...
Tom Clegg
01:36 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Reviewing commit:2e76e6a. I mostly have questions.
* There's a lot of code cleanup here, which provides little im...
Brett Smith
08:45 pm Revision 6ad9adc1 (arvados): 4266: Add word missing from comment.
Tom Clegg
08:45 pm Revision b25d2ec2 (arvados): 4266: Use each_line as enumerator instead of building an array with ...
Tom Clegg
08:34 pm Revision 0c6f7b22 (arvados): 4266: Add missing "next" statement, oops.
Tom Clegg
08:18 pm Revision edac8924 (arvados): 4084: An actual failing test that detects the "new log lines causes ...
Peter Amstutz
07:57 pm Revision e102efba (arvados): 4227: update fixtures to use bigger finish times
Radhika Chippada
07:44 pm Revision 86e8d9a3 (arvados): Merge branch 'master' of git.curoverse.com:arvados into 4227-date-di...
Radhika Chippada
07:42 pm Bug #4195 (In Progress): [Documentation] Fix Workbench pipeline tutorial
Radhika Chippada
07:34 pm Revision 3203a943 (arvados): 4084: Add live logging test
Peter Amstutz
07:18 pm Revision 22dbb061 (arvados): 4084: Should be able to write tests against websocket-based function...
Peter Amstutz
06:40 pm Revision b5c04e9b (arvados): Merge branch '4139-node-manager-polling-logging-wip'
Refs #4275, #4139. Brett Smith
06:33 pm Revision 9362030c (arvados): 4139: Improve scheduling of Node Manager polls.
* Catch all exceptions, so that we keep polling no matter what
happens. Use CLIENT_ERRORS as a hint about how much...
Brett Smith
06:33 pm Revision 4fb27993 (arvados): 4139: Improve logging in Node Manager poll actors.
Brett Smith
06:33 pm Revision 15f36750 (arvados): 4139: Node Manager callback actor avoids redundant delivery calls.
This helps make it more responsive when it receives a shutdown
request.
Brett Smith
05:55 pm Task #4277 (Resolved): Review branch: 4227-date-display
Radhika Chippada
05:48 pm Revision 183df814 (arvados): 4227: some more test and fixture updates.
Radhika Chippada
05:46 pm Revision de79b73c (arvados): 4266: Tweak long-line handling.
Tom Clegg
05:40 pm Bug #4227 (In Progress): [Workbench] Pipeline elapsed time is misformatted
The issue is in dates.js, another one of the under-tested javascript areas. Fix issue and add tests. Radhika Chippada
05:29 pm Revision 6d3a8884 (arvados): 4266: Fix OOM when stderr has a lot of data with no newlines.
Tom Clegg
05:28 pm Revision 19c0f65c (arvados): 4227: minor test upadtes
Radhika Chippada
05:05 pm Revision 3254f0a9 (arvados): 4266: Clean up streambuf.split(newline) loop.
Tom Clegg
05:01 pm Task #4260 (Resolved): Review branch: 4054-sharing-email
Radhika Chippada
01:45 pm Task #4260 (In Progress): Review branch: 4054-sharing-email
Brett Smith
05:00 pm Bug #4054 (Resolved): [Workbench] In the project sharing tab, show email addresses alongside full...
Applied in changeset arvados|commit:7d7e23d01f1d00edf49ba50ded5ffe8054691ada. Radhika Chippada
02:03 pm Bug #4054: [Workbench] In the project sharing tab, show email addresses alongside full names.
commit:1bb0592 looks great, please merge. Thanks. Brett Smith
05:00 pm Revision 972974d7 (arvados): Merge branch 'master' into 4227-date-display
Radhika Chippada
04:57 pm Task #4224 (Resolved): Review 3787-docker-docs
Peter Amstutz
04:56 pm Revision 7d7e23d0 (arvados): closes #4054
Merge branch '4054-sharing-email' Radhika Chippada
04:54 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
... Peter Amstutz
04:09 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
I'm copying a pipeline with a 5990M collection. I noticed this code:... Peter Amstutz
04:54 pm Revision 24ea6749 (arvados): 4091: the test with 200 jobs and 10 pipelines is failing in jenkins ...
Radhika Chippada
04:48 pm Revision e0f182c2 (arvados): Merge branch 'master' into 4054-sharing-email
Radhika Chippada
04:47 pm Revision cef5c3f1 (arvados): 4227: AM / PM indicator fix
Radhika Chippada
03:20 pm Task #4210 (In Progress): populate portable_data_hash in the collection chooser
Tim Pierce
02:58 pm Revision 76786270 (arvados): 4139: Remove cloud node setup code from API server.
This code has never been used in production, and its functionality has
officially been assumed by Node Manager.
Brett Smith
02:11 pm Revision 1a3d59cd (arvados): Arvados python SDK: do not blow up when HOME is not set.
No issue # Ward Vandewege
01:00 pm Revision a013dc7e (arvados-dev): * exclude /usr/local/lib/python2.7/dist-packages/tests from our ...
* exclude /usr/local/arvados/src/.git from the arvados-src package (bugfix)
No issue #
Ward Vandewege
01:00 pm Revision a013dc7e (arvados): * exclude /usr/local/lib/python2.7/dist-packages/tests from our fpm ...
* exclude /usr/local/arvados/src/.git from the arvados-src package (bugfix)
No issue #
Ward Vandewege
01:00 pm Revision 1a655bf2 (arvados): run-build-packages: Test that fpm is callable before trying to do
anything.
No issue #
Ward Vandewege
01:00 pm Revision 1a655bf2 (arvados-dev): run-build-packages: Test that fpm is callable before trying to do
anything.
No issue #
Ward Vandewege
12:42 pm Task #4272 (In Progress): Review 4266-log-performance
Brett Smith
12:17 pm Revision 8f4aa687 (arvados-dev): Build a few more dependency packages for node manager.
refs #3244 Ward Vandewege
12:17 pm Revision 8f4aa687 (arvados): Build a few more dependency packages for node manager.
refs #3244 Ward Vandewege
12:10 am Bug #4273 (New): [API] as admin user, permission denied canceling a job (started by another user)
Hitting the cancel button in workbench for job 9tee4-8i9sb-rgnue1x0sowi0x6 yields
{
":errors":[
"#<Arvados...
Ward Vandewege

10/20/2014

10:00 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
In @PipelineInstancesController#update@ there is some (possibly now unreachable) code that does something very simila... Tom Clegg
09:35 pm Task #4272 (Resolved): Review 4266-log-performance
Tom Clegg
09:35 pm Task #4267 (Resolved): Optimize ruby code
Tom Clegg
06:50 pm Task #4267 (Resolved): Optimize ruby code
Tom Clegg
09:35 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
4266-log-performance @ commit:2e76e6a
Laptop tests show crunch-dispatch.rb accepting ~200MiB/s using 80% CPU while...
Tom Clegg
07:56 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Clues:
* Possible http://serverfault.com/questions/452833/how-to-resolve-high-cpu-excessive-stat-etc-localtime-and-c...
Tom Clegg
06:50 pm Bug #4266 (In Progress): [Crunch] crunch-dispatch should process logs efficiently, particularly w...
Tom Clegg
06:49 pm Bug #4266 (Resolved): [Crunch] crunch-dispatch should process logs efficiently, particularly whil...
Example, while tossing rate-limited logs:
* ...
Tom Clegg
09:30 pm Revision 2e76e6ae (arvados): 4266: Fix log processing performance.
* Remove "max log table entries per job" limit (and its horrible
memory leak).
* When logs are coming fast, but un...
Tom Clegg
08:50 pm Revision 8d7ac593 (arvados): 4239: Build more dependencies of new google-api-python-client.
Refs #4239. Brett Smith
08:50 pm Revision 8d7ac593 (arvados-dev): 4239: Build more dependencies of new google-api-python-client.
Refs #4239. Brett Smith
08:40 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
At commit commit:81c3241:
Peter Amstutz wrote:
> * I used arv-copy and got a pipeline: 4xphq-d1hrv-c25qsfov6u70jt...
Tim Pierce
08:39 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
... Peter Amstutz
08:08 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
* This is not terribly reassuring: ... Peter Amstutz
07:57 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
* I used arv-copy and got a pipeline: 4xphq-d1hrv-c25qsfov6u70jt1 It has been given an unhelpful generic name (grant... Peter Amstutz
07:20 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Revision at commit:8bd432b:

_The re.sub 'repl' function takes a MatchObject as argument, not a string. Oops._
...
Tim Pierce
06:34 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
... Peter Amstutz
06:23 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Nice finds. New version at commit:cdaf5c7.
Peter Amstutz wrote:
> * Help text says "Copy a pipeline instance from...
Tim Pierce
08:36 pm Revision 81c3241d (arvados): 3699: bug fixes
* abort() should not crash the program because it's calling logging.info
wrong
* if the pipeline description is Non...
Tim Pierce
08:27 pm Bug #4269 (Resolved): [API] Disallow collection UUIDs in script_parameters, only allow portable d...
One of the unintended side effects of #3036 is that the Collection chooser dialog has been filling in collection reco... Peter Amstutz
07:40 pm Support #3787 (Resolved): [Documentation] Add a section in the User Guide about how to create, up...
Applied in changeset arvados|commit:a22d6e6bf03c6f274237f775a4c02122c9ce38ef. Anonymous
07:33 pm Support #3787: [Documentation] Add a section in the User Guide about how to create, upload, and u...
Peter Amstutz wrote:
> Brett Smith wrote:
> > This is good, but it still doesn't mention anything about the user ru...
Brett Smith
07:25 pm Support #3787: [Documentation] Add a section in the User Guide about how to create, upload, and u...
Brett Smith wrote:
> This is good, but it still doesn't mention anything about the user running the commands bei...
Peter Amstutz
07:03 pm Support #3787: [Documentation] Add a section in the User Guide about how to create, upload, and u...
Reviewing commit:ff76923
Peter Amstutz wrote:
> Brett Smith wrote:
> > * The standard blurb about having a usabl...
Brett Smith
06:09 pm Support #3787: [Documentation] Add a section in the User Guide about how to create, upload, and u...
Brett Smith wrote:
> Reviewing commit:4c0c769
>
> I like everything on this page. Thanks for writing it up. I u...
Peter Amstutz
01:52 pm Support #3787: [Documentation] Add a section in the User Guide about how to create, upload, and u...
Reviewing commit:4c0c769
I like everything on this page. Thanks for writing it up. I understand this is intended...
Brett Smith
07:36 pm Revision a22d6e6b (arvados): Merge branch '3787-docker-docs' closes #3787
Peter Amstutz
07:35 pm Revision ff9423f0 (arvados): 3787: docker group -> @docker@ group for consistency
Peter Amstutz
07:23 pm Revision cc515621 (arvados): 3787: Add note about needing to be in docker group. A few other min...
Peter Amstutz
07:17 pm Revision 8bd432b7 (arvados): 3699: bug fix
The re.sub 'repl' function takes a MatchObject as argument, not a
string. Oops.
Also we need to do manifest.splitlin...
Tim Pierce
06:18 pm Revision cdaf5c71 (arvados): 3699: collection copying bug fixes
From code review #3699-35:
* Updated help text
* Find collection UUIDs and hashes throughout script_parameters even i...
Tim Pierce
06:12 pm Revision ff769230 (arvados): 3787: Update title, grammar, add "Share Docker images", add job-pipe...
Peter Amstutz
05:49 pm Revision 2556bf9a (arvados): Merge branch 'master' into 4026-project-move-admin
Conflicts:
apps/workbench/test/integration/projects_test.rb
Radhika Chippada
05:34 pm Revision 1bb0592a (arvados): Merge branch 'master' into 4054-sharing-email
Radhika Chippada
05:21 pm Bug #4265: [Workbench] default .ssh/config instructions should specify cluster name
The instructions for updating @.ssh/config@ that are listed at https://workbench.qr1hi.arvadosapi.com/manage_account ... Tim Pierce
05:17 pm Bug #4265 (New): [Workbench] default .ssh/config instructions should specify cluster name
Tim Pierce
05:06 pm Story #3826: [Crunch] Display network activity in crunchstat
Tim Pierce wrote:
> Reviewing @ commit:a5ec4164:
>
> Something we should consider is whether we can reuse any of ...
Tom Clegg
04:34 pm Revision 41887dd2 (arvados): 3826: Merge branch 'master' into 3826-crunchstat-netstats
Tom Clegg
04:28 pm Story #4091 (Resolved): [Workbench] Add tests for undertested parts of Workbench, including infin...
Added tests for infinite scrolling: commit 3844c251d4db322759a23a6370faefb7c8e27728 Radhika Chippada
04:27 pm Task #4226 (Resolved): Review 4062-infinite-scroll-repeat-issue (this addresses 4062 and 4091)
Radhika Chippada
01:47 pm Task #4226 (In Progress): Review 4062-infinite-scroll-repeat-issue (this addresses 4062 and 4091)
Tom Clegg
04:18 pm Revision c744c6ce (arvados): 3826: Fix confusing reuse of variable name.
Tom Clegg
04:18 pm Revision 06d0338d (arvados): 3826: Use strconv instead of scanner + sscanf.
Tom Clegg
04:10 pm Revision ae670519 (arvados): 3826: Use global logChan. Use ioutil.ReadFile.
Tom Clegg
03:57 pm Revision 85c6c9ee (arvados): 3826: Clean up slice initialization.
Tom Clegg
03:45 pm Bug #4062 (Resolved): [Workbench] Infinite scrolling in the 'Jobs and pipelines' tab should not k...
Applied in changeset arvados|commit:3844c251d4db322759a23a6370faefb7c8e27728. Radhika Chippada
02:46 pm Bug #4062: [Workbench] Infinite scrolling in the 'Jobs and pipelines' tab should not keep repeati...
Radhika Chippada wrote:
> * Tom, thanks for the tip about scrolling size. Infinite scrolling is now working in the t...
Tom Clegg
03:39 pm Task #4263 (Resolved): Review 4058-workbench-collection-redirect
Peter Amstutz
03:39 pm Task #4150 (Resolved): Add tests
Peter Amstutz
03:39 pm Task #4149 (Resolved): Redirect when there is a single collection, show a "menu" page when there ...
Peter Amstutz
03:39 pm Revision d599adb3 (arvados): 4058: Tests for portable data hash redirection and multiple matches ...
Peter Amstutz
03:25 pm Revision 3844c251 (arvados): closes #4062
Merge branch '4062-infinite-scroll-repeat-TC' Radhika Chippada
02:47 pm Revision 1f168b8d (arvados): 4062: Do not clobber next_page_url filters with local filters.
Tom Clegg
02:45 pm Revision 59807e4a (arvados): 4058: If a portable data hash correpsonds to a single collection, au...
redirect to the collection page. If not, show a special "menu" page listing
the matching collections.
Peter Amstutz
02:24 pm Revision 4335bce9 (arvados): 4062: Merge branch 'master' into 4062-infinite-scroll-repeat-TC
Tom Clegg
01:45 pm Bug #4068 (Rejected): [Workbench] the /manage_account account page does not show all repositories...
Rejecting since it is not a bug. Radhika Chippada
01:39 pm Task #4261 (Resolved): Review branch: 4026-project-move-admin
Branch ready for review. Radhika Chippada
01:22 pm Revision 12df2994 (arvados): 4026: admin user can move a project under another user's home project.
Radhika Chippada
01:02 pm Task #4224 (In Progress): Review 3787-docker-docs
Brett Smith
12:59 pm Support #4133 (Resolved): [Support] fix bugs and write tests (first half)
Brett Smith

10/18/2014

12:37 am Revision 55cc2709 (arvados): 4054: minor test update
Radhika Chippada
12:12 am Task #4260 (Resolved): Review branch: 4054-sharing-email
Branch ready for review. Radhika Chippada
12:09 am Revision aa2245a2 (arvados): Merge branch 'master' into 4054-sharing-email
Radhika Chippada

10/17/2014

10:40 pm Revision 554b4b88 (arvados): 4054: show email address in sharing tab and update test to verify.
Radhika Chippada
09:12 pm Bug #4064 (Resolved): [Crunch] Typoed "output_of" value in pipeline leaves a job stuck in the queue
Fixed in #3698 Peter Amstutz
09:02 pm Bug #4054 (In Progress): [Workbench] In the project sharing tab, show email addresses alongside f...
Radhika Chippada
09:00 pm Bug #3698 (Resolved): [Crunch] Pipeline runner should detect when "output_of" refers to a non-exi...
Applied in changeset arvados|commit:269adb302bf244332706a1fe053feddc402eb4be. Anonymous
08:52 pm Bug #3698: [Crunch] Pipeline runner should detect when "output_of" refers to a non-existent compo...
commit:5716ec8 is good to merge, thanks. Brett Smith
07:52 pm Bug #3698 (In Progress): [Crunch] Pipeline runner should detect when "output_of" refers to a non-...
Peter Amstutz
08:56 pm Task #4257 (Resolved): Review 3698-invalid-output-of
Peter Amstutz
08:44 pm Task #4257 (In Progress): Review 3698-invalid-output-of
Brett Smith
07:37 pm Task #4257 (Resolved): Review 3698-invalid-output-of
Peter Amstutz
08:54 pm Revision 269adb30 (arvados): Merge branch '3698-invalid-output-of' closes #3698
Peter Amstutz
08:53 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
* Help text says "Copy a pipeline instance from one Arvados instance to another", but should mention you can copy tem... Peter Amstutz
07:20 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Try again at revision commit:b81c434: @copy_git_repo@ should now correctly handle different branches in the source re... Tim Pierce
03:16 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Ready for re-review at commit:41c5cc5: collection copying now gets you a nice report by default (can disable with @--... Tim Pierce
08:35 pm Bug #4068 (Feedback): [Workbench] the /manage_account account page does not show all repositories...
Ward, you were probably referring to the repository: https://workbench.qr1hi.arvadosapi.com/repositories/qr1hi-s0uqq-... Radhika Chippada
08:31 pm Bug #4068 (In Progress): [Workbench] the /manage_account account page does not show all repositor...
Radhika Chippada
08:34 pm Bug #3856: [Workbench] Integration tests don't run with Firefox 32/33
It looks like this issue remains in Firefox 33. Brett Smith
08:29 pm Task #4171 (Closed): [Crunch] arv-run-pipeline-instance should detect bad "output_of" values and ...
Brett Smith
08:27 pm Bug #4200 (Closed): [Crunch] Notify user, cancel pipeline when it cannot run because a parameter ...
Brett Smith
08:22 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Un-stealing this ticket because #4248 isn't even a bug, so I'm not working on this anymore (although working on the c... Brett Smith
07:46 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Stealing the ticket because it's easy and I'm working in this space anyway for #4248. Brett Smith
08:17 pm Feature #4248: [Crunch] Collate task output (if any) even if the job failed.
I totally botched the diagnosis of this bug by misreading the Job log (mea culpa). The underlying command invoked by... Brett Smith
03:43 pm Feature #4248 (Duplicate): [Crunch] Collate task output (if any) even if the job failed.
qr1hi-8i9sb-h6ur26bp5gzd6am failed. But Bryan knows that even the failed command produces output, and it's much easi... Brett Smith
07:51 pm Revision 180c14b7 (arvados): Merge branch 'master' into 4062-infinite-scroll-repeat-issue
Radhika Chippada
07:50 pm Bug #4062: [Workbench] Infinite scrolling in the 'Jobs and pipelines' tab should not keep repeati...
* Tom, thanks for the tip about scrolling size. Infinite scrolling is now working in the test
* I noticed that the...
Radhika Chippada
07:47 pm Revision 11f281a7 (arvados): Make sure to use httpclient 2.5.0 or higher for Workbench. Older
versions force the use of SSLv3, which is no longer advisable now that
Poodle is a thing.
No issue #
Ward Vandewege
07:39 pm Revision 33d94890 (arvados): 4062: created_at filter in load_contents_objects
Radhika Chippada
07:37 pm Task #4145 (Resolved): Add validation that output_of links refer to existing components
Peter Amstutz
07:36 pm Revision 5716ec8e (arvados): 3698: Fix: components keys are symbols, not strings. Tweaked error ...
tell you what the invalid output_of actually is. Peter Amstutz
07:17 pm Revision 578b33f1 (arvados): 3698: Add check that output_of refers to an actual component.
Peter Amstutz
07:15 pm Revision b81c4344 (arvados): 3699: allow script_version to be a branch
Fix copy_git_repo to behave properly when the source script_version
refers to a branch on the source repository:
* c...
Tim Pierce
06:47 pm Bug #4256: [API] Jobs that sit in the front of the queue for a long time without running should b...
These jobs have been in the queue for two weeks at the time of this writing:
qr1hi-8i9sb-abi1i4mhj1brv9p
qr1hi-8i...
Peter Amstutz
06:46 pm Bug #4256 (New): [API] Jobs that sit in the front of the queue for a long time without running sh...
If a job sits at the front of the queue without running for some period of time, it should be automatically cancelled... Peter Amstutz
06:45 pm Bug #4083 (Resolved): [SDKs] Add "import _strptime" to work around potential Python bug.
Applied in changeset arvados|commit:d9014288ed04b79bde6f626636a931b449323287. Anonymous
06:36 pm Bug #4083: [SDKs] Add "import _strptime" to work around potential Python bug.
commit:c5d5029 is good, thanks. Brett Smith
06:41 pm Task #4252 (Resolved): Review 4083-import-strptime
Peter Amstutz
06:34 pm Task #4252 (In Progress): Review 4083-import-strptime
Brett Smith
05:59 pm Task #4252 (Resolved): Review 4083-import-strptime
Peter Amstutz
06:40 pm Revision d9014288 (arvados): 4083: Searched for everything using strptime and added import _strpt...
Peter Amstutz
06:30 pm Story #4255 (New): [SDKs] Implement "arv keep less" and "arv keep check" natively instead of hopi...
Peter Amstutz
06:28 pm Feature #4254 (New): [Tests] Add crunch-job functional tests to the CI suite
Ward Vandewege
06:26 pm Feature #3813 (Resolved): [Workbench] add link to pipeline instance from job view page
Peter Amstutz
06:11 pm Feature #4253 (Resolved): [API] Users can create their own arvados-hosted git repositories
Summary: Similar to github. Each user gets one username, and owns the {git}/username/* namespace.
h2. Assigning us...
Tim Pierce
05:59 pm Task #4151 (Resolved): Figure out what uses strptime and fix them
Peter Amstutz
05:52 pm Task #4151 (In Progress): Figure out what uses strptime and fix them
Peter Amstutz
05:58 pm Revision c5d50294 (arvados): 4083: Searched for everything using strptime and added import _strpt...
Peter Amstutz
05:57 pm Feature #4251 (Resolved): [Documentation] (recurring) Write blog post *in first three days of spr...
Each blog post, when published, should also be e-mailed verbatim to the arvados user list. Ward Vandewege
05:56 pm Feature #4250 (Resolved): [Documentation] (recurring) Refresh user documentation
Go through the *user* documentation on doc.arvados.org, and make sure that it is up to date. If not, bring it up to d... Ward Vandewege
05:51 pm Task #4240 (Resolved): Review 4229-close-files
Peter Amstutz
03:08 pm Task #4240 (In Progress): Review 4229-close-files
Peter Amstutz
02:23 pm Task #4240 (Resolved): Review 4229-close-files
Tom Clegg
05:19 pm Feature #4057: [Workbench] Show which jobs occupy which nodes on dashboard
This information is available through the Node's @job_uuid@ field. Brett Smith
05:15 pm Bug #4249: [Workbench] Can't view/download files that are retrievable from arv-get
It may be worth noting that this Collection was created in a funny way. run-command uploaded the data to Keep, then ... Brett Smith
03:44 pm Bug #4249 (Resolved): [Workbench] Can't view/download files that are retrievable from arv-get
See the files in any subdirectory of qr1hi-4zz18-74ikz4mn29q3i34. Workbench returns a 404 when you try to view or do... Brett Smith
03:50 pm Bug #4229 (Resolved): [Keep] Add missing Close() calls
Applied in changeset arvados|commit:8af162e0e5703f8b3a1dd60d5fd9a110ff009e24. Anonymous
03:28 pm Bug #4229: [Keep] Add missing Close() calls
No comments. Looks good to me. Peter Amstutz
01:33 pm Bug #4229: [Keep] Add missing Close() calls
(commit:4ab1c9c also includes a new "update timestamp during PUT" test that doesn't rely on sleep(1).) Tom Clegg
01:30 pm Bug #4229 (In Progress): [Keep] Add missing Close() calls
Tom Clegg
03:45 pm Revision 8af162e0 (arvados): Merge branch '4229-close-files' closes #4229
Tom Clegg
03:41 pm Revision 0edcc26f (arvados): 3609: Don't match any character for -lfoo arguments, just match lett...
Peter Amstutz
03:40 pm Revision 36bf9496 (arvados): 3699: bugfix: some leftover recursive/force options
recursive -> args.recursive
force -> args.force
dst_git_repo -> args.dst_git_repo
Tim Pierce
03:30 pm Task #4241 (In Progress): Review 3609-arv-run
Peter Amstutz
03:00 pm Task #4241 (Resolved): Review 3609-arv-run
Peter Amstutz
03:18 pm Revision 14b624d4 (arvados-dev): A few improvements for run-build-packages.sh:
* fix suggestion of env variable setting
* add a few new python packages that were split off from
google-api-python...
Ward Vandewege
03:18 pm Revision 14b624d4 (arvados): A few improvements for run-build-packages.sh:
* fix suggestion of env variable setting
* add a few new python packages that were split off from
google-api-python...
Ward Vandewege
03:08 pm Revision 41c5cc5a (arvados): 3699: report on collection copying progress
Tim Pierce
03:06 pm Task #4226 (New): Review 4062-infinite-scroll-repeat-issue (this addresses 4062 and 4091)
Peter Amstutz
03:05 pm Task #4226 (In Progress): Review 4062-infinite-scroll-repeat-issue (this addresses 4062 and 4091)
Peter Amstutz
03:00 pm Task #3733 (Resolved): Write wrapper
Peter Amstutz
03:00 pm Task #4183 (Resolved): Review 3609-arv-ws
Peter Amstutz
02:59 pm Revision a0c099f4 (arvados): 3609: Look for parent project in current working dir and create pipe...
that project if writable. Added --project-uuid. Uploading no longer users
arv-put because it doesn't preserve file ...
Peter Amstutz
02:25 pm Revision fdb1bc14 (arvados): added by_id subdirectory notes and arvados#collection
No issue #. Nancy Ouyang
02:25 pm Bug #4239 (Resolved): [SDKs] Python SDK doesn't work with apiclient 1.3
Applied in changeset arvados|commit:95f99e05352e2a87ad627a0b4c775f7551ef9265. Brett Smith
01:59 pm Bug #4239 (In Progress): [SDKs] Python SDK doesn't work with apiclient 1.3
Brett Smith
01:30 pm Bug #4239 (Resolved): [SDKs] Python SDK doesn't work with apiclient 1.3
When you try to test the current SDK with apiclient 1.3 installed, the tests don't even run. "See a failed build log... Brett Smith
02:25 pm Revision 95f99e05 (arvados): 4239: Update Python SDK for google-api-python-client 1.3.
This package renames the module from apiclient to googleapiclient. It
provides a shim apiclient module for compatibi...
Brett Smith
01:29 pm Story #4238 (Closed): [Documentation] Show how to run a pipeline instance without using a template.
Tom Clegg
01:19 pm Story #4237 (New): [Documentation] Update and expand user/tutorials/tutorial-keep-mount.html to s...
Mention that VMs typically set up arv-mount for you when you log in. Show one or two simple examples of invoking arv-... Tom Clegg
12:36 pm Revision 0b3873cf (arvados): 4189: Diagnostics suite doesn't try to clear Rails cache.
Refs #4189. Brett Smith
03:28 am Revision 1f7dbdb8 (arvados): Merge branch 'master' into 4062-infinite-scroll-repeat-issue
Conflicts:
services/api/test/fixtures/collections.yml
services/api/test/fixtures/jobs.yml
Radhika Chippada
03:19 am Revision 4418304d (arvados): 4062: Do not include offset in the next_page_href when objects of mu...
Updated the tests and fixtures to expect all 200+ objects in the pipelines and jobs tab.
The test however is still no...
Radhika Chippada

10/16/2014

10:15 pm Story #3826: [Crunch] Display network activity in crunchstat
Reviewing @ commit:a5ec4164:
Something we should consider is whether we can reuse any of the code in @github.com/d...
Tim Pierce
08:41 pm Story #3826: [Crunch] Display network activity in crunchstat
Brett Smith wrote:
> This version looks good to me. Thanks for revamping the stat file finder logic a second time. ...
Tom Clegg
08:01 pm Story #3826: [Crunch] Display network activity in crunchstat
Tom Clegg wrote:
> Now at commit:a5ec416
This version looks good to me. Thanks for revamping the stat file finde...
Brett Smith
03:08 pm Story #3826: [Crunch] Display network activity in crunchstat
Now at commit:a5ec416 with...
> Returning a file instead of a path had occurred to me too: I didn't like doing all...
Tom Clegg
02:00 pm Story #3826: [Crunch] Display network activity in crunchstat
Brett Smith wrote:
> * The error: crunchstat has always had a classic time-of-check vs. time-of-open race condition,...
Tom Clegg
01:18 pm Story #3826: [Crunch] Display network activity in crunchstat
Thanks for a lot of nice refactoring. My review of commit:5de6c06 produced one ERROR, one WARNING, and one idea for ... Brett Smith
10:02 pm Feature #4233 (Resolved): [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Scope of this story:
* A graph appears on the log tab of a job that is running or queued.
** When a websocket messa...
Tom Clegg
09:58 pm Bug #4232 (Resolved): [Workbench] Pipeline instances with many components should render quickly (...
Tom Clegg
09:51 pm Task #4198: Review 3826-crunchstat-netstats
I assigned this to Tim because he volunteered to give it a Go eye, but he has his own review task (#4225). Assigning... Brett Smith
09:24 pm Revision 69e4d608 (arvados): Merge branch '4189-workbench-project-admin-attr-editing-wip'
Closes #4189, #4202. Brett Smith
09:20 pm Revision d7fdbbab (arvados): 4189: Workbench lets users with write permission rename objects in p...
The key part of this commit are the changes to ApplicationHelper.
There's also some refactoring to more consistently ...
Brett Smith
09:20 pm Revision bc4c747c (arvados): 4189: Look up owner's writable_by when API did not provide writable_...
Tom Clegg
09:20 pm Revision 75fd0cb8 (arvados): 4189: Add writable_by to User API response, so writable_by is availa...
Tom Clegg
09:20 pm Revision 84e64f6e (arvados): 4189: Admit in writable_by that an object is writable when its owner...
Tom Clegg
09:20 pm Revision d8255087 (arvados): 4189: Workbench tests clear more state during teardown.
I'm working on some new tests that pick up on stale state without
these changes.
Brett Smith
09:20 pm Revision d532da29 (arvados): 4189: Document the API server's writable_by field.
Brett Smith
09:00 pm Revision 5fd32211 (arvados): 4189: Document the API server's writable_by field.
Brett Smith
08:57 pm Revision 509065a0 (arvados): Started reading index from keep servers.
Added lots of code to handle unexpected results from keep server. Misha Zatsman
08:41 pm Revision 51c8987b (arvados): 4062: test updates
Radhika Chippada
08:39 pm Revision db047221 (arvados): 3826: Reverse fields in "stat not found" warning.
Tom Clegg
08:33 pm Revision 509e13fc (arvados): Merge branch 'master' into 4189-workbench-project-admin-attr-editing...
Brett Smith
08:32 pm Revision d071c34c (arvados): 3609: Further documentation improvements, --local now runs pipeline ...
Peter Amstutz
08:17 pm Revision ebf38316 (arvados): 4189: Add writable_by to User API response, so writable_by is availa...
Tom Clegg
08:11 pm Revision 9270b0a9 (arvados): 4189: Admit in writable_by that an object is writable when its owner...
Tom Clegg
08:09 pm Revision a64a976d (arvados): 4189: Look up owner's writable_by when API did not provide writable_...
Tom Clegg
07:58 pm Task #4225 (In Progress): Review 3826-crunchstat-netstats -- esp for language issues
Tim Pierce
04:07 pm Task #4225 (Resolved): Review 3826-crunchstat-netstats -- esp for language issues
(Supplement Brett's review, just because both Brett and I are relatively new to Go) Tom Clegg
07:46 pm Bug #4062: [Workbench] Infinite scrolling in the 'Jobs and pipelines' tab should not keep repeati...
Tom Clegg wrote:
> Hm, it _should_ be triggered by a "scroll" event. I'll see if I can spot anything.
(Copied fro...
Tom Clegg
06:43 pm Bug #4062: [Workbench] Infinite scrolling in the 'Jobs and pipelines' tab should not keep repeati...
Radhika Chippada wrote:
> * Fixed scrolling issue. The issue was in any tab that is displaying multiple data kinds. ...
Tom Clegg
05:00 pm Bug #4062: [Workbench] Infinite scrolling in the 'Jobs and pipelines' tab should not keep repeati...
* Fixed scrolling issue. The issue was in any tab that is displaying multiple data kinds. In this case, the first pag... Radhika Chippada
07:35 pm Revision 6ef24c81 (arvados): Merge branch 'master' into 3609-arv-run
Peter Amstutz
07:35 pm Revision ac4f4ab5 (arvados): Merge branch '3609-arv-ws' refs #3609
Peter Amstutz
07:34 pm Revision 25708a23 (arvados): 3609: Fix PollClient for case when there are no filters (get everyth...
Peter Amstutz
07:24 pm Revision 0dab3a40 (arvados): 3609: Testing fixups.
Peter Amstutz
07:21 pm Revision fa541df7 (arvados): 3609: Set "name" to abbreviated form, put full command line in the d...
Peter Amstutz
07:18 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Peter Amstutz wrote:
> Yep, added a "subscribed" event variable too. Refactored EventClientTest and PollClientTest ...
Brett Smith
07:01 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Brett Smith wrote:
> Reviewing commit:2379619
> Personally, I think we should make that the caller's responsibili...
Peter Amstutz
05:38 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Reviewing commit:2379619
The new logic for cloning an API client for PollClient seems to be inconsistently applied...
Brett Smith
05:04 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Brett Smith wrote:
> Reviewing arv-ws follow-ups at commit:58014b9.
>
> * Sleeping in multithreaded tests is real...
Peter Amstutz
02:58 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Brett Smith wrote:
> Reviewing the revamped arv-ws at commit:55888e6.
>
> h2. events module
>
> * Please add t...
Peter Amstutz
02:57 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Reviewing arv-ws follow-ups at commit:58014b9.
* Sleeping in multithreaded tests is really dicey business. It's d...
Brett Smith
07:05 pm Revision 04b8def3 (arvados): Merge branch '3609-arv-ws' into 3609-arv-run
Peter Amstutz
07:05 pm Revision d05825ff (arvados): 3609: Back out setting api_version, api_host, and api_insecure on ap...
and instead document that caller to arvados.events.subscribe() should pass in a
freshly created api client. Add even...
Peter Amstutz
07:03 pm Revision c12d9a86 (arvados): 3609: Back out setting api_version, api_host, and api_insecure on ap...
and instead document that caller to arvados.events.subscribe() should pass in a
freshly created api client. Add even...
Peter Amstutz
06:59 pm Revision f6605cb2 (arvados): 3906: Back out setting api_version, api_host, and api_insecure on ap...
and instead document that caller to arvados.events.subscribe() should pass in a
freshly created api client. Add even...
Peter Amstutz
06:21 pm Bug #4229: [Keep] Add missing Close() calls
4229-close-files @ commit:4ab1c9c Tom Clegg
06:19 pm Bug #4229 (Resolved): [Keep] Add missing Close() calls
Tom Clegg
06:20 pm Revision 4ab1c9c9 (arvados): 4229: Add missing Close() calls
Tom Clegg
06:19 pm Revision 6bbd591d (arvados): 4229: Get rid of sleep() in test
Tom Clegg
06:09 pm Revision 877c5387 (arvados): 4062: update python testing to handle the multiple fixture object cr...
Radhika Chippada
05:45 pm Bug #4228 (Resolved): [Workbench (probably)] Cannot create new collection with selected files in ...
this may be a permissions issue, but I took two files from collections/qr1hi-4zz18-7ovo7uokn1a9ndz, specifically tmp... Bryan Cosca
05:44 pm Revision 66b6518c (arvados): Better documentation WIP
Peter Amstutz
05:29 pm Bug #4227 (Resolved): [Workbench] Pipeline elapsed time is misformatted
In pipeline_instances/qr1hi-d1hrv-43y08obrh2vetuv, it says This pipeline started at 11:56 AM 10/16/2014. It failed af... Bryan Cosca
05:21 pm Revision f0210954 (arvados): Merge branch '3609-arv-ws' into 3609-arv-run
Peter Amstutz
05:20 pm Revision 23796191 (arvados): 3609: import signal; add_mutually_exclusive_group doesn't take any a...
Peter Amstutz
05:18 pm Revision 245c6abe (arvados): Merge branch '3609-arv-ws' into 3609-arv-run
Peter Amstutz
05:02 pm Task #4226 (Resolved): Review 4062-infinite-scroll-repeat-issue (this addresses 4062 and 4091)
Also see 4062-infinite-scroll-repeat-TC branch Radhika Chippada
04:47 pm Revision 8297039d (arvados): Python SDK is not compatible with apiclient 1.3.
Figuring out why this is needs more investigation. It's something I'd
like to do, but it seems urgent to push this f...
Brett Smith
04:45 pm Revision 3bf405f3 (arvados): Merge branch 'master' into 4062-infinite-scroll-repeat-issue
Radhika Chippada
04:41 pm Revision 41a57127 (arvados): 4062: test update
Radhika Chippada
04:23 pm Revision 723f0c84 (arvados): 3609: Add additional api_ fields to api client object so that subscr...
create a new api client. Change test to use event variable instead of
sleeping. Fix "Web sockets" -> "Websockets". ...
Peter Amstutz
04:03 pm Revision 00f62886 (arvados): 4189: Break the last commit.
This tries to use #attribute_editable? more consistently as Tom
suggested in feedback. The tests don't pass. See ti...
Brett Smith
04:00 pm Bug #4219 (Resolved): [Keep] keepstore should not fail permission signature verification just bec...
Applied in changeset arvados|commit:b19a6058168a290fe789b2228c13935edc6e5546. Anonymous
03:47 pm Bug #4219: [Keep] keepstore should not fail permission signature verification just because extra ...
Tim Pierce wrote:
> P.S. we should include tests for validating signatures both with and without size hints, just in...
Tom Clegg
03:06 pm Bug #4219: [Keep] keepstore should not fail permission signature verification just because extra ...
P.S. we should include tests for validating signatures both with and without size hints, just in case I screw this up... Tim Pierce
02:51 pm Bug #4219: [Keep] keepstore should not fail permission signature verification just because extra ...
LGTM. But can someone please explain to me what size hints are for in the first place? :-) Tim Pierce
05:36 am Bug #4219: [Keep] keepstore should not fail permission signature verification just because extra ...
> The API server generates signatures on hash+size, so VerifySignatures needs to include the size hint when verifying... Tom Clegg
01:21 am Bug #4219: [Keep] keepstore should not fail permission signature verification just because extra ...
Also, some time ago Peter found @regexp.MustCompile@ to compile a regex or panic if it can't. I don't know why I mis... Tim Pierce
01:19 am Bug #4219: [Keep] keepstore should not fail permission signature verification just because extra ...
Review @ commit:f39807a3c:
services/keepstore/perms.go:
The API server generates signatures on hash+size, so Ve...
Tim Pierce
03:51 pm Revision b19a6058 (arvados): Merge branch '4219-verify-with-hints' closes #4219
Tom Clegg
03:34 pm Revision 1d0d4b16 (arvados): 4219: Add test for missing size hint. Dry up "known signature hint" ...
Tom Clegg
03:31 pm Revision b7f67c80 (arvados): Merge branch 'master' into 3699-arv-copy
Tim Pierce
03:28 pm Revision 556fb854 (arvados): Making arv-run documentation more readable.
Peter Amstutz
03:13 pm Task #4221 (Resolved): Review 4219-verify-with-hints
Tim Pierce
05:37 am Task #4221 (In Progress): Review 4219-verify-with-hints
Tom Clegg
03:05 pm Revision a5ec4164 (arvados): 3826: Roll up Open() attempts into a slice and a loop.
Tom Clegg
02:57 pm Revision 7a6f2613 (arvados): Merge branch 'master' into 4062-infinite-scroll-repeat-issue
Radhika Chippada
02:54 pm Revision 6f7456f8 (arvados): 4062: trailing white space
Radhika Chippada
02:52 pm Revision 75b8b796 (arvados): 3826: Fix up formatting cf. gofmt
Tom Clegg
02:51 pm Revision 76ad4467 (arvados): 3609: Reenabled support for websockets. Now sets name of pipeline t...
Peter Amstutz
02:48 pm Revision 90057cfa (arvados): 3826: Just modify lastSample maps in place, instead of returning the...
Tom Clegg
02:45 pm Revision 61f351e9 (arvados): 4062: fix greedy infinite scrolling in tabs displaying more than one...
Not only did scrolling never stopped, it never reloaded the next page and reloaded the same first page again and agai... Radhika Chippada
02:45 pm Revision 987c225f (arvados): Merge branch '3609-arv-ws' into 3609-arv-run
Conflicts:
sdk/cli/bin/arv
Peter Amstutz
02:43 pm Revision b3f9cef0 (arvados): Merge branch 'master' into 3609-arv-ws
Peter Amstutz
02:41 pm Revision 4c0c7699 (arvados): Missing file
Peter Amstutz
02:40 pm Task #4224 (Resolved): Review 3787-docker-docs
Peter Amstutz
02:40 pm Task #4147 (Resolved): Write new documentation page
Peter Amstutz
02:40 pm Revision 1d13d7e2 (arvados): 3787: Extra note that once inside the container the user can do anyt...
Peter Amstutz
02:36 pm Revision becd1612 (arvados): 3826: Change FindStat to OpenStatFile to eliminate redundant Stat()
calls and races. Log every time we change our mind about where to read
a given statistic.
Tom Clegg
02:35 pm Revision cc09080c (arvados): 3787: Completed first draft explaining how to pull, configure, commi...
Peter Amstutz
02:29 pm Feature #4223 (In Progress): [SDKs] arv keep docker --download to get image from Arvados
Add "arv keep docker --download" to fetch a Docker image from Arvados and load it locally. Peter Amstutz
01:48 pm Revision 2b08ab24 (arvados): 3826: Use correct variable Sscanf. CPU stats work again.
Tom Clegg
01:32 pm Task #4178 (Resolved): Review 4126-preserve-parameter-hash
Peter Amstutz
01:32 pm Task #4170 (Resolved): Review 3656-arv-create
Peter Amstutz
01:32 pm Task #4179 (Resolved): Review 3692-event-bus-fix-and
Peter Amstutz
01:30 pm Revision 58014b96 (arvados): 3609: Prefetch pipeline components to find out which jobs to subscri...
Peter Amstutz
05:29 am Revision 5e2eeeaa (arvados): 4219: Use a precompiled global regexp for signature verification.
Tom Clegg
 

Also available in: Atom