Activity

From 10/21/2014 to 11/19/2014

11/19/2014

10:59 pm Bug #4400: [SDKs] Python package install should not print misleading message "fatal: Not a git re...
Reviewing commit:21ead51
There are many things that could theoretically go wrong trying to get the git log. I wor...
Brett Smith
06:25 am Bug #4400 (In Progress): [SDKs] Python package install should not print misleading message "fatal...
Tom Clegg
10:38 pm Task #4576 (In Progress): Review 4400-python-install-herring
Brett Smith
10:36 pm Bug #4622 (Duplicate): [Node Manager] Stop ShutdownActors when the node disappears
Under some circumstances, if a node goes away while a ShutdownActor is trying to shut it down, the ShutdownActor will... Brett Smith
10:17 pm Feature #4138: [Node Manager] Support Google Cloud Platform in node manager
Reviewing commit:ab8acfe
h2. GCE implementation
I realize how much it's a challenge to write this sort of code ...
Brett Smith
09:56 pm Revision c253c634 (sso-provider): Merge branch '4296-login-500' refs #4296
Peter Amstutz
09:18 pm Task #4620 (Resolved): fix bugs, write tests
Tim Pierce
09:18 pm Task #4542 (Resolved): Review branch: 4194-keep-logging
Tom Clegg
09:18 pm Task #4556 (Resolved): Confirm fixed by 3824
Tom Clegg
09:18 pm Task #4619 (Resolved): call normalize before reporting file list
Tim Pierce
09:17 pm Task #4618 (Resolved): Find/confirm the commit that fixed this
Tom Clegg
09:17 pm Task #4617 (Closed): Update doc
Tom Clegg
09:17 pm Task #4616 (Resolved): report job failures
Tim Pierce
09:16 pm Task #4615 (Resolved): identify job failure types
Tim Pierce
09:16 pm Task #4614 (Resolved): add apiserver version link
Tim Pierce
09:06 pm Task #4613 (Resolved): Workbench template for generating UI
Peter Amstutz
09:00 pm Task #4612 (Resolved): Start writing user guide page
Peter Amstutz
09:00 pm Task #4611 (New): Update doc to match current plans
Tom Clegg
08:59 pm Story #4609 (Resolved): [Crunch] Crunch v2 design doc
Tom Clegg
08:58 pm Task #4608 (Resolved): Investigate regression
Peter Amstutz
08:56 pm Story #4607 (Closed): [Crunch] Reusable task design doc
See [[Reusable tasks]] wiki. Tom Clegg
08:54 pm Task #4606 (Resolved): Report relevant package versions during install phase
Tom Clegg
08:54 pm Feature #4605 (Resolved): [Workbench] Workbench support for generating input UI from common workf...
Peter Amstutz
08:51 pm Task #4604 (Resolved): Sandboxing for javascript expressions
Peter Amstutz
08:50 pm Task #4603 (Resolved): Sit down with Brad Chapman
Peter Amstutz
08:43 pm Feature #4601 (Resolved): [SSO] Migrate OpenId users to OAuth/Google+
Peter Amstutz
08:39 pm Support #4600 (Resolved): Improve bc-bio support on Arvados
Peter Amstutz
08:34 pm Story #4599 (Closed): [Crunch] crunch-job should not retry tasks after its SLURM allocation is re...
When a job is assigned to a single node, and it fails, SLURM revokes the job allocation. See #4410 for example logs.... Brett Smith
08:34 pm Feature #4598 (Resolved): [Crunch] [DRAFT] Classify job failures by type, report statistics
For a given time interval
* Get a list of jobs created in this interval (no need to report the entire list)
* Repor...
Ward Vandewege
08:26 pm Task #4597 (Resolved): Turn on cli testing in run-tests.sh
Radhika Chippada
08:26 pm Task #4581 (In Progress): [Tests] Make cli tests pass or skip them
Radhika Chippada
07:38 pm Task #4581 (Resolved): [Tests] Make cli tests pass or skip them
Radhika Chippada
08:12 pm Story #4156 (In Progress): [Tests] Enable cli tests in run-tests.sh, skip any CLI tests that don'...
Radhika Chippada
07:38 pm Story #4156: [Tests] Enable cli tests in run-tests.sh, skip any CLI tests that don't pass
I tested my work as follows:
* Set ARVADOS_API_HOST and ARVADOS_API_TOKEN to point to my dev api server
* Run m...
Radhika Chippada
08:11 pm Support #4596 (Resolved): [Support] Fix bugs and write tests (second half)
Ward Vandewege
08:11 pm Support #4595 (Resolved): [Support] Fix bugs and write tests (first half)
Ward Vandewege
08:09 pm Support #4348 (Resolved): [Support] fix bugs and write tests (second half)
Tim Pierce
08:08 pm Feature #4027 (In Progress): [Crunch] Accept SDK version as a runtime constraint. Install SDK int...
Tom Clegg
08:08 pm Task #4352 (Resolved): fix bugs, write tests
Tim Pierce
08:07 pm Bug #4468 (Closed): Fiddlesticks when creating new collection from selected collections
Tried it again today and it created this collection successfully. Maybe I hit a transient server error.
Thanks!
Nancy Ouyang
08:05 pm Feature #4233 (In Progress): [Workbench] Graph CPU and IO statistics using live log feed on Jobs#...
Tom Clegg
04:55 am Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Bug reports after I tried running a "job with lots of tasks":http://crvr.se/9tee4-8i9sb-ylej7ujabowv44z:
* I don't t...
Tom Clegg
03:39 am Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Well, I think this is already pretty fun to watch, even with simulated data. I haven't looked at the code very hard, ... Tom Clegg
07:28 pm Bug #4591: [API] When websockets server runs out of memory, it should exit so it can be restarted...
or pending to complete for that matter Bryan Cosca
07:24 pm Bug #4591: [API] When websockets server runs out of memory, it should exit so it can be restarted...
also from queued to pending Bryan Cosca
04:57 pm Bug #4591 (Resolved): [API] When websockets server runs out of memory, it should exit so it can b...
Symptom: Pages not refreshing due to failure to connect to websockets
bcosc:
If I start a new instance, the page ...
Bryan Cosca
07:24 pm Revision 86eafc4c (arvados): Merge branch 'master' into 4156-cli-tests
Radhika Chippada
07:23 pm Revision d6e63c5f (arvados): 4156: skip arv-tag tests while arv-tag is being worked on.
Radhika Chippada
07:21 pm Task #4517 (Resolved): Review 4363-less-filename-munging
Brett Smith
07:18 pm Bug #3382 (Resolved): [Workbench] When specifying inputs for new pipeline instance, parameters sh...
Phil Hodgson
06:48 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
I had to remove the description from the pipeline_template fixture used for testing so that I could reproduce the ori... Phil Hodgson
02:11 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
Phil,
* This version looks awesome.
* One question. Why did you remove the description for the pipeline template ...
Radhika Chippada
09:17 am Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
I understand now. I've made the changes you recommended. Thanks! Phil Hodgson
07:17 pm Task #4485 (Resolved): Review 3382
Phil Hodgson
07:17 pm Task #4580 (In Progress): Review 4138-node-manager-google-cloud
Brett Smith
07:15 pm Revision b77fb699 (arvados): Merge branch '3382-always-show-inputs' (closes #3382)
Phil Hodgson
07:10 pm Story #4594 (Resolved): [Workbench] In the collections page, provide the ability to select indivi...
Since clippy is no longer supported, we now have no way of selecting individual files and combining them into a new c... Radhika Chippada
06:50 pm Revision 2834445f (arvados): Merge branch 'master' into 3382-always-show-inputs
Phil Hodgson
05:37 pm Task #4593 (Resolved): Fix
Tom Clegg
05:37 pm Task #4593 (Resolved): Fix
Tom Clegg
05:22 pm Bug #4592: [Workbench] Error when a collection with no name is selected as input to a pipeline co...
I selected qr1hi-4zz18-gi71q9r5pwb5voh as input to a pipeline instance (qr1hi-d1hrv-chpg85rdt1vvjcg) and I see error ... Radhika Chippada
05:19 pm Bug #4592 (Resolved): [Workbench] Error when a collection with no name is selected as input to a ...
Radhika Chippada
04:46 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
... Tom Clegg
04:44 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
Adding cr.normalize() fixed the bug:
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-o0tfeiug...
Sarah Guthrie
01:17 am Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
I'm going out on a limb here and guessing adding @cr.normalize()@ before before this part of @one_task_per_input_file... Tom Clegg
04:25 pm Revision beb7bc17 (arvados): Merge branch 'master' into 4156-cli-tests
Radhika Chippada
04:20 pm Feature #4250 (Resolved): [Documentation] (recurring) Refresh user documentation
Applied in changeset arvados|commit:a325b04603deacebc07d322e691d7cc4e38b2f24. Radhika Chippada
04:19 pm Revision a325b046 (arvados): closes #4250
Merge branch '4250-doc-updates' Radhika Chippada
04:19 pm Task #4565 (Resolved): Review branch: 4250-doc-updates
Radhika Chippada
04:01 pm Revision cfd47c9a (sso-provider): Fixes 500 error on welcome page.
Peter Amstutz
03:56 pm Bug #4296: [SSO] 500 from a fresh login
This seems like it might be the root cause of the redirection issue:
https://code.google.com/p/gdata-issues/issues...
Peter Amstutz
02:44 pm Bug #4589: [API] Problem connecting using Firefox
The in the meantime we can use the workaround described here:
http://www-01.ibm.com/support/docview.wss?uid=swg216...
Peter Amstutz
02:41 pm Bug #4589 (Resolved): [API] Problem connecting using Firefox
Firefox 31+ increased SSL certificate checking in a way that seems to silently break on our self-signed development/t... Peter Amstutz
02:00 pm Revision d270d652 (arvados): 4250: keep doc update
Radhika Chippada
01:59 pm Task #4588 (Resolved): Fix
Peter Amstutz
01:59 pm Task #4377 (In Progress): Diagnose
Peter Amstutz
01:57 pm Revision b5c641ca (arvados-dev): Refactor deploy script a bit; make it less sensitive to transien...
we don't care about.
No issue #
Ward Vandewege
01:57 pm Revision b5c641ca (arvados): Refactor deploy script a bit; make it less sensitive to transient er...
we don't care about.
No issue #
Ward Vandewege
01:26 pm Revision 854af806 (arvados): 4233: sort hover display by task then stat name
Phil Hodgson
12:49 pm Revision 057d1e8a (arvados): 4233: unused variable removed
Phil Hodgson
12:09 pm Revision f2652e70 (arvados): 4233: show empty log stats graph when no data, and also show a full ...
Phil Hodgson
09:51 am Revision e5d34588 (arvados): 4233: add deletion of existing log entries option to log replay help...
Phil Hodgson
09:15 am Revision 9d7efc36 (arvados): 3382: test that after editing that an input is editable a second time
- reverted from commit 7bd04ed26901e34e3e5788093bee12be4406dd7b and then adjusted according to latest code review Phil Hodgson
05:19 am Revision b40e3790 (arvados): 4233: In crunch-dispatch, log timestamps in UTC in the same format c...
Tom Clegg
04:56 am Task #4586 (In Progress): deploy on our installations
Ward Vandewege
04:56 am Task #4586 (Resolved): deploy on our installations
Ward Vandewege
04:56 am Task #4585 (Resolved): add code to puppet
Ward Vandewege
04:56 am Task #4585 (Resolved): add code to puppet
Ward Vandewege
01:26 am Bug #4515 (Feedback): [Workbench] Oops when selecting empty project in chooser
Tom Clegg
01:25 am Bug #4515: [Workbench] Oops when selecting empty project in chooser
Cannot reproduce on staging @ commit:6c68141, almost certainly fixed by commit:78447c7 during #4024. Tom Clegg
01:02 am Feature #4579 (Feedback): [Documentation] Run-command docs should remind user how & why to exit n...
Tom Clegg
01:00 am Feature #4579: [Documentation] Run-command docs should remind user how & why to exit non-zero on ...
If you use run-command, the only way to indicate success/failure is exit status. In both of these cases it looks like... Tom Clegg

11/18/2014

11:16 pm Task #4565: Review branch: 4250-doc-updates
In case you want to take another look. Thanks. Radhika Chippada
06:11 pm Task #4565 (In Progress): Review branch: 4250-doc-updates
Peter Amstutz
11:12 pm Story #4156: [Tests] Enable cli tests in run-tests.sh, skip any CLI tests that don't pass
Regarding branch 4156-cli-tests:
* Initially there were 17 failures and I fixed 15 of them. Please let me know if ...
Radhika Chippada
11:03 pm Task #4582 (Resolved): Review branches: arvados 4156-cli-tests and arvados-dev 4156-enable-cli-tests
Radhika Chippada
11:00 pm Task #4581 (Resolved): [Tests] Make cli tests pass or skip them
Make the tests in arvados/sdk/cli/test to pass. Or skip the ones that do not pass. Radhika Chippada
10:44 pm Task #4203 (Resolved): Implement arvnodeman.computenode.googlecloud
Tim Pierce
10:43 pm Task #4580 (Closed): Review 4138-node-manager-google-cloud
Ready to review at commit:ab8acfe
Some implementation notes:
* This code has not been tested against a live GCE...
Tim Pierce
10:43 pm Revision 56a7b681 (arvados): 4156: little cleanup
Radhika Chippada
10:34 pm Revision ab8acfe2 (arvados): 4138: support for Google Cloud Engine.
* Added:
** nodemanager/arvnodeman/computenode/drivers/gce.py
** nodemanager/doc/gce.example.cfg
** nodemanager/tests...
Tim Pierce
10:28 pm Revision 6f31d0c9 (arvados): Merge branch 'master' into 4250-doc-updates
Radhika Chippada
10:28 pm Revision 6e49612a (arvados): Merge branch 'master' into 4156-cli-tests
Radhika Chippada
10:27 pm Revision 9893a0fd (arvados): 4156: update tests to match current impl
Radhika Chippada
09:38 pm Revision 57813e01 (arvados): 4156: minor updates
Radhika Chippada
09:33 pm Revision 27d5f6ed (arvados): Do not blow up when another puppet process is already running during...
No issue # Ward Vandewege
09:33 pm Revision 27d5f6ed (arvados-dev): Do not blow up when another puppet process is already running du...
No issue # Ward Vandewege
09:22 pm Revision cd13ebef (arvados): Build a python-jsonschema package, because cwltool requires version 2.4
which is newer than what's available in wheezy(-backports).
refs #4572
Ward Vandewege
09:22 pm Revision cd13ebef (arvados-dev): Build a python-jsonschema package, because cwltool requires vers...
which is newer than what's available in wheezy(-backports).
refs #4572
Ward Vandewege
09:18 pm Bug #4426: [Documentation] Support searching documentation
Current workaround:
https://github.com/curoverse/arvados/search??utf8=✓&q=$SEARCHTERM
Nancy Ouyang
09:02 pm Feature #4579 (New): [Documentation] Run-command docs should remind user how & why to exit non-ze...
Some jobs encounter errors that seem like they should be fatal errors, but still report job success.
For example, ...
Bryan Cosca
08:10 pm Task #4519 (Resolved): Review 4380-node-manager-slurm-drain-wip
Applied in changeset arvados|commit:6c68141eb50255128cf38b5717b15b16f2a8cdff. Brett Smith
07:07 pm Task #4519 (In Progress): Review 4380-node-manager-slurm-drain-wip
Peter Amstutz
08:10 pm Bug #4380 (Resolved): [Node Manager] Should drain nodes via SLURM before terminating them
Applied in changeset arvados|commit:6c68141eb50255128cf38b5717b15b16f2a8cdff. Brett Smith
08:04 pm Revision 6c68141e (arvados): Merge branch '4380-node-manager-slurm-drain-wip'
Closes #4380, #4519. Brett Smith
08:04 pm Revision 4af4a2cf (arvados): 4380: Node Manager shutdown actor is more robust.
ComputeNodeShutdownActor now checks that destroying the cloud node
succeeds. Before retrying, it will check if the n...
Brett Smith
08:04 pm Revision 22381d21 (arvados): 4380: Node Manager monitors respond to shutdown_eligible message.
Brett Smith
08:04 pm Revision ffc7c1b2 (arvados): 4380: Add SLURM dispatcher to Node Manager.
Brett Smith
08:04 pm Revision 6874da0d (arvados): 4380: Fix retry scheduling for Node Manager change methods.
Brett Smith
07:49 pm Revision d677ef9c (arvados): 4156: update test to expect uuid instead of pdh
Radhika Chippada
07:34 pm Revision 8d324f6d (arvados): 4250: update pdh to uuid in keep tutorial
Radhika Chippada
07:25 pm Bug #4552 (Resolved): [API] Fix permission error due to stripped signatures when ensure_unique_na...
Applied in changeset arvados|commit:b1f65fcd4fa5fca5400f63fa25823fef6229a158. Anonymous
07:07 pm Bug #4552: [API] Fix permission error due to stripped signatures when ensure_unique_name behavior...
commit:22c1351 Looks good to me. Peter Amstutz
06:09 pm Bug #4552: [API] Fix permission error due to stripped signatures when ensure_unique_name behavior...
I'm getting a test failure:... Peter Amstutz
07:22 pm Feature #4194: [Keep] consistent logging for keepstore requests
commit:b1f3c94 LGTM, thanks! Tom Clegg
07:02 pm Feature #4194: [Keep] consistent logging for keepstore requests
Great. I update "=" to "+=". I also updated to use the same log statement in both error and success cases. Thanks. Radhika Chippada
06:55 pm Feature #4194: [Keep] consistent logging for keepstore requests
Radhika Chippada wrote:
> With length of data string printed: PUT e4d909c290d0fb1ca068ffaddf22cbd0 200 36
>
> Her...
Tom Clegg
06:04 pm Feature #4194: [Keep] consistent logging for keepstore requests
Radhika Chippada wrote:
> One question about the length versus data. The log message for PUT would be:
>
> With r...
Tim Pierce
06:00 pm Feature #4194: [Keep] consistent logging for keepstore requests
Tom, addressed your comments. Yes, you are right about printing data and I was also concerned about it, but lost trac... Radhika Chippada
05:19 pm Feature #4194: [Keep] consistent logging for keepstore requests
Couple of comments at commit:07bf4bb
I think we should lose the "show first 200 bytes" stuff. There are various pr...
Tom Clegg
03:30 pm Feature #4194 (Resolved): [Keep] consistent logging for keepstore requests
Applied in changeset arvados|commit:c621e2e901f5b5de4f72b1c6a9d8816aa5745292. Radhika Chippada
03:14 pm Feature #4194: [Keep] consistent logging for keepstore requests
Radhika Chippada wrote:
>
> When I tried to move this file into router package, the package git.curoverse.com/arva...
Tim Pierce
03:25 am Feature #4194: [Keep] consistent logging for keepstore requests
Tim, addressed all your feedback, except the first one about moving the Logging router into its own package named "ro... Radhika Chippada
07:16 pm Revision 89285c34 (arvados): Merge branch 'master' into 4250-doc-updates
Radhika Chippada
07:16 pm Revision b1f65fcd (arvados): Merge branch '4552-collection-unique-name' closes #4552
Conflicts:
services/api/app/models/collection.rb
Tom Clegg
07:14 pm Revision 4c138e32 (arvados): Merge branch 'master' into 4156-cli-tests
Radhika Chippada
07:14 pm Revision 1a2a05a4 (arvados): refs #4194
Merge branch '4194-keep-logging' Radhika Chippada
07:13 pm Revision 40b15b95 (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
07:06 pm Task #4568 (Resolved): Review 4552-collection-unique-name
Peter Amstutz
05:06 pm Task #4568 (In Progress): Review 4552-collection-unique-name
Peter Amstutz
08:04 am Task #4568 (Resolved): Review 4552-collection-unique-name
Tom Clegg
07:05 pm Revision 7533ea38 (arvados): 4156: update failing tests in test_arv-put that were expecting pdh i...
Radhika Chippada
06:53 pm Revision b1f3c944 (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
06:49 pm Revision 0e5cd501 (arvados): 4194: use same log statement for successes as well as errors.
Radhika Chippada
06:40 pm Revision 22c13513 (arvados): 4552: Set permit_unsigned_manifests=false needed for test.
Tom Clegg
06:40 pm Bug #4363 (Resolved): [Keep] arv-mount should not munge filenames unless required by POSIX
Applied in changeset arvados|commit:3735d52b65928e3626a8e223acadc318a3d31097. Anonymous
06:16 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
Tom Clegg wrote:
> Now at commit:9f52191.
This commit is good to merge. Thanks.
Brett Smith
04:36 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
Brett Smith wrote:
> I want to make sure we're on the same page about what this means: code that previously used UTF...
Tom Clegg
06:31 pm Revision 3735d52b (arvados): Merge branch '4363-less-filename-munging' closes #4363
Tom Clegg
06:30 pm Task #4572 (Resolved): Automatically build and install cwltool python package
Ward Vandewege
04:38 pm Task #4572 (In Progress): Automatically build and install cwltool python package
Peter Amstutz
02:21 pm Task #4572 (Resolved): Automatically build and install cwltool python package
Build and deploy the cwltool package from https://github.com/rabix/common-workflow-language/tree/master/reference to ... Peter Amstutz
06:28 pm Feature #4250: [Documentation] (recurring) Refresh user documentation
doc/user/topics/arv-run.html.textile.liquid
* You can also remove "--script-version 3609-arv-run" from the sample co...
Peter Amstutz
06:26 pm Revision 44c80db7 (arvados): Also build a deb package for python-pyexecjs, which is a dependency for
cwltool
refs #4572
Ward Vandewege
06:26 pm Revision 44c80db7 (arvados-dev): Also build a deb package for python-pyexecjs, which is a depende...
cwltool
refs #4572
Ward Vandewege
06:09 pm Bug #4577: [Crunch] Pipeline instance mysteriously restarts and fails
The actual command was:
$ arv-run --docker-image nancy/cgatools-wormtable /bin/bash ./makewormtable.sh qr1hi-4zz18-3...
Nancy Ouyang
06:07 pm Bug #4577 (Closed): [Crunch] Pipeline instance mysteriously restarts and fails
1) https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-qzactq0a5lamky7,
Failed near the end due to...
Nancy Ouyang
05:39 pm Revision f9ba8a73 (arvados): 4363: Fix flaky test case (race with filterable.js debounce timer).
Tom Clegg
05:37 pm Revision 97a2555a (arvados): 4194: use go fmt to replace spaces with tabs.
Radhika Chippada
05:29 pm Revision 3ce8039e (arvados): 4194: just print data size and never the data
Radhika Chippada
05:05 pm Revision d234c210 (arvados): 4035: Update Gemfile version for arvados-cli.
Peter Amstutz
05:01 pm Revision 85ea947a (arvados): Package cwltool.
Refs #4572 Ward Vandewege
05:01 pm Revision 85ea947a (arvados-dev): Package cwltool.
Refs #4572 Ward Vandewege
04:46 pm Task #4386 (Resolved): Review branch: 4024-pipeline-instances-scroll
Tom Clegg
04:45 pm Task #4576 (Resolved): Review 4400-python-install-herring
Tom Clegg
04:44 pm Story #4035: [Sample pipelines] Proof-of-concept support for common-workflow-language tool descri...
To test:... Peter Amstutz
04:43 pm Revision 21ead510 (arvados): 4400: Silence git error messages during package install (we ignore t...
Tom Clegg
04:37 pm Task #4512 (Resolved): Implement support in arv-run-pipeline-instance
Peter Amstutz
04:37 pm Task #4575 (Resolved): Review 4035-pipeline-support-cwl-tool
See note https://arvados.org/issues/4035 on how to test Peter Amstutz
04:33 pm Revision 9f52191b (arvados): 4363: Fix size hints for multi-byte manifests (backported from f78ca...
Tom Clegg
04:31 pm Revision 12b3b4e1 (arvados): 4035: Wait for arv-mount to start. Improve error handling. Add com...
Peter Amstutz
04:24 pm Revision 69fae522 (arvados): 4363: Accept manifest_text in a non-UTF-8 encoding that is equal to ...
Tom Clegg
03:58 pm Revision 22ae84c0 (arvados): 4363: Specify ASCII encoding in test case.
Tom Clegg
03:51 pm Story #4551: [SDKs] [Workbench] [API] Support UTF-8 filenames and stream names in all manifest-ha...
Some work done on 4551-utf-8 branch, see #4363 Tom Clegg
03:40 pm Task #4574 (Resolved): Invoke from workbench tests where needed
Tom Clegg
03:39 pm Task #4573 (Resolved): Add API and tests
Tom Clegg
03:38 pm Feature #4533: [API] [Tests] Add remote API for resetting database to test fixtures, for use by i...
4533-remote-reset @ -commit:8bb8524- commit:75634ad
* Updating bundle (commit:524fba5) makes test suites run in ra...
Tom Clegg
02:50 pm Feature #4533 (In Progress): [API] [Tests] Add remote API for resetting database to test fixtures...
Tom Clegg
03:29 pm Revision 3167e565 (arvados): 4533: Add more tests for disabling reset feature in config file.
Tom Clegg
03:11 pm Revision c621e2e9 (arvados): closes #4194
Merge branch '4194-keep-logging' Radhika Chippada
03:08 pm Revision aea8c62e (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
02:59 pm Revision a1df0187 (arvados): 4035: Use arv-mount to read the tool description file instead of arv...
Peter Amstutz
02:49 pm Revision 8bb85247 (arvados): 4533: Fix crash on nonexistent (or non-User) owner_uuid of role group.
Tom Clegg
02:48 pm Revision c0d9c656 (arvados): 4533: Reload database seeds during reset.
Tom Clegg
02:43 pm Revision 1362e1c7 (arvados): Merge branch 'master' into 4035-pipeline-support-cwl-tool
Peter Amstutz
02:34 pm Bug #3465 (Resolved): [SSO] Research requirements to upgrade SSO codebase to use oauth2 (or openi...
Peter Amstutz
02:32 pm Bug #3465 (New): [SSO] Research requirements to upgrade SSO codebase to use oauth2 (or openid con...
Workbench authentication process documented at [[Workbench authentication process]] Peter Amstutz
02:20 pm Bug #3465 (Resolved): [SSO] Research requirements to upgrade SSO codebase to use oauth2 (or openi...
Peter Amstutz
02:25 pm Task #4532 (Resolved): Review 4027-sdk-constraint-reuse-wip
Applied in changeset arvados|commit:14b762d2dd37a0a533532839aaf0488c11205e42. Brett Smith
04:14 am Task #4532 (In Progress): Review 4027-sdk-constraint-reuse-wip
Radhika Chippada
02:23 pm Task #4557 (Resolved): Review arvados-dev branch 4027-sdk-debian-packages-wip
"Reviewed by Tom":https://arvados.org/issues/4027#note-14 Brett Smith
02:21 pm Revision 14b762d2 (arvados): Merge branch '4027-sdk-constraint-reuse-wip'
Refs #4027. Closes #4532. Brett Smith
02:20 pm Task #4511 (Resolved): Work on reference implementation
Peter Amstutz
02:20 pm Task #4513 (Resolved): Conformance test framework
Peter Amstutz
02:19 pm Bug #4470 (Resolved): [Crunch] tmpdir not writable running jobs in Docker
I agree, I'm pretty certain this is resolved. (Tested running local jobs, and using arv run). Peter Amstutz
02:19 pm Revision 1a520a70 (arvados): 4027: Test updating job's SDK version after it's already set.
Brett Smith
02:19 pm Revision e8295893 (arvados): 4027: API server considers arvados_sdk_version for Job reuse.
* Extend "in git" and "not in git" filters to the arvados_sdk_version
column.
* When no filters are specified, if t...
Brett Smith
02:16 pm Feature #4571 (Resolved): [SSO] Support local user database on SSO server
Peter Amstutz
02:15 pm Task #4429 (Resolved): Document authentication dance between Workbench, API, SSO and external ide...
Peter Amstutz
02:15 pm Task #4379 (Resolved): Talk to Ward about what this involves
Peter Amstutz
02:13 pm Feature #4570 (Resolved): [SSO] Implement Google OAuth2 for new SSO installations
Peter Amstutz
02:10 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
Phil,
* The first check to see Inputs tab in "def create_and_run_pipeline_in_aproject" is ok. But we do not want to ...
Radhika Chippada
02:10 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Radhika Chippada wrote:
> Brett, sorry for the review confusion. I did start with reviewing the correct branch but m...
Brett Smith
12:25 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Brett, sorry for the review confusion. I did start with reviewing the correct branch but made a mistake in the end an... Radhika Chippada
01:59 pm Revision bc47a4a0 (arvados): 4027: Fixups suggested by code review.
Brett Smith
08:32 am Revision 8deda201 (arvados): 4363: Merge branch 'master' into 4363-less-filename-munging
Tom Clegg
08:31 am Revision 732f7f07 (arvados): 4363: Explicit UTF-8 for test string.
Tom Clegg
08:27 am Revision 763af541 (arvados): 4363: Validate utf-8 encoding of manifest_text.
Tom Clegg
08:27 am Revision f72ca2ac (arvados): 4363: Remove redundant test.
Tom Clegg
08:15 am Revision 14f2906a (arvados): 4533: Reset fixtures after testing user deactivation.
Tom Clegg
08:05 am Task #4569 (Resolved): Tidy up collection signing
Tom Clegg
08:05 am Task #4569 (Resolved): Tidy up collection signing
Move signing logic out of controller into model Tom Clegg
08:03 am Task #4555 (Resolved): Fix
Tom Clegg
08:00 am Revision 524fba52 (arvados): 4533: Update bundle.
Tom Clegg
08:00 am Revision d99ef829 (arvados): 4533: Add /database/reset API to roll everything back to fixtures.
Tom Clegg
07:36 am Revision b75e2a12 (arvados): 4400: Silence git error messages during package install (we ignore t...
Tom Clegg
07:36 am Revision dea90c95 (arvados): 4552: Use faster database_cleaner strategy.
Tom Clegg
07:36 am Revision 84d5db36 (arvados): 4552: Tidy up ensure_unique_name block.
Tom Clegg
07:36 am Revision 75a07d81 (arvados): 4552: Fix conflict between ensure_unique_name and signed manifests.
Tom Clegg
03:11 am Revision 07bf4bb6 (arvados): 4194: rename wrapper as logging_router
Radhika Chippada
12:45 am Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
Re-appeared on 9tee4 after updating docker image. Update to docker image re-installed the python arvados sdk. Change ... Sarah Guthrie

11/17/2014

11:41 pm Bug #4567 (Closed): [Crunch] job dies but is left in state "locked"
Job https://workbench.9tee4.arvadosapi.com/jobs/9tee4-8i9sb-q2qexkqhszi80pv died earlier today -- it was not running ... Tim Pierce
10:44 pm Task #4532 (Resolved): Review 4027-sdk-constraint-reuse-wip
Radhika Chippada
06:55 pm Task #4532 (In Progress): Review 4027-sdk-constraint-reuse-wip
Radhika Chippada
10:38 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Radhika,
Thanks for the feedback. I believe many of the tests you're requesting are covered by unit tests in @tes...
Brett Smith
09:50 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Tom Clegg wrote:
> This variable could probably be renamed to @PATCH_VERSION@:
You're proving why it should be re...
Brett Smith
08:31 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
4027-sdk-debian-packages-wip @ commit:ab8b92d
This variable could probably be renamed to @PATCH_VERSION@:
* ...
Tom Clegg
06:54 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Review feedback:
* I could not tell if such a test already exists; if not, does it make sense to add a test that f...
Radhika Chippada
10:31 pm Revision fc1a6288 (arvados): 4027: Add unit test suggested by code review.
Brett Smith
10:27 pm Revision 18103a8f (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
10:26 pm Revision ff071674 (arvados): 4194: MakeLoggingRESTRouter returns a pointer rather than the struct.
Radhika Chippada
10:13 pm Revision 84a1d6a6 (arvados): 4194: rename wrapper
Radhika Chippada
10:09 pm Revision 4805867b (arvados): Be a bit smarter about handling the dynamic dns resolver records for
compute nodes on api server startup.
refs #4461
Ward Vandewege
10:07 pm Story #4566 (New): [Documentation] Introduce compute workflow / pipeline concepts in user guide
The first page about running your own compute jobs (beyond using an existing template in Workbench) dives right into ... Tom Clegg
10:02 pm Revision 645a998c (arvados): 4194: rename RESTRouterWrapper as LoggingRESTRouter
Radhika Chippada
09:53 pm Revision 28c6bbee (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
09:47 pm Revision adb6ea84 (arvados): Merge branch '4027-sdk-debian-packages-wip'
Refs #4027. Closes #4557. Brett Smith
09:47 pm Revision adb6ea84 (arvados-dev): Merge branch '4027-sdk-debian-packages-wip'
Refs #4027. Closes #4557. Brett Smith
09:45 pm Task #4565 (Resolved): Review branch: 4250-doc-updates
Radhika Chippada
09:43 pm Revision 6268adae (arvados): 4027: Build packages for Ruby and Perl SDKs.
Brett Smith
09:43 pm Revision 6268adae (arvados-dev): 4027: Build packages for Ruby and Perl SDKs.
Brett Smith
09:42 pm Revision aa6f07c9 (arvados): 4250: update user guide to reflect current code.
Radhika Chippada
09:26 pm Support #4564 (Resolved): [Documentation] Document using common-workflow-language tools with Arva...
# Write a tutorial on how to try out the tool description language using Arvados. Provide an example specification do... Peter Amstutz
09:23 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
Tom Clegg wrote:
> Brett Smith wrote:
> > Okay, so, I'm glad to have some clarity around the encoding of manifests,...
Brett Smith
04:10 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
Brett Smith wrote:
> Okay, so, I'm glad to have some clarity around the encoding of manifests, but you realize it's ...
Tom Clegg
09:20 pm Bug #4562 (Resolved): [Documentation] Wiki page: explain appropriate use cases for arv-run vs. ru...
These general approaches need to be introduced and explained between http://doc.arvados.org/user/tutorials/intro-crun... Tom Clegg
09:10 pm Feature #4561 (New): [SDKs] Refactor run-command so it can be used as an SDK by scripts in a git ...
Currently you have two main options for running a job:
# Put the program you need in a docker image. Use run-command...
Tom Clegg
09:09 pm Bug #4560: [Documentation] We need a link to arv-copy in user guide.
Currently arv-copy documentation can be found in SDK Referece -> arv subcommands. Ward suggested that we create a lin... Radhika Chippada
09:08 pm Bug #4560 (Closed): [Documentation] We need a link to arv-copy in user guide.
Radhika Chippada
08:55 pm Revision c3db5a62 (arvados-dev): Retry docker push a few times if it fails.
No issue # Ward Vandewege
08:55 pm Revision c3db5a62 (arvados): Retry docker push a few times if it fails.
No issue # Ward Vandewege
08:25 pm Bug #4559 (Resolved): [Workbench] pipeline components with long names are obscured by status
On the pipeline instances view, the status column obscures pipeline component names after about 30 characters or so.
...
Tim Pierce
08:18 pm Task #4555 (In Progress): Fix
Tom Clegg
05:05 pm Task #4555 (Resolved): Fix
Tom Clegg
08:18 pm Task #4554 (Resolved): Add test
Tom Clegg
05:05 pm Task #4554 (In Progress): Add test
Tom Clegg
05:04 pm Task #4554 (Resolved): Add test
Tom Clegg
08:17 pm Revision e46d4846 (arvados): 4552: Tidy up ensure_unique_name block.
Tom Clegg
07:56 pm Bug #4558: [Workbench] Project Selection dropdown menu
* The Selection drowdown title is "Selection..." but it is a dropdown menu, not a popup. Hence, it should not have th... Radhika Chippada
07:52 pm Bug #4558 (Resolved): [Workbench] Project Selection dropdown menu
Radhika Chippada
07:28 pm Bug #4296: [SSO] 500 from a fresh login
Started GET "/" for 127.0.0.1 at 2014-11-17 14:27:34 -0500
Processing by AuthController#welcome as HTML
Rendered ...
Peter Amstutz
07:20 pm Revision ee756b10 (arvados): 4552: Test signing in collections.show.
Tom Clegg
07:02 pm Task #4557 (Resolved): Review arvados-dev branch 4027-sdk-debian-packages-wip
Brett Smith
07:02 pm Revision ab8b92df (arvados-dev): 4027: Build packages for Ruby and Perl SDKs.
Brett Smith
06:57 pm Revision fdb2dcbf (arvados): 4552: Use faster database_cleaner strategy.
Tom Clegg
06:48 pm Revision f330ec11 (arvados): 4552: Fix conflict between ensure_unique_name and signed manifests.
Tom Clegg
06:46 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
These jobs are failing for a variety of reasons, some of which look directly like compute node failures and some mayb... Tim Pierce
06:31 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
if it helps, ive found more jobs:
qr1hi-8i9sb-eipb3kuyac7absp#Log
qr1hi-8i9sb-5cb9i2keadpevcq#Log
Bryan Cosca
06:02 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
The logs suggest that this is related to #4482 (though it may be a red herring):... Tim Pierce
04:29 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
The jobs before in my previous update were able to be run successfully the next day. Today, this one is bothering me,... Bryan Cosca
05:41 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
I've added the tests you suggested, though I'm not sure the second one where we check a second time that it can still... Phil Hodgson
04:33 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
Review feedback:
* Worked in my manual testing
* Code update looks good (per Tom's agreed upon solution)
* I...
Radhika Chippada
05:40 pm Revision 7bd04ed2 (arvados): 3382: test that after editing that an input is editable a second time
Phil Hodgson
05:40 pm Feature #4024 (Resolved): [Workbench] PipelineInstances#index should scroll down to show older pi...
Applied in changeset arvados|commit:ff7b22c70cd77073d9bdbebac0bf03d43745ed0c. Radhika Chippada
05:39 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
$ #<ArvadosApiClient::NoApiResponseException: HTTPClient::ReceiveTimeoutError error connecting to API server>
/home/...
Radhika Chippada
05:36 pm Revision ff7b22c7 (arvados): closes #4024
Merge branch '4024-pipeline-instances-scroll' Radhika Chippada
05:18 pm Revision 372cff3e (arvados): 3382: test that an input without a description is still displayed af...
Phil Hodgson
05:16 pm Revision d3229c7f (arvados): Merge branch 'master' into 3382-always-show-inputs
Phil Hodgson
05:05 pm Task #4556 (Resolved): Confirm fixed by 3824
Tom Clegg
05:05 pm Feature #4138 (In Progress): [Node Manager] Support Google Cloud Platform in node manager
Tim Pierce
05:05 pm Task #4203 (In Progress): Implement arvnodeman.computenode.googlecloud
Tim Pierce
05:02 pm Revision 95a61743 (arvados): Merge branch '4024-pipeline-instances-scroll' of git.curoverse.com:a...
Radhika Chippada
04:54 pm Bug #4553 (Closed): [Docker] Compute node records should get created automatically by build/run s...
Seems this doesn't _always_ happen. Tom Clegg
04:46 pm Revision 78447c70 (arvados): 4024: Make items_available, result_limit, and result_offset work for...
Tom Clegg
04:35 pm Feature #4194: [Keep] consistent logging for keepstore requests
Reviewing at commit:0e5dfbb
This looks great. A couple of suggestions for organizing the code:
Let's put route...
Tim Pierce
04:26 pm Task #4485 (In Progress): Review 3382
Radhika Chippada
04:15 pm Task #4542 (In Progress): Review branch: 4194-keep-logging
Tim Pierce
04:10 pm Bug #3824 (Resolved): [Crunch] crunch-job should create task execution environment inside docker ...
Applied in changeset arvados|commit:664919d58c3689cd9e0a25547ec1e02d9adda38c. Anonymous
04:04 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
commit:5058834 3824-task-work LGTM Peter Amstutz
03:38 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Reviewing commit:1137425
I still can't run a job inside Docker:...
Peter Amstutz
04:05 pm Revision 664919d5 (arvados): Merge branch '3824-task-work' closes #3824
Tom Clegg
04:04 pm Revision 9cd3ddf2 (arvados): 4363: Accept unicode class, not just unicode type.
Tom Clegg
04:04 pm Task #4549 (Resolved): Review 3824-task-work
Peter Amstutz
03:19 pm Task #4549 (In Progress): Review 3824-task-work
Peter Amstutz
02:40 pm Task #4549 (Resolved): Review 3824-task-work
Tom Clegg
04:01 pm Revision 4b20653d (arvados): 4363: Validate utf-8 encoding of manifest_text.
Tom Clegg
03:55 pm Revision 97ddc118 (arvados): 3824: Check whether there is anything to install before trying to lo...
Tom Clegg
03:55 pm Bug #4535 (Resolved): [API] Configuration option to set advertised hostname
Applied in changeset arvados|commit:9a46fb0033514db6dd5e8ab4ccf793f78458a734. Anonymous
03:50 pm Bug #4535: [API] Configuration option to set advertised hostname
LGTM Ward Vandewege
03:51 pm Feature #4251 (Resolved): [Documentation] (recurring) Write blog post *in first three days of spr...
Ward Vandewege
03:51 pm Task #4356 (Resolved): write blog post
Ward Vandewege
03:51 pm Revision 9a46fb00 (arvados): Merge branch '4535-configure-api-host-url' closes #4535
Peter Amstutz
03:49 pm Task #4537 (Resolved): Review 4535-configure-api-host-url
Ward Vandewege
03:39 pm Bug #4552 (Resolved): [API] Fix permission error due to stripped signatures when ensure_unique_na...
Tom Clegg
03:12 pm Revision 91e919d5 (arvados): Also build a package for python-six.
No issue # Ward Vandewege
03:12 pm Revision 91e919d5 (arvados-dev): Also build a package for python-six.
No issue # Ward Vandewege
03:08 pm Story #4551 (New): [SDKs] [Workbench] [API] Support UTF-8 filenames and stream names in all manif...
Acceptance: a "special file" (a file with special characters in its filename) should be handled in the following case... Tom Clegg
03:05 pm Revision bfd5100c (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
02:58 pm Task #4541 (Resolved): Review 4388-workbench-update
Tom Clegg
02:30 pm Task #4541 (In Progress): Review 4388-workbench-update
Brett Smith
02:42 pm Task #4550 (Resolved): Review 3824-docker-fixes (lower priority than 3824-task-work)
Tom Clegg
02:42 pm Revision 41f2b53c (arvados): 3824: Create "all users" group in seeds.rb instead of asking a human...
Tom Clegg
02:42 pm Revision b709c1bd (arvados): 3824: autorestart non-detached services regardless of exit code.
Tom Clegg
02:40 pm Bug #4470: [Crunch] tmpdir not writable running jobs in Docker
Should be fixed by 3824-task-work branch on #3824 Tom Clegg
02:38 pm Task #4548 (Resolved): Make sure JOB_TMP and TASK_TMP are writable by crunch user
Tom Clegg
02:35 pm Task #4548 (Resolved): Make sure JOB_TMP and TASK_TMP are writable by crunch user
Tom Clegg
02:35 pm Bug #4388 (Resolved): [SDKs] Manifest#each_line should not crash when encountering a blank line i...
Applied in changeset arvados|commit:d9f45bd01d2f5691a9aaca4f1fc00465497ef00c. Anonymous
02:31 pm Bug #4388: [SDKs] Manifest#each_line should not crash when encountering a blank line in a manifest.
commit:4c110b5f looks great. Thank you for following through on that; sorry for my oversight. Brett Smith
02:32 pm Revision d9f45bd0 (arvados): Merge branch '4388-workbench-update' closes #4388
Tom Clegg
01:20 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
I've made a lot of progress on this feature and I should like to get some feedback on where it's at before dotting te... Phil Hodgson
01:01 pm Revision 9d4b0f36 (arvados): 4233: simple but reasonably effective tests
Phil Hodgson
12:49 pm Task #4547 (Resolved): Review 4233
Phil Hodgson
12:48 pm Task #4545 (Resolved): Add tests for the charting
Phil Hodgson
10:54 am Task #4545 (In Progress): Add tests for the charting
Phil Hodgson
08:54 am Task #4545 (Resolved): Add tests for the charting
Phil Hodgson
08:55 am Task #4546 (Resolved): Document in Wiki how to use the log replay helper task
Phil Hodgson
08:54 am Task #4497 (Resolved): Graph logged crunchstat intervals in job log tab
Phil Hodgson
08:53 am Revision 26321ce3 (arvados): 4233: catch and ignore log processing errors
Phil Hodgson
08:49 am Revision 07ad3d1e (arvados): 4233: better labelling includes raw interval data and number formatting
Phil Hodgson
02:28 am Revision 0adcabd3 (arvados): 4024: update test assert
Radhika Chippada
01:58 am Revision e0f4747a (arvados): 4024: add test assertion to check no error in page.
Radhika Chippada
12:23 am Feature #4543 (New): [SDKs] it probably shouldn't be possible to have many docker images in Keep ...
Ward Vandewege

11/16/2014

11:10 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Tom,
* pipeline_instances page with no search string, with a matching search string works. However, if I were to e...
Radhika Chippada
05:28 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Now at commit:5d87bca after
* merging 4388-workbench-update to eliminate javascript errors that were breaking workbe...
Tom Clegg
09:18 pm Revision a128baa1 (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
09:18 pm Revision 43e019a1 (arvados): Merge branch '4024-pipeline-instances-scroll' of git.curoverse.com:a...
Radhika Chippada
09:12 pm Task #4542 (Resolved): Review branch: 4194-keep-logging
Radhika Chippada
08:57 pm Revision 0e5dfbbc (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
08:51 pm Revision de35a630 (arvados): 4194: logging writer copies / appends passed in data into its own bu...
Radhika Chippada
07:31 pm Bug #4461 (In Progress): [OPS] Replace dnsmasq with unbound
Ward Vandewege
07:19 pm Revision 73a84361 (arvados): 4233: show original data in hover info instead of proportions
Phil Hodgson
06:54 pm Revision 7395af3b (arvados): Make our dynamic dns update system for compute nodes more generic.
refs #4461 Ward Vandewege
06:34 pm Revision 4f257e48 (arvados): 3824: Create "all users" group in seeds.rb instead of asking a human...
Tom Clegg
06:33 pm Revision e4e47b5f (arvados): 3824: autorestart non-detached services regardless of exit code.
Tom Clegg
06:32 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
This is starting to be bothersome, I've been trying to rerun this same job and I keep getting the error:
2ecb1a2a2...
Bryan Cosca
06:31 pm Revision 3ca79283 (arvados): 3824: Enable websockets.
Tom Clegg
06:31 pm Revision 5662a056 (arvados): 3824: docker issue 3172 is closed, build works without -q.
Tom Clegg
04:48 pm Revision 7139cabb (arvados): 4233: chart stats for parallel tasks separately
- this commit also extends the scroll time to 10 minutes Phil Hodgson
02:42 pm Revision ec988adb (arvados): 4233: bug fix - rounding errors were causing us to miss maxima scrol...
Phil Hodgson
02:17 pm Revision e9ccda58 (arvados): 4233: do not scale the 'cpu' series stats, and divide them by cpu count
Phil Hodgson
02:02 pm Revision 8aad5da5 (arvados): 4233: only redraw graph a maximum of once every 5 seconds
Phil Hodgson
01:30 pm Bug #4395 (Resolved): [SDKs] sdk/go/keepclient race condition
Applied in changeset arvados|commit:a75ef0985d2a385165168cbb488cf97382308549. Ward Vandewege
01:25 pm Revision a75ef098 (arvados): Fix sdk/go/keepclient test race condition
This closes #4395 Ward Vandewege
01:14 pm Revision c8d0498d (arvados): 4233: will rescale y-axis for a series that scrolls off leaving less...
Phil Hodgson
09:16 am Revision 11374252 (arvados): 3824: Run build_script (and create *_WORK) inside the container.
Tom Clegg
08:59 am Bug #3824 (In Progress): [Crunch] crunch-job should create task execution environment inside dock...
Tom Clegg
06:46 am Revision 05c6711b (arvados): 4233: remove explicit JS includes for showing Keep histogram now tha...
Phil Hodgson
06:45 am Revision f2cf5a53 (arvados): 4233: keep graph data array sorted by timestamp
Phil Hodgson
04:48 am Revision 5d87bcae (arvados): 3400: Do not fetch API results just for the sake of looking up resou...
Tom Clegg
04:47 am Revision 83e73eda (arvados): 4024: @limit override must happen before find_objects_for_index.
Tom Clegg
04:46 am Revision 06afd90f (arvados): 3400: Do not fetch_multiple_pages in #index actions.
Tom Clegg
02:38 am Revision 4b322265 (arvados): 4024: Merge branch '4388-workbench-update' into 4024-pipeline-instan...
Tom Clegg
02:18 am Revision abe8fc4c (arvados): 4024: Merge branch 'master' into 4024-pipeline-instances-scroll
Tom Clegg
02:12 am Task #4541 (Resolved): Review 4388-workbench-update
Tom Clegg
02:11 am Bug #4388 (In Progress): [SDKs] Manifest#each_line should not crash when encountering a blank lin...
Tom Clegg
01:55 am Revision 4c110b5f (arvados): 4388: Fix typo
Tom Clegg
01:52 am Revision 2ac2528d (arvados): 4388: Update bundle
Tom Clegg

11/15/2014

11:51 pm Revision 9cd99d30 (arvados): 4388: Fix javascript errors.
Tom Clegg
03:55 pm Revision d78db2b1 (arvados): 4194: update keepstore and handler_test to make wrapper instance rat...
Radhika Chippada
02:17 pm Revision cb03f98d (arvados): 4233: now the y-axis series will scale to always be between 0 and 1
Phil Hodgson
01:27 pm Revision 768f5281 (arvados): 4233: why pass around global variables?
Phil Hodgson
12:41 pm Revision bce76593 (arvados): 4233: redraw graph when processing log events
- still very naive
- still does not scale y-axis
- does not try to limit x axis timeline to 20 minutes: just keeps ...
Phil Hodgson
03:27 am Revision 11236731 (arvados): 4194: refactor router wrapper into a separate file.
Radhika Chippada
02:32 am Revision 8c682e4f (arvados): Merge branch 'master' into 4194-keep-logging
Radhika Chippada
02:29 am Revision f798c910 (arvados): 4194: refactor REST Router wrapper into a separate package named kee...
Radhika Chippada

11/14/2014

11:07 pm Revision 6de0a4ab (arvados): Relax activesupport dependency to accommodate 4.x. refs #4388
Tom Clegg
10:55 pm Feature #4533: [API] [Tests] Add remote API for resetting database to test fixtures, for use by i...
https://github.com/DatabaseCleaner/database_cleaner Tom Clegg
07:06 pm Feature #4533 (Resolved): [API] [Tests] Add remote API for resetting database to test fixtures, f...
This should only work if @RAILS_ENV=test@ _and_ the feature is specifically enabled in the config file. Test cases sh... Tom Clegg
10:26 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
updated report from Sally:
- running this pipeline on 9tee4 works fine.
- re-running on qr1hi showed the same iss...
Ward Vandewege
03:48 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
Sally reports that re-running this pipeline appears to be producing the expected results, so I recommend that we tabl... Tim Pierce
09:16 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
I think the problem being reported is that you can't tell which jobs/outputs are part of pipeline A and which are par... Tom Clegg
09:12 pm Bug #4476 (In Progress): [Workbench] Search dialog infinite scrolling issue: second page and onwa...
Tom Clegg
08:56 pm Bug #4476: [Workbench] Search dialog infinite scrolling issue: second page and onwards do not fil...
This is likely a duplicate of a bug noticed and fixed in #4024. Tom Clegg
09:10 pm Bug #4493 (Resolved): [Crunch] job fails with Docker error "Engine is shutdown"
This looks like the node was shutting down while the job was running. This kind of thing is probably going to be fixe... Ward Vandewege
09:05 pm Bug #4464: [Workbench] Collections tab loads forever on a specific project
Eventually times out and shows Retry button. Browser console log shows "timeout" error message sent by Workbench. Tom Clegg
09:03 pm Bug #4482 (Resolved): [Crunch] Diagnostics failure "user not found on host"
Ward Vandewege
09:03 pm Bug #4522 (Rejected): [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError ...
Tom Clegg
08:51 pm Bug #4522: [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError error conne...
Todo: check the workbench and api server logs for when this happened. Ward Vandewege
04:38 pm Bug #4522: [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError error conne...
https://workbench.qr1hi.arvadosapi.com/collections is currently working for me. Is it working for you too?
That s...
Tim Pierce
01:37 am Bug #4522 (Rejected): [Workbench] qr1hi /collections page error "HTTPClient::ReceiveTimeoutError ...
Radhika Chippada
08:50 pm Bug #4474 (Resolved): [Node Manager] Node manager shut down node in middle of job
Ward Vandewege
04:47 pm Bug #4474: [Node Manager] Node manager shut down node in middle of job
Just to check our assumptions on this one: the log indicates that the node was shut down while a job was running, not... Tim Pierce
08:46 pm Feature #4539 (New): [Workbench] Job detail page should show the job status when the job is not r...
On the pipeline instance #show page, each job has a {progress bar or status badge}. On the job #show page, the markup... Ward Vandewege
08:38 pm Bug #4538: [SDKs] pipeline created by arv copy fails Commit.find_commit_range
Pipeline instance 9tee4-d1hrv-wapjyzr70sqqa06 generates the following errors when run, at https://workbench.9tee4.arv... Tim Pierce
08:36 pm Bug #4538 (Closed): [SDKs] pipeline created by arv copy fails Commit.find_commit_range
Tim Pierce
08:32 pm Revision f5113828 (arvados): 4194: rename RESTRouterWrapper
Radhika Chippada
08:23 pm Task #4537 (Resolved): Review 4535-configure-api-host-url
Peter Amstutz
08:22 pm Feature #4194: [Keep] consistent logging for keepstore requests
Capturing the informal review we just did face-to-face at commit:d4224bfe:
* The @WrapRESTRouter@ code could wrap ...
Tim Pierce
08:10 pm Bug #4523 (In Progress): [Workbench] Search dialog giving error when searching in "All projects" ...
Tom Clegg
01:40 am Bug #4523 (Resolved): [Workbench] Search dialog giving error when searching in "All projects" in ...
To reproduce:
Go to https://workbench.qr1hi.arvadosapi.com/, enter any term into the search box (I used "hash") an...
Radhika Chippada
08:08 pm Revision 97cd8d60 (arvados): 4194: remove some more old log statements
Radhika Chippada
08:06 pm Bug #4536 (Resolved): [SDKs] arv tag is broken
Ward Vandewege
08:04 pm Bug #4470: [Crunch] tmpdir not writable running jobs in Docker
On further research, this is a general problem, the data volume shows up as being owned by root inside the container,... Peter Amstutz
07:50 pm Revision 84b6c8f2 (arvados): 4194: since LoggingResponseWriter is doing the logging, remove some ...
Radhika Chippada
07:38 pm Revision 2070784e (arvados): 4535: Change default to false because ~ indicates "must be filled in".
Peter Amstutz
07:33 pm Revision 59f750a1 (arvados): 4535: Add default_url_options to application controller that consults
Rails.configuration. Added entry with documentation to
application.yml.default.
Peter Amstutz
07:28 pm Bug #4535 (Resolved): [API] Configuration option to set advertised hostname
In development mode, the default root_url of rails is 'localhost'. This gets advertised in the discovery document. ... Peter Amstutz
07:22 pm Feature #4534 (Resolved): [Tests] run-tests.sh should bring up API and Keep services for the dura...
Tom Clegg
07:14 pm Bug #4488: [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
I don't see how that works in the case of a federated environment, where a client may find itself talking to disks in... Tim Pierce
06:31 pm Bug #4488: [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
In a given scenario the SDK should either connect only to proxies, or only to disks -- so this shouldn't be an issue.... Tom Clegg
07:07 pm Revision 8b7ed36f (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
06:58 pm Task #4532 (Resolved): Review 4027-sdk-constraint-reuse-wip
Brett Smith
06:57 pm Revision 2f69408f (arvados): 4027: API server considers arvados_sdk_version for Job reuse.
* Extend "in git" and "not in git" filters to the arvados_sdk_version
column.
* When no filters are specified, if t...
Brett Smith
06:40 pm Feature #4531 (New): [Documentation] Set of introductory tutorials each focused on accomplishing ...
Tom Clegg
06:40 pm Feature #4530 (New): [Workbench] Show more (earlier) log entries for a running job
The "tail" shown in the web gui is nice, but I often want to see the early part of the job log while the job is runni... Sarah Guthrie
06:29 pm Bug #4529 (Closed): [SDKs] Ensure Python and Go SDKs in a given situation always choose either pr...
Tom Clegg
05:00 pm Feature #4528 (New): [Crunch] Dynamic task allocation based on job size determined at runtime
This doesn't work with tasks because I run out of memory often and need to parallelize between nodes instead of cores... Bryan Cosca
05:00 pm Story #4527 (Rejected): [Keep] DataManager automatically adds cloud storage when utilization is o...
Similar to NodeManager automatically spinning up compute nodes, DataManager could automatically allocate new storage ... Peter Amstutz
04:03 pm Revision d4224bfe (arvados): 4194: improve logging when large block is retrieved.
Radhika Chippada
03:56 pm Bug #4524: [Workbench] Error running pipeline with File input data type.
The URL makes this look like the problem could be excessive URL-encoding. Is this a problem specific to Clippy? If ... Tim Pierce
01:44 am Bug #4524: [Workbench] Error running pipeline with File input data type.
Run pipeline with File input (pipeline_templates/qr1hi-p5p6p-xt9iw6rmhvm93q5) -> Select a file (selected into a clipp... Radhika Chippada
01:43 am Bug #4524 (Closed): [Workbench] Error running pipeline with File input data type.
Run pipeline with File input (pipeline_templates/qr1hi-p5p6p-xt9iw6rmhvm93q5) -> Select a file (selected into a clipp... Radhika Chippada
03:31 pm Feature #4526 (New): [SDKs] run-command stream create pipes to stream stdin/stdout directly from/...
When redirecting stdin or stdout, run-command currently either opens a file on the FUSE mount (stdin) or writes a sta... Peter Amstutz
02:50 pm Revision 35c53e25 (arvados): 4194: Add LoggingResponseWriter and RESTRouter wrapper. Update keeps...
Radhika Chippada
02:41 pm Task #4498 (Resolved): Fix double-load after fwd/back
Tom Clegg
02:31 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
In order to support common workflow language tool descriptions, it will essential to be able to take Docker images co... Peter Amstutz
01:41 pm Story #4299: [Node Manager] Support a configurable throttle for creating cloud nodes
This is going to take a little more rearchitecting of Node Manager than I originally thought.
Imagine the case whe...
Brett Smith
06:16 am Revision f5a1a921 (arvados): 4024: Use filterable-control input values (if any) when first loadin...
Tom Clegg
02:47 am Revision 9100a3b1 (arvados): 4024: Use filterable-control input values (if any) when first loadin...
Tom Clegg
02:40 am Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
* Peter, thanks for the review feedback. I updated to use left padding of 0 when preview panel is used for selection,... Radhika Chippada
02:35 am Story #3177 (Resolved): [Workbench] File chooser dialog (replace remaining use of clippy)
Applied in changeset arvados|commit:3a31350c6265cb1135d3d4d40af436aae91a9894. Radhika Chippada
02:36 am Story #4525: [Workbench] Remove stale clippy code.
Since clippy is now retired (#3177), we can update the script tag in collection show_files partial.... Radhika Chippada
02:33 am Story #4525 (Resolved): [Workbench] Remove stale clippy code.
examples
* views/collections/_show_files.html.erb (see "note-1"://arvados.org/issues/4525#note-1 below)
* a good ch...
Radhika Chippada
02:30 am Task #4445 (Resolved): Review branch: 3177-collection-choose-files
Radhika Chippada
02:29 am Revision 3a31350c (arvados): closes #3177
Merge branch '3177-collection-choose-files' Radhika Chippada
02:12 am Revision c805714d (arvados): 3177: use no left padding when collection files preview panel is use...
Radhika Chippada
01:45 am Revision 9325dabc (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada

11/13/2014

11:43 pm Bug #4520 (Resolved): [SDKs] arv copy should respect --project-uuid when saving destination Colle...
arv copy --src settings --dst 9tee4 --project-uuid 9tee4-j7d0g-f75lcwo78ifvnl2 qr1hi-4zz18-85b713kdm9kle3r
(where se...
Sarah Guthrie
11:29 pm Revision 75759abc (arvados): 4024: Use filterable-control input values (if any) when first loadin...
Tom Clegg
11:02 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
Tom Clegg wrote:
> At commit:e8dd6d9
Okay, so, I'm glad to have some clarity around the encoding of manifests, bu...
Brett Smith
08:35 pm Bug #4363: [Keep] arv-mount should not munge filenames unless required by POSIX
At commit:e8dd6d9
Notes
* NUL bytes in filenames are now prohibited by CollectionWriter (this seemed more reasona...
Tom Clegg
10:27 pm Revision 95323ba3 (arvados): 4024: Add test for double-load bug.
Tom Clegg
10:12 pm Revision 67e6092c (arvados): 4035: Looks for "tooldescription" in the component, if found, proces...
Peter Amstutz
09:30 pm Task #4517 (In Progress): Review 4363-less-filename-munging
Brett Smith
07:57 pm Task #4517 (Resolved): Review 4363-less-filename-munging
Tom Clegg
09:25 pm Task #4519 (Resolved): Review 4380-node-manager-slurm-drain-wip
Brett Smith
09:24 pm Revision 7e9c860f (arvados): 4380: Node Manager shutdown actor is more robust.
ComputeNodeShutdownActor now checks that destroying the cloud node
succeeds. Before retrying, it will check if the n...
Brett Smith
09:24 pm Revision 31adfc80 (arvados): 4380: Add SLURM dispatcher to Node Manager.
Brett Smith
09:24 pm Revision ce4d36c4 (arvados): 4380: Fix retry scheduling for Node Manager change methods.
Brett Smith
09:21 pm Revision eb185aab (arvados): 4024: Remove unused /pipeline_instances/?search=x support.
Tom Clegg
08:48 pm Revision e8dd6d95 (arvados): 4363: Merge branch 'master' into 4363-less-filename-munging
Tom Clegg
08:47 pm Task #4498 (In Progress): Fix double-load after fwd/back
Tom Clegg
08:43 pm Bug #4518 (Resolved): [Documentation] typo in arv-run documentation
The first line says: The arv-run command enables you create Arvados pipelines at the command line that fan out to mul... Bryan Cosca
08:20 pm Revision 97bb0767 (arvados): 4363: Make _NameAttribute a unicode instead of a str. Avoid encoding...
Tom Clegg
08:06 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
Also (as we discussed) the files have some unnecessary left margin or padding (possibly due to the hidden checkboxes?). Peter Amstutz
07:59 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
There is a script tag in show_files that seems relevant:... Peter Amstutz
04:44 am Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
* Updated to allow selection of the row, instead of the checkbox.
* I did not introduce a new partial. The update ...
Radhika Chippada
07:57 pm Task #4510 (Resolved): Test some utf8 characters
Tom Clegg
04:48 pm Task #4510 (Resolved): Test some utf8 characters
Tom Clegg
07:54 pm Revision 34a73d54 (arvados): 4363: Remove redundant test.
Tom Clegg
07:45 pm Revision 1aa68382 (arvados): 4363: Compare unicode strings (ignore utf-8 encoding differences). B...
Tom Clegg
07:28 pm Revision f78caf95 (arvados): 4363: Do not blow up when manifests contain utf-8 characters.
Tom Clegg
07:11 pm Feature #4516 (New): [Workbench] Don't show empty projects/collections when using the chooser dia...
In the chooser dialog, it is unhelpful to show the user projects with no relevant contents, such as projects with no ... Peter Amstutz
07:06 pm Bug #4515 (Resolved): [Workbench] Oops when selecting empty project in chooser
Go to dashboard. Click on "Run pipeline". Under "Projects", select a project that is empty. The chooser will show ... Peter Amstutz
07:03 pm Bug #4514 (New): [Workbench] Pipelines that are in New or Ready state should show up somewhere on...
Peter Amstutz
06:14 pm Task #4513 (In Progress): Conformance test framework
Peter Amstutz
06:14 pm Task #4513 (Resolved): Conformance test framework
Peter Amstutz
06:14 pm Task #4512 (In Progress): Implement support in arv-run-pipeline-instance
Peter Amstutz
06:13 pm Task #4512 (Resolved): Implement support in arv-run-pipeline-instance
Peter Amstutz
06:13 pm Task #4511 (In Progress): Work on reference implementation
Peter Amstutz
06:13 pm Task #4511 (Resolved): Work on reference implementation
Peter Amstutz
06:13 pm Task #4382 (Resolved): Decide what to do
Peter Amstutz
04:54 pm Revision 069b22b2 (arvados): 4363: Test edge cases as directory names, too.
Tom Clegg
04:49 pm Task #4375 (Resolved): Add tests
Tom Clegg
04:49 pm Task #4365 (Resolved): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
04:42 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
4821022082141e6f5b79266ec6acf139+87/qr1hi-8i9sb-k3s82jjrvwqr1oq.log.txt
Hopefully this is the one! :)
Bryan Cosca
04:27 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Heres one that switches from 1-8
718372dd89ec3873df80ffd7dff00768+89/qr1hi-8i9sb-gctmuofg58gkt3k.log.txt
Bryan Cosca
04:16 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Here are a couple from 9tee4 for me:
539086fd4061f946361b858d58ed487f+89/9tee4-8i9sb-fiqxbkp5j4mydb8.log.txt
0bb6...
Abram Connelly
04:05 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Here are a couple examples:
41c21fe24f7e861f61af30a52e3ae3ef+87/qr1hi-8i9sb-xca86qu6z460no8.log.txt
682b61f380d30...
Bryan Cosca
02:26 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Phil Hodgson wrote:
> There's a y-axis problem here, because not all the sum(Dx) are measured in seconds, so there a...
Tom Clegg
01:06 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
There's a y-axis problem here, because not all the sum(Dx) are measured in seconds, so there are differing units of m... Phil Hodgson
04:42 pm Revision 4d01f18d (arvados): 4363: Test that munged filenames show up in os.listdir().
Tom Clegg
04:40 pm Revision e363a797 (arvados): 4363: Reject NUL characters in filenames in CollectionWriter.
Tom Clegg
04:39 pm Story #4509 (New): [Workbench] Better pipeline management
Right now, managing your pipelines from workbench is a bit difficult. From the dashboard recently finished pipeline ... Abram Connelly
03:33 pm Revision 23cebe86 (arvados): 4233: (naive) first iteration at graphing job log stats
- does not update, but graphs the story so far
- does not do scaling
- has no error checking
Phil Hodgson
03:20 pm Task #4495 (Resolved): Review 2853-rendezvous
Tom Clegg
02:50 pm Story #2853 (Resolved): [Keep] Use rendezvous hashing to assign blocks to servers in Go and Pytho...
Applied in changeset arvados|commit:06e402b11ad4d503feb5fa45845cb27c93478cfc. Anonymous
02:15 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
Tom Clegg wrote:
> Brett Smith wrote:
> > * Go's sort is not guaranteed to be stable. Python's is. Does this matt...
Brett Smith
02:47 pm Revision 06e402b1 (arvados): Merge branch '2853-rendezvous' closes #2853
Tom Clegg
02:47 pm Revision 4a84c449 (arvados): 4380: Node Manager monitors respond to shutdown_eligible message.
Brett Smith
02:27 pm Revision afdab872 (arvados): 2853: Merge branch 'master' into 2853-rendezvous
Tom Clegg
02:00 pm Task #4489 (Resolved): Review 4027-api-sdk-version-wip
Applied in changeset arvados|commit:809b122ee02d566b3bddb26df928e57efa39ed87. Brett Smith
01:57 pm Revision 809b122e (arvados): Merge branch '4027-api-sdk-version-wip'
Refs #4027. Closes #4489. Brett Smith
01:56 pm Revision f5c574f4 (arvados): 4027: Add arvados_sdk_version runtime constraint to API server.
Crunch will use this information to provide a specific SDK version in
the runtime environment.
Brett Smith
02:49 am Revision f81483a3 (arvados): 3177: update test to select row in preview panel
Radhika Chippada
02:19 am Revision 1ac0e3da (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
02:19 am Revision dff161c1 (arvados): 3177: file selection
Radhika Chippada

11/12/2014

11:21 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Brett Smith wrote:
> Don't read too much into it. At one point, I had trouble rolling back the short form migration...
Tom Clegg
10:13 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Tom Clegg wrote:
> At commit:db8f547...
>
> The only complaint I can find is that the arvados repository fixture ...
Brett Smith
06:37 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
At commit:db8f547...
The only complaint I can find is that the arvados repository fixture ("owned by All Users gro...
Tom Clegg
11:11 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
> Now at commit:9ef386f with todo: Rearrange KeepRendezvousWeightTestCase mock.
Tests are refactored at commit:cf1...
Tom Clegg
10:35 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
Brett Smith wrote:
> * Go's sort is not guaranteed to be stable. Python's is. Does this matter? It will only come...
Tom Clegg
09:13 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
h2. Compatibility
* Go's sort is not guaranteed to be stable. Python's is. Does this matter? It will only come ...
Brett Smith
02:22 pm Story #2853 (In Progress): [Keep] Use rendezvous hashing to assign blocks to servers in Go and Py...
Tom Clegg
11:10 pm Revision cf1db398 (arvados): 2853: Use mock from KeepClientServiceTestCase for rendezvous tests
instead of intruding on KeepClient's private instance variables. Tom Clegg
10:22 pm Revision 3894b788 (arvados): Update arv-tag --help text in arv subcommands documentation.
refs #4486 Ward Vandewege
10:20 pm Revision 5be66e86 (arvados): Make arv-tag print usage when --help is given. Also, fix typo in usa...
No issue # Ward Vandewege
10:19 pm Revision fd207a0e (arvados): Remove some redundant lines from sdk/bin/arv
No issue # Ward Vandewege
10:10 pm Revision be3c438f (arvados): 4027: Fixup arvados repo fixture to make it more realistic.
Brett Smith
09:57 pm Revision 9ef386f6 (arvados): 2853: Avoid using reserved word "hash" as a variable name.
Tom Clegg
09:57 pm Revision d833a286 (arvados): 2853: Fix reference to reference set.
Tom Clegg
09:57 pm Revision 754ff84a (arvados): 2853: Use Md5String() in getWeight().
Tom Clegg
09:55 pm Revision 53192c32 (arvados): 4363: Fix filename munging. Add tests.
Tom Clegg
09:52 pm Revision 1a001045 (arvados): 2853: Remove redundant test case.
Tom Clegg
09:41 pm Feature #4508 (New): [Documentation] Best practices for getting the most out of job re-use
Not sure how to name this, but I ran into the situation where:
I have 10 jobs running in a pipeline, and 9 complet...
Bryan Cosca
09:35 pm Bug #4507 (Duplicate): [SDKs] arv ws should exit on ctrl-c
At least, in log table polling mode, it takes ctrl-c the first few seconds after it starts, and then just ignores it. Ward Vandewege
09:35 pm Revision 99668934 (arvados): Merge branch '3609-run-command-bugfix'
Refs #3609. Tim Pierce
09:07 pm Revision ac21f0d4 (arvados): 3609: fix "NameError: name 'rcode' is not defined"
If run-command raises an exception in the main 'try' loop before any
subprocesses have run, rcode will not be defined...
Tim Pierce
09:04 pm Bug #4494: [Crunch] Do more error-checking and show more diagnostic info when installing a Docker...
more examples: qr1hi-8i9sb-kryvvban6b7hj74 qr1hi-8i9sb-wdv358fgjhh8fsa
This is starting to be a small annoyance of...
Bryan Cosca
08:49 pm Feature #4505 (Duplicate): [SDKs] "arv get {uuid}" outputs JSON representation of given object
Tom Clegg
08:47 pm Revision a0e70cf1 (arvados): Merge branch 'master' into 3177-collection-choose-files
Conflicts:
apps/workbench/app/views/collections/_choose_rows.html.erb
Radhika Chippada
08:43 pm Task #4364 (Resolved): Ensure posix-allowed filenames are not altered by arv-mount (add tests)
Tom Clegg
08:43 pm Task #4365 (In Progress): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
08:43 pm Task #4365 (Resolved): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
08:43 pm Task #4375 (In Progress): Add tests
Tom Clegg
08:43 pm Feature #4503 (New): [SDKs] Option to watch logs (instead of exiting) when queuing a job or pipel...
Much like the @-c@ in @xen create guestname -c@.
Adding this to @arv job create@ should be fairly straightforward:...
Tom Clegg
08:35 pm Revision c28b9b91 (arvados): 3177: in file chooser mode, allow row selection
Radhika Chippada
08:33 pm Feature #4502 (New): [SDKs] "arv recent [objectType]" lists recently modified objects
The API call for this is @groups.contents@ with no @uuid@ given, and @order="modified_at desc"@.
Defaulting to a @...
Tom Clegg
08:30 pm Bug #4501 (Resolved): [FUSE] arv-mount --by-id should expose the /by_id directory as well as (not...
Tom Clegg
08:25 pm Bug #4500 (New): [OPS] Improve and automate non-shared VM configuration
Todo:
* install docker on all VMs
* automate adding users to the docker and sudo groups on those nodes that are no...
Ward Vandewege
08:24 pm Feature #4486 (Resolved): [Documentation] document the arv cli tool
Ward Vandewege
08:00 pm Task #4430 (Resolved): review 4383-easy-install
Tom Clegg
08:00 pm Task #4441 (Resolved): Review 3400-workbench-all-items
Tom Clegg
08:00 pm Task #4435 (Resolved): Review 4434-collation
Tom Clegg
07:59 pm Bug #4363 (In Progress): [Keep] arv-mount should not munge filenames unless required by POSIX
Tom Clegg
07:58 pm Revision d3f844f1 (arvados): Export vars provided on command line, e.g., ARVADOS_DEBUG=1. No issue #
Tom Clegg
07:58 pm Revision d3f844f1 (arvados-dev): Export vars provided on command line, e.g., ARVADOS_DEBUG=1. No ...
Tom Clegg
07:50 pm Bug #4499: [SDKs] one_task_per_input_file should call normalize() before getting its list of files
It's interesting to me that this collection is kind of degenerate: each of the output files are produced from thousan... Tim Pierce
07:10 pm Bug #4499 (Resolved): [SDKs] one_task_per_input_file should call normalize() before getting its l...
sguthrie reports that "qr1hi-d1hrv-3n1gezo6gondyrv":http://crvr.se/qr1hi-d1hrv-3n1gezo6gondyrv, despite running with ... Tim Pierce
07:02 pm Revision 2d0d55e7 (arvados): 2853: Remove historical artifact: check for None instead of catching...
Tom Clegg
07:00 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
Tim Pierce wrote:
> Looks good. Only minor comment: launcher.py still imports ComputeNodeSetupActor, ComputeNodeShu...
Brett Smith
06:45 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
Reviewing 4380-node-manager-computenode-reorg-wip at commit:0d49d9d0a
Looks good. Only minor comment: launcher.py...
Tim Pierce
07:00 pm Task #4496 (Resolved): Review 4380-node-manager-computenode-reorg-wip
Applied in changeset arvados|commit:8f9f0dece977ccf5a778f3b3bd2379375e723c18. Brett Smith
06:59 pm Revision e158f485 (arvados): 2853: Merge branch 'master' into 2853-rendezvous
Conflicts:
sdk/python/arvados/keep.py
Tom Clegg
06:59 pm Revision 8f9f0dec (arvados): Merge branch '4380-node-manager-computenode-reorg-wip'
Refs #4380. Closes #4496. Brett Smith
06:59 pm Revision b626a85e (arvados): 4380: Reorganize arvnodeman.computenode.
This makes the hierarchy a little richer:
* arvnodeman.computenode.driver has all the cloud driver wrappers.
* arvno...
Brett Smith
06:50 pm Bug #4434 (Resolved): [API] Test suite should not depend on a particular database collation config.
Applied in changeset arvados|commit:5141c3ee23e89696773e227a93236ef2a51543c2. Anonymous
05:18 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
Tom, in that case, I am ok with what the test is doing. Please go ahead and merge. Thanks. Radhika Chippada
06:45 pm Bug #3400 (Resolved): [Workbench] Rails client library should offer an "all pages" mode for queri...
Applied in changeset arvados|commit:45bfc1104dd30fb97a586de5ff96d6b739f7bb2b. Anonymous
06:41 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
LGTM, thanks! Tom Clegg
06:12 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Tom Clegg wrote:
> > I added a 'get limited items more than default page size' test, but right now the API server ...
Peter Amstutz
05:16 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
At commit:91f0b18...
Peter Amstutz wrote:
> Well, I'm fairly certain that the 'get all items by default' is going...
Tom Clegg
03:59 pm Bug #3400 (New): [Workbench] Rails client library should offer an "all pages" mode for queries th...
Tom Clegg wrote:
> Looking at commit:0f9bca4...
>
> Peter Amstutz wrote:
> > I handled this on the client side b...
Peter Amstutz
06:42 pm Revision 5141c3ee (arvados): Merge branch '4434-collation' closes #4434
Tom Clegg
06:42 pm Revision 45bfc110 (arvados): Merge branch '3400-workbench-all-items' closes #3400
Peter Amstutz
06:28 pm Task #4495 (In Progress): Review 2853-rendezvous
Brett Smith
06:14 pm Revision 6bcb827b (arvados): Merge branch 'master' into 3400-workbench-all-items
Peter Amstutz
06:13 pm Revision 093cebc3 (arvados): 3400: test limit between server maxpagesize and 2x server maxpagesize.
Conflicts:
apps/workbench/test/unit/arvados_resource_list_test.rb
Tom Clegg
06:05 pm Task #4489 (In Progress): Review 4027-api-sdk-version-wip
Tom Clegg
06:02 pm Task #4498 (Resolved): Fix double-load after fwd/back
Tom Clegg
05:39 pm Revision 76c9a858 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
05:37 pm Revision 708772bc (arvados): 4233: correction: the 'text' in the properties hash when simulating ...
Phil Hodgson
05:08 pm Revision 53381c90 (arvados): Bugfix bad exception name in PySDK util.is_hex.
No issue #. Brett Smith
05:00 pm Revision 0536d6d6 (arvados-dev): Refs #3857: Build modern requests package for PySDK.
Brett Smith
05:00 pm Revision 0536d6d6 (arvados): Refs #3857: Build modern requests package for PySDK.
Brett Smith
04:53 pm Revision bc4992f9 (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
04:52 pm Revision 39e39add (arvados): 4024: move the search box to the top
Radhika Chippada
04:43 pm Revision 333fbec9 (arvados): Merge branch '4024-pipeline-instances-scroll' of git.curoverse.com:a...
Radhika Chippada
04:39 pm Revision 91f0b180 (arvados): 3400: Stub out obsolete #links_for and remove result_links and relat...
Set @result_limit and @result_offset to nil unless @fetch_multiple_pages ==
false. Add test for limit > default page...
Peter Amstutz
04:17 pm Revision a844af57 (arvados): Merge branch '3857-python-sdk-timeout-bugfix'
Fixes #3857. Tim Pierce
04:13 pm Revision d1cdd7ed (arvados): 3857: fix python-requests dependency
Multiple timeout support in python-requests is only supported in
versions 2.4.0 or later.
Tim Pierce
03:02 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
Peter Amstutz wrote:
> Even better would be to get rid of the checkboxes entirely and allow the user to click anywhe...
Tom Clegg
03:00 pm Story #4316 (Resolved): Review 3603-pysdk-file-api-wip
Applied in changeset arvados|commit:26aa2f1a1c8c9883beac1538c318279190f91c8a. Brett Smith
02:36 pm Story #4316: Review 3603-pysdk-file-api-wip
LGTM Peter Amstutz
02:57 pm Revision 26aa2f1a (arvados): Merge branch '3603-pysdk-file-api-wip'
Refs #3603. Closes #4316. Brett Smith
02:42 pm Revision 7bf8f6c7 (arvados): 3603: PySDK Collection objects support file-like APIs.
This commit adds an open() method to CollectionReader and
CollectionWriter. They mimic the built-in open(), returnin...
Brett Smith
02:38 pm Revision 7924077e (arvados): 3603: Clean up PySDK imports.
Sort; remove unused imports. Brett Smith
02:37 pm Revision c1d9150d (arvados): 3603: Fix context methods for PySDK Collection objects.
Brett Smith
02:32 pm Task #4497 (In Progress): Graph logged crunchstat intervals in job log tab
Phil Hodgson
12:41 pm Task #4497 (Resolved): Graph logged crunchstat intervals in job log tab
Phil Hodgson
02:02 pm Revision b2610e06 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
12:40 pm Task #4407 (Resolved): Provide a test helper that replays crunch job logs
Phil Hodgson
09:43 am Task #4407 (In Progress): Provide a test helper that replays crunch job logs
Phil Hodgson
12:40 pm Revision 73c02220 (arvados): 4233: "helper" method for replaying a job log from a specified file,...
Phil Hodgson
06:27 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Radhika Chippada wrote:
> Tom, addressed all your feedback. Also, search works with scrolling now for this page. Tha...
Tom Clegg
06:19 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Radhika Chippada wrote:
> Does the "compare" form defined at line 2 work?
This seems to have been broken by the t...
Tom Clegg
06:16 am Revision 6c7bfabc (arvados): 4024: Fix "compare pipelines" button.
Tom Clegg
02:30 am Progress, progress, progress
!>/attachments/download/413/forest_of_cranes.jpg!
It has been a while since we've blogged about our development prog...
Ward Vandewege
02:23 am Revision ee3e8585 (arvados): Fix broken doc link.
refs #4486 Ward Vandewege
01:36 am Revision c89f70e3 (arvados): Merge branch '4486-document-arv'
refs #4486 Ward Vandewege
01:35 am Revision f34bf1aa (arvados): Remove trailing whitespace.
refs #4486 Ward Vandewege
01:34 am Revision 0dbc7a34 (arvados): Merge branch 'master' into 4486-document-arv
refs #4486 Ward Vandewege

11/11/2014

11:27 pm Revision 2471e184 (arvados-dev): (minor) delete extra line in test 0
Sitaram Chamarty
11:10 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Looking at commit:0f9bca4...
Peter Amstutz wrote:
> I handled this on the client side by adjusting the limit to b...
Tom Clegg
10:26 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
4380-node-manager-computenode-reorg-wip is up for review. See the commit message in commit:0d49d9d for rationale. I... Brett Smith
10:25 pm Task #4496 (In Progress): Review 4380-node-manager-computenode-reorg-wip
Tim Pierce
10:25 pm Task #4496 (Resolved): Review 4380-node-manager-computenode-reorg-wip
Brett Smith
10:23 pm Revision 0d49d9d0 (arvados): 4380: Reorganize arvnodeman.computenode.
This makes the hierarchy a little richer:
* arvnodeman.computenode.driver has all the cloud driver wrappers.
* arvno...
Brett Smith
10:22 pm Story #2853: [Keep] Use rendezvous hashing to assign blocks to servers in Go and Python SDKs
2853-rendezvous @ commit:c7b7e4d
Notes
* Chose MD5. Faster hash functions are out there (e.g., blake2) but it see...
Tom Clegg
10:21 pm Revision f4ceb0aa (arvados): Add TCPKeepAlive and ServerAliveInterval ssh options to the .ssh/config
snippet that Workbench suggests.
no issue #
Ward Vandewege
10:11 pm Task #4495 (Resolved): Review 2853-rendezvous
Tom Clegg
10:10 pm Task #4491 (Resolved): Replace shuffling in Go SDK
Tom Clegg
09:32 pm Task #4491 (In Progress): Replace shuffling in Go SDK
Tom Clegg
09:31 pm Task #4491 (Resolved): Replace shuffling in Go SDK
Tom Clegg
10:10 pm Task #4492 (Resolved): Fix tests that expect old probe order
Tom Clegg
09:32 pm Task #4492 (In Progress): Fix tests that expect old probe order
Tom Clegg
09:32 pm Task #4492 (Resolved): Fix tests that expect old probe order
Tom Clegg
10:06 pm Bug #4494 (New): [Crunch] Do more error-checking and show more diagnostic info when installing a ...
Job "qr1hi-8i9sb-vx84guvzp3xvwgz":http://crvr.se/qr1hi-8i9sb-vx84guvzp3xvwgz failed with this diagnostic output:
<...
Tim Pierce
09:53 pm Revision 204419e1 (arvados): Add some basic documentation for the arv subcommands.
refs #4486 Ward Vandewege
09:51 pm Bug #4493 (Resolved): [Crunch] job fails with Docker error "Engine is shutdown"
Job "qr1hi-8i9sb-z8jwujrvgcvmr9h":http://crvr.se/qr1hi-8i9sb-z8jwujrvgcvmr9h failed with this in its error log:
<p...
Tim Pierce
09:42 pm Revision c7b7e4d4 (arvados): 2853: Remove shuffledServiceRoots() wrapper.
Tom Clegg
09:35 pm Story #4294 (Resolved): [Node Manager] Add support for min_nodes configuration value
Applied in changeset arvados|commit:e82cddfdbd763db27df889a6e316623df7b9c2a8. Tim Pierce
09:30 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
commit:7e8b0267 is good to merge, thanks. Brett Smith
09:08 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Brett Smith wrote:
> Sorry, unclear language on my part. Imagine a horribly buggy implementation that unconditional...
Tim Pierce
08:46 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Tim Pierce wrote:
> Brett Smith wrote:
> > Reviewing commit:3ee90fd
> >
> > * I know the story doesn't spec this...
Brett Smith
08:40 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Brett Smith wrote:
> Reviewing commit:3ee90fd
>
> * I know the story doesn't spec this, but it occurred to me rel...
Tim Pierce
03:13 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Reviewing commit:3ee90fd
* I know the story doesn't spec this, but it occurred to me relatively late: the daemon s...
Brett Smith
09:35 pm Bug #3857 (Resolved): [SDKs] Python KeepClient should use different timeouts for different operat...
Applied in changeset arvados|commit:ec75fda0fc2c86a77d831dcd7962ece7a2d6ae6d. Tim Pierce
09:14 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Reviewing commit:a98086e, and just one small technicality about the comments you added KeepClientRetryTestMixin. TES... Brett Smith
08:23 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> I'm confused -- I didn't reorder the import modules.
>
> (I'd like to adopt a convention of p...
Tim Pierce
08:19 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
All of these changes adopted at commit:6959469
Brett Smith wrote:
> Reviewing commit:1fa1006. I like this branch...
Tim Pierce
02:56 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Brett Smith wrote:
> * I feel like test_proxy_timeout better fits under KeepClientServiceTestCase than KeepClientRet...
Brett Smith
02:43 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Reviewing commit:1fa1006. I like this branch a lot. Thanks. This is all small potatoes stuff.
* The story says ...
Brett Smith
09:33 pm Task #4444 (Resolved): Review 3857-python-sdk-timeouts
Tim Pierce
02:06 pm Task #4444: Review 3857-python-sdk-timeouts
I understand from standup that Tom doesn't feel like he has to be the one to review this, so stealing it. Brett Smith
09:32 pm Task #4483 (Resolved): Review 4294-node-manager-min-nodes
Tim Pierce
02:58 pm Task #4483 (In Progress): Review 4294-node-manager-min-nodes
Brett Smith
09:32 pm Revision e82cddfd (arvados): Merge branch '4294-node-manager-min-nodes'
Fixes #4294. Tim Pierce
09:32 pm Task #4490 (Resolved): Replace shuffling in Python SDK
Tom Clegg
09:31 pm Task #4490 (Resolved): Replace shuffling in Python SDK
Tom Clegg
09:30 pm Revision e61de9ad (arvados): 2853: Add comment.
Tom Clegg
09:30 pm Revision ec75fda0 (arvados): Merge branch '3857-python-sdk-timeouts'
Fixes #3857. Tim Pierce
09:29 pm Revision d9d7af20 (arvados): 3857: fixed comment
Tim Pierce
09:20 pm Revision 1237511f (arvados): 2853: Use the same keep_service UUIDs so tests behave reliably.
Tom Clegg
09:05 pm Revision 7e8b0267 (arvados): 4294: additional unit tests
test_server_calc_returns_min_nodes_for_one_job
* Ensures that the @ServerCalculator@ still returns a wishlist with
_m...
Tim Pierce
08:41 pm Support #4348 (In Progress): [Support] fix bugs and write tests (second half)
Tim Pierce
08:41 pm Task #4352 (In Progress): fix bugs, write tests
Tim Pierce
08:39 pm Revision ca136c57 (arvados): 4294: code review feedback
* Added min_nodes to sample config files
* Renamed idle_nodes to needed_nodes
Tim Pierce
08:39 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
4027-api-sdk-version-wip is up for review. It implements the API server changes necessary to make it go. Once it's ... Brett Smith
08:37 pm Task #4489 (Resolved): Review 4027-api-sdk-version-wip
Brett Smith
08:37 pm Task #4208 (Resolved): jobs.create and jobs.update resolve runtime_constraints['arvados_sdk_versi...
Brett Smith
08:33 pm Revision db8f5472 (arvados): 4027: Add arvados_sdk_version runtime constraint to API server.
Crunch will use this information to provide a specific SDK version in
the runtime environment.
Brett Smith
08:23 pm Revision a98086e0 (arvados): 3857: fixed import order. d'oh
Tim Pierce
08:18 pm Revision 69594694 (arvados): 3857: code review feedback
* Set default timeouts to (20, 300) for proxies and (2, 300) for all
else.
* KeepService:
** Removed unused 'timeou...
Tim Pierce
08:17 pm Bug #4488 (Closed): [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
As it currently stands, if a KeepClient finds that any one of its back end is a proxy, it @KeepClient@ assumes that a... Tim Pierce
08:02 pm Revision fa3e996e (arvados): 2853: Update tests to survive ServiceRoots being a map[string]string.
Tom Clegg
07:49 pm Bug #4487 (Resolved): [Workbench] Users shouldn't have the option to "Remove selected" when they ...
!bug_remove_collections_in_shared.png!
Bryan Cosca
07:31 pm Revision 1304e044 (arvados): 2853: Add tests for reference set and some edge cases.
Tom Clegg
06:57 pm Revision 47b0cb35 (arvados): 2853: Add "reference set" test to check probe order agreement betwee...
Tom Clegg
05:51 pm Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
Thank you, Bryan. That will be useful I'm sure: for me it takes almost 20 seconds to load those jobs'n'pipes! Phil Hodgson
05:44 pm Revision e02ef893 (arvados): 2853: Fix instance ID in test fixture hostnames. Clean up brittle te...
Tom Clegg
05:24 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
bq. It's possible that wss://X works if you visit https://X first and force it to accept the certificate, though.
...
Phil Hodgson
05:11 pm Revision 9405b5f2 (arvados): 2853: Use rendezvous hashing to select probe order in Python library.
Tom Clegg
04:22 pm Feature #4486 (Resolved): [Documentation] document the arv cli tool
Ward Vandewege
03:17 pm Task #4485 (Resolved): Review 3382
Branch: 3382-always-show-inputs Phil Hodgson
03:17 pm Task #4484 (Resolved): Correct conditions for whether input parameters should be displayed
Phil Hodgson
02:32 pm Task #4484 (In Progress): Correct conditions for whether input parameters should be displayed
Phil Hodgson
02:32 pm Task #4484 (Resolved): Correct conditions for whether input parameters should be displayed
Phil Hodgson
03:16 pm Revision eee66a4f (arvados): 3382: always show input parameters, whether value is present or not
Phil Hodgson
02:03 pm Story #3177: [Workbench] File chooser dialog (replace remaining use of clippy)
Reviewing commit:d3cb946
The checkbox behavior is a little strange if there are two files in a collection.
# Th...
Peter Amstutz
01:47 pm Revision b7579d92 (arvados): 3603: Make CollectionWriter file flush test stricter.
Brett Smith
01:37 pm Revision 38ebd6d6 (arvados): 3603: Fixup last commit.
Brett Smith
10:14 am Revision a4b55a80 (arvados): 2853: Use rendezvous hashing to select probe order.
Tom Clegg
02:06 am Story #4035 (In Progress): [Sample pipelines] Proof-of-concept support for common-workflow-langua...
Peter Amstutz

11/10/2014

10:31 pm Story #4316: Review 3603-pysdk-file-api-wip
Peter Amstutz wrote:
> * As discussed briefly in IRC, consider having slightly different behavior for StreamFileRead...
Brett Smith
10:29 pm Revision 409a1a9c (arvados): 3603: Improve PySDK file API compatibility.
Per code review. Brett Smith
10:16 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
Radhika Chippada wrote:
> Review feedback:
>
> * If I had more than one collection starting with the same letter,...
Tom Clegg
04:11 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
Review feedback:
* If I had more than one collection starting with the same letter, for example if I were to add o...
Radhika Chippada
09:50 pm Revision 0198b493 (arvados): 4434: use select! instead of &= to preserve duplicates.
Tom Clegg
09:32 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
Ready for review at commit:3ee90fd
Because of the way the job queue is implemented, the min_nodes constraint is en...
Tim Pierce
07:18 pm Story #4294: [Node Manager] Add support for min_nodes configuration value
The tricky part with this feature is that it puts NodeManager in the position of needing to spin up new nodes without... Tim Pierce
09:29 pm Task #4354 (Resolved): decline node shutdown if it brings the number of nodes lower than min_nodes
Tim Pierce
09:29 pm Task #4355 (Resolved): min_nodes tests
Tim Pierce
09:29 pm Task #4353 (Resolved): spin up a new node if node list is less than min_nodes
Tim Pierce
09:29 pm Task #4483 (Resolved): Review 4294-node-manager-min-nodes
Tim Pierce
09:28 pm Revision 3ee90fd5 (arvados): 4294: added min_nodes config parameter
Added min_nodes configuration setting. The job queue will return a
wishlist with at least min_nodes elements in it, ...
Tim Pierce
08:55 pm Feature #4194: [Keep] consistent logging for keepstore requests
ResponseWriter doesn't let you read the response status code later, but you could wrap it with a LoggingResponseWrite... Tom Clegg
07:20 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
There wasn't a lot of love for my last suggestion. We have all this locking and state tracking code for a reason, to... Brett Smith
03:31 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
The fix for this is not simple.
Node allocation is handled by crunch-dispatch. It has all the logic to figure out...
Brett Smith
06:39 pm Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
This project is probably going to be the most help: qr1hi-j7d0g-6fum19pfbaxyy9x. Theres ~1000 jobs and pipelines in t... Bryan Cosca
06:21 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Phil Hodgson wrote:
> I am psyched to work on this, but my websockets server doesn't work in my dev environment. I'v...
Tom Clegg
06:18 pm Revision 89007272 (arvados): Expand websocket config comments. refs #4233
Tom Clegg
05:46 pm Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
Phil Hodgson wrote:
> Or, in the case of required parameters, the @and not pvalue_spec[:value]@ clause could be remo...
Tom Clegg
04:32 pm Revision cac035d7 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
04:15 pm Revision 5cfa1aab (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
03:16 pm Revision 5add3acf (arvados): Explicitly list the URL that get.arvados.org redirects to, for those
folks who would like to read the install script before executing it.
No issue #
Ward Vandewege
03:07 pm Bug #4478 (Resolved): Keep write error
This was resolved late last week; we ran out of space. Ward Vandewege
03:03 pm Revision c0c04546 (arvados): Python run_test_server runs websockets separately non-SSL for compat...
with default application.yml.default. refs #4084 Peter Amstutz
02:41 pm Bug #4482 (Resolved): [Crunch] Diagnostics failure "user not found on host"
This diagnostics job failed over the weekend: qr1hi-d1hrv-zu37v9z50imo6a9.
Looks like a node that didn't come up ...
Peter Amstutz
01:56 pm Support #4347 (Resolved): [Support] fix bugs and write tests (first half)
Brett Smith
03:21 am Revision e7752fc7 (arvados-dev): (minor) README fixup
Sitaram Chamarty
03:19 am Revision e3f3c267 (arvados-dev): (minor) another test fixup
why was I doing this manually till now? Sitaram Chamarty
03:19 am Revision d73f5443 (arvados-dev): (minor) fixup due to some (fedora??) path change
Sitaram Chamarty
03:11 am Revision b5649570 (arvados-dev): v3.6.2
Sitaram Chamarty
01:49 am Revision 3bad56be (arvados-dev): disallow ../ everywhere
This should have been done as soon as I rolled in support for "ua"
(unrestricted arguments; see comments in src/comma...
Sitaram Chamarty

11/09/2014

04:44 pm Feature #4481 (Resolved): [Documentation] (recurring) Refresh user documentation
Go through the *user* documentation on doc.arvados.org, and make sure that it is up to date. If not, bring it up to d... Ward Vandewege
04:43 pm Task #4480 (Resolved): write blog post
Ward Vandewege
04:43 pm Feature #4479 (Resolved): [Documentation] (recurring) Write blog post *in first three days of spr...
Each blog post, when published, should also be e-mailed verbatim to the arvados user list. Ward Vandewege
11:24 am Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
I am psyched to work on this, but my websockets server doesn't work in my dev environment. I've tried a series of dif... Phil Hodgson
11:19 am Task #4407 (New): Provide a test helper that replays crunch job logs
Phil Hodgson
11:18 am Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
Please define this further... How many is many and how quick is quickly? When I try this with a whole bunch of compon... Phil Hodgson
11:18 am Bug #3382: [Workbench] When specifying inputs for new pipeline instance, parameters should not di...
It seems to come down to a very simple line of code that decides whether to show an input parameter or not. In @pipel... Phil Hodgson
07:02 am Revision 1577e06b (arvados-dev): VREF/NAME_NC -- like VREF/NAME but for "new commits" only
Sitaram Chamarty

11/08/2014

05:23 pm Bug #4478 (Resolved): Keep write error
from: qr1hi-d1hrv-ooaz68wsp1gm7wx#Log from job qr1hi-8i9sb-i4pplxizsmn0ign but I cannot see the log from that job (b... Bryan Cosca
05:20 pm Bug #4477 (Resolved): [Workbench] Log tab not available
I get a blank box with a reload tab. jobs/qr1hi-8i9sb-i4pplxizsmn0ign#Log Bryan Cosca
02:37 pm Bug #4476 (Resolved): [Workbench] Search dialog infinite scrolling issue: second page and onwards...
Radhika Chippada
02:34 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Tom, question about apps/workbench/app/views/pipeline_instances/index.html.erb :
Does the "compare" form defined ...
Radhika Chippada
04:12 am Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Tom, addressed all your feedback. Also, search works with scrolling now for this page. Thanks. Radhika Chippada
04:15 am Task #4466 (Resolved): Scrolling when search filter is used
Radhika Chippada
04:15 am Task #4463 (Resolved): Add search filter to pipeline_instances page
Radhika Chippada
04:14 am Task #4331 (Resolved): Add infinite scrolling to pipeline_instances page.
Radhika Chippada
04:00 am Bug #4474 (Resolved): [Node Manager] Node manager shut down node in middle of job
See the log for qr1hi-8i9sb-fqi09pwnf36x3qe.
This may be fixed once 4380 is merged.
Ward Vandewege
03:50 am Revision 61f8ceeb (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
03:49 am Revision 8e209b3c (arvados): 4024: simplify search box
Radhika Chippada
12:33 am Revision e993707e (arvados): 4024: rearrange partial handling
Radhika Chippada
12:14 am Revision 2d10f584 (arvados): 4024: scrolling + search works now that filters are included in next...
Radhika Chippada

11/07/2014

11:47 pm Bug #4471: [Crunch] srun: error: Application launch failed: Communication connection failure
also occurred here:
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-7xe4y6klftdf2gw#Log
Fri...
Nancy Ouyang
11:43 pm Bug #4471 (Resolved): [Crunch] srun: error: Application launch failed: Communication connection f...
$ arv run /bin/bash createtwofiles.sh
======
Upload local files: "createtwofiles.sh"
Uploaded to qr1hi-4zz18-ezu...
Nancy Ouyang
10:36 pm Revision 16527c12 (arvados): 4024: Test that items_available takes filters into account.
Tom Clegg
10:32 pm Revision cba83883 (arvados): 4024: comment out code that disables scrolling when search is used.
Radhika Chippada
10:31 pm Task #4386 (In Progress): Review branch: 4024-pipeline-instances-scroll
Tom Clegg
02:28 pm Task #4386 (New): Review branch: 4024-pipeline-instances-scroll
Radhika Chippada
10:31 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
At commit:7b4fc9f...
The data-infinite-scroller attribute should be a jQuery selector string resolving to the elem...
Tom Clegg
02:30 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
Discussed this feature with Tom some more. We agreed that instead of adding infinite scrolling to the dashboard panel... Radhika Chippada
10:08 pm Revision 4ec7d62e (arvados): Tweak uuid of test fixture so it doesn't match other tests unintenti...
Peter Amstutz
09:54 pm Bug #4470 (Resolved): [Crunch] tmpdir not writable running jobs in Docker
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-e3jx9on6hkp9c8o#Components
$ arv run --local...
Nancy Ouyang
09:12 pm Task #4445 (In Progress): Review branch: 3177-collection-choose-files
Peter Amstutz
09:01 pm Revision 0db5d13d (arvados): PySDK CollectionReader can get empty collection.
Fixing a regression from refs #3706. Brett Smith
08:56 pm Bug #4468 (Closed): Fiddlesticks when creating new collection from selected collections
174 collections in a project: https://workbench.qr1hi.arvadosapi.com/projects/qr1hi-j7d0g-u69wosye1ycpjmk
https://...
Nancy Ouyang
08:55 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
4434-collation at commit:fbd2326 Tom Clegg
08:55 pm Task #4435 (In Progress): Review 4434-collation
Tom Clegg
08:55 pm Revision fbd23268 (arvados): 4434: Assume only that if a<b are lowercase ascii, aX<bY for any X, ...
Tom Clegg
08:55 pm Bug #4084 (Resolved): [Workbench] Pipeline instance Log pane should not get refreshed (it already...
Applied in changeset arvados|commit:370df5a95b6b143885fa4d96be90c51f25f8ad14. Anonymous
08:18 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
At commit:a7256de... too bad about the copy & paste, but w/e. Let's merge this Tom Clegg
08:50 pm Revision 370df5a9 (arvados): Merge branch '4084-log-pane-refresh' closes #4084
Peter Amstutz
08:48 pm Revision 0f9bca45 (arvados): 3400: ArvadosResourceList retains api token that is active when it i...
Tweaked fetch-multiple-pages loop. Made #each_page protected. _paging sets
fetch_multiple_pages(false).
Peter Amstutz
08:42 pm Feature #4467: [Workbench] Add "select all" button to project content panes
for example, what if we want to merge x collections within a project. If regex search functionality also worked, that... Bryan Cosca
08:36 pm Feature #4467 (Resolved): [Workbench] Add "select all" button to project content panes
("If we can do it inside of a data collection, can we do it inside of a project?") Bryan Cosca
08:42 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
commit:1fa1006 adds a _proxy_timeout_ configuration setting. The default _timeout_ value is now (3, 30) and the defa... Tim Pierce
03:53 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> This certainly should be testable, and some clever use of mocks should allow us to test the time...
Brett Smith
03:37 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
On the other hand, the more I think about it, the more it seems like the test we're talking about is just that @reque... Tim Pierce
02:48 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
This certainly should be testable, and some clever use of mocks should allow us to test the timeouts without actually... Tim Pierce
06:26 am Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
I can't say I've given this a _thorough_ look but I've noticed a couple of things:
I think it would be valuable to...
Tom Clegg
08:41 pm Revision 3bbb9887 (arvados): 4434: Merge branch 'master' into 4434-collation
Tom Clegg
08:38 pm Revision 1fa1006e (arvados): 3857: implement proxy_timeout
Add proxy_timeout argument to KeepClient.
Default timeouts are:
* timeout = (3, 30)
* proxy_timeout = (20, 60)
Adde...
Tim Pierce
08:36 pm Task #4466: Scrolling when search filter is used
Make it to display only matching rows when scrolled. Radhika Chippada
08:27 pm Task #4466 (Resolved): Scrolling when search filter is used
Radhika Chippada
08:27 pm Story #4442: [API] [Workbench] Site-wide regex searching
Currently the search box is a "LIKE" query, so foo%baz will find foobarbaz site-wide.
It seems like it would be ea...
Tom Clegg
08:25 pm Revision 7b4fc9f1 (arvados): 4024: disable scrolling when search filter is used; otherwise, non-m...
Radhika Chippada
08:18 pm Task #4290 (Resolved): Review 4084-log-pane-refresh
Tom Clegg
02:48 pm Task #4290 (In Progress): Review 4084-log-pane-refresh
Peter Amstutz
08:06 pm Bug #3698 (New): [Crunch] Pipeline runner should detect when "output_of" refers to a non-existent...
This needs another look. This logic should've detected qr1hi-d1hrv-i1d1jffl9nd5ylv, but apparently didn't—right now ... Brett Smith
07:43 pm Story #2990 (Resolved): Make lobstr pipeline template
Peter Amstutz
07:04 pm Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Tom Clegg wrote:
> Reviewing commit:2361a1b
>
> Instead of @assert a < 201@, say @assert_operator a, :<, 201@ -- ...
Peter Amstutz
05:44 am Bug #3400: [Workbench] Rails client library should offer an "all pages" mode for queries that ret...
Reviewing commit:2361a1b
Instead of @assert a < 201@, say @assert_operator a, :<, 201@ -- that way, when the asser...
Tom Clegg
07:01 pm Feature #4465 (Resolved): [Workbench] Link "apiserver version" to a redmine or github revision hi...
Link "Workbench version" to:... Tom Clegg
06:51 pm Revision 9547602d (arvados): 4024: trailing white space
Radhika Chippada
06:50 pm Revision 911c97b0 (arvados): 4024: a few more test cases for search filter in pipeline instances ...
Radhika Chippada
06:43 pm Bug #4464 (Resolved): [Workbench] Collections tab loads forever on a specific project
Namely, qr1hi-j7d0g-bfrqj767vpdk3dh Brett Smith
06:40 pm Bug #4402 (Closed): [SDKs] CollectionWriter.write_directory_tree(...,max_manifest_depth=0) should...
Tom filed this bug while working on #3706. Further testing revealed that there was never a bug to begin with, so thi... Brett Smith
04:47 pm Revision 7c76d921 (arvados): 4024: add tests for search filter in pipelin_instances page.
Radhika Chippada
04:39 pm Task #4463 (Resolved): Add search filter to pipeline_instances page
Radhika Chippada
04:26 pm Revision f628e383 (arvados): Merge branch 'master' into 4024-pipeline-instances-scroll
Radhika Chippada
04:25 pm Revision 7d197c6f (arvados): 4024: add search filter to pipeline instances page.
Radhika Chippada
03:22 pm Revision a7256deb (arvados): 4084: Add 'arv-log-refresh-control' div to job log pane. Log scroll...
Peter Amstutz
03:12 pm Revision 008cec91 (arvados): 4024: add integration tests for pipeline_instances page infinite scr...
Radhika Chippada
02:48 pm Task #4428 (Resolved): Review 4084-log-pane-refresh-TC
Peter Amstutz
02:48 pm Task #4373 (In Progress): Diagnose and fix
Peter Amstutz
02:46 pm Bug #4451: [Workbench] Fiddlesticks when rerunning pipeline with edited template
Workbench may not be able to run the pipeline in these cases, but it should say that explicitly rather than crashing. Brett Smith
02:43 pm Bug #4461 (Resolved): [OPS] Replace dnsmasq with unbound
Ward Vandewege
02:41 pm Bug #4460 (New): [Workbench] Sortable column headings (filename, size) in collections#show
Now that the Python SDK doesn't normalize manifests by default (#3706), viewing the output of Crunch scripts in Workb... Brett Smith
02:30 pm Task #4450 (Resolved): Review 4334-idle-star-is-down
Peter Amstutz
02:30 pm Task #4459 (Resolved): Review 4310-lock-before-fail
Peter Amstutz
02:19 pm Task #4459 (In Progress): Review 4310-lock-before-fail
Tom Clegg
01:54 pm Task #4459 (Resolved): Review 4310-lock-before-fail
Peter Amstutz
02:30 pm Bug #4334 (Resolved): [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* SLU...
Applied in changeset arvados|commit:1bb7352bf1425dc9acf028f863eaff1e5c207571. Anonymous
02:30 pm Bug #4310 (Resolved): [Crunch] crunch-dispatch --jobs locking is broken
Applied in changeset arvados|commit:04c1723357282d0ef2890e570cfab84d35b99da4. Anonymous
02:19 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
At commit:3e1ef3e
LGTM, except that it'll never work until you call it @ArvadosModel::AlreadyLockedError@. :)
Tom Clegg
02:28 pm Revision 1bb7352b (arvados): Merge branch '4334-idle-star-is-down' closes #4334
Peter Amstutz
02:28 pm Revision 04c17233 (arvados): Merge branch '4310-lock-before-fail' closes #4310 (again)
Peter Amstutz
02:23 pm Bug #4410 (In Progress): [Crunch] crunch-job should exit tempfail when a SLURM node fails
Brett Smith
02:22 pm Revision b5ed27eb (arvados): 4310: Qualify namespace of AlreadyLockedError
Peter Amstutz
02:06 pm Revision b917e8a2 (arvados): 4024: add infinite scrolling to pipeline_instances page.
Radhika Chippada
01:53 pm Revision 3e1ef3eb (arvados): 4310: Lock job before changing its state to failed.
Peter Amstutz
06:02 am Task #4444 (In Progress): Review 3857-python-sdk-timeouts
Tom Clegg
03:52 am Revision bf63e93a (arvados): 3400: test limit between server maxpagesize and 2x server maxpagesize.
Tom Clegg
03:28 am Revision 83369774 (arvados): 3400: Remove ArvadosResourceList#all
Tom Clegg
02:31 am Bug #4458 (Resolved): [Workbench] Replace e-mail address in menu bar with user icon and make sure...
not a huge deal, but happens whenever I split my laptop screen (1600x900) in half vertically and was a little disconc... Nancy Ouyang
02:25 am Bug #4452: [Workbench] Report a Problem" menu item does not like being opened in a new tab/window.
I like a new tab a lot better, because I can't accidentally hit escape and lose everything I wrote in the bug report.... Nancy Ouyang
01:59 am Revision d3cb9460 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada

11/06/2014

11:01 pm Task #4441 (In Progress): Review 3400-workbench-all-items
Tom Clegg
10:23 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
It seems it's not quite that easy to make the Rails application agree that @"abc" <= "BCD"@ in the same cases where t... Tom Clegg
10:21 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
I spent some time looking at the recent jobs on qr1hi to see if I could piece together a cause. Nothing definitive y... Brett Smith
03:16 pm Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
Here is a job that crashed because of compute3:
qr1hi-8i9sb-v6drlfmnikkkatu
Bryan Cosca
10:13 pm Bug #4310 (In Progress): [Crunch] crunch-dispatch --jobs locking is broken
commit:f3b3935 fixes a bug but it doesn't explain/address the problem at hand, i.e., "state invalid change from Faile... Tom Clegg
06:20 pm Bug #4310 (Resolved): [Crunch] crunch-dispatch --jobs locking is broken
Applied in changeset arvados|commit:a324727d478feb278ab35300c5b96e2349e23f3d. Anonymous
06:16 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
LGTM @ commit:f3b3935, thanks! Tom Clegg
06:11 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
Tom Clegg wrote:
> At commit:7d6454e
>
> Now that it's normal (during a race) for the "git tag" command to fail, ...
Peter Amstutz
05:53 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
At commit:7d6454e
Now that it's normal (during a race) for the "git tag" command to fail, but "git rev-list" failu...
Tom Clegg
04:43 pm Bug #4310: [Crunch] crunch-dispatch --jobs locking is broken
The bug is not in the actual locking code, the bug is in crunch-dispatch's handling of setting the git tags for locki... Peter Amstutz
04:24 pm Bug #4310 (In Progress): [Crunch] crunch-dispatch --jobs locking is broken
Peter Amstutz
10:12 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
Some additional sluthing shows that qr1hi-8i9sb-vt7mb676a4htd6k changed from "Running" to "Failed" at 2014-10-24T19:5... Peter Amstutz
09:59 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
4314-crunch-token-expire looks good to merge, but it doesn't explain the failures reported here, does it? Tom Clegg
09:52 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
The timing here makes the #4310 explanation less than 100% convincing. What would make crunch-dispatch take any inter... Tom Clegg
06:31 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
There's two different errors here.
* qr1hi-8i9sb-vt7mb676a4htd6k dies because of "Job state unexpectedly changed t...
Peter Amstutz
10:02 pm Revision a0ff0429 (arvados): Merge branch '4314-crunch-token-expire' refs #4314 refs #4310
Peter Amstutz
10:00 pm Task #4457 (Resolved): Review 4314-crunch-token-expire
Tom Clegg
09:54 pm Task #4457 (Resolved): Review 4314-crunch-token-expire
Peter Amstutz
09:51 pm Revision b19b2bc9 (arvados): 4314: Don't expire the token if the job is still in queued state.
Peter Amstutz
09:43 pm Feature #4456: [Workbench] Provide more feedback about when a queued job is likely to start.
Well, just pulling out to the Workbench homepage "there are N jobs ahead" would be a great start, I didn't think to l... Nancy Ouyang
09:30 pm Feature #4456 (New): [Workbench] Provide more feedback about when a queued job is likely to start.
From discussion in IRC, users often feel like the time their jobs start is effectively random. It would help to prov... Brett Smith
09:18 pm Biting Off More Than You Can Chew
!>oops_key.jpg!
Recently, a scientist in Denmark reported an "interesting issue":http://lists.gnu.org/archive/html/c...
Tim Pierce
09:05 pm Support #4013 (Closed): [SDKs] Pipeline instance logging emits misleading warning: API server did...
lgtm Sarah Guthrie
08:55 pm Bug #4408 (Resolved): [Workbench] Anonymous collection download links should not redirect to logi...
Applied in changeset arvados|commit:1d3987356d0ab60c4f6c80cbd11852b4209137f4. Brett Smith
08:33 pm Bug #4408: [Workbench] Anonymous collection download links should not redirect to login path.
LGTM Radhika Chippada
08:49 pm Revision 1d398735 (arvados): Merge branch '4408-collection-sharing-login-fix-wip'
Closes #4408. Brett Smith
08:32 pm Task #4448 (Resolved): Review 4408-collection-sharing-login-fix-wip
Radhika Chippada
08:32 pm Task #4448 (In Progress): Review 4408-collection-sharing-login-fix-wip
Radhika Chippada
05:00 pm Task #4448 (Resolved): Review 4408-collection-sharing-login-fix-wip
Brett Smith
08:31 pm Revision c53b0474 (arvados): 4408: Workbench Collection sharing allows file downloads again.
Earlier we refactored our API token loading code to load User.current
to check that it was valid. This approach does...
Brett Smith
07:48 pm Task #4353 (In Progress): spin up a new node if node list is less than min_nodes
Tim Pierce
07:48 pm Story #4294 (In Progress): [Node Manager] Add support for min_nodes configuration value
Tim Pierce
07:40 pm Feature #4088 (Resolved): [Workbench] On collections#show page, filter displayed files by filenam...
Applied in changeset arvados|commit:308a6da1a9fd716f3957b116110a932c08aefafe. Tim Pierce
06:29 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Tim Pierce wrote:
> The styling is definitely kind of weird here -- I think it's a consequence of having three butto...
Brett Smith
04:04 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Brett Smith wrote:
> Reviewing commit:50efff3
>
> * It looks like the Selection pulldown, Select all button, and ...
Tim Pierce
07:39 pm Bug #4452 (New): [Workbench] Report a Problem" menu item does not like being opened in a new tab/...
Oh... fiddlesticks.
Sorry, I had some trouble handling your request.
Missing template actions/report_issue_...
Ward Vandewege
07:37 pm Task #4384 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
07:31 pm Bug #4451: [Workbench] Fiddlesticks when rerunning pipeline with edited template
Also happens if you click "re-run options" and "run now".
But probably the root issue is I updated the pipeline tem...
Nancy Ouyang
07:25 pm Bug #4451 (Closed): [Workbench] Fiddlesticks when rerunning pipeline with edited template
Well, I paused a pipeline instance, then cancelled both running jobs while they were still queued, made some changes ... Nancy Ouyang
07:23 pm Task #4376 (Resolved): Diagnose and fix
Peter Amstutz
07:06 pm Task #4376 (In Progress): Diagnose and fix
Peter Amstutz
07:23 pm Task #4450 (Resolved): Review 4334-idle-star-is-down
Peter Amstutz
07:22 pm Revision 02351700 (arvados): 4334: Convert "idle*" state to "down"
Peter Amstutz
07:14 pm Revision 308a6da1 (arvados): Merge branch '4088-collection-show-files-filter'
Fixes #4088. Tim Pierce
07:06 pm Bug #4334 (In Progress): [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* ...
Peter Amstutz
06:56 pm Revision 00767fe5 (arvados): Go to next job after fail_job when there is a tag mismatch. refs #4310
Peter Amstutz
06:26 pm Task #4447 (Resolved): Review 4310-git-tag-race
Peter Amstutz
05:24 pm Task #4447 (In Progress): Review 4310-git-tag-race
Tom Clegg
04:44 pm Task #4447 (Resolved): Review 4310-git-tag-race
Peter Amstutz
06:23 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
@views/pipeline_instances/_show_log.html.erb@ also needs to be updated, it (ironically) has the same bug that the sto... Peter Amstutz
04:18 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> ...start_with?('Running')...
Ah, good catch. Fixed in commit:270b1fc
Tom Clegg
04:10 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Comments on commit:52083e6 4084-log-pane-refresh-TC
>
> * @views/jobs/_show_status.html.er...
Tom Clegg
03:18 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Also:
@views/pipeline_instances/_show_components.html.erb@...
Peter Amstutz
06:18 pm Revision a324727d (arvados): Merge branch '4310-git-tag-race' closes #4310
Peter Amstutz
06:11 pm Revision f3b39353 (arvados): 4310: Remove stderr redirect from git rev-list, add it to git tag. ...
output with "dispatch: ". Tweak error message if rev-list fails. Peter Amstutz
06:05 pm Feature #4383 (Resolved): [Docker] upload all docker containers to docker repository, and then ad...
Applied in changeset arvados|commit:5acdc268c662f452de81d2d00766a879c73f8c08. Ward Vandewege
05:20 pm Feature #4383: [Docker] upload all docker containers to docker repository, and then add a script ...
At commit:7ff4966
LGTM.
This shouldn't hold up the merge, but one more thing worth noting in the docs: The "qui...
Tom Clegg
04:31 pm Feature #4383: [Docker] upload all docker containers to docker repository, and then add a script ...
Thanks for the review - I've added the extra tests (that thought had crossed my mind, too). I've also stopped arvdock... Ward Vandewege
06:00 pm Revision 70f3e36e (arvados): Merge branch '4383-easy-install'
refs #4383 Ward Vandewege
06:00 pm Revision 0f3d2c5a (arvados): Merge branch 'master' into 4383-easy-install
refs #4383 Ward Vandewege
05:59 pm Revision 5acdc268 (arvados): Another documentation tweak based on review feedback.
closes #4383 Ward Vandewege
05:10 pm Revision 1491cdd6 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
05:05 pm Revision 29e012f7 (arvados): 3177: String != 'String'
Radhika Chippada
04:59 pm Revision 7ba3707a (arvados): 4408: Workbench Collection sharing allows file downloads again.
Earlier we refactored our API token loading code to load User.current
to check that it was valid. This approach does...
Brett Smith
04:44 pm Task #4374 (Resolved): Diagnose and fix
Peter Amstutz
04:44 pm Task #4374 (In Progress): Diagnose and fix
Peter Amstutz
04:37 pm Revision 7d6454e0 (arvados): 4310: Fix race condition between testing for tag and setting tag by ...
order of operations: try to set the tag, and only test for it if there is an
error.
Peter Amstutz
04:35 pm Bug #4389 (Resolved): [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Applied in changeset arvados|commit:72cf9a5814e52adb2b6c2f349cbef3de069722bb. Anonymous
04:09 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg wrote:
> Added test in commit:ed7369d
LGTM. Thanks very much.
Tim Pierce
04:33 pm Revision 72cf9a58 (arvados): Merge branch '4389-breadcrumbs-infinite-loop' closes #4389
Tom Clegg
04:30 pm Revision 7ff49661 (arvados): Install instructions: be a bit more explicit that arvdock is downloaded
and saved in the current working directory.
refs #4383
Ward Vandewege
04:12 pm Revision 270b1fc3 (arvados): 4084: Fix wrong state name: jobs are Running, pipelines are RunningO...
Tom Clegg
04:09 pm Task #4390 (Resolved): Review 4389-breadcrumbs-infinite-loop
Tim Pierce
04:09 pm Revision 3db43f17 (arvados): Merge branch 'master' into 4383-easy-install
refs #4383 Ward Vandewege
04:04 pm Revision 2c2212b5 (arvados): Only try to install .config/arvados/settings.conf if we have a token to
put in there.
refs #4383
Ward Vandewege
04:02 pm Revision 5b5c9a43 (arvados): 4088: code review feedback
* Modified styling for "Select all" and "Unselect all"
* "filename filter" -> "filename regex"
* Changed refutations ...
Tim Pierce
03:55 pm Revision 60c177af (arvados): 4389: Merge branch 'master' into 4389-breadcrumbs-infinite-loop
Tom Clegg
03:54 pm Feature #4446 (New): [Workbench] Provide feedback on dashboard to indicate that NodeManager is bo...
Peter Amstutz
03:53 pm Revision f9a218aa (arvados): 4084: Update views that were still using pane-anchor.
Tom Clegg
03:42 pm Revision a5b4a7e8 (arvados): 3177: try to partition input selection only if it is a string
Radhika Chippada
03:26 pm Revision bbfe0f05 (arvados): add 'arv-run' to setup.py refs #3609
Peter Amstutz
03:25 pm Revision abc28ee2 (arvados): Add more tests so that we cover all possible combinations of the
auto_admin_first_user and auto_admin_user configuration settings.
refs #4383
Ward Vandewege
03:23 pm Revision d20968af (arvados): Update the behavior of the auto_admin_user configuration field a bit to
make it more intuitive: the first user created with an e-mail address
that matches auto_admin_user will now become ad...
Ward Vandewege
03:17 pm Bug #4409: [Workbench] Want to remove projects from Home
From discussion with Tom:
* We should actually delete empty projects.
* Ideally, we don't render the delete butto...
Brett Smith
02:58 pm Story #3177 (In Progress): [Workbench] File chooser dialog (replace remaining use of clippy)
Radhika Chippada
02:54 pm Revision 723afcb8 (arvados): 3177: trailing white space
Radhika Chippada
02:54 pm Task #4445 (Resolved): Review branch: 3177-collection-choose-files
Radhika Chippada
02:53 pm Story #4316: Review 3603-pysdk-file-api-wip
* As discussed briefly in IRC, consider having slightly different behavior for StreamFileReader() based on how it is ... Peter Amstutz
02:49 pm Revision cffe9566 (arvados): 3177: add tests for a template that uses dataclass = File
Radhika Chippada
01:01 pm Revision 88d79325 (arvados): 3177: store input pdh value even when input dataclass is File. Updat...
Radhika Chippada
04:33 am Revision 1c0e350a (arvados): 3177: restrict only one file selection in collection chooser; remove...
Radhika Chippada
03:57 am Revision 81bfa2fd (arvados): 3177: propagate checkbox selection param when dataclass is File.
Radhika Chippada

11/05/2014

11:13 pm Task #4444 (Resolved): Review 3857-python-sdk-timeouts
Available for review at commit:3993ba4
Some notes:
* This change replaces httplib2 with the requests module in ...
Tim Pierce
11:13 pm Task #3916 (Resolved): Testing
Tim Pierce
11:12 pm Task #3915 (Resolved): Implement timeout configuration settings
Tim Pierce
11:12 pm Revision 3993ba46 (arvados): 3857: replaced httplib2 with 'requests'
Replaced httplib2 with the 'requests' library in modules that use it to
call Keep:
* arvados.collection
* arvados.kee...
Tim Pierce
11:07 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
Mmm, the link I provided in the bug is definitely prettier, but doesn't seem to actually be comparing... Can Bryan te... Jonathan Sheffi
08:31 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
Jonathan,
The fix for #4088 is deployed, which I hope will resolve your issues. Can you please compare a couple o...
Brett Smith
10:55 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Added test in commit:ed7369d Tom Clegg
07:29 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
OK, this makes sense. Is there an easy way we could construct a test for this? Could we add test fixtures for a circ... Tim Pierce
10:48 pm Revision ed7369d4 (arvados): 4389: Add test.
Tom Clegg
09:48 pm Story #4443 (Closed): [DRAFT] [Workbench] Tour Guide Dax follows you around for a while, showing ...
Tom Clegg
09:48 pm Story #4442 (Resolved): [API] [Workbench] Site-wide regex searching
Why stop at collections when we can search the entire curoverse using regex? Bryan Cosca
09:33 pm Bug #4408 (In Progress): [Workbench] Anonymous collection download links should not redirect to l...
Brett Smith
09:28 pm Bug #3400 (In Progress): [Workbench] Rails client library should offer an "all pages" mode for qu...
Peter Amstutz
09:27 pm Task #4441 (Resolved): Review 3400-workbench-all-items
Peter Amstutz
09:27 pm Task #4417 (Resolved): ArvadosResourceList returns exactly @limit items unless there are fewer th...
Peter Amstutz
02:45 am Task #4417 (Resolved): ArvadosResourceList returns exactly @limit items unless there are fewer th...
Peter Amstutz
09:27 pm Task #4418 (Resolved): Write tests
Peter Amstutz
02:52 am Task #4418 (Resolved): Write tests
Peter Amstutz
09:27 pm Task #4381 (Resolved): ArvadosResourceList returns all items unless @limit is non-nil
Peter Amstutz
09:26 pm Revision 2361a1b4 (arvados): 3400: Too much code that assumes it can call .first over and over wi...
incurring an API call each time (silly). Peter Amstutz
09:20 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Reviewing commit:50efff3
* It looks like the Selection pulldown, Select all button, and Deselect all button are su...
Brett Smith
08:57 pm Revision 47530892 (arvados): 3400: ArvadosResourceList returns all items (paging as necessary) un...
* ArvadosResourceList#each returns results incrementally. ArvadosResourceList#all (or ArvadosResourceList#results) p... Peter Amstutz
08:50 pm Story #3609 (Resolved): [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Applied in changeset arvados|commit:788ecdf8085f5e69cd3dc960f510b49f11432cb3. Anonymous
06:58 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
This LGTM enough to merge, thanks. The documentation makes me more confident that a new and unfamiliar user (i.e. me... Tim Pierce
02:33 am Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Tim Pierce wrote:
> Comments at commit:51de3bf2
>
> @doc/user/topics/run-command.html.textile.liquid@
> * The do...
Peter Amstutz
08:46 pm Revision 6ac59725 (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
08:44 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Review feedback: Given the size of the update for 4084, I limited my review to learn about this feature update and un... Radhika Chippada
08:21 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Comments on commit:52083e6 4084-log-pane-refresh-TC
* @views/jobs/_show_status.html.erb@ and @views/pipeline_insta...
Peter Amstutz
02:13 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
4084-log-pane-refresh-TC @ commit:52083e6
* All state goes on $pane. Reload events are sent to $pane. (The only time...
Tom Clegg
08:44 pm Revision 788ecdf8 (arvados): Merge branch 'origin-3609-arv-run' into master closes #3609
Conflicts:
sdk/cli/bin/arv
Peter Amstutz
08:40 pm Task #4428 (In Progress): Review 4084-log-pane-refresh-TC
Peter Amstutz
02:14 pm Task #4428 (Resolved): Review 4084-log-pane-refresh-TC
Tom Clegg
08:34 pm Support #4013: [SDKs] Pipeline instance logging emits misleading warning: API server did not retu...
Sally,
We've fixed this issue in the Python SDK. If you upgrade the SDK in your Docker images, and make sure it's...
Brett Smith
08:12 pm Feature #4383: [Docker] upload all docker containers to docker repository, and then add a script ...
At commit:611a332...
A more complete set of tests could be worthwhile to verify the interaction between the two au...
Tom Clegg
07:49 pm Story #2992: [Workbench] Support "display_order" (integer) key for pipeline template components. ...
I'm not sure lexical ordering is what our users want. Pipeline templates often have their components ordered by the ... Brett Smith
07:44 pm Bug #4432 (Closed): [SDKs] When copying pipeline instances using arv-copy, the component jobs get...
Brett Smith
07:44 pm Bug #4432 (Resolved): [SDKs] When copying pipeline instances using arv-copy, the component jobs g...
Bryan,
Turns out we already had an issue for this. Please watch #2992 if you're interested in following the devel...
Brett Smith
06:21 pm Bug #4432: [SDKs] When copying pipeline instances using arv-copy, the component jobs get re-arranged
This happens because Ruby hashes retain the order of keys, but Python dictionaries do not. As long as the pipeline i... Brett Smith
04:36 pm Bug #4432 (Closed): [SDKs] When copying pipeline instances using arv-copy, the component jobs get...
for example: qr1hi-d1hrv-k46opnhr3hovt7g, i expected BWA first and Haplotype caller last. Bryan Cosca
07:35 pm Task #4430 (In Progress): review 4383-easy-install
Tom Clegg
03:22 pm Task #4430 (Resolved): review 4383-easy-install
Ward Vandewege
07:35 pm Bug #4440 (Closed): [Documentation] "Writing a Crunch script" is mysterious
IN [[http://doc.arvados.org/user/tutorials/tutorial-firstscript.html]]
Everything after
"Next, create a submission ...
Nancy Ouyang
07:35 pm Bug #4185 (Resolved): [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Tom Clegg
07:34 pm Task #4372 (Resolved): Find out whether current stats make sense to users
Tom Clegg
07:30 pm Task #4370 (Resolved): Review 4357-node-manager-busy-nodes-wip
Applied in changeset arvados|commit:8ad92bb9e7950e0bf758716b40764d26ee33802c. Brett Smith
07:30 pm Bug #4357 (Resolved): [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes ar...
Applied in changeset arvados|commit:8ad92bb9e7950e0bf758716b40764d26ee33802c. Brett Smith
04:47 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Yup, this is easier to follow. LGTM. Tom Clegg
07:29 pm Revision 8ad92bb9 (arvados): Merge branch '4357-node-manager-busy-nodes-wip'
Closes #4357, #4370. Brett Smith
07:27 pm Revision 2c693ee5 (arvados): 4357: Node Manager boots new nodes when up nodes are busy.
The key part of this commit is the change to _nodes_wanted.
Everything else provides the information to make that cal...
Brett Smith
07:23 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
At commit:50517f3...
Rather than adding a new route we could use the @/?tab_pane=finished_pipelines (and name the ...
Tom Clegg
06:58 pm Task #4241 (Resolved): Review 3609-arv-run
Tim Pierce
06:57 pm Revision 974ad63f (arvados): Merge branch 'master' into 3177-collection-choose-files
Radhika Chippada
06:57 pm Revision 87567c94 (arvados): 3177: look for checked persistent selections on submit.
Radhika Chippada
06:49 pm Task #4386 (In Progress): Review branch: 4024-pipeline-instances-scroll
Tom Clegg
06:34 pm Story #4439 (New): [SDKs] Ensure each SDK and clients use a single codebase parse keep locators, ...
Peter Amstutz
06:33 pm Bug #4438 (New): [DRAFT] [SDKs] arv-keepdocker should be smarter about caching the image to upload
As of this writing, when arv-keepdocker uploads an image to Keep, it saves the image to disk first, under @~/.cache/a... Brett Smith
05:31 pm Bug #4409: [Workbench] Want to remove projects from Home
Ah, I just wanted the Projects to go away completely so they dont clutter. I'll use the workaround, thanks! Bryan Cosca
03:43 pm Bug #4409: [Workbench] Want to remove projects from Home
Bryan,
Remember that Arvados generally wants to keep data _somewhere_, for reproducibility. Normally, when you de...
Brett Smith
05:22 pm Revision e34d6859 (arvados): 4389: Merge branch 'master' into 4389-breadcrumbs-infinite-loop
Tom Clegg
05:19 pm Task #4435 (Resolved): Review 4434-collation
Tom Clegg
05:17 pm Bug #4434: [API] Test suite should not depend on a particular database collation config.
4434-collation @ commit:c1f7fd8
Also consolidated the two nearly-identical tests into a loop.
Tom Clegg
05:00 pm Bug #4434 (In Progress): [API] Test suite should not depend on a particular database collation co...
Tom Clegg
05:00 pm Bug #4434 (Resolved): [API] Test suite should not depend on a particular database collation config.
Tom Clegg
05:15 pm Revision c1f7fd8a (arvados): 4434: Test whether sort order matches application locale, instead of...
Tom Clegg
04:35 pm Task #4385 (Resolved): Review 4303-crunch-retry-logging-wip
Applied in changeset arvados|commit:f91dff0f2f49a83047e31b1a56dbddd85be6926a. Brett Smith
04:35 pm Bug #4303 (Resolved): [Crunch] Output of job gets stuck at collate step
Applied in changeset arvados|commit:f91dff0f2f49a83047e31b1a56dbddd85be6926a. Brett Smith
04:20 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
@$retry_msg@ should be @$next_retry_at@ here:... Peter Amstutz
02:52 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
commit:d5e7371a strips out the Perl line information, adds retry time information, and normalizes the whitespace. Re... Brett Smith
04:32 pm Revision f91dff0f (arvados): Merge branch '4303-crunch-retry-logging-wip'
Closes #4303, #4385. Brett Smith
04:31 pm Revision 16327d17 (arvados): 4303: crunch-job logs when it retries API calls.
Brett Smith
04:27 pm Revision bac6a080 (arvados): Fix `arv keep copy` → `arv copy` wrapper.
No issue #. Brett Smith
04:22 pm Bug #4431 (New): [SDKs] arv-copy should not require --dst-git-repo when copying on the same cluster
... Bryan Cosca
04:03 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> Alternatively, Brett points out that the Python "requests":http://docs.python-requests.org/en/la...
Tim Pierce
03:59 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Tim Pierce wrote:
> Alternatively, Brett points out that the Python "requests":http://docs.python-requests.org/en/la...
Brett Smith
03:57 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
Alternatively, Brett points out that the Python "requests":http://docs.python-requests.org/en/latest/ module might be... Tim Pierce
03:55 pm Task #4384 (In Progress): Review 4088-collection-show-files-filter
Brett Smith
03:22 pm Task #4405 (Resolved): add a feature to auto-admin the first user who signs in for a new installa...
Ward Vandewege
03:21 pm Revision 611a3323 (arvados): Merge branch 'master' into 4383-easy-install
Conflicts:
docker/api/application.yml.in
refs #4383
Ward Vandewege
03:18 pm Revision 18e63e25 (arvados): Add unit tests for new auto_admin_first_user configuration setting.
refs #4383 Ward Vandewege
03:06 pm Bug #4406 (Resolved): [Docker] Default arvdock doesn't start sso server container, but also assum...
This was already fixed in commits commit:a6606b79fb6496e43eef6b2e8b04d5c1061f5635 and commit:3978e8ae9c1b5bbc07c63fd0... Ward Vandewege
02:49 pm Revision d5e7371a (arvados): 4303: Improve error message display per code review.
Brett Smith
02:48 pm Revision 50517f39 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
02:27 pm Task #4429 (Resolved): Document authentication dance between Workbench, API, SSO and external ide...
Peter Amstutz
02:15 pm Task #4367 (Resolved): Review 3706-keep-warning
Tom Clegg
02:14 pm Task #4290 (Resolved): Review 4084-log-pane-refresh
Tom Clegg
02:14 pm Task #4413 (Resolved): Compress tab panes back to a single level
Tom Clegg
02:03 pm Revision 39af5239 (arvados): 4357: Restore "no state == no states match" behavior.
Brett Smith
02:02 pm Bug #4427 (New): [Workbench] Each active job/pipeline on the dashboard should show how many worke...
"Local jobs" will be easy to spot: they will have no worker nodes are allocated.
This answers the question "are th...
Ward Vandewege
01:53 pm Bug #4426 (Resolved): [Documentation] Support searching documentation
Brett Smith
08:52 am Revision 52083e6a (arvados): 4084: Add comment.
Tom Clegg
08:17 am Revision 1c410099 (arvados): 4084: Update comments.
Tom Clegg
08:17 am Revision 84cfa525 (arvados): 4084: Fix dashboard refresh.
Tom Clegg
08:17 am Revision 3981c82b (arvados): 4084: Remove excess loaded class.
Tom Clegg
08:17 am Revision 6862544e (arvados): 4084: Ignore bubbling arv-log-event events, just process each once a...
Tom Clegg
07:17 am Revision 36e465cf (arvados): 4084: Update comments.
Tom Clegg
07:14 am Revision eeb0021e (arvados): 4084: Ignore bubbling arv-log-event events, just process each once a...
Tom Clegg
04:28 am Revision 95d1231a (arvados): 4084: Merge branch 'master' into 4084-log-pane-refresh-TC
Conflicts:
services/api/test/fixtures/jobs.yml
Tom Clegg
04:20 am Revision f075cec9 (arvados): 4084: Use assert_text, not assert page_has_text?, to make tests reli...
Tom Clegg
03:54 am Revision 0f834e80 (arvados): 4084: Skip the "inactive pane" optimization when the div is not a ta...
Content divs that are _not_ tabbed panes no longer need to remember to
add an "active" flag.
Tom Clegg
03:40 am Revision 24d3d682 (arvados): 4084: Fix up whitespace (4-space indent, like the other *.js)
Tom Clegg
03:30 am Story #4424 (Closed): [Keep] [DRAFT] Use stronger hash algorithm (such as SHA-2) for Keep blocks
The md5 algorithm is well known to be insecure. Attackers can force hash collisions on arbitrary data, for example h... Peter Amstutz
03:00 am Bug #4410: [Crunch] crunch-job should exit tempfail when a SLURM node fails
Here is some more proof if needed:
qr1hi-8i9sb-b9bslx6nhjb0eff
qr1hi-8i9sb-ziako4ux0xc82ay
Bryan Cosca
02:57 am Task #4421 (Resolved): API server can migrate users from OpenID to OpenID Connect
Peter Amstutz
02:57 am Task #4420 (Resolved): Support user+pass database managed locally by SSO server
Peter Amstutz
02:56 am Task #4419 (Resolved): Support OpenID Connect for new log ins
Peter Amstutz
02:56 am Task #4379 (In Progress): Talk to Ward about what this involves
Peter Amstutz
02:28 am Revision 294d3c8d (arvados): 3609: Simplify "group" example a bit more.
Peter Amstutz
02:05 am Revision d5b8652f (arvados): 3609: Further improve documentation and code comments.
Peter Amstutz
12:25 am Revision 5257d993 (arvados): 4084: Move all pane state into $pane, flatten panes with multiple en...
Tom Clegg

11/04/2014

10:28 pm Revision a487f2c9 (arvados): 4357: Restore "any non-idle node is busy" behavior.
Brett Smith
10:11 pm Bug #3857 (In Progress): [SDKs] Python KeepClient should use different timeouts for different ope...
Tim Pierce
10:07 pm Bug #3857: [SDKs] Python KeepClient should use different timeouts for different operations
There doesn't appear to be a trivial fix to this one. httplib2 is built on Python's httplib, which takes a single _t... Tim Pierce
10:08 pm Task #3914 (Resolved): Study httplib2 and other docs
Tim Pierce
09:58 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Tom Clegg wrote:
> I was worried that this created a subtle dependency on "time for a requested node to boot up and ...
Brett Smith
07:51 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Brett Smith wrote:
> The code is correct. The rationale here is that if it's a new unpaired node, then it's most li...
Tom Clegg
07:12 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Tom Clegg wrote:
> Looking at commit:b0e6de3, just a few suspicious characters:
>
> ComputeNodeMonitorActor's sta...
Brett Smith
04:32 pm Bug #4357: [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes are busy
Looking at commit:b0e6de3, just a few suspicious characters:
ComputeNodeMonitorActor's state() method looks like i...
Tom Clegg
09:54 pm Revision 596d4488 (arvados): 4357: Eschew node monitor state() for in_state().
Brett Smith
09:28 pm Revision 2fe1e71c (arvados): 3609: Documentation improvements. More error checking on run-comman...
Peter Amstutz
09:16 pm Bug #4416 (Closed): [Workbench] "Manage" permission should be sufficient to edit project's name/d...
I was given manage access on a project shaed with me and I am not able to edit the name or the description.
!manag...
Bryan Cosca
09:04 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tim Pierce wrote:
> Review at commit:e4db374
>
> I think I'm getting more confused with each new commit!
Me to...
Tom Clegg
08:14 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Review at commit:e4db374
I think I'm getting more confused with each new commit!...
Tim Pierce
06:42 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg wrote:
> Indeed, and there's actually a whole lot more name_link cruft still sitting around that isn't nee...
Tim Pierce
06:28 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tim Pierce wrote:
> Review at commit:8e7d4e83
>
> If we're now ignoring @@name_link@ entirely when producing brea...
Tom Clegg
05:48 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Review at commit:8e7d4e83
If we're now ignoring @@name_link@ entirely when producing breadcrumbs, then this code i...
Tim Pierce
09:01 pm Revision f662e62c (arvados): 4389: Add debugging tools to dev bundle.
Tom Clegg
09:01 pm Revision 23aea08b (arvados): 4389: Fix infinite loop when ownership trail terminates at a self-ow...
Tom Clegg
08:09 pm Bug #4414 (Resolved): [Workbench] "Add new project" button missing from projects dropdown.
Currently no "Add new project" button is rendering on the "Projects" dropdown menu, even though the following code sn... Peter Amstutz
07:56 pm Revision e4db3740 (arvados): 4389: Fix missing first step of breadcrumb trail.
Tom Clegg
07:11 pm Feature #4233: [Workbench] Graph CPU and IO statistics using live log feed on Jobs#show
Here's a mini log excerpt.... Tom Clegg
06:51 pm Revision be60ff5c (arvados): 4357: Fixups from code review.
Brett Smith
06:45 pm Task #4413 (Resolved): Compress tab panes back to a single level
Peter Amstutz
06:25 pm Revision 2663cf43 (arvados): 4389: Put back @name_link to avoid the slippery slope of feature creep.
Tom Clegg
06:24 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
As it happens, I was able (by accident) to get an error that triggered the retry, the way it gets printed out is a li... Peter Amstutz
05:48 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
Peter Amstutz wrote:
> After fixing the mode, I get this error:
Both fixed in commit:625ac982 and ready for anoth...
Brett Smith
04:42 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
The +x bits got removed:... Peter Amstutz
06:20 pm Task #4390 (In Progress): Review 4389-breadcrumbs-infinite-loop
Tom Clegg
05:47 pm Revision 625ac982 (arvados): 4303: Fixup syntax issue in crunch-job.
Brett Smith
05:38 pm Revision d5cf000e (arvados): 4412: Remaining Ruby clients use :body_object for API requests.
A follow-up from the last commit. Refs #4412. Brett Smith
05:35 pm Bug #4412 (Resolved): [SDKs] arv edit fails under Ruby 2.1.4
Applied in changeset arvados|commit:cbb6e930023aeffdd03332894c85bc156316c72f. Brett Smith
05:29 pm Bug #4412 (In Progress): [SDKs] arv edit fails under Ruby 2.1.4
Brett Smith
05:22 pm Bug #4412 (Resolved): [SDKs] arv edit fails under Ruby 2.1.4
When you run arv edit under Ruby 2.1.4, doing normal edit work, there's an exception when it calls the Arvados API up... Brett Smith
05:31 pm Revision cbb6e930 (arvados): 4412: arv edit consistently uses :body_object in API requests.
Fixes #4412. Brett Smith
04:43 pm Task #4333 (Resolved): Review 4031-fix-graph-connections
Peter Amstutz
04:32 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Comments at commit:51de3bf2
@doc/user/topics/run-command.html.textile.liquid@
* The documentation for list expans...
Tim Pierce
04:26 pm Bug #4410 (Resolved): [Crunch] crunch-job should exit tempfail when a SLURM node fails
h2. Change to implement
(Draft) approach to the "retry" vs. "state machine" problem:
* crunch-job exits EX_RETRY_...
Brett Smith
04:24 pm Task #4385 (In Progress): Review 4303-crunch-retry-logging-wip
Peter Amstutz
04:14 pm Revision 0528a6d4 (arvados-dev): Small tweaks: fix example for running one API test in run-tests.sh;
capitalize Arvados in easy-docker-install.sh
no issue #
Ward Vandewege
04:14 pm Revision 0528a6d4 (arvados): Small tweaks: fix example for running one API test in run-tests.sh;
capitalize Arvados in easy-docker-install.sh
no issue #
Ward Vandewege
04:14 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
* Tom Clegg wrote:
> "anchor-and-pane" is an element that serves as a $pane in the reload function when the user h...
Peter Amstutz
03:45 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Tom Clegg wrote:
>
> > I understand the anchor/pane distinction, I'm just resisting the an...
Tom Clegg
03:23 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> I understand the anchor/pane distinction, I'm just resisting the anchor/anchor-and-pane/pane di...
Peter Amstutz
04:00 pm Bug #4031 (Resolved): [Workbench] Nodes should be connected via input=output in provenance/used b...
Applied in changeset arvados|commit:d65b1921a9aeffd6906b95aa927a07a48f013b32. Anonymous
03:16 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Brett Smith wrote:
> Reviewing commit:b798b32
>
> * The new test fixtures upset other Workbench tests:
> [...]...
Peter Amstutz
03:57 pm Revision d65b1921 (arvados): Merge branch '4031-fix-graph-connections' closes #4031
Peter Amstutz
03:48 pm Bug #4409 (New): [Workbench] Want to remove projects from Home
In my qr1hi-tpzed-rv6f0l8lbvdzkog#Subprojects, I'm trying to delete New Project and New project (2). When I use eithe... Bryan Cosca
03:35 pm Revision f809f3ed (arvados): 4084: Remove "no-auto-reload" css class hint, tabs no longer reload ...
default so it is not necessary to have a class to suppress that behavior. Peter Amstutz
03:20 pm Feature #3618 (Resolved): [Workbench] In project view, sort results in the collections (and other...
Applied in changeset arvados|commit:c54353188145d882218997a4d746c8b091a070e7. Anonymous
02:39 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Phil Hodgson wrote:
> No problem! This now uses the same run-times as before.
Perfect, thanks. commit:db2411a5 i...
Brett Smith
02:00 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
No problem! This now uses the same run-times as before. Phil Hodgson
01:45 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Phil Hodgson wrote:
> pipeline_instances_test.rb now works with the new fixture indexing. Thanks!
But you did it ...
Brett Smith
11:33 am Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
pipeline_instances_test.rb now works with the new fixture indexing. Thanks! Phil Hodgson
03:17 pm Task #4173 (Resolved): Review 3618
Phil Hodgson
03:16 pm Revision c5435318 (arvados): Merge branch '3618-column-ordering' closes #3618
Phil Hodgson
03:15 pm Revision 94e9d86f (arvados): 4031: Fix tests. Move RequestDuck to test_helper.rb so as not to du...
Peter Amstutz
03:02 pm Task #4370 (In Progress): Review 4357-node-manager-busy-nodes-wip
Tom Clegg
02:48 pm Revision e0a85f87 (arvados): Update version dependency to ensure CollectionReader has a normalize...
Tom Clegg
02:47 pm Revision 850bc55e (arvados): Merge branch 'master' into 3618-column-ordering
Phil Hodgson
02:09 pm Revision 038b1bc4 (arvados): 3603: PySDK Collection objects support file-like APIs.
This commit adds an open() method to CollectionReader and
CollectionWriter. They mimic the built-in open(), returnin...
Brett Smith
02:08 pm Bug #4408 (Resolved): [Workbench] Anonymous collection download links should not redirect to logi...
To reproduce:
# Visit collection page.
# Click "Create sharing link".
# Open the resulting link in a new/incognito...
Tom Clegg
01:58 pm Revision db2411a5 (arvados): 3618: accommodate new fixture indexing in pipeline_instance tests (i...
Phil Hodgson
01:47 pm Revision 9166af7c (arvados): 3603: Clean up PySDK imports.
Sort; remove unused imports. Brett Smith
01:47 pm Revision 52a2fc66 (arvados): 3603: Fix context methods for PySDK Collection objects.
Brett Smith
11:36 am Task #4407 (In Progress): Provide a test helper that replays crunch job logs
Phil Hodgson
11:36 am Task #4407 (Resolved): Provide a test helper that replays crunch job logs
Phil Hodgson
11:32 am Revision 963f0bf8 (arvados): 3618: accommodate new fixture indexing in pipeline_instance tests
Phil Hodgson
04:55 am Bug #4406 (Resolved): [Docker] Default arvdock doesn't start sso server container, but also assum...
Hi all. I hope this is helpful. My apologies in advance if I'm doing something wrong.
A naive user would usualy at...
Robert Syme

11/03/2014

10:45 pm Story #3706 (Resolved): [SDKs] Remove fallback-to-keep warning from python SDK if block hash has ...
Applied in changeset arvados|commit:68dae835a2f8bebd5664211a60fc76d50e5ecc23. Anonymous
09:05 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
I recanted on IRC. For posterity: I think _work_trees needs to say: @max_depth = (None if max_manifest_depth < 0 els... Brett Smith
08:25 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Tom Clegg wrote:
> Brett Smith wrote:
> > * This branch removes the line @self.mock_get_collection(client, 404, Non...
Brett Smith
07:56 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Brett Smith wrote:
> Great, thanks. One small thing: in _populate, please prefer @is None@ over @== None@ and @is n...
Tom Clegg
02:15 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Reviewing commit:ce2362b
Tom Clegg wrote:
> Brett Smith wrote:
> > * Would it make more sense to move the popula...
Brett Smith
10:32 pm Revision f05771f1 (arvados): When auto_admin_first_user is set to true (default false), the first
user to sign in on a new installation will be an admin.
refs #4383
Ward Vandewege
10:32 pm Task #4405 (In Progress): add a feature to auto-admin the first user who signs in for a new insta...
Ward Vandewege
10:31 pm Task #4405 (Resolved): add a feature to auto-admin the first user who signs in for a new installa...
Ward Vandewege
10:30 pm Revision 68dae835 (arvados): Merge branch '3706-keep-warning' closes #3706
Tom Clegg
10:29 pm Feature #4404 (New): [API] [SDKs] Include provenance information for uploaded Collections
This could include:
- Who uploaded
- Date
- IP of source machine where data was uploaded
- Maybe information ...
Adam Berrey
10:27 pm Revision 3e5e8972 (arvados): 3706: Oops, the test was broken, the feature works fine.
Tom Clegg
10:13 pm Revision a70e6990 (arvados): 3706: Add (skipped) test for broken max_manifest_depth=0 feature.
Tom Clegg
10:11 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Reviewing commit:b798b32
* The new test fixtures upset other Workbench tests:
...
Brett Smith
09:07 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Brett Smith wrote:
> Reviewing commit:4d257ed
>
> * I think the regexps that search for Collection UUIDs and port...
Peter Amstutz
10:10 pm Bug #4402 (Closed): [SDKs] CollectionWriter.write_directory_tree(...,max_manifest_depth=0) should...
Tom Clegg
09:30 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Tom Clegg wrote:
> > I think this is way too complicated and hard to follow. Why is the extr...
Tom Clegg
08:35 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> Peter Amstutz wrote:
> > > Yes -- I'd still like to know why/when we disagree with bootstrap abo...
Peter Amstutz
09:15 pm Revision b17d41c1 (arvados): 4084: Only load tab on switch if it doesn't have "pane-loaded" class...
default throttle to 15 sec instead of 3 (but refresh panels can set their own
throttle time.)
Peter Amstutz
09:08 pm Task #4143 (Resolved): Write tests
Peter Amstutz
09:08 pm Task #4142 (Resolved): Diagnose and fix
Peter Amstutz
09:00 pm Revision b798b325 (arvados): 4031: Add owner_uuid to graph_test_collection fixtures.
Peter Amstutz
08:39 pm Bug #4369 (Closed): [Crunch] Unexpected backward incompatibility in run-command
Brett Smith
08:37 pm Bug #4369: [Crunch] Unexpected backward incompatibility in run-command
The job seems to be running fine here: qr1hi-8i9sb-yfj9negdn8zqemy. I think everything is OK and nothing needs to be ... Bryan Cosca
06:26 pm Bug #4369: [Crunch] Unexpected backward incompatibility in run-command
I'm sorry, I thought I had I kept the input the same, but I guess I didn't. I'll test this again. I have this job: qr... Bryan Cosca
06:17 pm Bug #4369 (In Progress): [Crunch] Unexpected backward incompatibility in run-command
Brett Smith
06:17 pm Bug #4369: [Crunch] Unexpected backward incompatibility in run-command
Bryan,
The error message here seems to come from Rmake itself, after run-command starts it. The bug could still b...
Brett Smith
08:27 pm Revision b7ec3833 (arvados): 3706: Merge branch 'master' into 3706-keep-warning
Tom Clegg
08:07 pm Revision 5dd7bd8a (arvados): Merge remote-tracking branch 'origin/master' into 4031-fix-graph-con...
Conflicts:
services/api/test/fixtures/collections.yml
Peter Amstutz
08:06 pm Revision 15dbb311 (arvados): 4031: Improve provenance graph tests for readability, use fixtures i...
hardcoded hashes. Improve efficiency of matching collections in search_edges.
Remove spurious debug code.
Peter Amstutz
07:33 pm Revision 411305d8 (arvados): 3706: Remove superfluous conditional.
Tom Clegg
06:33 pm Revision 47c349ca (arvados): 3706: Add back "collections.get => 404" to "fallback to Keep" test.
Tom Clegg
06:31 pm Revision 3978e8ae (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested (part 2).
refs #4383
Ward Vandewege
06:31 pm Revision c5c8c883 (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested (part 2).
refs #4383
Ward Vandewege
06:28 pm Bug #4401 (Resolved): [Docker] Check dependencies at top of build.sh
* test for docker version - exclude version 1.2.0 (but allow 1.2.0-dev) because of known bug
* test for presence o...
Ward Vandewege
06:26 pm Bug #4400: [SDKs] Python package install should not print misleading message "fatal: Not a git re...
Perhaps check whether SETUP_DIR/../../.git exists in sdk/python/setup.py before trying to get a version date from git... Tom Clegg
06:22 pm Bug #4400 (Resolved): [SDKs] Python package install should not print misleading message "fatal: N...
Installing the @arvados_fuse@ and @arvados-python-client@ packages produces the following output:... Peter Amstutz
06:21 pm Bug #4391 (Closed): [Workbench] Selection clip does not show list of selected items in drop down
I'm closing this bug, because we're going to "fix" it by getting rid of the selection clip entirely. The main use of... Brett Smith
01:12 am Bug #4391 (Closed): [Workbench] Selection clip does not show list of selected items in drop down
when I select items, the selection clippy in the upper right shows the number of items selected, but when I click on ... Adam Berrey
04:35 pm Bug #4388 (Resolved): [SDKs] Manifest#each_line should not crash when encountering a blank line i...
Applied in changeset arvados|commit:ae96829cc088d18c7aaf438eacb75830c7a40662. Brett Smith
03:57 pm Bug #4388 (In Progress): [SDKs] Manifest#each_line should not crash when encountering a blank lin...
Brett Smith
04:32 pm Bug #4399 (Resolved): [Tests] Fix whatever sometimes causes Jenkins tests to fail with ECONNREFUSED
The workbench tests sometimes fail catastrophically on Jenkins with many errors similar to the following:... Peter Amstutz
04:29 pm Revision ab3b9556 (arvados): 3706: Prefer "is None" and "is not None" to "== None" and "!= None".
Tom Clegg
04:29 pm Revision 3b408ec4 (arvados): 3706: Mutating normalize() does not return self.
Tom Clegg
04:29 pm Revision 6c7e0599 (arvados): 3706: Process directory trees in sorted() order, instead of the order
returned by os.listdir().
This causes write_directory_tree() to produce a manifest that is
normalized to the greates...
Tom Clegg
04:26 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
Ward says that if the node's shutdown window closes while the node is draining, Node Manager should cancel the shutdo... Brett Smith
04:25 pm Revision ae96829c (arvados): 4388: Ruby Keep::Manifest skips blank lines in manifests.
Closes #4388. Brett Smith
03:51 pm Task #4397 (Resolved): add validation
Tim Pierce
03:34 pm Revision a6606b79 (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested.
refs #4383
Ward Vandewege
03:33 pm Revision f8002c59 (arvados): The sso server docker image is not used by default at the moment, so
arvdock shouldn't try to start it unless explicitly requested.
refs #4383
Ward Vandewege
03:13 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thanks Phil, I like all the changes as of commit:2a48239. Just one more thing: changing the test fixture indices has... Brett Smith
03:00 pm Story #4316: Review 3603-pysdk-file-api-wip
Taking this back because I'm going to have to resolve some merge conflicts with a branch Tom is working on. Brett Smith
11:23 am Bug #4395 (Resolved): [SDKs] sdk/go/keepclient race condition

From https://ci.curoverse.com/job/arvados-api-server/1040/console
----------------------------------------------...
Ward Vandewege
04:40 am Revision 31407b1e (arvados): system_user and anonymous_user should be excluded from
auto_setup_new_user, always.
refs #4383
Ward Vandewege
04:39 am Revision 4498d813 (arvados): system_user and anonymous_user should be excluded from
auto_setup_new_user, always.
refs #4383
Ward Vandewege
02:05 am Revision 28053f8a (arvados): Enable auto_setup_new_users in the docker API server image.
refs #4383 Ward Vandewege
02:03 am Revision 234f7303 (arvados): Enable auto_setup_new_users in the docker API server image.
refs #4383 Ward Vandewege
01:36 am Bug #4394 (New): [Workbench] Make duplicate name error message more user-friendly
When I tried to use the same collection name twice, the error message (the uniqueness constraint violation exception ... Adam Berrey
01:34 am Feature #4393 (New): [Workbench] Display portable data hash, parent project, file count in Collec...
Let's say I've created a Collection "Gemini data" and copied it into a variety of different projects. Then I created ... Adam Berrey
01:08 am Revision a383999f (arvados): Add instructions for 'binary' docker installation.
refs #4383 Ward Vandewege

11/02/2014

02:41 am Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> > Yes -- I'd still like to know why/when we disagree with bootstrap about which elements shou...
Tom Clegg
12:48 am Revision 076ba4ed (arvados): Rename easy installation script. Update comments at the top of the s...
refs #4383 Ward Vandewege
12:48 am Revision 076ba4ed (arvados-dev): Rename easy installation script. Update comments at the top of t...
refs #4383 Ward Vandewege
12:41 am Revision 7ae95cd8 (arvados-dev): Add first version of the easy-evaluation script.
refs #4383 Ward Vandewege
12:41 am Revision 7ae95cd8 (arvados): Add first version of the easy-evaluation script.
refs #4383 Ward Vandewege

11/01/2014

07:46 pm Task #4390 (Resolved): Review 4389-breadcrumbs-infinite-loop
Tom Clegg
07:46 pm Bug #4389 (In Progress): [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg
07:46 pm Bug #4389: [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
4389-breadcrumbs-infinite-loop
* commit:ebd8e5c fixes bug.
* commit:8e7d4e8 adds debugger to bundle.
Tom Clegg
07:41 pm Bug #4389 (Resolved): [Workbench] Fix infinite loop in ApplicationController#project_breadcrumbs
Tom Clegg
07:45 pm Revision 8e7d4e83 (arvados): 4389: Add debugging tools to dev bundle.
Tom Clegg
07:44 pm Revision ebd8e5cd (arvados): 4389: Fix infinite loop when ownership trail terminates at a self-ow...
Tom Clegg
07:10 pm Revision 1b9ca54a (arvados): Make run-docker-tests.sh a bit smarter about detecting common failures.
No issue # Ward Vandewege
07:10 pm Revision 1b9ca54a (arvados-dev): Make run-docker-tests.sh a bit smarter about detecting common fa...
No issue # Ward Vandewege
06:32 pm Bug #4388 (Resolved): [SDKs] Manifest#each_line should not crash when encountering a blank line i...
While displaying the collections tab on "show Home project":... Tom Clegg
06:28 pm Revision a434d701 (arvados): 4084: Do not reload up-to-date panes when switching tabs.
Tom Clegg
06:25 pm Revision e0b4da87 (arvados): 4084: Bootstrap manages the "active" class on tabs, not us.
Tom Clegg
02:28 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thanks again for the great feedback Brett. I've addressed all of the points you've raised. The refactoring of the scr... Phil Hodgson
02:22 pm Revision 2a482395 (arvados): 3618: refactor scroll tests to share code
Phil Hodgson
12:42 am Feature #4383 (In Progress): [Docker] upload all docker containers to docker repository, and then...
Ward Vandewege
12:40 am Revision e9db1de8 (arvados): Make sure all executables we package are executable.
No issue # Ward Vandewege
12:40 am Revision e9db1de8 (arvados-dev): Make sure all executables we package are executable.
No issue # Ward Vandewege
12:35 am Revision 7b3296a9 (arvados-dev): Upload our docker images to the docker.io registry.
refs #4383 Ward Vandewege
12:35 am Revision 7b3296a9 (arvados): Upload our docker images to the docker.io registry.
refs #4383 Ward Vandewege

10/31/2014

11:47 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Brett Smith wrote:
> First, mea culpa on the bad tests for max_manifest_depth. I wrote those when I was adding retr...
Tom Clegg
08:10 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
First, mea culpa on the bad tests for max_manifest_depth. I wrote those when I was adding retry support to arv-put, ... Brett Smith
11:46 pm Revision ce2362b3 (arvados): 3706: Clarify test case.
Tom Clegg
11:43 pm Revision 09aa8bc2 (arvados): 3706: Clarify test case.
Tom Clegg
11:36 pm Revision 55a0e060 (arvados): 3706: Prefer join() to many string concatenations.
Tom Clegg
11:20 pm Revision e753cd61 (arvados): 3706: Prefer join() to many string concatenations.
Tom Clegg
10:58 pm Revision 83acfa97 (arvados): 3706: Prefer "if x" to "if len(x) > 0".
Tom Clegg
10:56 pm Revision 017587d7 (arvados): 3706: Two blank lines after class definition.
Tom Clegg
09:21 pm Revision f9328bf5 (arvados): 3706: Really make the API server return the wrong data, instead of j...
Tom Clegg
09:17 pm Bug #4380 (In Progress): [Node Manager] Should drain nodes via SLURM before terminating them
Brett Smith
09:15 pm Bug #4380: [Node Manager] Should drain nodes via SLURM before terminating them
To start draining a node:
@scontrol update NodeName=computeNN State=DRAIN@
To check current node state:
@sin...
Brett Smith
06:10 pm Bug #4380 (Resolved): [Node Manager] Should drain nodes via SLURM before terminating them
Brett Smith
08:58 pm Revision d2519d36 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Conflicts:
services/api/test/fixtures/api_client_authorizations.yml
services/api/test/fixtures/users.yml
Radhika Chippada
08:55 pm Bug #4040 (Resolved): [Tests] FUSE mount test suite should not fail just because new collection f...
Applied in changeset arvados|commit:313f5fedd4214d077e2b5c7c26bab4df3895c44a. Tim Pierce
08:40 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
With that said (#4387), LGTM Radhika Chippada
08:29 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
Added #4387 to track some of the tests suggested in this ticket. Tim Pierce
08:23 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
New revision at commit:f39bdf8
Radhika Chippada wrote:
> Review feedback. Some of the items I listed below may be...
Tim Pierce
08:54 pm Feature #4024: [Workbench] PipelineInstances#index should scroll down to show older pipelines, an...
How do we want to prevent page refresh on the dashboard refreshing the recently finished pipelines panel when the use... Radhika Chippada
08:48 pm Revision 7505be2b (arvados): 3706: Put --normalize and --max-manifest-depth arguments in a mutual...
Tom Clegg
08:46 pm Revision c57a72b3 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
08:45 pm Revision 313f5fed (arvados): Merge branch '4040-fuse-tests'
Fixes #4040. Tim Pierce
08:45 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Summary of everything that's happened in the last couple of days:
Updated this branch at commit:50efff371 with cha...
Tim Pierce
08:44 pm Revision fad87116 (arvados): 3706: normalize() returns None instead of self. Add equally convenie...
Tom Clegg
08:40 pm Task #4351 (Resolved): Review 4040-fuse-tests
Radhika Chippada
08:37 pm Revision 51de3bf2 (arvados): 3609: Correctly recognize and rewrite directory names in collections.
Peter Amstutz
08:36 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Tim Pierce wrote:
> Review @ commit:0edcc26f:
>
> @sdk/python/arvados/commands/run.py@
> * The @slots@ stuff was...
Peter Amstutz
08:36 pm Story #4387: [Tests] additional FUSE tests
It would also help tremendously if the variables such as d1, d2, d3 etc in the "test_mount.py" are given self explana... Radhika Chippada
08:29 pm Story #4387 (Resolved): [Tests] additional FUSE tests
Additional tests of the FUSE driver that would be useful. Discussed in #4040.
* Authenticate as the @fuse@ user (r...
Tim Pierce
08:30 pm Revision 3f9d8b5c (arvados): 3706: Catch and return exceptions in _populate_* methods to dry up _...
Tom Clegg
08:23 pm Revision f39bdf87 (arvados): 4040: code review feedback
* Renamed
** collection_owned_by_fuse_1 -> collection_1_owned_by_fuse
** collection_owned_by_fuse_2 -> collection_2_o...
Tim Pierce
08:13 pm Revision 102582e4 (arvados): Fix broken link in docs. Duh.
refs #4186 Ward Vandewege
08:09 pm Revision 78343b45 (arvados): 4024: update fixture to set state to Complete for some of the finish...
Radhika Chippada
07:36 pm Task #4386 (Resolved): Review branch: 4024-pipeline-instances-scroll
This branch addresses adding infinite scrolling to recently finished pipelines panel in the dashboard. Radhika Chippada
07:33 pm Revision c00109a6 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
07:32 pm Revision bdd31f24 (arvados): 4024: add integration tests to dashboard finished pipelines panel.
Radhika Chippada
07:26 pm Revision 0812bc1c (arvados): 3609: Inherit --retries from _util. Be more specific about error be...
Peter Amstutz
07:00 pm Task #4367 (In Progress): Review 3706-keep-warning
Brett Smith
06:57 pm Task #4385 (Resolved): Review 4303-crunch-retry-logging-wip
Brett Smith
06:57 pm Bug #4303 (In Progress): [Crunch] Output of job gets stuck at collate step
4303-crunch-retry-logging-wip is up for review, to handle the quick fix suggested above, until we port to Python. Brett Smith
06:54 pm Revision d688971e (arvados): 4303: crunch-job logs when it starts retrying API calls.
Brett Smith
06:51 pm Task #4384 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
06:49 pm Task #4205 (Resolved): Add "select all" / "deselect all" buttons to app/views/collections/_show_f...
Tim Pierce
06:45 pm Feature #4302: [Crunch] Pipelines should not fail immediately after one job failure, but continue...
arv-run-pipeline-instance has (had?) this option, but there has never been a way in Workbench to specify whether you ... Tom Clegg
06:37 pm Revision 50efff37 (arvados): 4088: use filterable.js to filter on client side
Implemented client-side filtering via filterable.js:
* Designated filename rows as "filterable"
* Designated filename...
Tim Pierce
06:21 pm Feature #4383 (Resolved): [Docker] upload all docker containers to docker repository, and then ad...
Ward Vandewege
06:19 pm Task #4382 (Resolved): Decide what to do
Peter Amstutz
06:12 pm Bug #4368: [Crunch] Improve node failure detection and job retry logic
Made lower priority in favor of #4380. Brett Smith
01:39 pm Bug #4368 (Closed): [Crunch] Improve node failure detection and job retry logic
One of Crunch's ideal responsibilities is that it's supposed to detect when a job fails because a node failed, and re... Brett Smith
06:10 pm Task #4381 (Resolved): ArvadosResourceList returns all items unless @limit is non-nil
Peter Amstutz
06:09 pm Task #4379 (Resolved): Talk to Ward about what this involves
Peter Amstutz
06:09 pm Task #4377 (Resolved): Diagnose
Peter Amstutz
06:08 pm Task #4376 (Resolved): Diagnose and fix
Peter Amstutz
06:08 pm Task #4375 (Resolved): Add tests
Tom Clegg
06:08 pm Task #4374 (Resolved): Diagnose and fix
Peter Amstutz
06:08 pm Task #4373 (Resolved): Diagnose and fix
Peter Amstutz
06:06 pm Task #4372 (Resolved): Find out whether current stats make sense to users
Tom Clegg
06:01 pm Task #4370 (Resolved): Review 4357-node-manager-busy-nodes-wip
Brett Smith
05:59 pm Revision b0e6de37 (arvados): 4357: Node Manager boots new nodes when up nodes are busy.
The key part of this commit is the change to _nodes_wanted.
Everything else provides the information to make that cal...
Brett Smith
05:28 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> Punted to #4339.
Thanks.
> > > Evidently this is worth testing, since it's apparently eas...
Peter Amstutz
05:28 pm Revision 1693dc61 (arvados): 4084: Change $(this) to this and add comments. Refactor @pidfile in...
Peter Amstutz
03:55 pm Bug #4369 (Closed): [Crunch] Unexpected backward incompatibility in run-command
in job: qr1hi-8i9sb-fm7d28agolgd6fs, im running run-command: 83a9390a05bbffc2e4ea95dd693af3ab3547fa12, a pretty rece... Bryan Cosca
03:47 pm Revision e6d161cc (arvados): 4084: Fix workbench tests.
Peter Amstutz
03:44 pm Task #4325 (Resolved): Review 3824-crunch-container-setup
Tom Clegg
03:04 pm Revision 27b534dd (arvados): Merge branch '4186-install-doc-improvements-2'
refs #4186 Ward Vandewege
03:03 pm Revision 4978c1e7 (arvados): Clean up the installation overview pages a bit more.
refs #4186 Ward Vandewege
02:52 pm Revision 9ac37f36 (arvados): Merge branch 'master' into 4186-install-doc-improvements-2
Ward Vandewege
02:51 pm Revision afc70738 (arvados): Add keepstore installation page.
refs #4186 Ward Vandewege
02:50 pm Revision 28ac1f93 (arvados): Workbench: Change from yui to uglifier to compress javascript in
config/environments/production.rb.example
No issue #
Ward Vandewege
02:42 pm Revision d14c0c81 (arvados): Keepproxy just needs an anonymous token.
refs #4186 Ward Vandewege
02:42 pm Revision 7c3f2671 (arvados): Fix typo.
refs #4186 Ward Vandewege
02:42 pm Revision ed4105d0 (arvados): Batch of improvements for the manual installation documentation:
* add prerequisites section
* add shell server section
* add keepproxy section
* many other updates throughout
refs ...
Ward Vandewege
02:00 pm Bug #4357 (In Progress): [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes...
Brett Smith
01:44 pm Task #4326 (Resolved): Review branch: 4091-test-infinite-scrolling
Tom Clegg
01:26 pm Task #4362 (Resolved): Review 4359-project-paging
Tom Clegg
01:04 pm Revision 9fa70c84 (arvados): 3618: improve api security for sorting to make sure each column we s...
Phil Hodgson
01:04 pm Revision 4d195ee9 (arvados): 3618: make sure something happens if the order param is actually det...
Phil Hodgson
01:03 pm Revision b28531cd (arvados): 3618: bug fix: was confusing the "desc" meaning a "descending sort" ...
Phil Hodgson
12:56 pm Revision e3e54264 (arvados): Merge branch 'master' into 3618-column-ordering
Conflicts (all resolved including fixes):
apps/workbench/app/controllers/projects_controller.rb
apps/workbench/app/...
Phil Hodgson
02:07 am Revision 930198d1 (arvados): Fix typo.
refs #4186 Ward Vandewege
01:47 am Revision 3042c000 (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
01:28 am Revision a4b6e0ad (arvados): Merge branch 'master' into 4024-scroll-dashboard-recent-pipelines
Radhika Chippada
01:26 am Revision 2db7fce3 (arvados): 4024: add inifinite scrollling to dashboard.
Radhika Chippada

10/30/2014

09:23 pm Bug #4303: [Crunch] Output of job gets stuck at collate step
Two things happened here:
* The Docker image used has an older Python SDK that does not record Keep's authorizatio...
Brett Smith
09:15 pm Bug #3824 (Resolved): [Crunch] crunch-job should create task execution environment inside docker ...
Applied in changeset arvados|commit:c6a03a7abff947dc8242e8be18b4b5e6920a3e4a. Anonymous
09:11 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> Reviewing commit:c199c0c, and my only concern is the TASK_KEEPMOUNT comment. Looking at it aga...
Tom Clegg
08:36 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Reviewing commit:c199c0c, and my only concern is the TASK_KEEPMOUNT comment. Looking at it again, I feel more strong... Brett Smith
06:51 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Tom Clegg wrote:
> Brett Smith wrote:
> > And then some longer-standing issues in the Dockerfiles. I'm okay with s...
Tom Clegg
06:11 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> And then some longer-standing issues in the Dockerfiles. I'm okay with seeing these addressed ...
Tom Clegg
05:58 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Using Data::Dumper, the log message now looks like this:... Tom Clegg
09:13 pm Revision c6a03a7a (arvados): Merge branch '3824-crunch-container-setup' closes #3824
Tom Clegg
09:13 pm Revision 4cbb3944 (arvados): 3824: Merge branch 'master' into 3824-crunch-container-setup
Tom Clegg
09:05 pm Revision b39e2b4e (arvados): 3824: Fix comment to state that tasks must not assume $TASK_KEEPMOUN...
Tom Clegg
09:00 pm Story #4359 (Resolved): [Workbench] Clean up project paging after #4091 bug fixes
Applied in changeset arvados|commit:92822dd390f4b3efeb183452b7ddf866c41bda17. Anonymous
08:20 pm Story #4359: [Workbench] Clean up project paging after #4091 bug fixes
Review feedback: Code updates look good. All tests passed and also manual verification passed. Pointed to staging and... Radhika Chippada
08:33 pm Revision 6dabd04b (arvados): Fix google-api-client version deps. No issue #
Tom Clegg
08:30 pm Revision 92822dd3 (arvados): Merge branch '4359-project-paging' closes #4359
Tom Clegg
08:29 pm Bug #4307 (Resolved): [Workbench] Pipeline instance name text should be editable after the instan...
Brett Smith
08:28 pm Bug #4307 (New): [Workbench] Pipeline instance name text should be editable after the instance st...
Brett Smith
05:50 pm Bug #4307 (Resolved): [Workbench] Pipeline instance name text should be editable after the instan...
Applied in changeset arvados|commit:fd0ca9211847806adb2e97c0ae78e9312ef89ca1. Brett Smith
08:16 pm Task #4362 (In Progress): Review 4359-project-paging
Radhika Chippada
08:13 pm Revision a95a8120 (arvados): Merge branch '4088-filterable-docs' refs #4088
Tom Clegg
08:12 pm Revision 540680b2 (arvados): 4088: Add usage docs to filterable.js
Tom Clegg
08:06 pm Task #4367 (Resolved): Review 3706-keep-warning
Tom Clegg
08:06 pm Task #4346 (Resolved): Write tests
Tom Clegg
05:52 pm Task #4346 (In Progress): Write tests
Tom Clegg
08:06 pm Story #3706: [SDKs] Remove fallback-to-keep warning from python SDK if block hash has a permissio...
Along the way I noticed a few things were being broken by CollectionReader and CollectionWriter automatically applyin... Tom Clegg
07:59 pm Revision 0e8d9b4c (arvados): 3706: Use normalize() in arv-mount.
Tom Clegg
06:48 pm Revision c199c0cf (arvados): 3824: Import GPG key needed for RVM installation.
Tom Clegg
06:27 pm Revision ce6f044c (arvados): 3824: Remove redundant "apt-get update", standardize on "apt-get upd...
Tom Clegg
06:04 pm Revision 1bcfc05d (arvados): 3824: Set mode on /etc/fuse.conf in compute image.
Tom Clegg
05:53 pm Task #4283 (Resolved): Make test case
Tom Clegg
05:52 pm Task #4365 (Resolved): Ensure posix-incompatible filenames do not cause I/O errors (add tests)
Tom Clegg
05:51 pm Task #4364 (Resolved): Ensure posix-allowed filenames are not altered by arv-mount (add tests)
Tom Clegg
05:45 pm Revision fd0ca921 (arvados): 4307: Workbench: only pipeline components are not editable after start.
This fixes a regression from d7fdbbab. Closes #4307. Brett Smith
05:43 pm Revision 9b959a51 (arvados): 4088: Add usage docs to filterable.js
Tom Clegg
05:11 pm Bug #4044 (Resolved): [Crunch] job spawns tasks but never runs them, gets stuck waiting for first...
Tom Clegg
05:05 pm Revision da6674e4 (arvados): 3824: Bring back $! in error message, in case it's helpful.
Tom Clegg
05:02 pm Revision 51e79a3b (arvados): 3824: Merge branch 'master' into 3824-crunch-container-setup
Tom Clegg
05:00 pm Revision 1bcf9398 (arvados): 3824: Use Data::Dumper instead of custom quoting to show srun/task e...
Tom Clegg
03:59 pm Task #4173 (In Progress): Review 3618
Brett Smith
03:38 pm Bug #4363 (Resolved): [Keep] arv-mount should not munge filenames unless required by POSIX
One particularly unfortunate outcome of the current "strip characters we think you shouldn't use" code is:... Tom Clegg
02:55 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Reviewing commit:c10b68e
* There seems to be a bug in the history handling for the Description column. Steps to r...
Brett Smith
01:50 pm Task #4351 (In Progress): Review 4040-fuse-tests
Radhika Chippada
01:46 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
Review feedback. Some of the items I listed below may be out of scope / too hard to do / do not add much value; pleas... Radhika Chippada
12:54 pm Feature #4343: [SDKs] arv create needs --project-uuid and --name parameters for appropriate classes
I'm going to put this in Future sprints because there's a workaround: when you're writing the object JSON, you can se... Brett Smith
12:52 pm Feature #4349: [SDKs] When editing a template in arv-edit and faced with a parse error, when tryi...
This sounds pretty cool but I'm not sure it's going to be possible. Because arv edit uses your preferred editor, som... Brett Smith
12:50 pm Bug #4358: [Tests] When comparing pipelines, the graph should highlight the differences by using ...
#4088 might resolve this when it gets merged soon. Let's double-check after that and see if there are any outstandin... Brett Smith

10/29/2014

09:10 pm Task #4362 (Resolved): Review 4359-project-paging
Tom Clegg
09:10 pm Task #4361 (Resolved): Remove overlapping uuids using filters
Tom Clegg
09:10 pm Task #4361 (Resolved): Remove overlapping uuids using filters
Tom Clegg
09:10 pm Task #4360 (Resolved): Use inequality operators instead of adding/subtracting 1 second from times...
Tom Clegg
09:09 pm Task #4360 (Resolved): Use inequality operators instead of adding/subtracting 1 second from times...
Tom Clegg
09:08 pm Story #4359 (Resolved): [Workbench] Clean up project paging after #4091 bug fixes
Tom Clegg
09:06 pm Revision 1d2cdef7 (arvados): 4091: Use <=N instead of <N+1. Pass "uuid not in" filter to API inst...
Tom Clegg
08:43 pm Bug #4358 (New): [Tests] When comparing pipelines, the graph should highlight the differences by ...
https://workbench.qr1hi.arvadosapi.com/pipeline_instances/compare?uuids%5B%5D=qr1hi-d1hrv-pep5f13gwh50paf&uuids%5B%5D... Jonathan Sheffi
08:26 pm Task #4351: Review 4040-fuse-tests
Per our discussion, revision commit:5214183 includes more descriptive variable names in the @FuseSharedTest@. Tim Pierce
07:35 pm Task #4351 (Resolved): Review 4040-fuse-tests
Tim Pierce
08:24 pm Bug #4040: [Tests] FUSE mount test suite should not fail just because new collection fixtures hav...
Per discussion in the office: commit:5214183 has been updated to use more descriptive variable names in the test, to ... Tim Pierce
08:23 pm Revision 52141835 (arvados): 4040: clarify variable names
Per code review: give d1, d2, d3 more descriptive variable names. Tim Pierce
08:17 pm Bug #4357 (Resolved): [Node Manager] Should spin up more nodes (up to max_nodes) when up nodes ar...
Consider the following scenario:
* 2 nodes are currently up.
* A job that needs two nodes is created, assigned to...
Brett Smith
08:07 pm Task #4356 (Resolved): write blog post
Tim Pierce
08:07 pm Task #4355 (Resolved): min_nodes tests
Tim Pierce
08:07 pm Task #4354 (Resolved): decline node shutdown if it brings the number of nodes lower than min_nodes
Tim Pierce
08:06 pm Task #4353 (Resolved): spin up a new node if node list is less than min_nodes
Tim Pierce
08:05 pm Task #4352 (Resolved): fix bugs, write tests
Tim Pierce
07:40 pm Story #4293: [Node Manager] Write off cloud nodes that spend too long in booted state
Fixing this effectively requires fixing #4322, which was originally filed separately. Adjusting this story to accoun... Brett Smith
07:35 pm Task #4207 (Resolved): Add fixtures exclusively for testing FUSE mounts
Tim Pierce
07:25 pm Story #4091 (Resolved): [Workbench] Add tests for undertested parts of Workbench, including infin...
Applied in changeset arvados|commit:e2fe6c0e5c1c62a37e03519590c04a5186a2cc9b. Radhika Chippada
07:23 pm Revision e2fe6c0e (arvados): closes #4091
Merge branch '4091-test-infinite-scrolling' Radhika Chippada
07:23 pm Revision c105f356 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
07:21 pm Revision 78fc6d80 (arvados): 4091: set the limit size to 50 for "Jobs and pipelines" tab.
Radhika Chippada
07:19 pm Feature #4027: [Crunch] Accept SDK version as a runtime constraint. Install SDK into the docker c...
Proposed implementation. After the normal Docker image install, use @docker run@ to install the exact specified vers... Brett Smith
07:13 pm Revision ddc1f6b0 (arvados): 4040: update FUSE driver tests with stable fixtures
Added test fixtures specifically for FUSE driver tests. Tim Pierce
07:13 pm Story #4350 (New): [Workbench] Order by Collections "Name" column puts "folders" (collections con...
Phil Hodgson
07:09 pm Task #4330 (New): Review branch: 4291-collection-sharing-link-refresh-issue
Radhika Chippada
07:09 pm Bug #4291 (New): [Workbench] Create sharing link for a collection is broken
Radhika Chippada
06:58 pm Revision 7d8d1b78 (arvados): Fix Node Manager test bug introduced by last commit.
Bad Brett, only running specific tests. No issue #. Brett Smith
06:56 pm Feature #4349 (New): [SDKs] When editing a template in arv-edit and faced with a parse error, whe...
it would make editing templates faster Bryan Cosca
06:47 pm Bug #4297 (Resolved): [Crunch] crunch-dispatch eats way too much cpu
Tom Clegg
06:32 pm Support #4348 (Resolved): [Support] fix bugs and write tests (second half)
Ward Vandewege
06:32 pm Support #4347 (Resolved): [Support] fix bugs and write tests (first half)
Ward Vandewege
06:22 pm Revision 9ee4a125 (arvados): Fix race condition in Node Manager shutdown tests.
ComputeNodeMonitorActor considers a shutdown when it's initialized.
Blocking on the subscription we send ensures that...
Brett Smith
06:16 pm Bug #4314: [Crunch] Figure out why this job was marked Failed unexpectedly
Could be a duplicate of #4310 Tom Clegg
05:53 pm Support #4134 (Resolved): [Support] fix bugs and write tests (second half)
Ward Vandewege
04:53 pm Revision 5560cdf3 (arvados): Fix the goldang consarned FUSE tests again.
No issue #, dammit Tim Pierce
04:43 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Brett Smith wrote:
> Tim Pierce wrote:
> > Rewriting the tab that way would involve a substantial rewrite of the _s...
Tom Clegg
03:35 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Tim Pierce wrote:
> It seems like the distinction will be clear in practice, when the user's search for "a[b" turns ...
Brett Smith
03:26 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Brett Smith wrote:
> Tim Pierce wrote:
> > > * For consistency with our other search fields, I think the filter but...
Tim Pierce
01:31 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Tim Pierce wrote:
> New revision at commit:f549c9f
>
> Rewriting the tab that way would involve a substantial rewr...
Brett Smith
04:27 pm Revision b09dddc9 (arvados): Keepproxy just needs an anonymous token.
refs #4186 Ward Vandewege
04:26 pm Task #4345 (Resolved): Do not warn unless both methods fail
Tom Clegg
04:25 pm Task #4345 (Resolved): Do not warn unless both methods fail
Tom Clegg
04:26 pm Task #4346 (Resolved): Write tests
Tom Clegg
04:07 pm Task #4205 (In Progress): Add "select all" / "deselect all" buttons to app/views/collections/_sho...
Tim Pierce
04:07 pm Task #4332 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
04:07 pm Task #4206 (Resolved): write workbench tests
Tim Pierce
04:07 pm Task #4204 (Resolved): Add regex box and filter to app/views/collections/_show_files.html.erb
Tim Pierce
04:07 pm Revision c19bb2a3 (arvados): Merge branch '4088-collection-show-files-filter'
Refs #4088. Tim Pierce
04:05 pm Bug #4344 (Resolved): [SDK] can't make an anonymous token from the cli
Trying to make an anonymous token:
$ arv api_client_authorization create --api-client-authorization='{"scopes":["G...
Ward Vandewege
03:49 pm Feature #4343 (New): [SDKs] arv create needs --project-uuid and --name parameters for appropriate...
this way, we wouldn't have to go through home, find the template and put it into the project.
We can run arv creat...
Bryan Cosca
03:45 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Peter Amstutz wrote:
> Tom Clegg wrote:
> > The first thing I did was "all jobs" &rarr; a job &rarr; clicked on a f...
Tom Clegg
03:44 pm Revision 9d5b7d2e (arvados): Batch of improvements for the manual installation documentation:
* add prerequisites section
* add shell server section
* add keepproxy section
* many other updates throughout
refs ...
Ward Vandewege
03:43 pm Revision 92860ee8 (arvados): Merge branch 'master' into 4186-install-doc-improvements
Ward Vandewege
03:40 pm Revision 1edad4ad (arvados): 4088: filter only on files
Only apply the regex filter to files; continue to process subdirectories
as normal in order to keep the appropriate f...
Tim Pierce
03:39 pm Revision c10b68e9 (arvados): 3618: Make tests pass: bugs were revealed in "Other objects" tab rel...
Phil Hodgson
03:37 pm Support #4186 (In Progress): [Documentation] Install documentation improvements
Ward Vandewege
03:31 pm Task #4320 (Resolved): Remember sort order when switching tabs
Phil Hodgson
03:30 pm Task #4341 (In Progress): Make the manual installation documentation more complete.
Ward Vandewege
03:29 pm Task #4341 (Resolved): Make the manual installation documentation more complete.
Ward Vandewege
03:19 pm Revision 55099743 (arvados): 4088: fix alignment for right-floating input field
Tim Pierce
03:02 pm Bug #4334: [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* SLURM state
Last night, we encountered on an issue on qr1hi where SLURM was reporting nodes as idle* when they were actually down... Brett Smith
02:52 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
Reviewing commit:4d257ed
* I think the regexps that search for Collection UUIDs and portable data hashes should be...
Brett Smith
02:24 pm Bug #4339 (Resolved): [Workbench] Add test for "error while loading tab" iframe. See #4084
Tom Clegg
11:21 am Revision 9f37a732 (arvados): Merge branch 'master' into 3618-column-ordering
Phil Hodgson
11:20 am Revision 9ad6d61c (arvados): 3618: store in the browser history state the current sort settings f...
Phil Hodgson
03:12 am Revision d06e68ae (arvados): Workbench: Change from yui to uglifier to compress javascript in
config/environments/production.rb.example
No issue #
Ward Vandewege
02:27 am Revision 89ba1124 (arvados): Improve config/application.yml.example for the API server and workbe...
* API server: define prefix_uuid in development mode
* workbench: add a production section
No issue #
Ward Vandewege

10/28/2014

09:29 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
New revision at commit:f549c9f
Brett Smith wrote:
> Reviewing commit:e34135f677
>
> * I know the story specifi...
Tim Pierce
07:23 pm Feature #4088: [Workbench] On collections#show page, filter displayed files by filename regexp, a...
Reviewing commit:e34135f677
* I know the story specifies this, so it's not on you, but I'll throw it out there: I'...
Brett Smith
02:45 pm Feature #4088 (In Progress): [Workbench] On collections#show page, filter displayed files by file...
Tim Pierce
09:26 pm Revision f549c9f0 (arvados): 4088: code review feedback
* Filter files by regex before .take(10000)
* Added "regular expression" placeholder in the filter input box
* Issue ...
Tim Pierce
09:16 pm Bug #4336 (Resolved): [Documentation] Improve the 'Upload data to Keep' documentation page at htt...

* Update screenshot
* Update arv-put output (it returns a collection now)
* Remove the bit about downloading a fi...
Ward Vandewege
09:03 pm Bug #4335 (Closed): [Crunch] Improve node startup speed. 15 min is too slow.
It can take up to 15 minutes for a node to appear when a new job is queued. See if we can reduce that. Some of this t... Ward Vandewege
08:05 pm Revision c4aefe62 (arvados): 4031: Test for collection provenance/used_by
Peter Amstutz
08:02 pm Task #4333 (In Progress): Review 4031-fix-graph-connections
Brett Smith
06:21 pm Task #4333 (Resolved): Review 4031-fix-graph-connections
Peter Amstutz
07:49 pm Bug #4334 (Resolved): [Crunch] crunch-dispatch should not allocate Jobs to nodes in the idle* SLU...
In SLURM, "state*" means "the node was last known to be in state, but I haven't heard from it in a while." Currently... Brett Smith
07:41 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
Tom Clegg wrote:
> The first thing I did was "all jobs" &rarr; a job &rarr; clicked on a few tabs, and the Provenanc...
Peter Amstutz
06:10 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
The first thing I did was "all jobs" &rarr; a job &rarr; clicked on a few tabs, and the Provenance page showed a "rel... Tom Clegg
07:36 pm Revision 31e1d10e (arvados): Merge remote-tracking branch 'origin/master' into 4084-log-pane-refresh
Peter Amstutz
07:36 pm Revision ab874e9d (arvados): 4084: Split out behavior of updating job subscribe list to
arv-log-event-subscribe-to-pipeline-job-uuids. Fix arv:pane:reload
setTimeout() that was missing a timeout. Rename ...
Peter Amstutz
07:09 pm Bug #4031: [Workbench] Nodes should be connected via input=output in provenance/used by graphs
This one got away from me a little bit. The code had bit rotted pretty badly and was broken in a number of ways, so ... Peter Amstutz
06:21 pm Task #4143 (In Progress): Write tests
Peter Amstutz
06:21 pm Task #4142 (In Progress): Diagnose and fix
Peter Amstutz
06:18 pm Revision 4d257edd (arvados): 4031: Find for collection dependencies even in the middle of script ...
fields. Server side collections with same PDH into a single entry with a
special name. Fix node descriptions, hyper...
Peter Amstutz
05:50 pm Task #4332 (In Progress): Review 4088-collection-show-files-filter
Brett Smith
03:18 pm Task #4332 (Resolved): Review 4088-collection-show-files-filter
Tim Pierce
05:32 pm Revision 2d244def (arvados): Fix off-by-one error in Node Manager server calculations.
This bug prevented Node Manager from starting nodes for a job that
requested a number of nodes equal to the daemon's ...
Brett Smith
05:28 pm Task #4326: Review branch: 4091-test-infinite-scrolling
Updated per your feedback. Please take another look. Thanks. Radhika Chippada
01:47 pm Task #4326 (In Progress): Review branch: 4091-test-infinite-scrolling
Tom Clegg
05:21 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
I got the hash job to run correctly inside a Docker container inside my Docker cluster. That's pretty awesome. Than... Brett Smith
02:01 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Tom Clegg wrote:
> Brett Smith wrote:
> > * If you want to elucidate the comment about TASK_KEEPMOUNT: you may want...
Brett Smith
05:51 am Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> When I click the log in button, I land on a page at https://172.17.0.117/auth/joshid/callback?r...
Tom Clegg
05:44 am Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> I'm working on building all the Docker infrastructure necessary to test this, but while I do, I...
Tom Clegg
05:16 pm Revision fb2ee403 (arvados): 4091: update jobs fixture to set same created_at timestamp for some ...
Radhika Chippada
04:18 pm Revision cbc29982 (arvados): 4091: enhance code to handle the case where there are more than one ...
Also, handle the case where the entire next page has the same created_at time as the previous page's last item; to ke... Radhika Chippada
03:16 pm Revision e34135f6 (arvados): 4088: filter collection file view by regex
Added a "Filter" field for supplying a regular expression to filter
filenames. Updated integration tests.
Tim Pierce
02:59 pm Revision 81bb05b5 (arvados): 3824: Remove redundant addition of arvados package repo and key.
Tom Clegg
02:44 pm Task #4206 (In Progress): write workbench tests
Tim Pierce
02:44 pm Task #4204 (In Progress): Add regex box and filter to app/views/collections/_show_files.html.erb
Tim Pierce
02:35 pm Revision f78b6578 (arvados): 3824: Add sources.list file missing from commit:0f9aaf1
Tom Clegg
02:24 pm Story #4091: [Workbench] Add tests for undertested parts of Workbench, including infinite scroll.
At commit:97f3db9
I think the approach is correct here: if the sort key isn't always unique, get an overlapping pa...
Tom Clegg
01:52 pm Revision 6e2ba4de (arvados): Merge branch '4291-collection-sharing-link-refresh-issue' of git.cur...
Radhika Chippada
01:50 pm Bug #4297 (Feedback): [Crunch] crunch-dispatch eats way too much cpu
Tom Clegg
01:50 pm Revision 36195687 (arvados): 4291: update to address the refrsh issue as suggested in this Stack ...
http://stackoverflow.com/questions/6560592/rails-3-ajax-update-partial-doesnt-work-without-page-refresh Radhika Chippada
01:44 pm Task #4330 (In Progress): Review branch: 4291-collection-sharing-link-refresh-issue
Tom Clegg
01:26 pm Task #4330 (Closed): Review branch: 4291-collection-sharing-link-refresh-issue
Just one line change. Radhika Chippada
01:44 pm Bug #4291: [Workbench] Create sharing link for a collection is broken
commit:5bd0cf6 doesn't look very convincing to me. If the trouble were excess quoting, would this really cause "fail ... Tom Clegg
01:25 pm Bug #4291 (In Progress): [Workbench] Create sharing link for a collection is broken
Radhika Chippada
01:30 pm Task #4331 (Resolved): Add infinite scrolling to pipeline_instances page.
Radhika Chippada
01:28 pm Feature #4024 (In Progress): [Workbench] PipelineInstances#index should scroll down to show older...
Radhika Chippada
01:24 pm Task #4329 (Resolved): Sort order created_at being ignored by the server
Radhika Chippada
01:20 pm Task #4328 (Resolved): Data collections tab for a project displaying all object types.
Radhika Chippada
01:09 pm Task #4328 (Resolved): Data collections tab for a project displaying all object types.
It would be easiest to see this in action in bcosc's Home project. Radhika Chippada
01:03 pm Task #4320 (In Progress): Remember sort order when switching tabs
Phil Hodgson
12:56 pm Revision 5bd0cf6c (arvados): 4291: update to address the refrsh issue
Radhika Chippada
10:54 am Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thanks for the great feedback.
* The "raw" rendering of database columns: apologies for wasting our energy; this w...
Phil Hodgson
10:48 am Revision d0e60c70 (arvados): 3618: remove unnecessary "raw" directive for the sort columns table ...
Phil Hodgson
05:06 am Revision fb1bf9fd (arvados): 3824: Fix up logging messages.
Tom Clegg
03:13 am Task #4304 (Resolved): Review 4015-collection-chooser-portable-data-hash
Tim Pierce
02:24 am Revision 2b6948ff (arvados): 3706: Merge branch 'master' into 3706-keep-warning
Tom Clegg
02:20 am Revision 8323e56e (arvados): 3706: Remove automatic normalization. Add --normalize option to
arv-put. Add normalize() and stripped_manifest() methods to
CollectionReader. Clean up normalize code.
Tom Clegg
02:12 am Revision 112d6ce9 (arvados): 3706: Consolidate more regular expressions into util package.
Tom Clegg
02:08 am Revision d9e2eb19 (arvados): 3706: Do not leave zero-length file segment at end of stream after f...
Tom Clegg
02:04 am Revision 6817b34d (arvados): 3706: In CollectionReader, try fetching manifests before/after API
server when the ID is a Keep locator with/without a permission hint
respectively. Do not display a warning if the man...
Tom Clegg

10/27/2014

09:29 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
Brett Smith wrote:
> I'm working on building all the Docker infrastructure necessary to test this, but while I do, I...
Brett Smith
07:44 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
I'm working on building all the Docker infrastructure necessary to test this, but while I do, I wanted to provide my ... Brett Smith
04:42 pm Bug #3824: [Crunch] crunch-job should create task execution environment inside docker container, ...
3824-crunch-container-setup @ commit:30bdc9b
* JOB_WORK and TASK_WORK are docker data volumes, instead of bind mou...
Tom Clegg
09:04 pm Revision 6d23c296 (arvados): 4031: Refresh provenance helper graph generation to fix bugs and mak...
use of available human readable names such as collections and components. Added tests. Peter Amstutz
08:45 pm Task #4326 (Resolved): Review branch: 4091-test-infinite-scrolling
I think infinite scrolling is working now. Radhika Chippada
08:44 pm Story #4091: [Workbench] Add tests for undertested parts of Workbench, including infinite scroll.
Updated API server groups_controller to order on created_at time instead of uuid. This seems to have helped with the ... Radhika Chippada
08:38 pm Revision 97f3db9c (arvados): 4091: retain filters in project contents collections and similar tabs.
Radhika Chippada
08:24 pm Revision e1020f4a (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
08:23 pm Revision 337a0bdb (arvados): 4091: change project contents order from uuid to created_at.
Radhika Chippada
08:15 pm Bug #4015 (Resolved): [Workbench] Collection chooser should be filling in portable_data_hash as w...
Applied in changeset arvados|commit:846ac5d419862e2b0051ec0843e71c601b35da44. Tim Pierce
07:51 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
Tim, thanks for updating. The tests are much better and feel like they are doing it all in a flow now. Thanks. Radhika Chippada
07:41 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
Followup question from Radhika:
> I could be wrong, but I could not find anything special in the new collection and ...
Tim Pierce
06:05 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
Radhika Chippada wrote:
> I only have some comments about the tests.
>
> * pipeline_instances_test.rb
>
> Plea...
Tim Pierce
05:38 pm Bug #4015: [Workbench] Collection chooser should be filling in portable_data_hash as well as coll...
I only have some comments about the tests.
* pipeline_instances_test.rb
Please remove “from” in “Create a pipel...
Radhika Chippada
08:13 pm Revision 846ac5d4 (arvados): Merge branch '4015-collection-chooser-portable-data-hash'
Fixes #4015. Tim Pierce
07:49 pm Revision f923effe (arvados): 4015: update FUSE mount tests (again)
Tim Pierce
07:37 pm Revision fff7228b (arvados): 4015: simplify integration tests
Responding to code review in #4015-8:
We can (and should) test that the collection portable_data_hash is
recorded in...
Tim Pierce
05:46 pm Revision c330d589 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
05:39 pm Task #4304 (In Progress): Review 4015-collection-chooser-portable-data-hash
Radhika Chippada
05:36 pm Story #3706 (In Progress): [SDKs] Remove fallback-to-keep warning from python SDK if block hash h...
Tom Clegg
05:36 pm Task #4323 (Resolved): Review 4297-dispatch-load
Tom Clegg
03:05 pm Task #4323 (In Progress): Review 4297-dispatch-load
Brett Smith
02:38 pm Task #4323 (Resolved): Review 4297-dispatch-load
Tom Clegg
05:35 pm Revision e68bf42e (arvados): Merge branch '4297-dispatch-load' refs #4297
Tom Clegg
05:35 pm Revision 47853db9 (arvados): 3706: Silence fallback-to-keep warning, show both errors (API and Ke...
Tom Clegg
05:32 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
Tom Clegg wrote:
> Brett Smith wrote:
> > Now, more philosophically: these changes make crunch-dispatch more respon...
Brett Smith
05:19 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
Brett Smith wrote:
> Reviewing commit:789e479
>
> On the code itself:
>
> * @fail_job@ uses @rescue@ to detect...
Tom Clegg
04:15 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
Reviewing commit:789e479
On the code itself:
* @fail_job@ uses @rescue@ to detect when Log creation fails, but ...
Brett Smith
05:00 pm Task #4325 (In Progress): Review 3824-crunch-container-setup
Brett Smith
04:43 pm Task #4325 (Resolved): Review 3824-crunch-container-setup
Tom Clegg
04:54 pm Revision 8c492b39 (arvados): 4297: Merge branch 'master' into 4297-dispatch-load
Tom Clegg
04:53 pm Revision af2ca91d (arvados): 4297: Rename @have_tags -> @job_tags, @have_commits -> @fetched_comm...
Tom Clegg
04:52 pm Revision 2776ad1b (arvados): 4297: Use save! instead of save to ensure failures get logged.
Tom Clegg
04:13 pm Revision c79874f4 (arvados): 3824: Do not say "There are jobs in the queue ahead of this one" if...
Tom Clegg
04:13 pm Revision 30bdc9b4 (arvados): 3824: Use keep volumes big enough to store the arvados/jobs docker i...
Tom Clegg
04:13 pm Revision c0943b24 (arvados): 3824: Add dnsmasq to compute images, to make docker-in-docker work. ...
Tom Clegg
04:13 pm Revision 0f9aaf18 (arvados): 3824: Use a docker volume for TASK_WORK, clean up env var and tmp di...
Tom Clegg
04:02 pm Bug #4324 (New): [Docker] Fix supervisor.conf to supervise services instead of running init.d sta...
Tom Clegg
03:44 pm Bug #4249 (Resolved): [Workbench] Can't view/download files that are retrievable from arv-get
Resolved by #4285 Radhika Chippada
03:40 pm Bug #4285 (Resolved): [Workbench] Not found error when the view or download icons are clicked for...
Applied in changeset arvados|commit:a3db87c5a23f3a1e72ea82304d24db8c1757c095. Radhika Chippada
03:39 pm Bug #4285: [Workbench] Not found error when the view or download icons are clicked for a file in ...
Thanks Brett. I updated accordingly. Radhika Chippada
03:04 pm Bug #4285: [Workbench] Not found error when the view or download icons are clicked for a file in ...
Reviewing commit:f1eb092
I suggest writing the main fix as...
Brett Smith
03:39 pm Task #4319 (Resolved): Review branch: 4285-view-download-collection-subdir-files
Radhika Chippada
02:50 pm Task #4319 (In Progress): Review branch: 4285-view-download-collection-subdir-files
Brett Smith
03:38 pm Revision a3db87c5 (arvados): closes #4285
Merge branch '4285-view-download-collection-subdir-files' Radhika Chippada
03:36 pm Bug #3978: [SDKs] Pipelines started from the CLI should set status to "Paused" when aborted
This looks like commit:8dea7244cf5e50b9fa70bec15b1db3fd2cdd03bf should have already implemented this.
If it is sti...
Tim Pierce
03:28 pm Revision 6ed15992 (arvados): 4285: use regexp to prepent ./ to file path
Radhika Chippada
03:02 pm Revision e7489357 (arvados): 3824: Do not say "There are jobs in the queue ahead of this one" if...
Tom Clegg
03:02 pm Revision 3569bc7d (arvados): 3824: Add dnsmasq to compute images, to make docker-in-docker work. ...
Tom Clegg
03:02 pm Revision 68402362 (arvados): 3824: Use keep volumes big enough to store the arvados/jobs docker i...
Tom Clegg
03:02 pm Revision 66bf1aa3 (arvados): 3824: Use a docker volume for TASK_WORK, clean up env var and tmp di...
Tom Clegg
02:41 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Phil Hodgson wrote:
> * Switching tabs causes refresh: this is true and I tend to agree, but the problem is not due ...
Brett Smith
02:37 pm Story #3609: [SDKs] arv-run wrapper to interactively submit 'run-command' jobs
Review @ commit:0edcc26f:
@sdk/python/arvados/commands/run.py@
* The @slots@ stuff was really confusing to me, an...
Tim Pierce
02:31 pm Bug #4291: [Workbench] Create sharing link for a collection is broken
Tried this using bcosc's account. The sharing link IS created and the link works as well. However, the the page does ... Radhika Chippada
02:16 pm Task #4263 (Resolved): Review 4058-workbench-collection-redirect
Peter Amstutz
02:15 pm Task #4301 (Resolved): Review 4295-efficient-websockets
Peter Amstutz
02:10 pm Task #4322 (Resolved): [Node Manager] Should not pair cloud and Arvados nodes immediately after b...
The development of Node Manager went like this:
* First, it immediately paired cloud and Arvados nodes when bootin...
Brett Smith
02:02 pm Task #4321 (New): [SDK] PySDK should arrange exit(111) when a temporary failure exception is unca...
By default, Python exits 1 when there's any uncaught exception. We should introspect these for exceptions that repre... Brett Smith
01:30 pm Revision d5caf622 (arvados): 3603: Improve StreamFileReader.readline() readability.
Brett Smith
01:23 pm Revision 55a92a21 (arvados): 3603: Improve Collection.open signatures and document.
Brett Smith
01:04 pm Revision aec1913f (arvados): 3603: Remove duplicate stream tests from test_collections.
Brett Smith
01:01 pm Revision deeb84da (arvados): 3603: Style improvements.
* Rename util.splitstream to stream.split, and make the signature more
like os.path.split.
* NameAttribute becomes ...
Brett Smith

10/26/2014

12:32 pm Task #4173 (New): Review 3618
Phil Hodgson
12:31 pm Task #4320 (Resolved): Remember sort order when switching tabs
Or, I would propose, at least when using the Browser back (as in #3634), using URL rewriting that would include the s... Phil Hodgson
12:29 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
The "description" columns in the various Project tabs, I'm discovering, are a bit strange, in that they do not seem t... Phil Hodgson
12:25 pm Revision 6bfa1307 (arvados): 3618: best guesses about which database columns could be used for so...
Phil Hodgson
12:24 pm Revision 37b76527 (arvados): 3618: When changing to sorting on a different column, make sure the ...
Phil Hodgson

10/25/2014

06:57 pm Revision 6ad6190f (arvados): 3618: Add Workbench integration test for sorting data collections
Phil Hodgson
06:56 pm Revision fd1613bf (arvados): 3618: correctly propagate the ordering parameters when scrolling
Phil Hodgson
02:09 pm Task #4319 (Resolved): Review branch: 4285-view-download-collection-subdir-files
Radhika Chippada
02:01 pm Revision f1eb092c (arvados): 4285: prepend './' to file path being retrieved when it is in a subd...
Radhika Chippada
08:18 am Revision f7a0b413 (arvados): 3618: Add some basic API server tests for the sort feature
Phil Hodgson
08:17 am Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
Thinking further about the @sortable_columns@ hash in Workbench, I wonder if we shouldn't more strongly consider havi... Phil Hodgson
02:04 am Bug #4313 (Resolved): [Tests] remove stale *.pyc files between Jenkins tests
Ward Vandewege
02:01 am Revision e71be835 (arvados-dev): Clean up *.pyc files between tests.
closes #4313 Ward Vandewege
02:01 am Revision e71be835 (arvados): Clean up *.pyc files between tests.
closes #4313 Ward Vandewege
01:01 am Revision 35ae6cc3 (arvados): 3603: Use endswith since I'm changing these lines anyway.
Brett Smith

10/24/2014

11:17 pm Revision 42beb8f6 (arvados): 3603: Fixup cruft I added during development.
Brett Smith
10:09 pm Revision 6527508b (arvados): 3603: Fix up duplicate readlines() in StreamFileReader.
Brett Smith
09:38 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
3603-pysdk-file-api-wip is up for review. It adds open() methods to CollectionReader and CollectionWriter that act l... Brett Smith
09:37 pm Story #4316 (Resolved): Review 3603-pysdk-file-api-wip
Brett Smith
09:24 pm Revision 2fcc2134 (arvados): 3603: Clean up PySDK imports.
Sort; remove unused imports. Brett Smith
09:24 pm Revision 5fa3808d (arvados): 3603: PySDK Collection objects support file-like APIs.
This commit adds an open() method to CollectionReader and
CollectionWriter. They mimic the built-in open(), returnin...
Brett Smith
09:24 pm Revision 824b37d6 (arvados): 3603: Fix context methods for PySDK Collection objects.
Brett Smith
08:27 pm Bug #4314 (Resolved): [Crunch] Figure out why this job was marked Failed unexpectedly
examples: qr1hi-8i9sb-cha7spydhjauvvq qr1hi-8i9sb-w5hjmuq7vicng11 qr1hi-8i9sb-vt7mb676a4htd6k
They seemed to have ...
Bryan Cosca
08:06 pm Revision 32aa86dd (arvados-dev): Clean up *.pyc files between tests.
closes #4313 Ward Vandewege
07:01 pm Revision 3a47eb91 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
07:00 pm Revision 4e148ec9 (arvados): 4091: add offset to next page url
Radhika Chippada
06:45 pm Revision ffea5372 (arvados-dev): 4313: remove stale *.pyc files
Tim Pierce
06:44 pm Bug #4313 (Resolved): [Tests] remove stale *.pyc files between Jenkins tests
Before a Jenkins test or install of the Python SDK, remove any leftover *.pyc files from a previous build. Tim Pierce
06:29 pm Story #4312 (Resolved): [Crunch] crunch-job should report current Python SDK version at start of ...
In the epic command line crunch-job uses to start each task, add something like... Tom Clegg
06:26 pm Bug #3486: [DRAFT] [Crunch] Cannot have script parameter value of "false" because arv-run-pipelin...
Check whether this can be resolved like so:... Tom Clegg
06:09 pm Bug #4015 (In Progress): [Workbench] Collection chooser should be filling in portable_data_hash a...
Ward Vandewege
06:08 pm Support #4134 (In Progress): [Support] fix bugs and write tests (second half)
Ward Vandewege
06:08 pm Bug #4031 (In Progress): [Workbench] Nodes should be connected via input=output in provenance/use...
Peter Amstutz
05:58 pm Revision ef56ac56 (arvados): Merge branch '3699-arv-copy'
Refs #3699. Tim Pierce
05:57 pm Revision fb01e304 (arvados): 3699: fix namespace clash: rename module to arv_copy
Prevents confusion with the Python 'copy' module.
No issue # (bug fix)
Tim Pierce
05:54 pm Bug #4185 (Feedback): [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Tom Clegg
05:53 pm Bug #4185: [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Added "swap" to crunchstat memory stats, to help expose low-memory conditions. ("pgmajfault" was also added, in #3826... Tom Clegg
05:51 pm Bug #4185 (In Progress): [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Tom Clegg
05:43 pm Feature #3618: [Workbench] In project view, sort results in the collections (and other) tab by cl...
* Switching tabs causes refresh: this is true and I tend to agree, but the problem is not due to this feature additio... Phil Hodgson
05:40 pm Revision c5f31bd6 (arvados): 3618: replace js use of == and != with the more predictable === and !==
Phil Hodgson
05:33 pm Bug #4310 (Resolved): [Crunch] crunch-dispatch --jobs locking is broken
[Crunch] qr1hi-d1hrv-xg61rrhrxctnjrb failed with 'state invalid change from Failed to Complete'
We have 2 crunch-d...
Ward Vandewege
05:29 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
I transferred an entire pipeline instance from qr1hi and it ran on my workstation with no changes. Merge this thing! Peter Amstutz
05:25 pm Story #3699 (Resolved): [SDKs] Copy a pipeline instance, along with its input and output data, fr...
Applied in changeset arvados|commit:35ade8a042094a27e2ca5cfd5e9754aa3513410c. Tim Pierce
03:41 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Peter Amstutz wrote:
> When you're copying a pipeline instance that's been run already, the docker image will have b...
Tim Pierce
03:10 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
When you're copying a pipeline instance that's been run already, the docker image will have been resolved into an exp... Peter Amstutz
05:25 pm Task #3838 (Resolved): Review 3699-arv-copy
Tim Pierce
05:21 pm Bug #4309 (New): [SDK] arv-copy collection copy performance
Originally https://arvados.org/issues/3699#note-43
I'm copying a pipeline with a 5990M collection. I noticed this...
Peter Amstutz
05:20 pm Bug #4249 (In Progress): [Workbench] Can't view/download files that are retrievable from arv-get
Tom Clegg
05:20 pm Revision 35ade8a0 (arvados): Merge branch '3699-arv-copy'
Closes #3699. Tim Pierce
05:19 pm Bug #4285 (In Progress): [Workbench] Not found error when the view or download icons are clicked ...
Tom Clegg
05:11 pm Bug #4297 (In Progress): [Crunch] crunch-dispatch eats way too much cpu
Ward Vandewege
03:30 pm Story #4305: [Node Manager] Investigate and try to address RAM use
Another idea that occurred to me: arvnodeman.computenode.ec2 loads information about node sizes, images, security gro... Brett Smith
03:19 pm Story #4308 (Closed): [API] [SDKs] Enable API versioning
Increasingly we're running into the problem where the SDK is written against an older version of the API that turns o... Peter Amstutz
02:19 pm Revision 2c16f4fb (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada
02:17 pm Revision c1efd42b (arvados): 4091: adjust the test fixture to use less data to match the limit si...
Radhika Chippada
02:13 pm Revision 0862d720 (arvados): Increase the timeout on "lots of events" websocket test. refs #4295
Peter Amstutz
01:57 pm Bug #4307 (Resolved): [Workbench] Pipeline instance name text should be editable after the instan...
I thought this used to be able to work but now I can't edit it? For example: pipeline_instances/qr1hi-d1hrv-b8ubha43x... Bryan Cosca
01:56 pm Task #4306 (Resolved): [API] "All users" group needs group_class: role
The instructions for adding the "All users" class should include specifying "group_class":"role", otherwise the "all ... Peter Amstutz
01:35 pm Feature #4051 (Rejected): [Workbench] Pipeline component display order should be controlled by so...
Duplicate. Moved over to #2992 Peter Amstutz
01:18 pm Bug #3824 (In Progress): [Crunch] crunch-job should create task execution environment inside dock...
Tom Clegg
01:18 pm Task #4225 (Resolved): Review 3826-crunchstat-netstats -- esp for language issues
Tom Clegg
01:05 pm Bug #4295 (Resolved): [API] Improve websocket efficiency
Applied in changeset arvados|commit:cf1097ef1225c05eb4431093a4971739a3ee5a37. Anonymous
01:03 pm Revision cf1097ef (arvados): Merge branch '4295-efficient-websockets' closes #4295
Peter Amstutz
01:02 pm Revision 563b588d (arvados): 4295: Use EventMachine::schedule when there is potentially more even...
Peter Amstutz
12:47 pm Revision e3fe23ff (arvados): 4295: Fix typo in comment
Peter Amstutz
12:06 pm Revision 66c13b60 (arvados): Merge branch 'master' into 3618-column-ordering
Phil Hodgson
10:10 am Revision 1bde97d8 (arvados): Merge branch 'master' into 4091-test-infinite-scrolling
Radhika Chippada

10/23/2014

10:49 pm Task #4210 (Resolved): populate portable_data_hash in the collection chooser
Tim Pierce
10:35 pm Revision 87b2e5da (arvados): Merge branch 'master' into 4015-collection-chooser-portable-data-hash
Tim Pierce
10:34 pm Revision 7086db26 (arvados): 4015: fix pipeline instance tests
Tim Pierce
10:05 pm Bug #4195 (Resolved): [Documentation] Fix Workbench pipeline tutorial
Applied in changeset arvados|commit:587fcc936d7b5b0b8c16220a5932cf9441e02ab0. Radhika Chippada
05:11 pm Bug #4195: [Documentation] Fix Workbench pipeline tutorial
* The screenshot on user/getting_started/workbench.html is out of date
* (step 9) Finished jobs are now labeled "com...
Peter Amstutz
10:02 pm Task #4280 (Resolved): Review branch: 4195-pipeline-tutorial
Radhika Chippada
04:59 pm Task #4280 (In Progress): Review branch: 4195-pipeline-tutorial
Peter Amstutz
10:01 pm Revision 587fcc93 (arvados): closes #4195
Merge branch '4195-pipeline-tutorial' Radhika Chippada
10:00 pm Revision 6a406787 (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
09:59 pm Revision 35804515 (arvados): 4195: update workbench dashboard pic
Radhika Chippada
09:44 pm Bug #4295: [API] Improve websocket efficiency
Reviewing commit:de3bb6c. There's a small typo in your comments for @push_events@ where it says "it may nil" (missin... Brett Smith
07:53 pm Bug #4295 (In Progress): [API] Improve websocket efficiency
Peter Amstutz
06:11 pm Bug #4295: [API] Improve websocket efficiency
puma also shouldn't recover from out of memory conditions, it should just die. That way runit will restart it.
<pr...
Ward Vandewege
05:54 pm Bug #4295 (Resolved): [API] Improve websocket efficiency
* "logs.id > ?" condition is open ended. This should have a limit and schedule more work if necessary.
* Should loo...
Peter Amstutz
09:32 pm Revision 016ecd4c (arvados): Merge branch '4186-install-doc-improvements'
refs #4186 Ward Vandewege
09:31 pm Revision 091d56d4 (arvados): Merge branch 'master' into 4186-install-doc-improvements
Ward Vandewege
09:25 pm Bug #4228 (Resolved): [Workbench (probably)] Cannot create new collection with selected files in ...
Applied in changeset arvados|commit:fcfd4428e2889ceb847b64b0819207c421de1abd. Radhika Chippada
08:46 pm Bug #4228: [Workbench (probably)] Cannot create new collection with selected files in shared pipe...
Do we want to add a test? Otherwise this looks good to me. Peter Amstutz
02:00 pm Bug #4228 (In Progress): [Workbench (probably)] Cannot create new collection with selected files ...
Radhika Chippada
09:24 pm Revision 22db612b (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
09:24 pm Task #4287 (Resolved): Review branch: 4228-collection-subdir-files
Radhika Chippada
05:14 pm Task #4287 (In Progress): Review branch: 4228-collection-subdir-files
Peter Amstutz
09:23 pm Revision fcfd4428 (arvados): closes #4228
Merge branch '4228-collection-subdir-files' Radhika Chippada
09:16 pm Task #4301 (In Progress): Review 4295-efficient-websockets
Brett Smith
07:52 pm Task #4301 (Resolved): Review 4295-efficient-websockets
Peter Amstutz
09:09 pm Story #4305 (Closed): [Node Manager] Investigate and try to address RAM use
Node Manager uses ~1GiB of RAM on our production clusters. Investigate why it's so large, and try to bring it down.
...
Brett Smith
09:05 pm Task #4304 (Resolved): Review 4015-collection-chooser-portable-data-hash
Ready for review @ commit:87b2e5d, including tests and updated fixtures. Tim Pierce
09:03 pm Revision ae4948ee (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
09:02 pm Revision 140012f1 (arvados): 4015: test recording collection hashes for pipeline inputs
Tim Pierce
09:02 pm Revision 4a774fdb (arvados): 4015: use portable_data_hash to populate chooser
Tim Pierce
09:00 pm Bug #4256: [API] Jobs that sit in the front of the queue for a long time without running should b...
The fiddlesticks error is covered in #4273. This ticket is now specifically about jobs sitting in the queue for a lo... Peter Amstutz
08:58 pm Revision 95b0d814 (arvados): Add install dependencies for the SSO server.
refs #4186 Ward Vandewege
08:52 pm Revision 7149ee5d (arvados): Merge branch 'master' into 4228-collection-subdir-files
Conflicts:
apps/workbench/test/integration/collections_test.rb
Radhika Chippada
08:36 pm Revision 1ed38089 (arvados): refs #4227
Merge branch '4227-test-fix' Radhika Chippada
08:30 pm Bug #4303 (Resolved): [Crunch] Output of job gets stuck at collate step
This job (qr1hi-8i9sb-56vgstlp2wk56vn) ran for ~6h and while watching the logs it seemed to have stalled towards its ... Bryan Cosca
08:29 pm Revision 0311a59f (arvados): Explain the Keepstore's -permission-key-file argument and API server's
blob_signing_key configuration value.
refs #4186
Ward Vandewege
08:29 pm Revision 34471863 (arvados): no issue #
Radhika Chippada
08:26 pm Feature #4302 (New): [Crunch] Pipelines should not fail immediately after one job failure, but co...
The current pipeline running model very linear:
If A > B > C > D (the output of a is needed to run b, etc). if B fai...
Bryan Cosca
08:26 pm Revision 1a20f5f5 (arvados): no issue #
Merge branch 'master' of git.curoverse.com:arvados Radhika Chippada
08:22 pm Revision 4265a54a (arvados): refs #4227 - update strptime format for parsing pipeline start and f...
Radhika Chippada
08:22 pm Revision de3bb6cb (arvados): 4295: Abort on NoMemoryError
Peter Amstutz
07:59 pm Revision 93ffb7c3 (arvados): First set of improvements:
* Suggest skipping SSO server installation for now, until we upgrade that codebase
* Be more explicit about the desi...
Ward Vandewege
07:55 pm Bug #4266 (Resolved): [Crunch] crunch-dispatch should process logs efficiently, particularly whil...
Tom Clegg
07:55 pm Task #4272 (Resolved): Review 4266-log-performance
Tom Clegg
07:54 pm Task #4283 (In Progress): Make test case
Tom Clegg
07:54 pm Task #4282 (Resolved): Create/setup task temp dirs at runtime
Tom Clegg
07:52 pm Revision fdaaff31 (arvados): 4295: Add test that large numbers of events are handled efficiently ...
Peter Amstutz
07:45 pm Revision 9feeea12 (arvados): Merge branch '4139-clean-api-node-cruft-wip'
Refs #4139, #4274. Closes #4276. Brett Smith
07:44 pm Revision 91738b3c (arvados): 4139: Remove cloud node setup code from API server.
This code has never been used in production, and its functionality has
officially been assumed by Node Manager.
Brett Smith
07:44 pm Revision 351895cf (arvados): 4139: Node create API requires a node parameter.
This makes it more consistent with other API create methods. Brett Smith
07:41 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
4297-dispatch-load @ commit:789e479
* Don't refresh node status more than once per second
* Cache api tokens, don...
Tom Clegg
06:32 pm Bug #4297: [Crunch] crunch-dispatch eats way too much cpu
crunch-dispatch in --jobs mode eats way to much cpu. The ps output below has 2 ruby processess owned by root. Those a... Ward Vandewege
06:20 pm Bug #4297 (Resolved): [Crunch] crunch-dispatch eats way too much cpu
Ward Vandewege
07:39 pm Revision 789e4799 (arvados): 4297: Cache results of git-fetch-pack, git-tag, and API token
creation. Fail jobs on git repo/version failures instead of retrying
forever.
Tom Clegg
07:37 pm Revision ea80735a (arvados): refs #4227 - rescue from any error in parsing pipeline start and fin...
Radhika Chippada
07:36 pm Revision a3ba50fd (arvados): 4139: Node create API requires a node parameter.
This makes it more consistent with other API create methods. Brett Smith
07:29 pm Revision 21ccdae7 (arvados): 4295: Fixed tests
Peter Amstutz
07:22 pm Revision 74e7f636 (arvados): 4295: First pass at more efficient database utilization. A few test...
Peter Amstutz
07:05 pm Story #4299 (Rejected): [Node Manager] Support a configurable throttle for creating cloud nodes
You should be able to specify that the daemon should not create more than N cloud nodes in T duration of time. The d... Brett Smith
06:58 pm Bug #4298 (Resolved): [Workbench] Admin user should see cpu/ram/scratch capacity after clicking a...
The values are blank. I verified that the node records do have the correct information. Ward Vandewege
06:53 pm Revision 21d67203 (arvados): 4297: Do not update_node_status more than once per second.
Tom Clegg
05:55 pm Bug #4296 (Resolved): [SSO] 500 from a fresh login
Steps to reproduce:
# Start with a new browser session. No cookies, etc.
# Visit workbench.qr1hi.
# Click "Log ...
Brett Smith
05:53 pm Revision 2def2025 (arvados): Increase limit for collections controller querying same portable_dat...
workaround to fix tests, refs #4058, but really needs a proper fix, refs #3400 Peter Amstutz
05:46 pm Story #4294 (Resolved): [Node Manager] Add support for min_nodes configuration value
When the daemon gets a new list of cloud nodes, if the total count of nodes is less than min_nodes, it should start o... Brett Smith
05:43 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Okay: at commit:e845145 this code uses @arvados.commands.keepdocker.list_images_in_arv@ to identify which docker imag... Tim Pierce
05:43 pm Story #4293 (Resolved): [Node Manager] Write off cloud nodes that spend too long in booted state
If the cloud has an internal error starting a node, Node Manager won't shut it down until the normal shutdown window ... Brett Smith
05:36 pm Revision e8451457 (arvados): 3699: figure out correct docker image to fetch
Use arvados.commands.keepdocker.list_images_in_arv to figure out which
Docker image is represented by a given image n...
Tim Pierce
05:31 pm Bug #4291 (Resolved): [Workbench] Create sharing link for a collection is broken
It gives me a Not Found message. i.e. collections/qr1hi-4zz18-ntyi7uygpyep0sx under sharing and permissions button. (... Bryan Cosca
05:19 pm Revision 22c51cdf (arvados): 3824: Use a docker volume for TASK_WORK, clean up env var and tmp di...
Tom Clegg
03:52 pm Task #4290 (In Progress): Review 4084-log-pane-refresh
Tom Clegg
03:17 pm Task #4290 (Resolved): Review 4084-log-pane-refresh
Peter Amstutz
03:38 pm Bug #4084: [Workbench] Pipeline instance Log pane should not get refreshed (it already stays up-t...
This story experienced some scope creep due to the need to rework websocket based refreshing to really solve the prob... Peter Amstutz
03:20 pm Bug #4058 (Resolved): [Workbench] "Show portable data hash" page should show the kind of content ...
Applied in changeset arvados|commit:11085f87c952c7e46a15c88e144190cac32b95a8. Anonymous
02:27 pm Bug #4058: [Workbench] "Show portable data hash" page should show the kind of content that relate...
Peter Amstutz wrote:
> Done.
commit:81cb0b6a still says "collection have." Make "collections" plural and this is...
Brett Smith
01:39 pm Bug #4058: [Workbench] "Show portable data hash" page should show the kind of content that relate...
Brett Smith wrote:
> Reviewing commit:d599adb
>
> The code is good. A couple of things about the view. First, t...
Peter Amstutz
03:18 pm Revision 11085f87 (arvados): Merge branch '4058-workbench-collection-redirect' closes #4058
Peter Amstutz
03:18 pm Revision 34a9171f (arvados): 4058: Typo fix "collection" -> "collections"
Peter Amstutz
03:17 pm Task #4155 (Resolved): Write tests
Peter Amstutz
01:40 pm Task #4155 (In Progress): Write tests
Peter Amstutz
01:39 pm Task #4155 (Resolved): Write tests
Peter Amstutz
03:12 pm Revision d8c4d51e (arvados): 4084: Added tests for auto-refresh of pipeline instance, job, and da...
Peter Amstutz
03:03 pm Bug #4289: [Workbench] Job view should include the relevant component name(s) from each pipeline ...
When having this job !8555b7122bea802f5570203e89669e2f.png! and clicking on the uuid to bring up the job page, the na... Bryan Cosca
03:03 pm Bug #4289 (New): [Workbench] Job view should include the relevant component name(s) from each pip...
There is a list of pipelines that used the job, but they don't show the name of the relevant component.
It's proba...
Bryan Cosca
02:29 pm Bug #4288: [API] api server docker_images endpoint
Clients should be able to ask the API server for the UUID and/or content hash of a collection that a given docker ima... Tim Pierce
02:25 pm Bug #4288 (New): [API] api server docker_images endpoint
Tim Pierce
01:40 pm Task #4154 (Resolved): Investigate
Peter Amstutz
01:38 pm Revision 81cb0b6a (arvados): 4058: Tweaked presentation per review feedback
Peter Amstutz
01:37 pm Revision f8dab157 (arvados): 4091: pass limit parameter from project tabs.
Radhika Chippada
01:31 pm Story #4091 (In Progress): [Workbench] Add tests for undertested parts of Workbench, including in...
* Reopening it for the following reason:
The test with "2 pipelines and 200 jobs" is failing more than occasionall...
Radhika Chippada
02:30 am Bug #4026 (Resolved): [Workbench] "Move to project..." button should be displayed to an admin use...
Applied in changeset arvados|commit:c6056f6f1bb99fa10bc2046266accc4a85f66aad. Radhika Chippada
02:28 am Bug #4026 (In Progress): [Workbench] "Move to project..." button should be displayed to an admin ...
Radhika Chippada
02:26 am Task #4261 (Resolved): Review branch: 4026-project-move-admin
Radhika Chippada
02:25 am Revision c6056f6f (arvados): closes #4026
Merge branch '4026-project-move-admin' Radhika Chippada
02:24 am Revision a008743d (arvados): 4026: simplify writable check
Radhika Chippada
12:10 am Revision 789e1eb8 (arvados): Merge branch 'master' into 4026-project-move-admin
Radhika Chippada

10/22/2014

11:38 pm Revision a124a535 (arvados): Merge branch 'master' into 4228-collection-subdir-files
Radhika Chippada
11:12 pm Revision 3ca013ae (arvados): 4228: add test for combining files from a collection subdir.
Radhika Chippada
09:36 pm Task #4287 (Resolved): Review branch: 4228-collection-subdir-files
Radhika Chippada
09:32 pm Bug #4286 (Rejected): Files in subdirectories of collection should be viewable/downloadable
Duplicate of #4285 Radhika Chippada
09:30 pm Bug #4286 (Rejected): Files in subdirectories of collection should be viewable/downloadable
For example, collections/qr1hi-4zz18-74ikz4mn29q3i34 Bryan Cosca
09:29 pm Bug #4285: [Workbench] Not found error when the view or download icons are clicked for a file in ...
Observed this issue while testing 4228:
Not only are we getting empty collections when combining files that are in...
Radhika Chippada
09:28 pm Bug #4285 (Resolved): [Workbench] Not found error when the view or download icons are clicked for...
Radhika Chippada
09:18 pm Revision 3bf2514d (arvados): 4228: fix arv_normalize input when a file in a subdir of a collectio...
Radhika Chippada
09:04 pm Revision f4bc3892 (arvados): 4084: Remove stray debugging statement
Peter Amstutz
08:44 pm Revision f7aa5c8d (arvados): 4084: Missing files.
Peter Amstutz
08:40 pm Revision 222ce293 (arvados): 4084: Job display, log and buttons refresh using same mechanism as p...
* Job cancel button is now an AJAX call instead of a page reload.
* Remove "cancel job" button from tab line buttons ...
Peter Amstutz
08:38 pm Bug #4026: [Workbench] "Move to project..." button should be displayed to an admin user even if t...
Reviewing commit:2556bf9
It's possible to simplify this condition by saying ...
Brett Smith
08:36 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Peter Amstutz wrote:
> Boo! It needs to either create docker_image_repo+tag links for the Docker image, or rewrite ...
Tim Pierce
05:19 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
Peter Amstutz wrote:
> See attached image, there's a very clear falloff between blocks -- doing this sequentially is...
Tim Pierce
08:28 pm Revision d3dbc2c0 (arvados): 3699: copy docker image links
copy_docker_images and copy_docker_image copy any docker image
collections and add 'docker_image_repo+tag' and 'docke...
Tim Pierce
08:17 pm Revision f2ba19f9 (arvados): 4228: fix arv_normalize input when a file in a subdir of a collectio...
Radhika Chippada
08:07 pm Task #4261 (In Progress): Review branch: 4026-project-move-admin
Brett Smith
08:06 pm Bug #4058: [Workbench] "Show portable data hash" page should show the kind of content that relate...
Reviewing commit:d599adb
The code is good. A couple of things about the view. First, there's a typo: "collection...
Brett Smith
07:30 pm Revision 47221ee0 (arvados): 4084: Rework refresh event handling:
* Tabs no longer refresh on log events by default
* Added explicit 'arv-refresh-on-log-event' class to refresh panes
...
Peter Amstutz
07:30 pm Task #4263 (In Progress): Review 4058-workbench-collection-redirect
Brett Smith
07:13 pm Revision a8b3df3d (arvados): 4137: Fix bad state reference in Node Manager daemon.
Refs #4137. Brett Smith
07:00 pm Bug #4227 (Resolved): [Workbench] Pipeline elapsed time is misformatted
Applied in changeset arvados|commit:6eaaae29a7af005e417673d79e0951122065e685. Radhika Chippada
06:47 pm Bug #4227: [Workbench] Pipeline elapsed time is misformatted
Thanks for following through on this. commit:99ad159 is good to merge, thanks. Brett Smith
03:34 pm Bug #4227: [Workbench] Pipeline elapsed time is misformatted
Reviewing commit:e102efba. The fix is good, but I'm surprised at how involved the test code is.
* I'm not sure I ...
Brett Smith
06:58 pm Task #4277 (Resolved): Review branch: 4227-date-display
Radhika Chippada
05:22 pm Task #4277: Review branch: 4227-date-display
Ready for another look. Radhika Chippada
03:05 pm Task #4277 (In Progress): Review branch: 4227-date-display
Brett Smith
06:57 pm Revision 6eaaae29 (arvados): closes #4227
Merge branch '4227-date-display' Radhika Chippada
06:55 pm Revision ff36aa7e (arvados): Merge branch 'master' into 4227-date-display
Conflicts:
apps/workbench/test/integration/projects_test.rb
Radhika Chippada
06:46 pm Revision 83fc1e7b (arvados): refs #4091 - comment out the test that is failing intermittently in ...
Radhika Chippada
06:29 pm Revision 58ead50f (arvados): 4139: Fix race condition in Node Manager tests.
Get a reference to the monitor mock earlier, before the daemon starts
working with it. Otherwise, we might get incon...
Brett Smith
06:01 pm Revision 5870334b (arvados): Report "swap" memory statistic if kernel provides it. refs #4185
Tom Clegg
05:25 pm Bug #4185: [Crunch] crunchstat memory reports seem suspect for multithreaded programs
OTOH maybe I was looking at the wrong task above, because now top says... Tom Clegg
03:39 pm Bug #4185: [Crunch] crunchstat memory reports seem suspect for multithreaded programs
Watching a java program on compute0.q (qr1hi-8i9sb-brduspenge0fw63)... Tom Clegg
05:12 pm Revision 99ad159b (arvados): 4227: much simplified date display test
Radhika Chippada
03:55 pm Revision e6359fe1 (arvados): Merge branch 'master' into 4227-date-display
Radhika Chippada
03:05 pm Story #3826 (Resolved): [Crunch] Display network activity in crunchstat
Applied in changeset arvados|commit:89f38df7ce6e3af8e6119a111cdf985de6e0a0e9. Anonymous
02:56 pm Story #3826: [Crunch] Display network activity in crunchstat
Tim Pierce wrote:
> That's ok. Mostly I'm calling this out to find out if we are still seeing edge cases where crun...
Tom Clegg
02:37 pm Story #3826: [Crunch] Display network activity in crunchstat
Reviewing @ commit:41887dd:
Thanks for making these changes! LGTM.
Tom Clegg wrote:
> Tim Pierce wrote:
> > ...
Tim Pierce
03:03 pm Revision a522b584 (arvados-dev): Add services/crunchstat to test suite. refs #3826
Tom Clegg
03:03 pm Revision a522b584 (arvados): Add services/crunchstat to test suite. refs #3826
Tom Clegg
03:01 pm Revision 89f38df7 (arvados): Merge branch '3826-crunchstat-netstats' closes #3826
Tom Clegg
02:57 pm Revision fe5ee2e3 (arvados): 3826: Merge branch 'master' into 3826-crunchstat-netstats
Tom Clegg
02:43 pm Revision d501ef45 (arvados): 3824: Show stdout/stderr if shell cmd fails in install script.
Tom Clegg
02:38 pm Story #4284 (Closed): [Crunch] Add unit and functional tests to crunchstat test suite
Tim Pierce
02:35 pm Revision 1aabac3c (arvados): Merge branch '4139-node-manager-race-fix-wip'
Refs #4139, #4275. Brett Smith
02:35 pm Task #4283 (Resolved): Make test case
Tom Clegg
02:34 pm Revision 8d263952 (arvados): 4139: Node Manager more closely tracks nodes it boots.
When using Node Manager on EC2, we saw a race condition where a node
would finish setting up, but would not be return...
Brett Smith
02:32 pm Task #4282 (In Progress): Create/setup task temp dirs at runtime
Tom Clegg
02:32 pm Task #4282 (Resolved): Create/setup task temp dirs at runtime
Tom Clegg
02:13 pm Task #4198 (Resolved): Review 3826-crunchstat-netstats
Tom Clegg
02:02 pm Revision ca1ddb91 (arvados): 4139: Node Manager supports subscribing to shutdown events.
This is necessary to fix a race condition. The daemon needs to be
able to track nodes that it has booted even if the...
Brett Smith
01:35 pm Revision 1c44466e (arvados): Make run-deploy.sh a bit smarter about which compute nodes are actually
up.
Note: there are still race conditions to be addressed here. Or maybe
better, we probably just shouldn't care abo...
Ward Vandewege
01:35 pm Revision 1c44466e (arvados-dev): Make run-deploy.sh a bit smarter about which compute nodes are a...
up.
Note: there are still race conditions to be addressed here. Or maybe
better, we probably just shouldn't care abo...
Ward Vandewege

10/21/2014

10:17 pm Task #4280 (Resolved): Review branch: 4195-pipeline-tutorial
Branch ready for review. The tutorial needed update to match the latest dashboard, where "Add new project" button is ... Radhika Chippada
10:12 pm Revision 3ff1b002 (arvados): Merge branch 'master' into 4195-pipeline-tutorial
Radhika Chippada
10:11 pm Revision a15315b9 (arvados): 4195: fix the tutorial to match the latest dashboard ui.
Radhika Chippada
09:29 pm Revision 06686c47 (arvados): Merge branch '4266-log-performance' refs #4266
Tom Clegg
09:12 pm Revision 7d6bf718 (arvados): 4266: Merge branch 'master' into 4266-log-performance
Tom Clegg
09:10 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Tom Clegg wrote:
> Looping with @each_line@ is certainly better than constructing an array. I also used @$/@ instead...
Brett Smith
09:05 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Brett Smith wrote:
> Thanks. Looking at the short-circuit condition again, is it possible we'll double-count some @...
Tom Clegg
07:27 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Reviewing commit:de79b73
Tom Clegg wrote:
> Brett Smith wrote:
> > * There's a lot of code cleanup here, which p...
Brett Smith
05:34 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Brett Smith wrote:
> Reviewing commit:2e76e6a. I mostly have questions.
>
> * There's a lot of code cleanup here...
Tom Clegg
01:36 pm Bug #4266: [Crunch] crunch-dispatch should process logs efficiently, particularly while throwing ...
Reviewing commit:2e76e6a. I mostly have questions.
* There's a lot of code cleanup here, which provides little im...
Brett Smith
08:45 pm Revision 6ad9adc1 (arvados): 4266: Add word missing from comment.
Tom Clegg
08:45 pm Revision b25d2ec2 (arvados): 4266: Use each_line as enumerator instead of building an array with ...
Tom Clegg
08:34 pm Revision 0c6f7b22 (arvados): 4266: Add missing "next" statement, oops.
Tom Clegg
08:18 pm Revision edac8924 (arvados): 4084: An actual failing test that detects the "new log lines causes ...
Peter Amstutz
07:57 pm Revision e102efba (arvados): 4227: update fixtures to use bigger finish times
Radhika Chippada
07:44 pm Revision 86e8d9a3 (arvados): Merge branch 'master' of git.curoverse.com:arvados into 4227-date-di...
Radhika Chippada
07:42 pm Bug #4195 (In Progress): [Documentation] Fix Workbench pipeline tutorial
Radhika Chippada
07:34 pm Revision 3203a943 (arvados): 4084: Add live logging test
Peter Amstutz
07:18 pm Revision 22dbb061 (arvados): 4084: Should be able to write tests against websocket-based function...
Peter Amstutz
06:40 pm Revision b5c04e9b (arvados): Merge branch '4139-node-manager-polling-logging-wip'
Refs #4275, #4139. Brett Smith
06:33 pm Revision 4fb27993 (arvados): 4139: Improve logging in Node Manager poll actors.
Brett Smith
06:33 pm Revision 9362030c (arvados): 4139: Improve scheduling of Node Manager polls.
* Catch all exceptions, so that we keep polling no matter what
happens. Use CLIENT_ERRORS as a hint about how much...
Brett Smith
06:33 pm Revision 15f36750 (arvados): 4139: Node Manager callback actor avoids redundant delivery calls.
This helps make it more responsive when it receives a shutdown
request.
Brett Smith
05:55 pm Task #4277 (Resolved): Review branch: 4227-date-display
Radhika Chippada
05:48 pm Revision 183df814 (arvados): 4227: some more test and fixture updates.
Radhika Chippada
05:46 pm Revision de79b73c (arvados): 4266: Tweak long-line handling.
Tom Clegg
05:40 pm Bug #4227 (In Progress): [Workbench] Pipeline elapsed time is misformatted
The issue is in dates.js, another one of the under-tested javascript areas. Fix issue and add tests. Radhika Chippada
05:29 pm Revision 6d3a8884 (arvados): 4266: Fix OOM when stderr has a lot of data with no newlines.
Tom Clegg
05:28 pm Revision 19c0f65c (arvados): 4227: minor test upadtes
Radhika Chippada
05:05 pm Revision 3254f0a9 (arvados): 4266: Clean up streambuf.split(newline) loop.
Tom Clegg
05:01 pm Task #4260 (Resolved): Review branch: 4054-sharing-email
Radhika Chippada
01:45 pm Task #4260 (In Progress): Review branch: 4054-sharing-email
Brett Smith
05:00 pm Bug #4054 (Resolved): [Workbench] In the project sharing tab, show email addresses alongside full...
Applied in changeset arvados|commit:7d7e23d01f1d00edf49ba50ded5ffe8054691ada. Radhika Chippada
02:03 pm Bug #4054: [Workbench] In the project sharing tab, show email addresses alongside full names.
commit:1bb0592 looks great, please merge. Thanks. Brett Smith
05:00 pm Revision 972974d7 (arvados): Merge branch 'master' into 4227-date-display
Radhika Chippada
04:57 pm Task #4224 (Resolved): Review 3787-docker-docs
Peter Amstutz
04:56 pm Revision 7d7e23d0 (arvados): closes #4054
Merge branch '4054-sharing-email' Radhika Chippada
04:54 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
... Peter Amstutz
04:09 pm Story #3699: [SDKs] Copy a pipeline instance, along with its input and output data, from one arva...
I'm copying a pipeline with a 5990M collection. I noticed this code:... Peter Amstutz
04:54 pm Revision 24ea6749 (arvados): 4091: the test with 200 jobs and 10 pipelines is failing in jenkins ...
Radhika Chippada
04:48 pm Revision e0f182c2 (arvados): Merge branch 'master' into 4054-sharing-email
Radhika Chippada
04:47 pm Revision cef5c3f1 (arvados): 4227: AM / PM indicator fix
Radhika Chippada
03:20 pm Task #4210 (In Progress): populate portable_data_hash in the collection chooser
Tim Pierce
02:58 pm Revision 76786270 (arvados): 4139: Remove cloud node setup code from API server.
This code has never been used in production, and its functionality has
officially been assumed by Node Manager.
Brett Smith
02:11 pm Revision 1a3d59cd (arvados): Arvados python SDK: do not blow up when HOME is not set.
No issue # Ward Vandewege
01:00 pm Revision a013dc7e (arvados): * exclude /usr/local/lib/python2.7/dist-packages/tests from our fpm ...
* exclude /usr/local/arvados/src/.git from the arvados-src package (bugfix)
No issue #
Ward Vandewege
01:00 pm Revision a013dc7e (arvados-dev): * exclude /usr/local/lib/python2.7/dist-packages/tests from our ...
* exclude /usr/local/arvados/src/.git from the arvados-src package (bugfix)
No issue #
Ward Vandewege
01:00 pm Revision 1a655bf2 (arvados): run-build-packages: Test that fpm is callable before trying to do
anything.
No issue #
Ward Vandewege
01:00 pm Revision 1a655bf2 (arvados-dev): run-build-packages: Test that fpm is callable before trying to do
anything.
No issue #
Ward Vandewege
12:42 pm Task #4272 (In Progress): Review 4266-log-performance
Brett Smith
12:17 pm Revision 8f4aa687 (arvados): Build a few more dependency packages for node manager.
refs #3244 Ward Vandewege
12:17 pm Revision 8f4aa687 (arvados-dev): Build a few more dependency packages for node manager.
refs #3244 Ward Vandewege
12:10 am Bug #4273 (New): [API] as admin user, permission denied canceling a job (started by another user)
Hitting the cancel button in workbench for job 9tee4-8i9sb-rgnue1x0sowi0x6 yields
{
":errors":[
"#<Arvados...
Ward Vandewege
 

Also available in: Atom