Activity

From 03/06/2017 to 04/04/2017

04/04/2017

09:10 pm Story #7824: [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
Added test cases at commit:dfd3260e8
Test run: https://ci.curoverse.com/job/developer-run-tests/219/
Lucas Di Pentima
09:08 pm Revision dfd3260e (arvados): 7824: Added test cases.
Lucas Di Pentima
08:48 pm Revision 42e6998c (arvados): 8465: added stdin redirection for collection
Radhika Chippada
08:36 pm Bug #8104: [SDK] PyCurl 7.21.5 breaks keepclient
(I think this is the minimum version that has the #6073 fix: https://github.com/pycurl/pycurl/blob/master/ChangeLog#L... Peter Amstutz
08:35 pm Bug #8104: [SDK] PyCurl 7.21.5 breaks keepclient
If this happens before #11308 merges, please consider cherry-picking commit:adac4b967382c280022d202d56d7fee41764ef35 ... Tom Clegg
08:28 pm Bug #8104: [SDK] PyCurl 7.21.5 breaks keepclient
Suggest the following version dependency change:... Peter Amstutz
07:23 pm Feature #11146: [Crunch2] [Workbench] Show slurm queue position of containers submitted to slurm ...
from squeue(1): "The default value of sort for jobs is "P,t,-p" (increasing partition name then within a given partit... Tom Clegg
07:15 pm Bug #8371 (Closed): [Deployment] Upgrading Rails packages on CentOS uninstalls them
Tried on arvagrant, with CentOS 7, deploying first version
20161229114527-997479d1408139e96ecdb42a60b4f727f814f6c9...
Javier Bértoli
06:35 pm Story #11421 (New): [Workbench] UUIDs & PDHs should be hyperlinked
Use regex to recognize UUIDs anywhere on a workbench page and hyperlink them. Tom Morris
06:11 pm Task #11409 (Resolved): Review 11407-go-sdk-debug
Peter Amstutz
06:03 pm Revision 4bb024ae (arvados): 11413: Use getattr() in exception handler.
Peter Amstutz
05:12 pm Revision 0487aeb5 (arvados): 11308: Create missing temp dir. Unset proxy env during tests.
Tom Clegg
05:11 pm Revision 46f6db13 (arvados): 11308: Remove obsolete test setup steps.
Tom Clegg
03:41 pm Task #11418 (Resolved): pass tests with python3
Tom Clegg
03:41 pm Task #11418 (Resolved): pass tests with python3
Tom Clegg
03:41 pm Feature #11419 (New): [SDKs] support text-mode open() in Python 3
Tom Clegg
03:40 pm Revision a03ce405 (arvados): 11413: Wrap destroy_node with similar logic to create_node: on excep...
the node list to determine if the node was actually destroyed successfully. Peter Amstutz
03:39 pm Revision 77f5a84c (arvados): Merge branch '11100-cr-output-ttl'
refs #11100 Tom Clegg
03:21 pm Revision 4a35e06b (arvados): 11413: Fix issues with node manager on GCE:
* Always override Node.size with CloudSizeWrapper
* Get updated node record before setting metadata to minimize 'Sup...
Peter Amstutz
03:18 pm Story #11308: Support Python3 for arvados-python-client & command line utilities
... Tom Clegg
02:35 pm Task #11388 (In Progress): Review 11100-cr-output-ttl
Tom Clegg
06:44 am Revision 6d9cf49e (arvados): 11308: pep8
Tom Clegg
06:44 am Revision d761fb1e (arvados): 11308: Fix keepstub bugs and Python 3 compatibility.
Tom Clegg
06:44 am Revision c633f38b (arvados): 11308: Add stderr assertion for easier debugging.
Tom Clegg
06:44 am Revision adac4b96 (arvados): 11308: Close socket after pycurl.
Tom Clegg
06:44 am Revision e8074a3c (arvados): 11308: Fix key order sensitivity.
Tom Clegg
06:44 am Revision cb371701 (arvados): 11308: Expect full class name in traceback.
Tom Clegg
06:44 am Revision 86409934 (arvados): 11308: Update assertion to accommodate different exception in py3.
Tom Clegg
06:44 am Revision 991d037e (arvados): 11308: Fix string/bytes confusion for Python 3
Tom Clegg
06:44 am Revision cd708c67 (arvados): 11308: assertRegexpMatches -> assertRegex
Tom Clegg
06:44 am Revision 04f38e70 (arvados): 11308: Fix traceback.format_exc() usage.
Tom Clegg
04:06 am Bug #11136: Nginx config should speak JSON when returning its own response for unproxyable API re...
When apiserver itself responds ≥400, it returns a body like this... Tom Clegg
01:52 am Revision 5f238a36 (arvados): 11308: Add stderr assertion for easier debugging.
Tom Clegg
01:52 am Revision 86ab369f (arvados): 11308: Update assertion to accommodate different exception in py3.
Tom Clegg
01:52 am Revision 3fcd28c6 (arvados): 11308: Fix keepstub bugs and Python 3 compatibility.
Tom Clegg
01:52 am Revision 3622c512 (arvados): 11308: Expect full class name in traceback.
Tom Clegg
01:52 am Revision 44a87969 (arvados): 11308: pep8
Tom Clegg
01:52 am Revision a5957935 (arvados): 11308: Fix traceback.format_exc() usage.
Tom Clegg
01:52 am Revision d0b76e97 (arvados): 11308: Close socket after pycurl.
Tom Clegg
01:52 am Revision 5f17b001 (arvados): 11308: Fix string/bytes confusion for Python 3
Tom Clegg
01:52 am Revision fd548e89 (arvados): 11308: assertRegexpMatches -> assertRegex
Tom Clegg

04/03/2017

09:46 pm Bug #11136: Nginx config should speak JSON when returning its own response for unproxyable API re...
One approach is to do something like: ... Nico César
09:25 pm Story #7824: [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
Updates at commit:313415e33
Test run: https://ci.curoverse.com/job/developer-run-tests/218/
Note: tests are pendi...
Lucas Di Pentima
09:16 pm Revision 313415e3 (arvados): 7824: Now a subdirectory can be asked to be listed. Also, enhanced e...
Lucas Di Pentima
08:45 pm Revision 2c0c6e6b (arvados): 7824: Several improvements:
* Added error reporting on cases where the user ask for downloading a nonexisting file/subdir inside a collection.
* ...
Lucas Di Pentima
08:39 pm Feature #11410 (New): [SDK] tool for copying CWL file + input collections
arv-copy can copy workflow records (+ dependencies). However, our current workflow is oriented around CWL files stor... Peter Amstutz
08:25 pm Bug #11407 (Resolved): [SDK] Go respects ARVADOS_DEBUG to enable debug logging
Applied in changeset arvados|commit:07c92074fe2b493dc8cd0abdad154e5b36d4adfc. Peter Amstutz
08:07 pm Bug #11407: [SDK] Go respects ARVADOS_DEBUG to enable debug logging
Might be good to do that in init() instead of re-installing debug mode each time a new KeepClient is created. LGTM ot... Tom Clegg
07:27 pm Bug #11407 (In Progress): [SDK] Go respects ARVADOS_DEBUG to enable debug logging
Peter Amstutz
06:27 pm Bug #11407 (Resolved): [SDK] Go respects ARVADOS_DEBUG to enable debug logging
keepclient.New() should check for ARVADOS_DEBUG in environment and enable DebugPrintf() Peter Amstutz
08:21 pm Revision 07c92074 (arvados): Merge branch '11407-go-sdk-debug' closes #11407
Peter Amstutz
08:20 pm Revision 1654f776 (arvados): 11407: keepclient checks for ARVADOS_DEBUG and enables debugging.
Peter Amstutz
07:45 pm Task #11409 (In Progress): Review 11407-go-sdk-debug
Tom Clegg
07:27 pm Task #11409 (Resolved): Review 11407-go-sdk-debug
Peter Amstutz
07:26 pm Revision 9595389f (arvados): 11407: keepclient checks for ARVADOS_DEBUG and enables debugging.
Peter Amstutz
06:07 pm Revision 988e9052 (arvados): 7824: Log errors when trying to read the collection specified.
Lucas Di Pentima
05:52 pm Revision 3cc77494 (arvados): 7824: Closing file when finished writing
Lucas Di Pentima
01:52 pm Revision 17f22a2b (arvados): 8567: Add workaround for "trap EXIT" in pid 1 bash process. Add com...
Peter Amstutz
12:59 pm Feature #8465 (In Progress): [Crunch2] Support stdin/stderr redirection
Radhika Chippada
06:42 am Bug #11405 (New): [arv-put] Lumpy / slow upload
I'm not 100% sure that this is a bug, but it seems weird, so wanted to capture the data.
The last hour of the uplo...
Tom Morris
05:07 am Revision fd8940c4 (arvados): 11308: Close socket after pycurl.
Tom Clegg
05:07 am Revision 63eac50b (arvados): 11308: assertRegexpMatches -> assertRegex
Tom Clegg
05:07 am Revision d39d59e9 (arvados): 11308: Fix traceback.format_exc() usage.
Tom Clegg
05:07 am Revision 5901b749 (arvados): 11308: Fix string/bytes confusion for Python 3
Tom Clegg
05:07 am Revision 2685e2ea (arvados): 11308: Expect full class name in traceback.
Tom Clegg

04/02/2017

11:15 pm Revision 82f763b6 (arvados): 11308: run-tests --skip python2
Tom Clegg
05:26 am Revision 76d9365a (arvados): more str vs bytes, for py3
Tom Clegg

04/01/2017

10:00 pm Revision 41e9f18d (arvados): 11308: Fix deprecated logger.warn -> logger.warning.
Tom Clegg
09:52 pm Revision a81a5f35 (arvados): 11308: md5 -> hashlib.
Tom Clegg
09:45 pm Revision 0199da87 (arvados): 11308: Fix variable name conflict.
Tom Clegg
09:45 pm Revision 0e0c1400 (arvados): 11308: Fix bytes vs. str problems.
Tom Clegg
09:45 pm Revision 7fde9a0a (arvados): 11308: Eliminate old_div().
Tom Clegg
09:45 pm Revision d1af87de (arvados): 11308: Import future module.
Tom Clegg
09:43 pm Revision f69e114c (arvados): 11308: Futurize.
Tom Clegg
09:43 pm Revision e61df483 (arvados): 11308: Futurize stage2.
Tom Clegg
09:43 pm Revision 9b823dc4 (arvados): 11308: Test sdk/python with Python 3.
Tom Clegg
09:43 pm Revision fbce7b14 (arvados): 11308: UserDict to Python 3.
Tom Clegg
09:43 pm Revision de259910 (arvados): 11308: md5 to hashlib.
Tom Clegg
09:43 pm Revision 8e485674 (arvados): 11308: Update python-gflags.
Tom Clegg
09:43 pm Revision d8fef944 (arvados): 11308: fmt
Tom Clegg
09:43 pm Revision 5e46c19f (arvados): 11308: Fix futurize.
Tom Clegg
02:18 am Feature #11100: [CWL] Intermediary collection handling can be specified
Peter Amstutz wrote:
> Documentation of the @output_ttl@ should specify units.
Indeed. Got it in [[Containers API...
Tom Clegg
02:07 am Revision ff3bb22d (arvados): 11100: Adjust delete_at in before_validation hook instead of validat...
Tom Clegg

03/31/2017

09:49 pm Revision 00161497 (arvados): 11100: a-c-r sets output_ttl and deletes intermediate collections on...
Peter Amstutz
09:26 pm Revision b651984f (arvados): 11100: Specify units in output_ttl docs.
Tom Clegg
08:25 pm Feature #11100: [CWL] Intermediary collection handling can be specified
Documentation of the @output_ttl@ should specify units.
Should the code to adjust delete_at to the earliest valid ...
Peter Amstutz
01:44 am Feature #11100: [CWL] Intermediary collection handling can be specified
With "earliest possible delete_at":
11100-cr-output-ttl @ commit:65121f8db54a1ed15207d050e1f48c5fc26d646b
Tom Clegg
01:36 am Feature #11100 (In Progress): [CWL] Intermediary collection handling can be specified
Tom Clegg
08:20 pm Bug #11402 (Resolved): Failure caching discovery document in crunch
Applied in changeset arvados|commit:55c34fb97edfba5a014eb43b965130cf11dbda8a. Tom Clegg
08:08 pm Bug #11402 (Resolved): Failure caching discovery document in crunch
... Peter Amstutz
08:17 pm Revision 55c34fb9 (arvados): 11402: Disable caching if $HOME/ is not writable, instead of returni...
closes #11402 Tom Clegg
07:14 pm Story #7824: [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
arv-get should get some test cases, as well. At minimum, something like:
* Get a single file from a collection
*...
Peter Amstutz
07:00 pm Story #7824: [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
One last thought. It seems a bit inefficient to iterate over every single file in the collection to only extract a s... Peter Amstutz
06:47 pm Story #7824: [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
get.py L170... Peter Amstutz
04:49 pm Story #7824: [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
Branch @7824-arvls-arvput-collection-api-usage@ at commit:c820bfc91be7635739bad0857ba3a385d1334b6a _(I've realized th... Lucas Di Pentima
06:08 pm Bug #6304 (In Progress): [API] Fix config file race condition and improve test cases for DNS upda...
Lucas Di Pentima
06:04 pm Revision 28e59edc (arvados): closes #11368
Merge branch '11368-collection-file-rename-warning' Radhika Chippada
06:03 pm Revision 4af850d6 (arvados): 11368: show error if user tries to rename a collection file with a d...
Radhika Chippada
06:00 pm Revision c0d251c4 (arvados): 11368: optimize coll.exist?(new_file_path) invocation
Radhika Chippada
05:54 pm Revision 736a629e (arvados): Merge branch '11398-nodes-items-available'
refs #11398 Tom Clegg
05:52 pm Revision 5ee2b960 (arvados): 11398: Fix missing items_available in nodes#index response.
Tom Clegg
05:45 pm Task #11272 (In Progress): Review 7824-arvls-arvput-collection-api-usage
Peter Amstutz
05:37 pm Story #10401: [CWL] Limit expansion of Directory inputs
Not sure what to make of this. Master (b9236fbe81426446e1b541a45e219bbe513fe8d0) passes.... Tom Clegg
05:10 pm Task #11194 (In Progress): Review 10401-limit-dir-expansion
Tom Clegg
04:40 pm Revision c820bfc9 (arvados): 7824: Use logging facility to show error messages.
Lucas Di Pentima
03:39 pm Revision 02a997da (arvados): 11368: show error if user tries to rename a collection file with a d...
Radhika Chippada
03:06 pm Task #11367 (Resolved): Need to pass CWL tests
Peter Amstutz
03:06 pm Task #11224 (Resolved): Update API usage
Peter Amstutz
03:06 pm Task #11192 (Resolved): Review 9132-dockerclient
Peter Amstutz
02:45 pm Story #9132 (Resolved): [Crunch2] crunch-run uses official docker client library
Applied in changeset arvados|commit:b9236fbe81426446e1b541a45e219bbe513fe8d0. Peter Amstutz
02:41 pm Revision b9236fbe (arvados): Merge branch '9132-dockerclient' closes #9132
Peter Amstutz
02:24 pm Revision fb1c8e81 (arvados): 7824: Updated code to use newer Collection APIs, leaving all_streams...
Lucas Di Pentima
02:17 pm Revision b351a877 (arvados): 9132: Fix test errors due to rebase.
Peter Amstutz
01:57 pm Revision 0b04efef (arvados): Fix package test for ubuntu1204.
refs #10797 Ward Vandewege
01:37 am Story #11308 (In Progress): Support Python3 for arvados-python-client & command line utilities
Tom Clegg

03/30/2017

10:47 pm Revision 65121f8d (arvados): 11100: If caller sets collection.delete_at too early, set it to the ...
Tom Clegg
10:46 pm Revision 7f881ce0 (arvados-dev): Merge branch 'master' of git.curoverse.com:arvados-dev
Git sync user
10:44 pm Revision 8a1d756a (arvados-dev): Make delete script a little more verbose. Update remote branches...
refs #11020 Javier Bértoli
10:02 pm Revision 1a4a2f32 (arvados): 9132: Fix ContainerCreate to include HostConfig, container UUID as n...
Peter Amstutz
09:19 pm Feature #11100: [CWL] Intermediary collection handling can be specified
Tom Clegg wrote:
> Currently it's an error to set delete_at to a time earlier than blob_signature_ttl. Some time pas...
Peter Amstutz
09:11 pm Feature #11100: [CWL] Intermediary collection handling can be specified
11100-cr-output-ttl @ commit:4437774e863465c0daa41dfd9716174e18d93122 Tom Clegg
09:08 pm Feature #11100: [CWL] Intermediary collection handling can be specified
Currently it's an error to set delete_at to a time earlier than blob_signature_ttl. Some time passes between when the... Tom Clegg
09:11 pm Revision 4437774e (arvados): 11100: Add comment about delete_at validation race.
Tom Clegg
08:56 pm Revision a12ed889 (arvados): 11100: Clean up permission checks.
Tom Clegg
08:50 pm Revision c507b0b0 (arvados): 11100: Add container_requests.output_ttl field. Fix validation of ou...
Tom Clegg
07:40 pm Revision 38141f72 (arvados): 8567: Log total bytes to migrate
Peter Amstutz
07:14 pm Revision acb0bd43 (arvados): 8567: Use arvados.config instead of os.environ. Tweak disk space ac...
Peter Amstutz
06:40 pm Revision 0568c2d4 (arvados): 7824: Moved arv-get code to arvados.commands and replaced bin/arv-ge...
Lucas Di Pentima
06:32 pm Revision d6703f16 (arvados): 9132: Fix after rebase
Peter Amstutz
06:32 pm Revision e8e9262a (arvados): 9132: few more updates to use the new API
Peter Amstutz
06:32 pm Revision bebac87e (arvados): 9132: Use ThinDockerClientProxy to overcome the import issue around ...
Perform most of the test updates needed to use the new API. Radhika Chippada
06:32 pm Revision 6fe136c2 (arvados): 9132: WIP switching to using official Docker Go client.
Peter Amstutz
06:32 pm Revision f34f20a9 (arvados): Merge branch '11332-fix-crunchscript' refs #11332
Peter Amstutz
06:15 pm Revision 154ae0d4 (arvados): 7824: Further ordering fixes. Now all arv-ls tests passes.
Lucas Di Pentima
05:41 pm Revision ff8d14ac (arvados): Merge branch '7709-api-rails4' (partial)
refs #7709
refs #11100
Tom Clegg
05:34 pm Bug #11397 (Resolved): [Ruby 2.3.3] Make json gem dependency > 1.7.7
arvados and arvados-cli gems accept 1.8.x.
New gems aren't published yet but as of commit:78ca1460d58172f455540929...
Tom Clegg
05:09 pm Bug #11397 (Resolved): [Ruby 2.3.3] Make json gem dependency > 1.7.7
gem json 1.7.7 doesn't compile in distros nowadays . If this is not a hard dependency for arvados, will be good to h... Nico César
05:18 pm Bug #11190: Containers seem to run more than once, which isn't supposed to happen
I wonder if we should move the state transition to "Running" as soon as crunch-run has starting doing anything substa... Peter Amstutz
05:12 pm Task #11225 (Resolved): Update cwltool
Peter Amstutz
04:44 pm Bug #11396: Network saturation
Possibly not relevant, but the example job that failed under saturation conditions ended up failing with the followin... Joshua Randall
04:42 pm Bug #11396: Network saturation
Might be useful in the context of running a squid proxy between keep clients and keepstores:
- https://github.com/f...
Joshua Randall
04:41 pm Bug #11396 (New): Network saturation
Some of our extremely I/O intensive jobs are able to completely saturate the network links. When that happens, jobs f... Joshua Randall
03:15 pm Revision 433c48ed (arvados): 8567: Improve disk space accounting. Default to use overlay storage...
Peter Amstutz
03:06 pm Revision ae7f5a9c (arvados): 7824: Fix upper/lower case ordering on arv-ls.
Lucas Di Pentima
02:45 pm Revision 37313363 (arvados): 7709: Do not set job_readable when it won't be used.
Tom Clegg
02:45 pm Revision 68287280 (arvados): 7709: De-duplicate "ensure unique name" implementations.
Tom Clegg
02:45 pm Revision de1e1bf2 (arvados): 7709: Leave container_request alone when applying default keep_cache...
Tom Clegg
02:45 pm Revision d040869c (arvados): 7709: Fix tests (count existing links before adding new ones).
Tom Clegg
02:29 pm Revision fbc867e0 (arvados): 11209: Restore missing import.
refs #11209 Tom Clegg
02:09 pm Revision c6a8839b (arvados): 11332-fix-crunchscript: Set ACCEPTLIST_RE because crunch_script alte...
point doesn't go through main. Peter Amstutz
01:23 am Revision 78ca1460 (arvados): 11355: Arvados gems accept json 2.x.
refs #11355 Tom Clegg

03/29/2017

09:18 pm Bug #4124: [Crunch] Socket timed out on send/recv operation causes pipeline failure
well i found this from 2016-04-12 :... Nico César
07:58 pm Bug #4124: [Crunch] Socket timed out on send/recv operation causes pipeline failure
Review production cluster logs to see if this specific timeout message has been seen. If not, close this. Otherwise, ... Tom Morris
08:10 pm Task #11392 (New): Review
Tom Morris
08:10 pm Task #11391 (New): Review
Tom Morris
08:09 pm Task #11390 (New): Review
Tom Morris
08:09 pm Task #11389 (Resolved): Review 11100-cwl-set-output-ttl
Tom Clegg
08:09 pm Task #11388 (Resolved): Review 11100-cr-output-ttl
Tom Clegg
08:08 pm Task #11385 (Resolved): Review branch 8465-stdin-redirection
Radhika Chippada
08:07 pm Task #11384 (Resolved): Review branch 11365-collection-lock-button
Radhika Chippada
08:05 pm Task #11382 (Resolved): Review 6304-dns-update-fix
Lucas Di Pentima
08:05 pm Task #11381 (Resolved): Review 10111-cr-provenance-graph
Lucas Di Pentima
08:04 pm Task #11379 (Resolved): Review 11308-python3
Tom Clegg
08:03 pm Task #11378 (Resolved): Warn that most users don't want --unmount-all
Tom Clegg
08:03 pm Task #11377 (Resolved): Honor subtype arg
Tom Clegg
08:03 pm Task #11376 (Resolved): Review 11209-unmount-subtype
Tom Clegg
08:02 pm Task #11375 (Resolved): Review 11349-nodemanager-status-api
Tom Clegg
07:49 pm Task #11370 (Resolved): Update cwl runner after API feature is merged
Peter Amstutz
07:40 pm Story #11365: [Workbench] Add lock button for collection display to enable rename & delete
The lock / unlock is at UI level only. For ex: if I unlock, and close the browser and reopen in a new browser, the co... Radhika Chippada
05:46 pm Story #11365 (Resolved): [Workbench] Add lock button for collection display to enable rename & de...
Because renaming or deleting a file changes the portable data hash of a collection, we want to warn the user of the c... Tom Morris
07:35 pm Bug #11283: duplicate key value violates unique constraint "index_nodes_on_slot_number"
We can do better than this in source:services/api/app/models/node.rb... Tom Clegg
07:16 pm Task #11367 (Resolved): Need to pass CWL tests
Peter Amstutz
07:06 pm Story #9132: [Crunch2] crunch-run uses official docker client library
Assigning to Peter to debug / fix any issues with docket client invocations. Thanks. Radhika Chippada
03:11 pm Story #9132: [Crunch2] crunch-run uses official docker client library
Yea, that might be the legitimate exit code. But the CWL test should pass, and it isn't, so it needs further investi... Peter Amstutz
12:57 am Story #9132: [Crunch2] crunch-run uses official docker client library
> I think maybe the return code from ContainerWait is not being interpreted properly
We are just returning what is...
Radhika Chippada
04:11 pm Task #11199 (Resolved): Review 10218-record-node-info
Radhika Chippada
04:10 pm Task #11265 (Resolved): Review branch 3821-collection-file-manage
Radhika Chippada
04:00 pm Revision 0708d4a0 (arvados): 10401: Bump cwltool for packing fix.
Peter Amstutz
04:00 pm Revision 25ab6beb (arvados): 10401: Bump schema salad for self-colliding id fix.
Peter Amstutz
03:59 pm Revision 201ddbd8 (arvados): 10401: Update crunch script, no longer expands directories by default.
Peter Amstutz
03:59 pm Revision 692ef5fd (arvados): 10401: Fixup file/directory literal handling
Peter Amstutz
03:59 pm Revision 7bd9af41 (arvados): 10401: Bump arvados-python-client version for updates to
arvados.command.run.uploadfiles. Peter Amstutz
03:59 pm Revision d7d00f51 (arvados): 10401: Only upload file:// identifiers.
Peter Amstutz
03:59 pm Revision 5cd99e52 (arvados): 10401: Use custom_schema_callback. Bump schema-salad and cwltool ve...
Peter Amstutz
03:58 pm Revision 820d3244 (arvados): 10401: Use use_custom_schema feature for extensions.
Peter Amstutz
03:58 pm Revision 6b0632d7 (arvados): 10401: Allow Arvados extensions to be used in "requirements" not jus...
Peter Amstutz
03:58 pm Revision 33b9f9bd (arvados): 10401: Rework support for uploading Directories (don't assume files are
enumerated). Peter Amstutz
03:51 pm Revision acefccc4 (arvados): Merge branch '11235-log-retryable'
refs #11235 Tom Clegg
03:51 pm Revision 20d1e6ac (arvados): 10401: Bump cwltool for packing fix.
Peter Amstutz
03:50 pm Story #3821 (Resolved): [Workbench] Delete and rename files in collections
Applied in changeset arvados|commit:2b27132d13fd72f29dbab2297f0d2dc1c110eed1. Radhika Chippada
03:41 pm Story #3821: [Workbench] Delete and rename files in collections
LGTM, please merge. Lucas Di Pentima
03:33 pm Story #3821: [Workbench] Delete and rename files in collections
> Could you update the rest of the routes so that instead of using the “:on => :member” style, use the newer “on: :me... Radhika Chippada
02:33 pm Story #3821: [Workbench] Delete and rename files in collections
Some comments:
* File @apps/workbench/config/routes.rb@:
** Related detail: Could you update the rest of the rout...
Lucas Di Pentima
03:50 pm Story #4594 (Resolved): [Workbench] In the collections page, provide the ability to select indivi...
Applied in changeset arvados|commit:2b27132d13fd72f29dbab2297f0d2dc1c110eed1. Radhika Chippada
03:49 pm Revision b3d286cd (arvados): 11235: Log a message when a job is interrupted by node failure.
...and say what's going to happen as a result, even if that is not
"giving up" yet.
Tom Clegg
03:44 pm Revision 2b27132d (arvados): closes #3821
Merge branch '3821-collection-file-manage' Radhika Chippada
03:43 pm Revision 46fac76c (arvados): Fix invalid records in API collections test fixture and improve erro...
to include both values. Incidentally revealed by adding PDH index to
collections table. refs #11361
Peter Amstutz
03:28 pm Revision 3306ff58 (arvados): 3821: improve the tooltip on rename file option.
Radhika Chippada
02:54 pm Revision 32430fd4 (arvados): Fix packaging for python-arvados-cwl-runner refs #11333
Peter Amstutz
04:26 am Revision f92654c5 (arvados): Merge branch '11361-pdh-index'
refs #11361 Tom Clegg

03/28/2017

10:01 pm Revision 01da808f (arvados): 11361: Add pdh index to collections table.
Tom Clegg
08:29 pm Story #9132: [Crunch2] crunch-run uses official docker client library
I'm running stuff and getting an exit code of "2" when it should be "0". I think maybe the return code from Containe... Peter Amstutz
08:17 pm Task #11353 (Resolved): use arv-mount --unmount-all in crunch-job
Tom Clegg
08:13 pm Revision fe0751fd (arvados): Merge branch '11209-unmount-replace'
refs #11209 Tom Clegg
08:07 pm Task #11265 (In Progress): Review branch 3821-collection-file-manage
Lucas Di Pentima
08:01 pm Revision 126a8a23 (arvados): Merge branch '11333-cwl-phone-home' closes #11333
Peter Amstutz
08:01 pm Revision 07e060db (arvados): 3821: update test assertion that randomly fails; in fact, I don't se...
Radhika Chippada
08:00 pm Revision 951ba69d (arvados): 10401: Bump schema salad for self-colliding id fix.
Peter Amstutz
07:52 pm Revision 71f0b2cc (arvados): 11332: Suppress phone-home behavior in check_exists by recognizing
http://arvados.org/cwl and returning True. Peter Amstutz
07:52 pm Revision 11e42199 (arvados): 11333: Add explicit version pin on 'typing'
Peter Amstutz
07:50 pm Revision fdc7164e (arvados): Merge branch '11332-cwl-filenames' closes #11332
Peter Amstutz
07:26 pm Revision 4b8e618c (arvados): Merge branch 'master' into 3821-collection-file-manage
Radhika Chippada
06:51 pm Story #11350 (Resolved): [Nodemanager] Merge cloud_environment support to upstream libcloud
Fix tests so this pull request can be merged:
https://github.com/apache/libcloud/pull/969
Peter Amstutz
06:43 pm Story #11349: [Node Manager] Add status URL for node manager
See source:sdk/python/tests/keepstub.py and source:sdk/python/tests/test_keep_client.py for example of starting up a ... Tom Clegg
06:33 pm Story #11349 (Resolved): [Node Manager] Add status URL for node manager
Implemented HTTP server which serves status URL with JSON format output
Configurable port #
Start with the data w...
Tom Morris
06:33 pm Story #3821: [Workbench] Delete and rename files in collections
Branch 3821-collection-file-manage @ commit:07e060d
* Added a "Remove selected files" option to the Selection drop...
Radhika Chippada
06:07 pm Revision 189495ad (arvados): 3821: collection viewed from another object
Radhika Chippada
05:57 pm Revision 1c4a828b (arvados): 10401: Bump arvados-python-client version for updates to
arvados.command.run.uploadfiles. Peter Amstutz
05:57 pm Revision 9b6019bc (arvados): 10401: Only upload file:// identifiers.
Peter Amstutz
05:57 pm Revision 62b4f786 (arvados): 10401: Update crunch script, no longer expands directories by default.
Peter Amstutz
05:57 pm Revision ea937330 (arvados): 10401: Fixup file/directory literal handling
Peter Amstutz
05:57 pm Revision 8065702d (arvados): 10401: Use custom_schema_callback. Bump schema-salad and cwltool ve...
Peter Amstutz
05:57 pm Revision ca6de897 (arvados): 10401: Rework support for uploading Directories (don't assume files are
enumerated). Peter Amstutz
05:57 pm Revision c31a9cf4 (arvados): 10401: Allow Arvados extensions to be used in "requirements" not jus...
Peter Amstutz
05:57 pm Revision dbb5d6ea (arvados): 10401: Use use_custom_schema feature for extensions.
Peter Amstutz
05:46 pm Feature #7709: [API] Upgrade API server to Rails 4.2
This LGTM, thanks! Lucas Di Pentima
05:36 pm Feature #7709: [API] Upgrade API server to Rails 4.2
Lucas Di Pentima wrote:
> * File @services/api/app/controllers/application_controller.rb@ - Line 491: Was @has_key?(...
Tom Clegg
04:59 pm Feature #7709: [API] Upgrade API server to Rails 4.2
Phew, lots of reading! Some minor comments:
* File @services/api/app/controllers/application_controller.rb@ - Line...
Lucas Di Pentima
05:34 pm Task #11292 (Resolved): Review 11209-unmount-replace
Lucas Di Pentima
05:33 pm Revision e1e05845 (arvados): 7709: Fix lazy splat.
Tom Clegg
05:33 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
LGTM. All tests passing now. Lucas Di Pentima
02:13 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
Fixed a race condition in the tests, and a problem with the refactored "standalone mode" code (evidently it's critica... Tom Clegg
05:32 pm Revision 78ff2a60 (arvados): 7709: Dispatch assert_equal to assert_nil when needed to accommodate...
Tom Clegg
05:24 pm Revision 7fd4aa96 (arvados): 7709: Use assert_nil instead of assert_equal nil.
Tom Clegg
04:57 pm Revision 5f260ce7 (arvados): 11333: Add explicit version pin on 'typing'
Peter Amstutz
04:54 pm Revision f14965fa (arvados): 3821: The "Remove selected files" option should only be presented if...
Radhika Chippada
04:44 pm Revision 00deca5e (arvados): 11332: Suppress phone-home behavior in check_exists by recognizing
http://arvados.org/cwl and returning True. Peter Amstutz
04:37 pm Revision a7748734 (arvados): 11332: Override relaxed path checks to be even more relaxed, and bum...
schema salad pin for hashes-in-filenames fix. Peter Amstutz
04:29 pm Story #10401: [CWL] Limit expansion of Directory inputs
10401-limit-dir-expansion
* Bump cwltool version, add support for cwltool:LoadListing hint which controls expansio...
Peter Amstutz
04:02 pm Bug #11236 (Resolved): Dependencies in Ubuntu 16.04 (xenial) offer to REMOVE arvados-node-manager
Run... Javier Bértoli
03:33 pm Revision 2b2c23bf (arvados): 3821: attr_accessor not needed on collection "filename"
Radhika Chippada
03:25 pm Revision dfa41e50 (arvados): 3821: add an integration test to rename a file in a collection
Radhika Chippada
02:48 pm Story #6777 (Rejected): [Documentation] recommend ruby2.1 package on debian 8
I don't think we can use the "system ruby" approach. There are some intervals when Debian ships with a version we can... Tom Clegg
02:43 pm Bug #8222 (Resolved): [SDK] "gem install arvados" fails on ruby <2.2.2 since activesupport 5.0.0 ...
arvados and arvados-cli gems decline activesupport 5 now Tom Clegg
02:30 pm Revision fb7bb4c8 (arvados): 7709: Avoid omniauth >= 1.5.0 to stay compatible with Ruby < 2.1.9
Tom Clegg
02:19 pm Task #11340 (Resolved): Review 10401-run-upload-dir
Tom Clegg
01:57 pm Revision 22a6d5ae (arvados): 10401: Update crunch script, no longer expands directories by default.
Peter Amstutz
01:56 pm Revision 86fec403 (arvados): 10401: Pin 'typing' dependency to resolve dependency conflict.
Peter Amstutz
01:30 pm Revision 262dfdbc (arvados): 10401: Override relaxed path checks to be even more relaxed.
Peter Amstutz
05:52 am Revision 8b4d5991 (arvados): 11209: Test using ./bin/arv-mount from source dir.
Tom Clegg

03/27/2017

11:37 pm Revision 823ef132 (arvados): 3821: integration test to remove files from a collection
Radhika Chippada
10:43 pm Revision 8cd68a56 (arvados): 11209: Replace "--unmount /path/..." with "--unmount-all /path".
Tom Clegg
10:36 pm Revision 387376e5 (arvados): 11209: Fix daemon mode.
DaemonContext cannot happen after listen_for_events(). Tom Clegg
10:35 pm Revision c33eb319 (arvados): 3821: collection controller tests for remove and rename files.
Radhika Chippada
08:29 pm Bug #11257: [CWL] Fails with $schemas referencing remote resources.
Fix pending in #10401 (as part of larger pathmapper refactor) Peter Amstutz
08:27 pm Revision c627686e (arvados): 10401: Fixup file/directory literal handling
Peter Amstutz
08:23 pm Revision 922e79be (arvados): Update cwl test_submit refs #10401
Peter Amstutz
08:18 pm Revision 0582da72 (arvados): 10401: Only upload file:// identifiers.
Peter Amstutz
08:04 pm Revision eafc2f38 (arvados): 10401: Bump arvados-python-client version for updates to
arvados.command.run.uploadfiles. Peter Amstutz
08:03 pm Revision acaa7f27 (arvados): 10401: Use use_custom_schema feature for extensions.
Peter Amstutz
08:03 pm Revision 7563a5bd (arvados): 10401: Use custom_schema_callback. Bump schema-salad and cwltool ve...
Peter Amstutz
08:03 pm Revision 869a759f (arvados): 10401: Allow Arvados extensions to be used in "requirements" not jus...
Peter Amstutz
08:03 pm Revision a3d6e83a (arvados): 10401: Rework support for uploading Directories (don't assume files are
enumerated). Peter Amstutz
07:54 pm Revision ca19a29f (arvados): Merge branch '10401-run-upload-dir' refs #10401
Peter Amstutz
07:33 pm Story #10401: [CWL] Limit expansion of Directory inputs
10401-run-upload-dir @ commit:7e9156a LGTM
Tom Clegg
07:17 pm Story #10401: [CWL] Limit expansion of Directory inputs
10401-run-upload-dir
Add support for uploading Directories in the "uploadfiles" method of arv-run (used by a-c-r)
Peter Amstutz
07:07 pm Revision d1a64a8b (arvados): 10401: Use custom_schema_callback. Bump schema-salad and cwltool ve...
Peter Amstutz
07:05 pm Task #11340 (Resolved): Review 10401-run-upload-dir
Peter Amstutz
07:03 pm Revision 54afede3 (arvados): 10401: Allow Arvados extensions to be used in "requirements" not jus...
Peter Amstutz
07:03 pm Revision bf7d4235 (arvados): 10401: Rework support for uploading Directories (don't assume files are
enumerated). Peter Amstutz
07:03 pm Revision d32ca4db (arvados): 10401: Use use_custom_schema feature for extensions.
Peter Amstutz
06:58 pm Revision 7e9156ae (arvados): 10401: Support in arv-run for uploading Directories.
Peter Amstutz
06:35 pm Task #11264 (In Progress): Review 7709-api-rails4
Lucas Di Pentima
06:29 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
Tom Clegg wrote:
> I figure since we'll try to mount at the literal path "/path/..." we have to assume "/path/..."...
Lucas Di Pentima
06:18 pm Feature #7709: [API] Upgrade API server to Rails 4.2
> we should do 4.2.5 because of Ubuntu16's default pg is 9.5
(Done, and in the meantime we have a workaround for thi...
Tom Clegg
06:14 pm Task #11337 (Resolved): Check ruby warnings and Rails upgrade notes
Tom Clegg
06:12 pm Revision 8d9b12f2 (arvados): 7709: Fix Ruby warnings.
Tom Clegg
05:51 pm Revision d42ec212 (arvados): 7709: Fix warning while suppressing warnings.
Tom Clegg
05:49 pm Revision c066a2e6 (arvados): 7709: Suppress Ruby warnings while loading gems.
Tom Clegg
05:19 pm Revision c36272a5 (arvados): 7709: Fix some ruby warnings.
Tom Clegg
04:49 pm Revision 30dbddd3 (arvados): 7709: Remove services/api/log/
Tom Clegg
04:49 pm Revision ab314b9e (arvados): 7709: Remove passenger/puma websocket tests.
Tom Clegg
04:49 pm Revision c9a361f7 (arvados): 7709: De-duplicate "ensure unique name" implementations.
Tom Clegg
04:49 pm Revision 126dd750 (arvados): 7709: Serialized fields reject wrong types with useful error messages.
Tom Clegg
04:49 pm Revision 84ad2157 (arvados): 7709: Update bundle
Tom Clegg
04:49 pm Revision dfd8c4bb (arvados): 7709: A scope that permits GET permits HEAD too.
Tom Clegg
04:49 pm Revision 7c6852e1 (arvados): 7709: Accommodate Rails3 or 4 error message.
Tom Clegg
04:49 pm Revision de4df7f8 (arvados): 7709: Fix full-text index check
PostgreSQL query from http://stackoverflow.com/a/6777904
(In Rails 4.2, ActiveRecord::Base.connection.indexes() no l...
Tom Clegg
04:49 pm Revision 390af6a1 (arvados): 7709: Allow null for empty serialized fields.
Tom Clegg
04:49 pm Revision 9090c60b (arvados): 7709: Upgrade to rails4, fix some of the compatibility issues.
Tom Clegg
04:49 pm Revision 045bace6 (arvados): 7709: Fix state leaking between test suites.
Tom Clegg
04:49 pm Revision 09dcf71e (arvados): 7709: Leave container_request alone when applying default keep_cache...
Tom Clegg
04:49 pm Revision 099a8c62 (arvados): 7709: Fix tests (count existing links before adding new ones).
Tom Clegg
04:49 pm Revision 05d453ec (arvados): 7709: Do not set job_readable when it won't be used.
Tom Clegg
04:26 pm Revision 13c47e13 (arvados): Pin ws4py <0.4 (our websocket tests fail on 0.4.1)
No issue # Tom Clegg
02:42 pm Task #11266 (Resolved): Review 11065-rotate-logs
Tom Clegg
02:42 pm Task #11329 (Resolved): Review 10766-install-ws
Tom Clegg
02:41 pm Task #11328 (Resolved): update Upgrading wiki
Tom Clegg
01:49 pm Revision 04997f11 (arvados): Merge branch 'master' into 9132-dockerclient
Radhika Chippada

03/24/2017

08:58 pm Revision e47a4660 (arvados): 3821: Rename collection file path
Radhika Chippada
08:27 pm Task #11337 (In Progress): Check ruby warnings and Rails upgrade notes
Tom Clegg
08:27 pm Task #11337 (Resolved): Check ruby warnings and Rails upgrade notes
Tom Clegg
08:03 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
11209-unmount-replace @ commit:b7a664f09052ac048e506bed9bb48b54bc2a9bd4
* remove superfluous crunchstat import
* un...
Tom Clegg
07:59 pm Revision b7a664f0 (arvados): 11209: Remove unused imports.
Tom Clegg
07:59 pm Revision b3fe3084 (arvados): 11209: Add tests for --unmount and --replace flags.
Tom Clegg
07:55 pm Revision 2d0872f9 (arvados): 11209: Fix missing import. Use context handler for standalone mode.
Tom Clegg
06:42 pm Revision ce4970b9 (arvados): Remove debug printf.
No issue # Tom Clegg
06:41 pm Revision d31988b6 (arvados): Remove -i flag from Rails3 pg_dump invocation.
No issue # Tom Clegg
03:37 pm Revision 0dea965e (arvados): 3821: remove selection file in collection file row
Radhika Chippada
02:55 pm Revision fe446e10 (arvados): updated documentation about the docker 1.9 migration process
refs #11305 Nico César
02:26 pm Revision bbacca53 (arvados): 3821: added 'Remove selected files' to collection#show page.
Radhika Chippada
02:12 pm Feature #7709: [API] Upgrade API server to Rails 4.2
some extra info: https://gist.github.com/nruth/a3bc1b75281109b036e4
we should do 4.2.5 because of Ubuntu16's defau...
Nico César
01:31 pm Revision 727c1e47 (arvados): Merge branch '8567-docker-migrator' refs #8567
Peter Amstutz
01:44 am Story #11308: Support Python3 for arvados-python-client & command line utilities
We appear to have suffered from serious scope creep here. Somehow we went from SDK & command line tools to almost all... Tom Morris

03/23/2017

10:15 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
Lucas Di Pentima wrote:
> * File @services/fuse/arvados_fuse/command.py@
> ** Line 14: Can this line be eliminated ...
Tom Clegg
06:19 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
* File @services/fuse/arvados_fuse/command.py@
** Line 14: Can this line be eliminated because of line 15?
** Shoul...
Lucas Di Pentima
10:09 pm Revision cebc9af0 (arvados): 11209: Try unmounting at least once even if timeout=0.
Tom Clegg
10:09 pm Revision 4e3263ea (arvados): 11209: "--unmount /path/..." unmounts /path and all fuse mounts belo...
Tom Clegg
10:09 pm Revision 86ec536f (arvados): 11209: Add arv-mount --unmount and --replace flags
Tom Clegg
10:07 pm Revision a1fe9aad (arvados): 11209: Merge branch 'master' into 11209-unmount-replace
Tom Clegg
10:06 pm Revision 1c999994 (arvados): 11209: Try unmounting at least once even if timeout=0.
Tom Clegg
09:38 pm Revision 4afa5013 (arvados): 7824: Updated arv-ls to use CollectionReader's keys() API instead of...
Lucas Di Pentima
09:05 pm Revision 067c44e3 (arvados-dev): arvados-version-server:
* more refactoring
No issue #
Ward Vandewege
08:58 pm Story #9132: [Crunch2] crunch-run uses official docker client library
Radhika Chippada wrote:
> * What ContainerStartOptions should we use?
Empty LGTM. The options seem to be for chec...
Tom Clegg
06:48 pm Story #9132: [Crunch2] crunch-run uses official docker client library
Branch 9132-dockerclient @ commit:374dff075f0d2961b3843d952ccca9f55d972e9a
* Uses new docker client API.
* What...
Radhika Chippada
08:37 pm Story #3821 (In Progress): [Workbench] Delete and rename files in collections
Radhika Chippada
08:16 pm Revision ae8aaa4c (arvados): Merge branch '11325-no-broken-nodes' refs #11323, refs #11324, refs ...
Peter Amstutz
08:15 pm Feature #10766 (Resolved): [Docs] [arvados-ws] make the arvados-ws documentation official, remove...
Applied in changeset arvados|commit:8ada36c931712304c4b2c70bdcbc316b1ad2c4e2. Tom Clegg
07:22 pm Feature #10766 (In Progress): [Docs] [arvados-ws] make the arvados-ws documentation official, rem...
Tom Clegg
06:20 pm Feature #10766: [Docs] [arvados-ws] make the arvados-ws documentation official, remove all mentio...
review commit:e8cc0d73309236d6efc243371969f83808e42d30
some c&p issues I mention Tom
the documentation is fairl...
Nico César
05:48 pm Feature #10766: [Docs] [arvados-ws] make the arvados-ws documentation official, remove all mentio...
10766-install-ws @ commit:e8cc0d73309236d6efc243371969f83808e42d30
Tom Clegg
08:13 pm Revision b8000c3c (arvados): 11323: Don't try to offer_arvados_pair on unpaired nodes which are b...
Peter Amstutz
08:12 pm Revision 2e32ef16 (arvados): 11324: Fix crash in NodeManagerDaemonActor when receiving a node_can...
message for a node that has already been shut down. Peter Amstutz
08:10 pm Revision 8ada36c9 (arvados): Merge branch '10766-install-ws'
closes #10766 Tom Clegg
08:05 pm Story #11065 (Resolved): [API] Delete rows from logs table when they exceed a configured threshold
Applied in changeset arvados|commit:4600343d1bff7ac4f7b9f08486541444c31af8b6. Tom Clegg
07:51 pm Story #11065: [API] Delete rows from logs table when they exceed a configured threshold
LGTM Radhika Chippada
07:19 pm Story #11065: [API] Delete rows from logs table when they exceed a configured threshold
Radhika Chippada wrote:
> * “Time to keep audit logs (a row in the log table added … “ => “Time to keep audit logs (...
Tom Clegg
03:38 pm Story #11065: [API] Delete rows from logs table when they exceed a configured threshold
* “Time to keep audit logs (a row in the log table added … “ => “Time to keep audit logs (a row in the log table *is*... Radhika Chippada
07:56 pm Revision 4600343d (arvados): Merge branch '11065-rotate-logs'
closes #11065 Tom Clegg
07:56 pm Revision fd776714 (arvados): 11065: Avoid scientific notation in PostgreSQL literal.
Tom Clegg
07:31 pm Task #11192 (In Progress): Review 9132-dockerclient
Tom Clegg
07:18 pm Revision 6722b420 (arvados): 11065: Update comments.
Tom Clegg
06:55 pm Bug #11221 (Resolved): [systemd] Always restart exited services, even after 3 startup failures
Applied in changeset arvados|commit:a8378b8deaa2bbf9d2c154d9d9bb072538c288cc. Tom Clegg
05:10 pm Bug #11221: [systemd] Always restart exited services, even after 3 startup failures
review at commit:273a233818ae39e843fab0276f9e381da6645d28
Ready to merge
Nico César
06:51 pm Revision a8378b8d (arvados): Merge branch '11221-always-restart-services'
closes #11221 Tom Clegg
06:09 pm Revision 912c6ffe (arvados): 11323: Don't try to offer_arvados_pair on unpaired nodes which are b...
Peter Amstutz
06:07 pm Revision 4bdebc39 (arvados): 11324: Fix crash in NodeManagerDaemonActor when receiving a node_can...
message for a node that has already been shut down. Peter Amstutz
06:07 pm Revision 2aef6ca0 (arvados): 11325: Remove "broken node" check. Assume if the node really isn't
functioning, it should be "down" in SLURM anyway. Remove test_broken_node_not_counted because broken node check is r... Peter Amstutz
06:05 pm Revision 5aeebd0c (arvados): 10766: Fix copy-paste error in godoc link.
Tom Clegg
05:55 pm Revision 374dff07 (arvados): Merge branch 'master' into 9132-dockerclient
Conflicts:
services/crunch-run/crunchrun.go
Radhika Chippada
05:50 pm Task #11328 (In Progress): update Upgrading wiki
Tom Clegg
05:48 pm Task #11328 (Resolved): update Upgrading wiki
Tom Clegg
05:48 pm Task #11327 (Resolved): update install docs
Tom Clegg
05:47 pm Task #11327 (Resolved): update install docs
Tom Clegg
05:48 pm Task #11329 (Resolved): Review 10766-install-ws
Tom Clegg
05:46 pm Revision e8cc0d73 (arvados): 10766: Migrate install guide from puma to arvados-ws.
Tom Clegg
05:30 pm Revision 1decc19f (arvados): 11323: Don't try to offer_arvados_pair on unpaired nodes which are b...
Peter Amstutz
05:23 pm Revision 6280916d (arvados): 11325: Remove "broken node" check. Assume if the node really isn't
functioning, it should be "down" in SLURM anyway. Peter Amstutz
05:10 pm Task #11311 (Resolved): Review 11221-always-restart-services
Nico César
04:48 pm Task #11311 (In Progress): Review 11221-always-restart-services
Nico César
04:11 pm Feature #3231 (Closed): design document for websockets/event bus
Tom Clegg
04:03 pm Task #11292 (In Progress): Review 11209-unmount-replace
Lucas Di Pentima
03:20 pm Task #11267 (Resolved): Review 10669-safe-http-cache
Peter Amstutz
02:26 pm Task #11267 (In Progress): Review 10669-safe-http-cache
Peter Amstutz
03:00 pm Bug #10669 (Resolved): googleapiclient.errors.InvalidJsonError retrieving discovery document
Applied in changeset arvados|commit:1667f9860de21d29bbe32bb827db29eca62d9aeb. Tom Clegg
02:56 pm Bug #10669: googleapiclient.errors.InvalidJsonError retrieving discovery document
Peter Amstutz wrote:
> Did you try the multithreaded test_cache_crud against the regular httplib2 cache? Does the (...
Tom Clegg
02:52 pm Bug #10669: googleapiclient.errors.InvalidJsonError retrieving discovery document
Ah yes, older versions of httplib2 used just the md5 but current versions use a munged url plus md5. And yeah, I assu... Tom Clegg
02:33 pm Bug #10669: googleapiclient.errors.InvalidJsonError retrieving discovery document
For what its worth, from my cache directory:
Old filename:
qr1hi.arvadosapi.com,discovery,v1,apis,arvados,v1,rest...
Peter Amstutz
02:08 pm Bug #10669: googleapiclient.errors.InvalidJsonError retrieving discovery document
Did you try the multithreaded test_cache_crud against the regular httplib2 cache? Does the (unsafe) cache fail the t... Peter Amstutz
02:56 pm Revision 1667f986 (arvados): Merge branch '10669-safe-http-cache'
closes #10669 Tom Clegg
02:43 pm Revision c56743e3 (arvados): 10669: Improve error reporting in test case.
Tom Clegg
02:26 pm Task #11312 (Resolved): Review 11255-docker-host-networking
Peter Amstutz
02:26 pm Task #11269 (Resolved): Review 11170-stale-squeue-procs
Peter Amstutz
01:55 pm Feature #11255 (Resolved): [Crunchv2] Option to use host networking for containers
Applied in changeset arvados|commit:ae970cb115251915c0a8e1052b23acdd2ab70fee. Peter Amstutz
01:52 pm Revision ae970cb1 (arvados): Merge branch '11255-docker-host-networking' closes #11255
Peter Amstutz
01:50 pm Revision a67faeeb (arvados): 11255: Fix whitespace
Peter Amstutz
01:49 pm Revision 82ff0337 (arvados): 11255: Add documentation about configuration to enable host networki...
Peter Amstutz
01:49 pm Revision 950ae963 (arvados): 11255: Add -container-enable-networking and -container-network-mode ...
Peter Amstutz
01:35 pm Bug #11170 (Resolved): Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Applied in changeset arvados|commit:83203f5c739ee0b0199e76babccb60e832a0de8e. Lucas Di Pentima
01:31 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Lucas Di Pentima wrote:
> Done: commit:2741b54
LGTM
Peter Amstutz
01:33 pm Revision 83203f5c (arvados): Merge branch '11170-stale-squeue-procs'
Closes #11170 Lucas Di Pentima
01:00 pm Task #11266 (In Progress): Review 11065-rotate-logs
Radhika Chippada
04:21 am Task #11316 (Resolved): make other components' integration tests pass
Tom Clegg
04:19 am Revision 7772dca4 (arvados): 10669: pep8
Tom Clegg
04:16 am Revision 514cd364 (arvados): 10669: Test that SafeHTTPCache is actually used.
Tom Clegg

03/22/2017

11:41 pm Revision e468c36b (arvados): Merge branch 'master' into 9132-dockerclient
Conflicts:
services/crunch-run/crunchrun.go
Radhika Chippada
10:02 pm Bug #10669: googleapiclient.errors.InvalidJsonError retrieving discovery document
10669-safe-http-cache @ commit:514cd364c3cb27b633c1368cd06d6a54927c98a8
This branch uses ~/.cache/arvados/discover...
Tom Clegg
05:19 pm Bug #10669 (In Progress): googleapiclient.errors.InvalidJsonError retrieving discovery document
Tom Clegg
09:57 pm Revision 36678007 (arvados): 10669: Only delete *.tmp when cleaning old cache files.
Tom Clegg
09:50 pm Revision f0a34ecb (arvados): 10669: Bust old (possibly broken) cache entries by naming our files ...
Tom Clegg
09:50 pm Revision e47fe866 (arvados): 10699: Delete >2-day old cache entries.
Tom Clegg
09:49 pm Revision 8d2dd800 (arvados): 10669: Robust cache for httplib2
Tom Clegg
09:23 pm Task #11318 (Resolved): thread- and process-safe cache
Tom Clegg
05:11 pm Task #11318 (In Progress): thread- and process-safe cache
Tom Clegg
05:11 pm Task #11318 (Resolved): thread- and process-safe cache
Tom Clegg
08:47 pm Revision c071433a (arvados): 9132: Use ThinDockerClientProxy to overcome the import issue around ...
Perform most of the test updates needed to use the new API. Radhika Chippada
08:25 pm Feature #10218 (Resolved): [Crunch2] Gather and record cloud/physical node information for each c...
Applied in changeset arvados|commit:dc6c3fccb583ae98eee808addb526c45ebdbf2c6. Lucas Di Pentima
07:48 pm Feature #10218: [Crunch2] Gather and record cloud/physical node information for each container
Any reason not to combine the paths like {"df", "-m", "/", os.TempDir()}?
LogContainerRecord() should call @defer ...
Tom Clegg
07:35 pm Feature #10218: [Crunch2] Gather and record cloud/physical node information for each container
More updates: commit:a54e888
Test run: https://ci.curoverse.com/job/developer-run-tests/202/
Re-ran failed test: ht...
Lucas Di Pentima
06:18 pm Feature #10218: [Crunch2] Gather and record cloud/physical node information for each container
Updates at commit:5976c75
Test run: https://ci.curoverse.com/job/developer-run-tests/200/
Now the whole container...
Lucas Di Pentima
08:18 pm Revision dc6c3fcc (arvados): Merge branch '10218-record-node-info'
Closes #10218 Lucas Di Pentima
07:56 pm Revision bc8a4a88 (arvados): 10218: Avoid running df commands more than necessary. Updated test t...
Lucas Di Pentima
07:30 pm Revision 262d1e44 (arvados): 11065: Merge branch 'master' into 11065-rotate-logs
Tom Clegg
07:07 pm Revision a54e8886 (arvados): 10218: Added calls to "df -i" to record free i-nodes. Combined stdou...
Lucas Di Pentima
06:51 pm Revision 432e71ae (arvados): 10218: Ask for disk space on 2 specific filesystems (/ & /tmp) to av...
Lucas Di Pentima
06:45 pm Revision 6b2005a2 (arvados): 10218: Merge branch 'master' into 10218-record-node-info
Lucas Di Pentima
06:29 pm Story #7824 (In Progress): [SDKs] arv-get and arv-ls should use new PySDK Collection APIs
Lucas Di Pentima
06:01 pm Revision 5976c751 (arvados): 10218: Get the container record directly from the API server, instea...
Lucas Di Pentima
05:35 pm Revision 9db2a4c4 (arvados): 11255: Fix whitespace.
Peter Amstutz
05:33 pm Revision b50e323e (arvados): Merge branch '7709-sdk-cli-active_support'
refs #7709 Tom Clegg
05:31 pm Revision 6498c775 (arvados): 11305: expanded documentation for docker migration
refs #11305 Nico César
05:28 pm Task #11319 (Resolved): Review 7709-sdk-cli-active_support
Lucas Di Pentima
05:14 pm Task #11319 (Resolved): Review 7709-sdk-cli-active_support
Tom Clegg
05:28 pm Feature #7709: [API] Upgrade API server to Rails 4.2
LGTM, please merge Lucas Di Pentima
05:14 pm Feature #7709: [API] Upgrade API server to Rails 4.2
7709-sdk-cli-active_support @ commit:2fd606b328508babad9af6c0a30c159568b525c2 Tom Clegg
05:05 pm Feature #11255: [Crunchv2] Option to use host networking for containers
flag help messages should probably just indent with tabs instead of a combination of spaces and tabs. The rest LGTM, ... Tom Clegg
04:29 pm Feature #11255: [Crunchv2] Option to use host networking for containers
11255-docker-host-networking updated:
-container-enable-networking=[default, always]
-container-network-mode=[a...
Peter Amstutz
04:56 pm Revision ee4b429b (arvados): 11255: Add documentation about configuration to enable host networki...
Peter Amstutz
04:26 pm Revision 6ec5886c (arvados): 11255: Add -container-enable-networking and -container-network-mode ...
Peter Amstutz
04:07 pm Revision 49510014 (arvados): Fix broken link from crunch2 to crunch1 docs.
refs #6520 Tom Clegg
04:04 pm Revision 5689f1de (arvados): Do not let golang.org/x/tools/cmd/bundle get ahead of Ruby bundler.
refs https://dev.arvados.org/projects/arvados/wiki/Emacs_and_Go
No issue #
Tom Clegg
03:57 pm Revision 659b4944 (arvados): 8567: Add start_docker and kill_docker functions with wait loops.
Peter Amstutz
03:23 pm Revision 2fd606b3 (arvados): 7709: arvados-cli allows activesupport>=4
Tom Clegg
02:45 pm Task #11316 (In Progress): make other components' integration tests pass
Tom Clegg
02:45 pm Task #11316 (Resolved): make other components' integration tests pass
Tom Clegg
02:21 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Done: commit:2741b54 Lucas Di Pentima
02:09 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Can we get... Peter Amstutz
01:51 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
New updates at commit:077878d
Test run: https://ci.curoverse.com/job/developer-run-tests/197/
I've updated the te...
Lucas Di Pentima
02:18 pm Revision 2741b54c (arvados): 11170: Calling close method from an ensure block.
Lucas Di Pentima
02:18 pm Revision 8b278cdd (arvados): 11065: Defer audit log cleanup until after_commit.
Tom Clegg
02:06 pm Task #11298 (Resolved): make tests pass in rails4
Tom Clegg
01:21 pm Revision 077878d9 (arvados): 11170: Updated tests to reflect the use of IO instead of File.
Lucas Di Pentima
06:41 am Revision 5bc1b840 (arvados): 7709: Fix broken link from crunch2 to crunch1 docs.
Tom Clegg
06:20 am Revision 94068b9b (arvados): 7709: Fix full-text index check
PostgreSQL query from http://stackoverflow.com/a/6777904
(In Rails 4.2, ActiveRecord::Base.connection.indexes() no l...
Tom Clegg
05:26 am Revision 772511f3 (arvados): 7709: Serialized fields reject wrong types with useful error messages.
Tom Clegg
05:26 am Revision 4f81fec4 (arvados): 7709: Update bundle
Tom Clegg
05:26 am Revision bb17c578 (arvados): 7709: Remove services/api/log/
Tom Clegg
05:26 am Revision b4951aa7 (arvados): 7709: Remove passenger/puma websocket tests.
Tom Clegg
05:26 am Revision 5c304fbf (arvados): 7709: Allow null for empty serialized fields.
Tom Clegg
05:26 am Revision 8053d3b0 (arvados): 7709: Upgrade to rails4, fix some of the compatibility issues.
Tom Clegg
05:26 am Revision b9dcb648 (arvados): 7709: De-duplicate "ensure unique name" implementations.
Tom Clegg

03/21/2017

09:37 pm Revision 05c97120 (arvados): 8567: Make sure /root/.cache/arvados/docker is tempdir volume mount ...
Peter Amstutz
08:19 pm Revision 54d7045b (arvados): 7709: Do not set job_readable when it won't be used.
Tom Clegg
08:19 pm Revision 9cdf7ca4 (arvados): 7709: Leave container_request alone when applying default keep_cache...
Tom Clegg
08:18 pm Revision 3a022c4f (arvados): 7709: arvados-cli allows activesupport>=4
Tom Clegg
08:18 pm Revision 6c49531f (arvados): 7709: Fix tests (count existing links before adding new ones).
Tom Clegg
06:45 pm Bug #11278: Trailing space on string pasted into search box should not cause "Oops request failed"
This failure is happening in /pipeline_instances and project#show pages as well. Radhika Chippada
06:02 pm Revision bbe8547e (arvados): 8567: Use vfs Docker graph driver for maximum compatability. --dry-...
maximum image size. Add --tempdir option. Peter Amstutz
05:48 pm Story #6053 (Resolved): [Workbench] [Performance] Dashboard display is sluggish
Now the collections and links are retrieved in one call. And the redundant nodes calls are eliminated. Radhika Chippada
05:23 pm Bug #4923 (Resolved): [Workbench] Editable "name" column is presented but not actually available ...
For object types with no name column, such as Humans and Specimens, the column no longer displays the editable option... Radhika Chippada
05:13 pm Feature #11255: [Crunchv2] Option to use host networking for containers
11255-docker-host-networking @ commit:bfd73917834d89e9e8c55b6bb4e05912741fbf8a
I think the flag docs should say "f...
Tom Clegg
04:33 pm Feature #11255 (In Progress): [Crunchv2] Option to use host networking for containers
Peter Amstutz
04:56 pm Task #11312 (In Progress): Review 11255-docker-host-networking
Tom Clegg
04:33 pm Task #11312 (Resolved): Review 11255-docker-host-networking
Peter Amstutz
04:52 pm Bug #4041 (Resolved): [SDKs] arv pipeline_instance --help should work even if api server is not r...
Now "arv pipeline_instance --help" displays help information even when the API server is not running. Radhika Chippada
04:39 pm Story #3462 (Closed): [Workbench] We need a name for the drop-down menu with email address.
The UI changed since this ticket creation and we now use a User icon for this menu and address it as such. Radhika Chippada
03:41 pm Revision f8084a54 (arvados): Fix test broken by change of default behavior in arv-keepdocker. ref...
Peter Amstutz
03:40 pm Story #11065: [API] Delete rows from logs table when they exceed a configured threshold
11065-rotate-logs @ commit:37e995fb7423b2b353c599e2a1b00bda7c29ee6f Tom Clegg
08:00 am Story #11065 (In Progress): [API] Delete rows from logs table when they exceed a configured thres...
Tom Clegg
03:39 pm Revision 37e995fb (arvados): 11065: Delete old audit logs.
Tom Clegg
03:27 pm Revision bfd73917 (arvados): 11255: Add -container-network-mode option.
Peter Amstutz
03:06 pm Task #11311 (Resolved): Review 11221-always-restart-services
Tom Clegg
02:46 pm Story #11309 (Resolved): [Crunch2] crunchstat-summary --container UUID should summarize container...
Tom Clegg
08:00 am Feature #7709 (In Progress): [API] Upgrade API server to Rails 4.2
Tom Clegg
08:00 am Task #11298 (In Progress): make tests pass in rails4
Tom Clegg
08:00 am Task #11297 (Resolved): update bundle
Tom Clegg
06:08 am Story #11308 (Resolved): Support Python3 for arvados-python-client & command line utilities
Python 3 has been available for many years and the Python 2/3 migration is reaching its final stages. As a first ste... Tom Morris

03/20/2017

11:41 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Updates at commit:79e53c0
Test run: https://ci.curoverse.com/job/developer-run-tests/196/
Lucas Di Pentima
07:32 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
@squeue_jobs@ and @scancel@ should use the block form of @IO.popen()@ so that it is closed automatically. See @stdou... Peter Amstutz
07:02 pm Bug #11170: Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Updated at branch @11170-stale-squeue-procs@ - commit:f31475d
Test run: https://ci.curoverse.com/job/developer-run-t...
Lucas Di Pentima
09:39 pm Revision 79e53c0e (arvados): 11170: Treat the squeue/scancel calls as files instead of treating t...
Lucas Di Pentima
08:08 pm Feature #11255 (New): [Crunchv2] Option to use host networking for containers
Peter Amstutz
07:39 pm Feature #11255 (In Progress): [Crunchv2] Option to use host networking for containers
Peter Amstutz
07:07 pm Revision b77893f2 (arvados): 10218: Merge branch 'master' into 10218-record-node-info
Lucas Di Pentima
07:04 pm Revision e20dfe63 (arvados): If API server doesn't publish supported Docker image versions, make ...
error instead of a warning (can be overridden with --force-image-format)
refs #8567
Peter Amstutz
06:56 pm Revision f31475df (arvados): 11170: Set up a thread to reap the status of squeue runs so that the...
Lucas Di Pentima
06:34 pm Revision db7c2ba7 (arvados): Merge branch '8567-docker-migrator' refs #8567
Peter Amstutz
05:22 pm Feature #10218: [Crunch2] Gather and record cloud/physical node information for each container
Is it necessary to split JSON into multiple lines rather than just writing it as one chunk? If we write it as one chu... Tom Clegg
04:58 pm Revision 90e44a0d (arvados-dev): Merge branch 'master' of git.curoverse.com:arvados-dev
Git sync user
04:56 pm Revision 9b40808f (arvados-dev): install-arvados-jobs-image: Delete check for Docker image+repo a...
because it incorrectly skips upload in circumstances when the image+repo exists
but associated with the wrong differe...
Peter Amstutz
03:58 pm Revision 433cd703 (arvados): 8567: Bugfix check for existing repo+tag links.
Peter Amstutz
03:47 pm Task #11199 (In Progress): Review 10218-record-node-info
Tom Clegg
03:04 pm Revision 9c99316b (arvados): closes #11290
Merge branch '11290-caret-font' Radhika Chippada
02:20 pm Feature #7709: [API] Upgrade API server to Rails 4.2
So far, the most annoying part has been making the websocket tests (or server?) work. Switching to arvados-ws and aba... Tom Clegg
02:14 pm Bug #3224: [Workbench] Search box on collections page should use infinite scroll instead of (brok...
The collections page is linked from the dashboard ("all collections" button).
All of the bugs noted still exist to...
Tom Clegg
02:02 pm Revision 03589784 (arvados): 8567: arv-keepdocker catches EPIPE so it doesn't print backtrace whe...
other commands such as "head". Peter Amstutz
01:36 pm Revision fd42d69f (arvados): 8567: Add migrate19
Peter Amstutz
01:31 pm Bug #11071: [Workbench] qr1hi performance tests are broken
I updated the table above:... Nico César
10:34 am Revision 99ee4701 (arvados): 11290: Reverted "fa-caret-down" usage back to 'span class="caret"' w...
Radhika Chippada
09:52 am Revision f1ff5973 (arvados): 11290: Revert back fa-caret-down usage to 'span class="caret"' with ...
Radhika Chippada

03/19/2017

01:20 am Task #11298 (Resolved): make tests pass in rails4
Tom Clegg
01:19 am Task #11297 (In Progress): update bundle
Tom Clegg
01:19 am Task #11297 (Resolved): update bundle
Tom Clegg

03/18/2017

06:28 am Bug #11296 (New): [arv-put] bad progress indicator
/usr/bin/arv-put 0.1.20170309224426
The progress indicator for my upload currently looks like:
$ time arv-put -...
Tom Morris

03/17/2017

09:54 pm Revision 2accec1f (arvados): 8567: Better command line UI
Peter Amstutz
08:59 pm Bug #11170 (In Progress): Stale squeue processes on c97qk caused by "crunch-dispatch --jobs"
Lucas Di Pentima
08:41 pm Task #11292 (Resolved): Review 11209-unmount-replace
Tom Clegg
08:41 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
11209-unmount-replace @ commit:5752685c137c5e37e13845f5328e9a3930fa3100
This should let us replace the @"mount|awk...
Tom Clegg
08:41 pm Feature #10218: [Crunch2] Gather and record cloud/physical node information for each container
Updates in branch @10218-record-node-info@ at commit:b30e81e
Test run: https://ci.curoverse.com/job/developer-run-te...
Lucas Di Pentima
08:40 pm Bug #11288 (Resolved): [Nodemanager] Need reason to set DOWN state
Applied in changeset arvados|commit:de283bd8dd383a4177bb714212cf7c59f38a23d8. Peter Amstutz
05:22 pm Bug #11288 (Resolved): [Nodemanager] Need reason to set DOWN state
Slurm expects a reason when setting node to DOWN:... Peter Amstutz
08:36 pm Revision de283bd8 (arvados): Merge branch '11288-slurm-down-reason' closes #11288
Peter Amstutz
08:32 pm Revision 5752685c (arvados): 11209: "--unmount /path/..." unmounts /path and all fuse mounts belo...
Tom Clegg
08:29 pm Revision b30e81ee (arvados): 10218: Save the container record as a json file and also write it on...
Lucas Di Pentima
06:15 pm Feature #11100: [CWL] Intermediary collection handling can be specified
* Add a "output_ttl" on container request which means output will have trash_at and delete_at set now + output_ttl (a... Peter Amstutz
05:27 pm Revision da8c9048 (arvados): 11288: Slurm requires reason to put node in DOWN state.
Peter Amstutz
04:56 pm Task #11268 (Resolved): Review 11014-hide-node-status
Lucas Di Pentima
01:25 am Task #11268 (In Progress): Review 11014-hide-node-status
Radhika Chippada
02:50 pm Bug #11014 (Resolved): [Workbench] Hide the "idle/busy nodes" part of the dashboard if crunch1 AP...
Applied in changeset arvados|commit:47178c71032b476e34fd0c6b10065e1b96a568f1. Lucas Di Pentima
02:21 pm Bug #11014: [Workbench] Hide the "idle/busy nodes" part of the dashboard if crunch1 APIs are disa...
Thanks for the comments, all addressed at commit:bf03dd4
Test run: https://ci.curoverse.com/job/developer-run-test...
Lucas Di Pentima
02:40 am Bug #11014: [Workbench] Hide the "idle/busy nodes" part of the dashboard if crunch1 APIs are disa...
* Rather than executing “PipelineInstance.api_exists?” multiple times, can we declare a variable such as “show_node_s... Radhika Chippada
02:44 pm Revision 47178c71 (arvados): Merge branch '11014-hide-node-status'
Closes #11014 Lucas Di Pentima
02:16 pm Revision bf03dd4f (arvados): 11014: When PipelineInstance API is off and also show_recent_collect...
Corrected test name.
Avoid calling PipelineInstance.api_exist?(:index) more than once.
Lucas Di Pentima
02:12 pm Story #11285 (New): Update Pipeline Optimization wiki with CWL/Crunchv2
update https://dev.arvados.org/projects/arvados/wiki/Pipeline_Optimization with CWL references instead of pipeline te... Bryan Cosca
01:57 pm Bug #11283 (Resolved): duplicate key value violates unique constraint "index_nodes_on_slot_number"
this is part of a 2.6G log file: ... Nico César
01:05 am Revision a8b6688f (arvados): 9132: few more updates to use the new API
Radhika Chippada

03/16/2017

08:57 pm Task #11271 (Resolved): Review 11254-nodemanager-no-actor
Peter Amstutz
08:40 pm Task #11271 (In Progress): Review 11254-nodemanager-no-actor
Tom Clegg
08:55 pm Bug #11254 (Resolved): [Node manager] backtrace on node shutdown
Applied in changeset arvados|commit:996b635700d7270229200a56d2c2b9f7c96a84fb. Peter Amstutz
08:39 pm Bug #11254: [Node manager] backtrace on node shutdown
11254-nodemanager-no-actor @ commit:2c69d49 LGTM
...although I'd say the duplicated conditions here were already a...
Tom Clegg
08:52 pm Revision 996b6357 (arvados): Merge branch '11254-nodemanager-no-actor' closes #11254
Peter Amstutz
08:49 pm Revision c733e426 (arvados): 11209: Add arv-mount --unmount and --replace flags
Tom Clegg
08:49 pm Revision b60a21fe (arvados): 11254: Refactor _node_states
Peter Amstutz
08:43 pm Revision 9a7d9243 (arvados): 11209: Add arv-mount --unmount and --replace flags
Tom Clegg
08:28 pm Bug #4124: [Crunch] Socket timed out on send/recv operation causes pipeline failure
I don't know if we ever updated our default puppet configuration.
We've seen some unexplained SLURM timeouts on so...
Peter Amstutz
08:11 pm Revision 2c69d491 (arvados): 11254: Cloud nodes where "actor is None" are considered to be in shu...
only time it should be "None" is the period between a successful shutdown and
when the node disappears from the cloud...
Peter Amstutz
07:16 pm Revision 9f34ff6f (arvados): 10218: Use a []string for the entire command instead of splitting it.
Lucas Di Pentima
07:13 pm Bug #11014: [Workbench] Hide the "idle/busy nodes" part of the dashboard if crunch1 APIs are disa...
Re-ran the tests here: https://ci.curoverse.com/job/developer-run-tests/192/
Lucas Di Pentima
06:22 pm Bug #11014: [Workbench] Hide the "idle/busy nodes" part of the dashboard if crunch1 APIs are disa...
Updates on branch @11014-hide-node-status@ at commit:73dbf5b
Tests run at: https://ci.curoverse.com/job/developer-ru...
Lucas Di Pentima
02:48 pm Bug #11014 (In Progress): [Workbench] Hide the "idle/busy nodes" part of the dashboard if crunch1...
Lucas Di Pentima
06:18 pm Revision 73dbf5bf (arvados): 11014: Check for PipelineIndex#index API to exist for rendering the ...
Added related test. Lucas Di Pentima
05:24 pm Revision 386faadf (arvados): 10218: Wait for container to be started (not just created) before tr...
Tom Clegg
02:01 pm Revision 8513e042 (arvados): 10218: Split multi-line command output so that each line is written ...
Lucas Di Pentima
04:52 am Bug #11278 (Resolved): Trailing space on string pasted into search box should not cause "Oops req...
String was "170302-e00504-0041-bhh5ytalxx "
Deleting the trailing space causes this search to work
Tom Morris
01:43 am Bug #9588 (Resolved): [CWL] cwl-runner parses nested arrays repetively
This is no longer an issue. Jiayong Li

03/15/2017

11:13 pm Task #3718 (Closed): Hash out desired API with science team
Tom Morris
11:13 pm Task #3957 (Closed): crunch-job uses num_retries support in Perl SDK
Tom Morris
11:12 pm Task #3956 (Closed): Add num_retries arguments throughout Perl SDK
Tom Morris
11:12 pm Task #3060 (Closed): List of shared folders should say who owns each one (or description)
Tom Morris
11:12 pm Task #3058 (Closed): Suggest "what to do next" when viewing a new/empty folder
Tom Morris
11:12 pm Task #2645 (Closed): Generate "ready to ingest" message on the event bus
Tom Morris
11:12 pm Task #2633 (Closed): Implement TLS support internally
Tom Morris
11:12 pm Task #2636 (Closed): Test SSL support
Tom Morris
11:09 pm Task #5031 (Closed): Review/feedback
Tom Morris
11:04 pm Task #7726 (Closed): Review 7724-scoped-token
Tom Morris
10:54 pm Task #8846 (Closed): Review
Tom Morris
10:53 pm Task #9533 (Closed): Review 4753-websocket-test-port
Tom Morris
10:53 pm Task #2806 (Closed): Delete active and success attributes from pipeline_instance
Tom Morris
10:43 pm Task #3458 (Closed): Review 3452-put-collection-in-project
Tom Morris
10:27 pm Task #8955 (Closed): Review 8952-node-manager-safer-slurm-shutdown-check-wip
Tom Morris
10:21 pm Revision 1230d8a1 (arvados): 10218: Logging node information (cpu, mem, disk) by storing command ...
Lucas Di Pentima
08:13 pm Bug #10669 (New): googleapiclient.errors.InvalidJsonError retrieving discovery document
Tom Morris
08:12 pm Bug #10669 (Duplicate): googleapiclient.errors.InvalidJsonError retrieving discovery document
Tom Morris
08:12 pm Bug #9521 (Duplicate): Corrupt discovery document should be handled better
Tom Morris
08:10 pm Task #11272 (Resolved): Review 7824-arvls-arvput-collection-api-usage
Lucas Di Pentima
08:10 pm Task #11271 (Resolved): Review 11254-nodemanager-no-actor
Peter Amstutz
08:10 pm Task #11269 (Resolved): Review 11170-stale-squeue-procs
Lucas Di Pentima
08:07 pm Task #11268 (Resolved): Review 11014-hide-node-status
Radhika Chippada
08:07 pm Task #11267 (Resolved): Review 10669-safe-http-cache
Tom Clegg
08:07 pm Task #11266 (Resolved): Review 11065-rotate-logs
Tom Clegg
08:07 pm Task #11265 (Resolved): Review branch 3821-collection-file-manage
Radhika Chippada
08:07 pm Task #11264 (Resolved): Review 7709-api-rails4
Tom Clegg
08:07 pm Task #11263 (Resolved): Review
Tom Clegg
08:06 pm Bug #11254 (In Progress): [Node manager] backtrace on node shutdown
Tom Morris
08:03 pm Bug #11254 (Resolved): [Node manager] backtrace on node shutdown
Fixed slurmd in the compute nodes and it is working ok now. Javier Bértoli
06:53 pm Bug #11254: [Node manager] backtrace on node shutdown
The backtrace looks like an unintended side effect of #10846.
On further research, we determined the underlying re...
Peter Amstutz
03:45 pm Bug #11254 (Resolved): [Node manager] backtrace on node shutdown
After upgrading c97qk to Xenial, trying to run a test job https://workbench.c97qk.arvadosapi.com/pipeline_instances/c... Javier Bértoli
07:43 pm Feature #11255: [Crunchv2] Option to use host networking for containers
summon Nico before discussing implementing Nico César
03:50 pm Feature #11255 (Resolved): [Crunchv2] Option to use host networking for containers
Docker bridge networking has bugs on certain kernels. Add a flag to crunch-run to instruct containers to use host ne... Peter Amstutz
07:35 pm Story #9132: [Crunch2] crunch-run uses official docker client library
Please take over 9132-dockerclient
* Replace API calls to equivalent ones, see https://godoc.org/github.com/docker...
Peter Amstutz
07:31 pm Bug #11261: [API] full text search on pipeline_instances table is extremely slow (wrong index?)
... Tom Clegg
07:30 pm Bug #11261: [API] full text search on pipeline_instances table is extremely slow (wrong index?)
Copied from #11071:
Version query:...
Tom Clegg
07:29 pm Bug #11261 (New): [API] full text search on pipeline_instances table is extremely slow (wrong ind...
Tom Clegg
07:26 pm Bug #11260 (New): [API] "arv group contents" produces a 404 error (seems to POST instead of GET?)
Tom Clegg
07:23 pm Bug #11071: [Workbench] qr1hi performance tests are broken
Version query:... Tom Clegg
04:55 pm Bug #11071: [Workbench] qr1hi performance tests are broken
I searched using "hash" in our staging environment, and I saw about 10% improvement for the first page.
Before:
...
Radhika Chippada
07:21 pm Story #11259 (Duplicate): [VG][myBRCA] Update status API at beginning and end of sample run
Tom Morris
07:13 pm Story #11259 (Duplicate): [VG][myBRCA] Update status API at beginning and end of sample run
Tom Morris
06:54 pm Bug #11257 (New): [CWL] Fails with $schemas referencing remote resources.
Workflows with external http resources listed in $schemas get into trouble with the code to find and upload local dep... Peter Amstutz
05:37 pm Bug #11237: python-arvados-python-client depends on old versions of packages
This pin comes from commit:ec3ff9b4 "Pin google-api-python-client and oauth2client versions to deal with incompatabil... Tom Clegg
05:20 pm Task #11141 (Resolved): Review 6520-nodemanager-docs
Peter Amstutz
03:31 pm Story #11251: [Tests] Make workbench integration tests finish faster (at least in Jenkins)
IMO we should be fixing slow/redundant test cases before we give up and make the test pipeline/server fatter. It look... Tom Clegg
03:23 am Story #11251: [Tests] Make workbench integration tests finish faster (at least in Jenkins)
Branch 11251-split-wb-integration-tests takes an initial stab at using minutest --exclude option.
This branch inte...
Radhika Chippada
03:19 am Story #11251: [Tests] Make workbench integration tests finish faster (at least in Jenkins)
Similar to workbench_units, workbench_functionals, workbench_integration, it would be helpful if we further split wor... Radhika Chippada
01:29 am Story #11251 (New): [Tests] Make workbench integration tests finish faster (at least in Jenkins)
Radhika Chippada
03:11 pm Task #11205 (Resolved): Review branch 11071-fts-perf-test
Radhika Chippada
03:03 pm Revision 54837bca (arvados): 8567: Add check that admin token is used and ensure that migration l...
created owned by system user. Also fix tests now that arv-keepdocker uses
logging instead of printing directly to sy...
Peter Amstutz
02:54 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
The "fuse bug":https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=632258 seems to be related to a double-mounted mount... Tom Clegg
11:15 am Bug #11209: stuck keep fuse mounts not cleared by crunch-job
When I run `umount -f` to clear the problem, it has always been as root. Never tried running it as any other user. Joshua Randall
02:41 pm Story #9589: [Workbench] Update collection interface for collections with non-nil trash_at
* Do we want to support "Move collection" option for an expiring collection?
* Do we want to support "Copy to proj...
Radhika Chippada
04:10 am Revision dd1db553 (arvados): 11251: -v works with -e in TESTOPTS
Radhika Chippada
02:58 am Revision 0ed39efc (arvados): 11251: an intial stab at using minitest --exclude option to split wo...
Radhika Chippada
12:15 am Bug #4124: [Crunch] Socket timed out on send/recv operation causes pipeline failure
Peter - please review whether the recommended message timeout has already been incorporated and close this out. Thx Tom Morris

03/14/2017

11:52 pm Bug #4886 (Closed): [Docker] Web upload stuck at "upload in progress"
Sorry this lingered so long, but the code base has change so much since this was reported that it'd be impossible to ... Tom Morris
11:41 pm Bug #8371: [Deployment] Upgrading Rails packages on CentOS uninstalls them
Javier - can you please review the current state of this and either close or update? Thanks! Tom Morris
08:05 pm Bug #11071 (Resolved): [Workbench] qr1hi performance tests are broken
Applied in changeset arvados|commit:b1aa6c85c3db947f0963b1bddb2784c115f5c97d. Radhika Chippada
07:59 pm Bug #11071: [Workbench] qr1hi performance tests are broken
> Do you think that the line at services/api/app/controllers/arvados/v1/groups_controller.rb:99 could be improved in ... Radhika Chippada
07:26 pm Bug #11071: [Workbench] qr1hi performance tests are broken
This lgtm. Only one little question: Do you think that the line at @services/api/app/controllers/arvados/v1/groups_co... Lucas Di Pentima
03:04 pm Bug #11071: [Workbench] qr1hi performance tests are broken
Tests @ https://ci.curoverse.com/job/developer-run-tests/186/ Radhika Chippada
08:01 pm Revision b1aa6c85 (arvados): closes #11071
Merge branch '11071-fts-perf-test' Radhika Chippada
08:00 pm Revision 98329b75 (arvados): 11071: formatting on the long if statement
Radhika Chippada
07:56 pm Bug #11186 (Duplicate): Priority 0 state shouldn't be labeled "Ready"
See #11250 Peter Amstutz
06:29 pm Bug #11186: Priority 0 state shouldn't be labeled "Ready"
Suggest "Stopped" Peter Amstutz
07:35 pm Revision 91118e3a (arvados): Add missing documentation file. refs #6520
Peter Amstutz
07:17 pm Revision bdaa9de9 (arvados): Merge branch '8567-api-select-docker-fmt' refs #8567
Peter Amstutz
07:17 pm Revision d363323b (arvados): Merge branch '8567-cwl-docker-img' refs #8567
Peter Amstutz
07:15 pm Story #11123 (Resolved): Add node manager to install guide
Applied in changeset arvados|commit:449d780f0a470f67d1a28fe1459a8bab79562069. Peter Amstutz
04:02 pm Story #11123: Add node manager to install guide
Made some updates, if you want to take another quick look: 6520-nodemanager-docs Peter Amstutz
03:10 pm Story #11123: Add node manager to install guide
Yeap. My bad, probably run the wrong @git diff@ when checking which files needed to review.
Now, ignoring my last...
Javier Bértoli
02:57 pm Story #11123: Add node manager to install guide
Javier Bértoli wrote:
> Question, in *doc/install/install-keepstore.html.textile.liquid*: does it make sense to docu...
Peter Amstutz
07:09 pm Revision 449d780f (arvados): Merge branch '6520-nodemanager-docs' closes #11123
Peter Amstutz
06:30 pm Story #11250 (Resolved): [Workbench] Better user-facing terms for container states
* When a container is in the slurm queue, its state is displayed as "Locked". This is confusing to users who don't a... Peter Amstutz
06:18 pm Feature #11249 (New): [SDKs] Writable collection files returned by Go SDK should be seekable
The reading+seeking and writing code need to be reconciled so OpenFile and Create return an object that can read, wri... Tom Clegg
05:29 pm Feature #10664 (Duplicate): arv-keepdocker should upload images with image:tag
Tom Clegg
04:44 pm Revision eabc13f2 (arvados): 8567: Add note about updating API server configuration.
Peter Amstutz
04:39 pm Revision dee634b2 (arvados): 8567: Add docker19 migration instructions to install guide.
Peter Amstutz
04:30 pm Revision 205b0776 (arvados): 8567: Creates migration links.
Peter Amstutz
04:30 pm Revision 2ed5325b (arvados): 8567: Add check for ARVADOS_API_HOST_INSECURE
Peter Amstutz
04:30 pm Revision 1d7577d0 (arvados): 8567: Add status reporting to migrate script.
Peter Amstutz
04:30 pm Revision 6058f336 (arvados): 8567: Move out of tools/ into sdk/python and docker/docker19-migrate.
Peter Amstutz
04:30 pm Revision 55c719bf (arvados): 8567: Rename docker19-migrate to migrate-docker19 for consistency with
arv-migrate-docker19. Add docstrict to migrate19() function. Peter Amstutz
04:30 pm Revision f074ef81 (arvados): 8567: Fix migrate links to use PDH instead of UUID.
Better error reporting.
Migrate script cleans up /var/lib/docker inside container.
Peter Amstutz
04:30 pm Revision 0eb52182 (arvados): 8567: Docker image migration WIP.
Peter Amstutz
04:25 pm Revision 5fffad60 (arvados): 8567: Fix tests now that container_image provides docker repo+tag an...
Peter Amstutz
04:03 pm Revision 355fe24b (arvados): 8567: If a search_term looks like a PDH, always treat it as one. Al...
correct optional parameter syntax. Peter Amstutz
03:38 pm Revision 25296def (arvados): 6520: Add page with sample ping script. Improve instructions on cre...
compute node a little bit. Peter Amstutz
03:37 pm Task #11205 (In Progress): Review branch 11071-fts-perf-test
Lucas Di Pentima
03:21 pm Task #11141 (Feedback): Review 6520-nodemanager-docs
Javier Bértoli
03:06 pm Revision c04608e4 (arvados): 6520: Add node_mem_scaling to documentation.
Peter Amstutz
02:59 pm Revision a1383389 (arvados): 6520: Add information about setting up SLURM to crunchv2 documentation.
Peter Amstutz
02:59 pm Revision 7eb2eff1 (arvados): 6520: Node manager docs WIP
Peter Amstutz
02:46 pm Revision 6ea807b2 (arvados): 8567: Use Docker image repo+tag name instead of PDH so that API serv...
Peter Amstutz

03/13/2017

10:05 pm Revision c7515954 (arvados): 11071: test count=none in groups#contents method.
Radhika Chippada
09:37 pm Revision dbb0d22a (arvados): 8567: Tests default to image format v1 to avoid breaking all the tes...
uses the :docker_image collection. Peter Amstutz
09:31 pm Revision 918e16de (arvados): 8567: Adjust job container resolve test now that images are filtered...
support version. Peter Amstutz
08:40 pm Revision a7220572 (arvados): 8567: Refactor code that queries migration links into get_compatible...
Peter Amstutz
06:48 pm Bug #11209 (In Progress): stuck keep fuse mounts not cleared by crunch-job
Tom Clegg
06:48 pm Bug #11209: stuck keep fuse mounts not cleared by crunch-job
Normally crunch-job frees up mount points using @fusermount -u -z@ but for some reason it isn't working here:
<pre...
Tom Clegg
04:55 pm Bug #11226: [SDK] Python client tries to cache discovery document at the same local path regardle...
Tom Morris wrote:
> I take it this got instagroomed while I was gone.
>
> Does this mean that #10669 is fixed (an...
Peter Amstutz
04:19 pm Bug #11226: [SDK] Python client tries to cache discovery document at the same local path regardle...
I take it this got instagroomed while I was gone.
Does this mean that #10669 is fixed (and can be closed) as well?
Tom Morris

03/11/2017

07:23 pm Bug #11238: job_task creation fails with ApiError - HttpError 422 - ActiveRecord::StatementInvali...
I've followed the directions at https://blog.dob.sk/2012/05/19/fixing-pg_dump-invalid-memory-alloc-request-size/ to c... Joshua Randall

03/10/2017

10:16 pm Story #8773 (Closed): [GATK Queue] Support a mechanism to redirect stderr for children
Tom Clegg
10:15 pm Bug #7000 (Closed): [Docker] API server starts before PostgreSQL is ready
Tom Clegg
10:15 pm Bug #7007 (Closed): [Docker] Bootstrap font fails to load in Workbench Docker image
Tom Clegg
10:15 pm Bug #7006 (Closed): [Docker] Fix SSO configuration in published images
Tom Clegg
10:15 pm Bug #7005 (Closed): [Docker] API server uses omniauth.rb for SSO configuration, not application.yml
Tom Clegg
10:15 pm Bug #6998 (Closed): [Docker] Workbench image doesn't serve HTTPS
Tom Clegg
10:10 pm Bug #5949 (Closed): [DRAFT] [Workbench] Users can be notified about changes to important pipelines
Tom Clegg
10:07 pm Feature #5828 (Closed): [Workbench] Create new collection with selected files copy streams as wel...
Tom Clegg
10:07 pm Bug #5850 (Closed): All clients authenticate directly against SSO server without going through AP...
Tom Clegg
10:04 pm Bug #5876 (Closed): [Docker] Needs smarter dependency ordering when restarting existing containers
Tom Clegg
10:04 pm Bug #5878 (Closed): [Workbench] PipelineInstancesTest#test_Create_and_run_a_pipeline is not reliable
Tom Clegg
10:04 pm Bug #5892 (Closed): [Workbench] collections#index returns 504 Gateway Timeout
Tom Clegg
10:04 pm Bug #5897 (Closed): [FUSE] Catch and recover from any API client exceptions
Tom Clegg
10:03 pm Feature #5900 (Closed): [SDK] Implement arvados.gettaskparam(*args) to match arvados.getjobparam(...
Tom Clegg
10:02 pm Bug #5905 (Closed): [SDKs] Improve certificate validation in Python SDK
Tom Clegg
10:01 pm Bug #5908 (Closed): [Workbench] collection#show performing too many unnecessary API server reques...
Tom Clegg
10:01 pm Bug #5923 (Closed): Fiddlesticks when trying to view a log file
Tom Clegg
10:01 pm Bug #5919 (Closed): Keep errors
Tom Clegg
10:01 pm Feature #5928 (Closed): Syntax highlighting of viewing source in workbench
Tom Clegg
10:01 pm Bug #5945 (Closed): arv-get is slow for this collection
Tom Clegg
10:00 pm Bug #6019 (Closed): [FUSE] `ls` in a large home directory (4400+ items) takes too long
Tom Clegg
10:00 pm Bug #6025 (Closed): [SSO] Authenticate users with OAuth2
Tom Clegg
10:00 pm Story #5098 (Closed): [Keep] Design: using Arvados to browse, and run jobs on, input data that is...
Tom Clegg
10:00 pm Feature #5414 (Closed): [Keep] Use data stored remotely (not in local keepstore)
Tom Clegg
07:06 pm Revision e1e0bec5 (arvados): 8567: Add & tweak tests for selecting compatible Docker image format.
Peter Amstutz
06:51 pm Revision f4a7c5e6 (arvados): 8567: find_all_for_docker_image() returns only Docker images compati...
Peter Amstutz
06:39 pm Story #4443 (Closed): [DRAFT] [Workbench] Tour Guide Dax follows you around for a while, showing ...
Tom Clegg
06:38 pm Story #4284 (Closed): [Crunch] Add unit and functional tests to crunchstat test suite
Tom Clegg
06:38 pm Bug #4123 (Closed): [API] move Job script/repository/docker validations from controller to model
Tom Clegg
06:36 pm Bug #4120 (Closed): [Workbench] [obsolete?] Pipeline state can be failed even though every job is...
Tom Clegg
06:35 pm Feature #3803 (Closed): [SDKs] Add a rate limiting feature to arv-put and arv-get (like rsync's b...
Tom Clegg
06:34 pm Story #3696 (Closed): [Workbench] Improve log viewer to more effectively expose relevant informat...
Tom Clegg
06:34 pm Feature #3987 (Closed): [Docker] Run a 5-second diagnostic suite after bringing up docker contain...
Tom Clegg
06:34 pm Bug #3910 (Closed): [SDKs] Client libraries should retry failed API requests after errors like Ga...
Tom Clegg
06:34 pm Feature #3955 (Closed): [Workbench] Render runtime-formatted timestamps as "8:00 am" or "Sep 23" ...
Tom Clegg
06:33 pm Feature #3923 (Closed): [Workbench] Use web notifications to alert user when pipelines finish
Tom Clegg
06:32 pm Story #3511 (Closed): [Documentation] Present an efficient pattern for developing a pipeline temp...
Tom Clegg
06:31 pm Story #3701 (Closed): [Workbench] Show current user's compute node usage over time
Tom Clegg
06:31 pm Story #3446 (Closed): [Workbench] Sort by name before uuid in search results.
Tom Clegg
06:30 pm Bug #3352 (Closed): [SDK] After ^C, arv-put sometimes exits but leaves processes/threads behind t...
Tom Clegg
06:30 pm Bug #3134 (Closed): [Workbench] Deleting a job in a project doesn't show delete wipe animation, i...
Tom Clegg
06:30 pm Bug #3166 (Closed): [Workbench] Generic "attributes" tab renders uuid as a link to the object, wi...
Tom Clegg
06:30 pm Bug #3483 (Closed): [Keep] Keep uses appropriate HTTP status codes for failed DELETE requests
Tom Clegg
06:29 pm Bug #3262 (Closed): [Documentation] Describe how to run tramp in emacs.
Tom Clegg
04:04 pm Bug #11238: job_task creation fails with ApiError - HttpError 422 - ActiveRecord::StatementInvali...
... Joshua Randall
03:36 pm Bug #11238: job_task creation fails with ApiError - HttpError 422 - ActiveRecord::StatementInvali...
These appear to be the corresponding log from the api server production.log (there does not appear to be any mention ... Joshua Randall
02:47 pm Bug #11238 (New): job_task creation fails with ApiError - HttpError 422 - ActiveRecord::Statement...
For some reason some of our jobs are failing with an API server error indicating a postgres statement was invalid bec... Joshua Randall
02:38 pm Task #11233 (Resolved): Review
Peter Amstutz

03/09/2017

10:44 pm Revision f63c160f (arvados): Bugfix: python Collection class sets _portable_data_hash in _populat...
refs #10956 Peter Amstutz
10:41 pm Revision 669e7f30 (arvados): 8567: Fix migrate links to use PDH instead of UUID.
Better error reporting.
Migrate script cleans up /var/lib/docker inside container.
Peter Amstutz
10:13 pm Bug #11237: python-arvados-python-client depends on old versions of packages
When updating an Ubuntu 16.04 host, @python-arvados-python-client@ complains that the available versions are not suit... Javier Bértoli
10:08 pm Bug #11237 (Resolved): python-arvados-python-client depends on old versions of packages
Javier Bértoli
09:41 pm Bug #11236 (Resolved): Dependencies in Ubuntu 16.04 (xenial) offer to REMOVE arvados-node-manager
Performing a dist-upgrade on an Ubuntu 16.04 (xenial) host offers to **REMOVE** @arvados-node-manager@
* Sources l...
Javier Bértoli
09:22 pm Bug #4344 (Resolved): [SDK] can't make an anonymous token from the cli
This works, but you have to say @"owner_uuid":"X"@, not @"user":"X"@. Tom Clegg
09:17 pm Bug #3999 (Closed): [Workbench] Pipeline timing number oddities
Tom Clegg
09:17 pm Bug #3855 (Closed): [SDK] New keep mount is very slow on initial usage
Tom Clegg
09:17 pm Bug #4132 (Closed): [Workbench] Add unit test infrastructure (and some examples) for JavaScript a...
Tom Clegg
09:16 pm Feature #3333 (Closed): [DRAFT] [Docker] Make local Docker install more useful for development
Tom Clegg
09:16 pm Bug #3847 (Resolved): [SDK] --project-uuid switch behaves strangely without = (seen in arv-keepdo...
Seems to have been fixed, although I don't see where/when.... Tom Clegg
08:28 pm Revision 605d11f2 (arvados): Merge branch '5036-arv-mount-type'
refs #5036 Tom Clegg
08:14 pm Feature #5036: [arv-mount] Change default mount type from "fuse" to "fuse.arvados"
LGTM. Peter Amstutz
07:56 pm Feature #5036 (In Progress): [arv-mount] Change default mount type from "fuse" to "fuse.arvados"
Tom Clegg
07:56 pm Feature #5036: [arv-mount] Change default mount type from "fuse" to "fuse.arvados"
5036-arv-mount-type @ commit:fa8c5cdb36fa89af92087d6465b207d65ffc9618 adds a "--subtype FOO" arg, which makes the fil... Tom Clegg
07:53 pm Revision fa8c5cdb (arvados): 5036: Add "--subtype foo" flag to set mounted filesystem type to "fu...
Tom Clegg
07:50 pm Bug #11226 (Resolved): [SDK] Python client tries to cache discovery document at the same local pa...
Applied in changeset arvados|commit:82697fea93b1c87cdee27d2b9a76c1b7ac07497e. Peter Amstutz
03:49 pm Bug #11226: [SDK] Python client tries to cache discovery document at the same local path regardle...
+1 Peter Amstutz
03:48 pm Bug #11226: [SDK] Python client tries to cache discovery document at the same local path regardle...
Suggest we
# pass cache_discovery=False to google-api-client so we get back to what we thought we were doing, i.e., ...
Tom Clegg
03:45 pm Bug #11226: [SDK] Python client tries to cache discovery document at the same local path regardle...
Also want to do one of:
a) continue to use httplib2 caching, which is apparently not multithread/multiprocess safe...
Peter Amstutz
03:38 pm Bug #11226: [SDK] Python client tries to cache discovery document at the same local path regardle...
https://github.com/google/google-api-python-client/pull/127
I think we can use the @cache_discovery@ option to bui...
Peter Amstutz
07:44 pm Revision 82697fea (arvados): Merge branch '11226-discovery-doc-cache' closes #11226
Peter Amstutz
07:40 pm Revision a15fc58f (arvados): 11226: Disable google api client discovery doc caching, use only htt...
Google API client has its own caching mechanism. The problem is, by default
this goes to /tmp/google-api-python-clie...
Peter Amstutz
06:11 pm Revision fe2484ec (arvados): 10401: Bump cwltool pin.
Peter Amstutz
03:55 pm Task #11233 (Resolved): Review
Peter Amstutz
03:53 pm Revision ebb0138d (arvados): 8567: Fix docker_migration_pdh to seach head/tail_uuid (PDH doesn't ...
Peter Amstutz

03/08/2017

10:04 pm Revision c69d4a2b (arvados): 10401: Fix arvcontainer use of pathmapper.
Peter Amstutz
08:33 pm Revision c7143dc9 (arvados): Add ability to use "arvbox start test" to re-run tests without teari...
restarting whole container. no issue # Peter Amstutz
08:33 pm Revision 005595fb (arvados): Arvbox now uses Go websockets server instead of Puma. no issue #
Peter Amstutz
07:31 pm Bug #11226 (Resolved): [SDK] Python client tries to cache discovery document at the same local pa...
The Python SDK instructs httplib2 to cache the discovery document in @~/.cache/arvados/discovery@. However, the goog... Peter Amstutz
06:43 pm Task #11225 (In Progress): Update cwltool
Peter Amstutz
06:43 pm Task #11225 (Resolved): Update cwltool
Peter Amstutz
06:41 pm Revision 16180e3b (arvados): 10401: Passes unit tests.
Peter Amstutz
06:23 pm Revision 08bf82bb (arvados): 10401: Allow Arvados extensions to be used in "requirements" not jus...
Peter Amstutz
06:19 pm Revision dd7710a6 (arvados): 10401: Use use_custom_schema feature for extensions.
Peter Amstutz
06:13 pm Revision e05dddc4 (arvados): 10401: Bump cwltool & schema salad pins.
Peter Amstutz
04:18 pm Bug #4748 (Closed): [API] Explain why there are 21 jobs with log = ""
Tom Clegg
04:17 pm Bug #4451 (Closed): [Workbench] Fiddlesticks when rerunning pipeline with edited template
Tom Clegg
04:16 pm Bug #4416 (Closed): [Workbench] "Manage" permission should be sufficient to edit project's name/d...
Tom Clegg
04:15 pm Bug #4440 (Closed): [Documentation] "Writing a Crunch script" is mysterious
Tom Clegg
04:15 pm Bug #4529 (Closed): [SDKs] Ensure Python and Go SDKs in a given situation always choose either pr...
Tom Clegg
04:14 pm Bug #4488 (Closed): [SDKs] arvados.keep.KeepClient.KeepService should know whether it is a proxy
Tom Clegg
04:12 pm Bug #4335 (Closed): [Crunch] Improve node startup speed. 15 min is too slow.
Tom Clegg
04:11 pm Bug #4218 (Closed): [Keep] Improve speed of /index requests
Tom Clegg
04:11 pm Story #4238 (Closed): [Documentation] Show how to run a pipeline instance without using a template.
Tom Clegg
04:10 pm Story #4305 (Closed): [Node Manager] Investigate and try to address RAM use
Tom Clegg
04:10 pm Bug #3688 (Closed): [API] User should be able to delete a project even though dependent logs exist
Tom Clegg
04:09 pm Story #3820 (Closed): [Crunch] Jobs need code from multiple git repositories
Tom Clegg
04:09 pm Feature #4131 (Closed): [Workbench] Support incremental loading of long job logs, using Range req...
Tom Clegg
04:09 pm Feature #4090 (Closed): Add code coverage report for workbench javascript
Tom Clegg
04:08 pm Story #4424 (Closed): [Keep] [DRAFT] Use stronger hash algorithm (such as SHA-2) for Keep blocks
Moved to [[Changing Keep hash algorithm]] Tom Clegg
04:06 pm Story #11123: Add node manager to install guide
Question, in *doc/install/install-keepstore.html.textile.liquid*: does it make sense to document the runit process, a... Javier Bértoli
03:52 pm Task #11141 (In Progress): Review 6520-nodemanager-docs
Peter Amstutz
03:01 pm Task #11224 (In Progress): Update API usage
Peter Amstutz
03:01 pm Task #11224 (Resolved): Update API usage
Peter Amstutz
02:20 pm Feature #10218 (In Progress): [Crunch2] Gather and record cloud/physical node information for eac...
Lucas Di Pentima
02:14 pm Bug #3624: [API] Remove redundant "updated_at" column
You know, we still have a redundant update_at column... Peter Amstutz

03/07/2017

10:23 pm Story #3812 (Closed): [SDKs] Clients should warn when they're expecting a newer API server
Tom Clegg
10:22 pm Bug #4756 (Rejected): [API] Add migration to change collection uuids to portable_data_hash in old...
Tom Clegg
10:18 pm Revision 5eae182a (arvados): 3853: Do not try to look up collections by PDH for update/delete act...
Tom Clegg
10:03 pm Bug #3954 (Closed): [API] permission_to_update should prohibit all changes to content-addressable...
Tom Clegg
10:03 pm Bug #4003 (Closed): [Crunch] crunch-dispatch errors that relate to a specific job should be avail...
Tom Clegg
10:03 pm Bug #3831 (Closed): [Crunch] inconsistent find_or_create behavior in pipeline runner vs job
Tom Clegg
10:02 pm Bug #3556 (Closed): [Documentation] Avoid using the term "parallel" when referring to Crunch conc...
Tom Clegg
10:01 pm Feature #3768 (Closed): [SDKs] Speculatively pre-fetch data blocks while reading from a collection.
Tom Clegg
10:01 pm Bug #3789 (Closed): [API] Pipeline template (temporarily?) disappears after move to project
Tom Clegg
10:00 pm Bug #3810 (Closed): [Crunch] run-command should bail when $(file) expands to a nonexistent path
Tom Clegg
09:59 pm Story #3795 (Closed): [Crunch/SDKs] Tasks need more retry support
Tom Clegg
09:59 pm Feature #3633 (Closed): [Workbench] Compare pipeline templates, similar to the existing pipeline ...
Tom Clegg
09:59 pm Story #3347 (Closed): [Crunch] Run dev (and real) jobs using a syntax as close as possible to "py...
Tom Clegg
09:58 pm Bug #3470 (Closed): [Workbench] Ajax updated pages don't interact correctly with browser history.
Tom Clegg
09:58 pm Story #3157 (Closed): [Workbench] Admin button to download user list as CSV
Tom Clegg
09:57 pm Bug #3418 (Rejected): [Crunch] crunch-job ignores task sequence
Tom Clegg
09:57 pm Feature #3329 (Closed): [Docker] Loose ends in local docker install
Tom Clegg
09:56 pm Bug #3386 (Closed): [Documentation] Crunch script can exit 111 to indicate transient failure (i.e...
Tom Clegg
09:56 pm Support #2870 (Closed): Write up PGP data curation plan
Tom Clegg
09:56 pm Bug #3624 (Closed): [API] Remove redundant "updated_at" column
Tom Clegg
09:55 pm Feature #3095 (Closed): [Workbench] Add "run" button to each pipeline template in project view
Tom Clegg
09:43 pm Bug #10669: googleapiclient.errors.InvalidJsonError retrieving discovery document
Discovery doc retrieval is done by google-api-client. We ask it to use httplib2's built-in cache mechanism.
Unfort...
Tom Clegg
09:30 pm Bug #11222 (New): Docker load time on compute node is too long
using a-c-r --local, it took 10 minutes to load a 3GB Docker image... Bryan Cosca
09:16 pm Bug #11221: [systemd] Always restart exited services, even after 3 startup failures
11221-always-restart-services @ commit:273a233818ae39e843fab0276f9e381da6645d28 Tom Clegg
09:06 pm Bug #11221 (Resolved): [systemd] Always restart exited services, even after 3 startup failures
Currently, when postgresql is unavailable for ~300ms when arvados-ws is trying to start (which is normal for a bottin... Tom Clegg
09:15 pm Revision 273a2338 (arvados): 11221: Always restart systemd services, even after a few startup fai...
Tom Clegg
08:45 pm Bug #3115 (Resolved): [API] Retrieving a nonexistent keep disk as an admin should not create a ne...
Applied in changeset arvados|commit:533a50bbcee4ece451a65e87066563a5b33ef150. Tom Clegg
08:39 pm Revision 533a50bb (arvados): Merge branch '3115-keep-disk-create-surprise'
closes #3115 Tom Clegg
08:32 pm Revision c97408a5 (arvados): 3115: Create keep_disks implicitly only in #ping action, not #show.
Tom Clegg
08:03 pm Story #3043 (Resolved): [SDKs] Add Go SDK page to doc site with examples similar to Python etc
Tom Clegg
08:03 pm Story #3045 (Closed): [Workbench] Generalize "re-run this job" button
Tom Clegg
08:02 pm Bug #3097 (Closed): [Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environme...
Tom Clegg
08:02 pm Story #3017 (Closed): [Workbench] When comparing pipeline instances, show/highlight the differing...
Tom Clegg
08:02 pm Story #2932 (Closed): Pipeline has default name from pipeline template ("instance of X") and star...
Tom Clegg
08:02 pm Bug #3159 (Closed): Display of the "Add a new keep disk" button in the keep disks page in incorre...
Tom Clegg
08:00 pm Story #2661 (Closed): Security audit
Tom Clegg
08:00 pm Feature #3895 (Closed): set up dev ci server
Tom Clegg
07:59 pm Story #4599 (Closed): [Crunch] crunch-job should not retry tasks after its SLURM allocation is re...
Tom Clegg
07:53 pm Feature #6312 (Resolved): [Workbench] Use download service instead of passing Keep data through R...
Tom Clegg
07:52 pm Feature #7709: [API] Upgrade API server to Rails 4.2
Release notes: http://guides.rubyonrails.org/ Peter Amstutz
07:38 pm Feature #8801 (Duplicate): [Crunch] log free disk space before task starts
Tom Morris
07:37 pm Feature #8196 (Duplicate): [Crunch] Jobs should log the hardware of their compute node(s)
Tom Morris
07:31 pm Bug #4222 (Closed): [Keep] Rename -enforce-permissions to -bypass-read-permissions with default=f...
Tom Morris
07:30 pm Bug #3555 (Closed): [API] Rename nondeterministic to impure
Tom Morris
07:28 pm Feature #6191 (Resolved): Propagate stderr from all srun uses (e.g., clean-tmp and docker-install...
Tom Clegg
07:13 pm Story #4101 (Rejected): Workbench tests: app/controllers/projects_controller.rb
Tom Clegg
07:13 pm Story #4100 (Rejected): Workbench tests: app/helpers/application_helper.rb
Tom Clegg
07:12 pm Story #4099 (Rejected): Workbench tests: app/helpers/pipeline_instances_helper.rb
Tom Clegg
07:12 pm Story #4098 (Rejected): Workbench tests: app/controllers/pipeline_instances_controller.rb
Tom Clegg
07:12 pm Story #4097 (Rejected): Workbench tests: app/controllers/users_controller.rb
Tom Clegg
07:12 pm Story #4096 (Rejected): Workbench tests: app/helpers/provenance_helper.rb
Tom Clegg
07:12 pm Story #4095 (Rejected): Workbench tests: app/controllers/groups_controller.rb
Tom Clegg
07:12 pm Story #4094 (Rejected): Workbench tests: app/controllers/jobs_controller.rb
Tom Clegg
07:12 pm Story #4093 (Rejected): Workbench tests: app/helpers/vcf_pipeline_helper.rb
Tom Clegg
07:12 pm Story #4092 (Rejected): Workbench tests: app/helpers/jobs_helper.rb
Tom Clegg
07:11 pm Bug #6086 (Closed): [API] Creating new job sometimes takes too long
Tom Clegg
07:10 pm Story #6407 (Closed): [Workbench] Collection file trees are collapsible
Tom Clegg
06:59 pm Bug #10350 (Resolved): [Documentation] Update /api/authentication.html with correct information
Fixed in #10346 Peter Amstutz
06:57 pm Bug #9702 (Closed): [Crunch2] Five CWL conformance tests are failing with Crunch2
Closing this as it no longer reflects the current state of CWL on crunch v2.
The latest conformance test results c...
Peter Amstutz
06:55 pm Story #9132 (In Progress): [Crunch2] crunch-run uses official docker client library
Peter Amstutz
06:53 pm Task #8845 (Resolved): Diagnose
Parent ticket is resolved. Peter Amstutz
06:47 pm Task #7601 (Resolved): Review 6358-put-rendezvous
Parent ticket is resolved. Peter Amstutz
06:47 pm Task #6299 (Resolved): Review
Parent ticket is resolved. Peter Amstutz
06:46 pm Task #5680 (Resolved): Async dispatch hooks from CWL engine
CWL is supported an Arvados. Peter Amstutz
06:45 pm Task #5449: Update examples to use new Python Collection SDK and add deprecation notes to old APIs
Workflow examples using CWL don't involve the SDK.
Pipeline examples that use the Python SDK are already marked as...
Peter Amstutz
06:41 pm Feature #4223: [SDKs] arv keep docker --download to get image from Arvados
I still find myself wanting this feature occasionally, although we may want to abandon this particular branch. Peter Amstutz
06:39 pm Task #5681 (Closed): Task dispatch from CWL job runner
arvados-cwl-runner doesn't use job_tasks (which are specific to crunch v1).
Peter Amstutz
06:37 pm Task #5679 (Resolved): CWL job runner framework
CWL is supported on Arvados. Peter Amstutz
06:32 pm Task #2637 (Closed): Add support for filters to generic create API
Parent ticket closed. Peter Amstutz
06:31 pm Task #2628 (Closed): Write wiki page design for simple joins in REST API
Not currently planned. Peter Amstutz
06:31 pm Task #3884 (Closed): Review 3605-improved-dashboard
Revisit dashboard in future tickets. Peter Amstutz
06:30 pm Task #4703 (Resolved): Work on CWL draft 1 spec for tools
CWL supported on Arvados.
Peter Amstutz
06:30 pm Story #11139 (Resolved): [Node manager] Expected MemTotal for each cloud node size
Applied in changeset arvados|commit:4812b5639cfaf724540786fcd331aaa227635c77. Lucas Di Pentima
06:07 pm Story #11139: [Node manager] Expected MemTotal for each cloud node size
Thanks, LGTM Peter Amstutz
05:59 pm Story #11139: [Node manager] Expected MemTotal for each cloud node size
Updates & master branch merge at commit:101e3227b25c16874fa73660bfd7e338fbfe0da2
Tests: https://ci.curoverse.com/job...
Lucas Di Pentima
02:54 pm Story #11139: [Node manager] Expected MemTotal for each cloud node size
Can you add a test that shows that changing the configuration parameter changes the server calculator.
Can you add...
Peter Amstutz
06:29 pm Task #4686 (Resolved): Example wrapping bcbio sub-tool using CWL tool description
bcbio generates CWL that runs on Arvados. Peter Amstutz
06:29 pm Task #4613 (Resolved): Workbench template for generating UI
Workbench generates input form for CWL workflows. Peter Amstutz
06:28 pm Task #4612 (Resolved): Start writing user guide page
CWL support in Arvados is documented. Peter Amstutz
06:27 pm Task #4575 (Resolved): Review 4035-pipeline-support-cwl-tool
CWL is supported in Arvados. Peter Amstutz
06:27 pm Task #4420 (Resolved): Support user+pass database managed locally by SSO server
Implemented commit:49ab94b9d8d2c6e85c22b0e19171255af66db5e2 Peter Amstutz
06:25 pm Revision 4812b563 (arvados): Merge branch '11139-nodemanager-mem-scale-factor'
Closes #11139 Lucas Di Pentima
06:25 pm Task #4146 (Closed): Fix crunch-job
Parent ticket closed. Peter Amstutz
06:24 pm Bug #4028 (Closed): [Crunch] Task stdout appearing in job logs should be labeled "stdout" instead...
Seems unlikely this will be fixed.
Crunch v2 logs distinguish between stdout and stderr.
Peter Amstutz
06:23 pm Task #4144 (Resolved): Use num_retries on regular collection writer instead of robust_put
Was implemented in commit:1281ecab8f2396739ee9232c36796e46cd551426
Also run-command is nearing end-of-life as it i...
Peter Amstutz
06:20 pm Task #3887 (Closed): Fix tests
Revisit dashboard / workbench design in future tickets. Peter Amstutz
06:20 pm Feature #3605 (Closed): [Workbench] improved dashboard page
Will dashboard design in future tickets. Peter Amstutz
06:18 pm Task #3324 (Closed): Build new docker image, run on qr1hi with test data
Bcbio now generates CWL to run on Arvados. Uses upstream bcbio Docker image. Peter Amstutz
06:17 pm Feature #3319 (Closed): [Sample Pipelines] Run monolithic bcbio pipeline on tiny dataset. Package...
Bcbio now generates CWL to run on Arvados. Peter Amstutz
06:16 pm Task #2648 (Closed): Write tests
No longer applicable due to closing of original ticket. Peter Amstutz
06:15 pm Task #2649 (Closed): Assign collection to project
Obsolete by arv-put --project-uuid Peter Amstutz
06:15 pm Task #3230 (Closed): Support bcbio parallelization framework
bcbio generates CWL files which are runnable on Arvados. Peter Amstutz
06:14 pm Task #2647 (Closed): Put files from staging directory into Keep
Obsoleted by enabling arv-put to upload directly to Keep via keepproxy. Peter Amstutz
06:14 pm Task #2643 (Closed): "Ready to ingest" endpoint (in /actions controller?)
Obsoleted by enabling arv-put to write directly to Keep using keepproxy. Peter Amstutz
06:13 pm Feature #2176 (Closed): API server supports atomic find_or_create operation
Containers API uses a different approach. Does not have compelling use case in other APIs. Peter Amstutz
06:12 pm Story #2627 (Closed): Write design for joins in API
Currently no plans to do this. Peter Amstutz
06:07 pm Task #11200 (Resolved): Review 11139-nodemanager-mem-scale-factor
Peter Amstutz
02:46 pm Task #11200 (In Progress): Review 11139-nodemanager-mem-scale-factor
Peter Amstutz
05:54 pm Revision 101e3227 (arvados): 11139: Merge branch 'master' into 11139-nodemanager-mem-scale-factor
Lucas Di Pentima
05:52 pm Revision 9dae7131 (arvados): 11139: Added new test to check for non-default values. Updated examp...
Lucas Di Pentima
03:57 pm Bug #11220 (Resolved): [SDKs] Fix misleading arv-mount/pysdk error messages by removing obsolete ...
Current error message:... Tom Clegg
03:54 pm Bug #9435 (Resolved): keep-balance failing when a small page of collections has the same modified...
In #9998 keep-balance started using count="none" and accommodating multiple pages of identical timestamps, so this sh... Tom Clegg
03:48 pm Story #6830 (Resolved): [API] [keep-balance] Option to return unsigned manifests from collections...
This was implemented in #9998. Tom Clegg
03:39 pm Bug #11190: Containers seem to run more than once, which isn't supposed to happen
... Tom Clegg
03:15 pm Bug #11166 (Resolved): [Crunch2] crunchrun.go should avoid name collisions when creating log coll...
Applied in changeset arvados|commit:a1b0149879593df786807afbefb26d4687ebe161. Tom Clegg
03:01 pm Bug #11166: [Crunch2] crunchrun.go should avoid name collisions when creating log collections
11166-log-name-collision @ commit:cb0b666f86ce87d35667e8e23e3775b703a37841 Tom Clegg
02:45 pm Bug #11166: [Crunch2] crunchrun.go should avoid name collisions when creating log collections
LGTM. Peter Amstutz
03:11 pm Revision a1b01498 (arvados): Merge branch '11166-log-name-collision'
closes #11166 Tom Clegg
03:02 pm Revision fce072c7 (arvados): 8567: Add check for ARVADOS_API_HOST_INSECURE
Peter Amstutz
02:46 pm Task #11196 (Resolved): Review 11166-log-name-collision
Peter Amstutz
02:27 pm Task #11196 (In Progress): Review 11166-log-name-collision
Peter Amstutz
02:26 pm Revision 123251c6 (arvados): 8567: Rename docker19-migrate to migrate-docker19 for consistency with
arv-migrate-docker19. Add docstrict to migrate19() function. Peter Amstutz
02:18 pm Revision 09fc7249 (arvados): 8567: Move out of tools/ into sdk/python and docker/docker19-migrate.
Peter Amstutz
02:18 pm Revision b5886da1 (arvados): 8567: Creates migration links.
Peter Amstutz
02:18 pm Revision 80d9b40b (arvados): 8567: Docker image migration WIP.
Peter Amstutz
02:18 pm Revision 57fec89d (arvados): 8567: Add status reporting to migrate script.
Peter Amstutz
02:18 pm Revision 5780b539 (arvados): 9132: WIP switching to using official Docker Go client.
Peter Amstutz

03/06/2017

10:38 pm Story #11139: [Node manager] Expected MemTotal for each cloud node size
Updates on @11139-nodemanager-mem-scale-factor@ branch at commit:b6423b5
Test run: https://ci.curoverse.com/job/deve...
Lucas Di Pentima
10:04 pm Revision b6423b5e (arvados): 11139: Added default config parameter 'node_mem_scaling' to be appli...
Added test checking the default config and that the value is actually applied to the server calculations. Lucas Di Pentima
08:58 pm Bug #11166 (In Progress): [Crunch2] crunchrun.go should avoid name collisions when creating log c...
Tom Clegg
08:24 pm Task #11212 (Resolved): use ensure_unique_name flag or timestamp
Tom Clegg
03:37 pm Task #11212 (Resolved): use ensure_unique_name flag or timestamp
Tom Clegg
07:59 pm Revision cb0b666f (arvados): 11166: Use ensure_unique_name to avoid collisions when saving logs a...
Tom Clegg
07:52 pm Revision 58342141 (arvados): 8567: Move out of tools/ into sdk/python and docker/docker19-migrate.
Peter Amstutz
07:31 pm Revision f2c45e2c (arvados): 8567: Add status reporting to migrate script.
Peter Amstutz
04:20 pm Story #11171: [Nodemanager] Packaging for compute node setup scripts
relevant modules in puppet:
arvados-compute-and-crunch-dispatch-dependencies
arvados-compute-dependencies
arvado...
Nico César
03:39 pm Revision 93384273 (arvados): 8567: Creates migration links.
Peter Amstutz
03:35 pm Bug #11138 (Resolved): Protection against running new style docker 1.10+ image on old docker host
Applied in changeset arvados|commit:a4a3227c634d8cfd54a23205be727e910032cbe9. Tom Clegg
02:09 pm Bug #11138: Protection against running new style docker 1.10+ image on old docker host
Thanks! LGTM. Lucas Di Pentima
03:31 pm Revision a4a3227c (arvados): Merge branch '11138-docker-load-fail'
closes #11138 Tom Clegg
03:23 pm Revision cee1c18c (arvados): 8567: Docker image migration WIP.
Peter Amstutz
02:10 pm Task #11197 (Resolved): Review 11138-docker-load-fail
Lucas Di Pentima
 

Also available in: Atom