Activity

From 01/05/2015 to 02/03/2015

02/03/2015

11:46 pm Revision af84e178 (arvados-dev): info: get description from the 'gitweb.description'
Sitaram Chamarty
11:20 pm Revision 56714c8d (arvados): 2659: add test cases where anonymous config is turned off for collec...
Radhika Chippada
11:19 pm Revision 60789154 (arvados): 2659: Add separate test for "run pipeline" notification when anonymo...
Tom Clegg
10:22 pm Revision 063c5461 (arvados): 2659: Do not ask to skip_around_filter(only:...) and skip_around_fil...
Tom Clegg
09:37 pm Revision 130b8d31 (arvados): 4823: Add tests for Collection.clone and Collection.merge
Peter Amstutz
09:33 pm Revision e0619201 (arvados): 2659: Check anon config at runtime instead of boot time in skip_befo...
Tom Clegg
09:07 pm Feature #5133 (New): [Crunch] Use uncommitted code in a git work tree to run a dockerized crunch ...
Tom Clegg
08:59 pm Revision a7b16675 (arvados): 4823: Add Collection.copy tests
Peter Amstutz
08:55 pm Task #5132 (Resolved): Review 5131-run-command-consume-backslashes-wip
Applied in changeset arvados|commit:906aa5e3427c1e89e5f426191e33af4b1c27fc7e. Brett Smith
08:43 pm Task #5132 (Resolved): Review 5131-run-command-consume-backslashes-wip
Brett Smith
08:55 pm Bug #5131 (Resolved): [Crunch] run-command passes escape backslashes through
Applied in changeset arvados|commit:906aa5e3427c1e89e5f426191e33af4b1c27fc7e. Brett Smith
07:20 pm Bug #5131 (In Progress): [Crunch] run-command passes escape backslashes through
Brett Smith
07:15 pm Bug #5131 (Resolved): [Crunch] run-command passes escape backslashes through
run-command lets you prefix characters with a backslash to prevent it from interpreting them. However, when you do t... Brett Smith
08:51 pm Revision 501a707f (arvados-dev): * Only source /etc/profile.d/rvm.sh if it exists and is a regula...
* Fix typo
No issue #
Ward Vandewege
08:51 pm Revision 501a707f (arvados): * Only source /etc/profile.d/rvm.sh if it exists and is a regular file
* Fix typo
No issue #
Ward Vandewege
08:49 pm Revision 3253570c (arvados-dev): * Only source /etc/profile.d/rvm.sh if it exists and is a regula...
* Fix typo
No issue #
Ward Vandewege
08:48 pm Revision 906aa5e3 (arvados): Merge branch '5131-run-command-consume-backslashes-wip'
Closes #5131, #5132. Brett Smith
08:40 pm Revision b495d8bd (arvados): 5131: run-command consumes escape backslashes.
run-command has long recognized backslashes to inhibit
substitution, but it was leaving those backslashes in the stri...
Brett Smith
08:24 pm Revision 4d8209df (arvados): 2659: Remove obsolete "don't create jobs in workbench" rule.
Tom Clegg
07:57 pm Revision afabee43 (arvados): 2659: Update test to match changed error message.
Tom Clegg
07:56 pm Revision 5b749587 (arvados): 2659: Remove obsolete "don't create collections in workbench" rule.
Tom Clegg
07:28 pm Revision 1b39a6e1 (arvados): 2659: Back out unneeded condition. Fix up whitespace.
Tom Clegg
07:27 pm Revision 416c5436 (arvados): 2659: Toggle features according to editable? and creatable? instead ...
Tom Clegg
07:26 pm Revision 8192c879 (arvados): 4823: Fix bugs, fix tests, existing tests pass again. Still need to...
Peter Amstutz
07:14 pm Revision 4cd97b2c (arvados): 2659: Fix indentation.
Tom Clegg
07:13 pm Revision 0d2e6cf3 (arvados): 2659: Use Collection.creatable? to toggle selection actions.
Tom Clegg
06:56 pm Revision 9fcabe97 (arvados): 2659: Reload seeds (system_user et al.) after cache is cleared. Be m...
Tom Clegg
06:41 pm Revision b9a8de22 (arvados): 5087: API server uses a crunch-job with bugfix.
Refs #5087. Brett Smith
06:34 pm Revision 9ea36303 (arvados): 2659: Set group_class=role on anonymous group, change name to "Anony...
Tom Clegg
04:44 pm Revision 89a8208e (arvados): 2659: Fix crash in /users/current when not logged in.
Tom Clegg
04:24 pm Support #5070 (In Progress): [Support] Fix bugs and write tests (first half)
Brett Smith
04:24 pm Story #5069 (Resolved): [Documentation] (recurring) Write blog post in first three days of sprint
https://arvados.org/blogs/27 Brett Smith
04:20 pm Revision f56d3a68 (arvados): Merge branch 'master' into 4823-python-sdk-writable-collection-api
Peter Amstutz
04:19 pm Revision 07032047 (arvados): 4823: Added merge(), live sync. Removed deferred _populate().
Peter Amstutz
04:18 pm Revision e1104f98 (arvados): 2659: Fix up 404 page.
Tom Clegg
04:11 pm January development review: Gotta go fast!
Arvados can already save researchers a lot of time just by keeping track of their data and analysis work. You never ... Brett Smith
03:40 pm Revision 17c5cc48 (arvados): 2659: Fix crashes when current_user is nil.
Tom Clegg
03:29 pm Revision 42fc0557 (arvados): 2659: Send anonymous token as a reader token with all requests.
Tom Clegg
03:20 pm Revision 7edde478 (arvados): 2659: Finally understood the mystery behind the "anonymous tests are...
There is a permission link fixture for anonymous group. I needed to create read permission link for anonymous user.
(...
Radhika Chippada
03:06 pm Task #5103 (In Progress): Implement live sync, merge
Peter Amstutz
01:33 pm Revision ec27ba2a (arvados): 2659: Expect redirect to login page when show method is executed in ...
Something is overriding the configured value from application.default.yml when the test is executed along with all ot... Radhika Chippada
01:08 pm Revision 50ab35e7 (arvados): 2659: fix test assertion
Radhika Chippada
12:00 pm Revision 4bc67f80 (arvados): 2659: enable anonymous user config in test environment.
Radhika Chippada
05:14 am Revision b23240bd (arvados): 2659: add a "you are not logged in" warning in 404 page.
Radhika Chippada
03:40 am Revision 33e6d335 (arvados): Merge branch 'master' into 2659-anonymous-share-projects
Radhika Chippada
03:39 am Revision 03428065 (arvados): 2659: skip require_thread_api_token filter only when anonymous confi...
Radhika Chippada

02/02/2015

11:23 pm Revision 9a6559f9 (arvados): 2659: Do not require login for project tab_counts method as well.
Remove anonymous login tests for /users and /groups pages since we are no longer doing session establishment for anon... Radhika Chippada
10:15 pm Revision 64e9180b (arvados): 2659: load @prov_svg outside of the 'if current_user' block so that ...
Radhika Chippada
09:39 pm Revision 89d4aec6 (arvados): 2659: prevent nil exception when a content hash link is clicked by a...
Radhika Chippada
09:29 pm Task #5130 (Resolved): Review 3021-leave-api-running (arvados-dev)
This can't be merged/used without 3021-leave-api-running (arvados) Tom Clegg
09:28 pm Task #5129 (Resolved): Review 3021-leave-api-running (arvados)
Tom Clegg
09:27 pm Task #4986 (Resolved): Refactor run_test_server.py to use API database reset rather than restarti...
Tom Clegg
08:55 pm Story #4904: [SDKs] Use websockets to restart/reconfigure a web service running on a VM whenever ...
On second thought, I have a couple of ideas that would be slightly less hacky without going all the way backwards.
Peter Amstutz
08:49 pm Story #4904: [SDKs] Use websockets to restart/reconfigure a web service running on a VM whenever ...
Will go back to the "shut down the container, shut down the mount, start a new mount, start a new container" approach... Peter Amstutz
08:16 pm Story #4904: [SDKs] Use websockets to restart/reconfigure a web service running on a VM whenever ...
Reviewing commit:8233bab
h2. Bugs
* On my system, using our own Docker package, the service refresh causes the ...
Brett Smith
08:53 pm Revision 7dcac823 (arvados): 4823: Add copyinto()
Peter Amstutz
08:50 pm Revision 96326e98 (arvados): 2659: anonymous token handling in api client updated
Radhika Chippada
08:20 pm Revision d4879073 (arvados): 2659: no need for permit_anonymous_browsing_for_public_data filter; ...
Radhika Chippada
08:16 pm Revision 951149b9 (arvados): 4823: Refactored Collection into SynchronizedCollectionBase, Subcoll...
Collection. Added clone(). Added method decorators for locking. Peter Amstutz
08:06 pm Revision 16e6df55 (arvados): 2659: is_anonymous helper method is not needed anymore.
Radhika Chippada
08:00 pm Revision 7f2c45b1 (arvados): 2659: do not include "You are viewing public data" in topnav when an...
Radhika Chippada
07:50 pm Revision 89fb910b (arvados): Documentation cleanup: CLI SDK:
- merge some information from the wiki.
- reorganize things a bit.
No issue #
Ward Vandewege
07:36 pm Revision 4470ba26 (arvados): 3021: Use `passenger stop` to shut down passenger. Restore database ...
Tom Clegg
07:30 pm Revision 411ce5bc (arvados): 2659: instead of setting up a session as anonymous user, just use an...
Radhika Chippada
04:44 pm Feature #5128 (New): [DRAFT] [FUSE] arv-mount supports FUSE for OS X
Peter Amstutz
03:27 pm Revision a526319c (arvados): 3021: Fix up some error checking.
Tom Clegg
03:27 pm Revision a526319c (arvados-dev): 3021: Fix up some error checking.
Tom Clegg
03:19 pm Revision 438752b8 (arvados): 4823: Added SYNC mode constants.
Peter Amstutz
03:14 pm Bug #5127 (New): [Docs] Note apt key information in Python package READMEs
Our Python client packages tell you how to install the software via apt. Those instructions need to be expanded to n... Brett Smith
03:03 pm Feature #5126 (New): [DRAFT] [SDKs] "arv-vc" command line tool supporting VCS workflow for collec...
Concept: arv-vc tool supporting version control system workflow over collections.
(This assumes a svn-like workflo...
Peter Amstutz
02:33 pm Revision 5bb11227 (arvados): 4823: Adding @_synchronized to protect arvfile and block manager. U...
docstrings to PEP 257 and PEP 287. Peter Amstutz
02:00 pm Task #5125 (Resolved): Review branch: 2659-anonymous-share-projects
Radhika Chippada
01:57 pm Story #2659: [Workbench] Anonymous user can access publicly shared data using Workbench and curl
Branch '2659-anonymous-share-projects' implemented workbench support for anonymous users. Some details:
* Updated ...
Radhika Chippada
01:46 pm Revision 876ca867 (arvados): 2659: add some more text assertions; several of the same tests are f...
Radhika Chippada
12:08 pm Revision 332015d1 (arvados): 2659: remove most of the user-based tests since they are covered in ...
Radhika Chippada
10:29 am Revision e925baa0 (arvados-dev): 3021: Cache packages with bundle package --all
Tom Clegg
10:29 am Revision e925baa0 (arvados): 3021: Cache packages with bundle package --all
Tom Clegg
10:27 am Revision a6969ab9 (arvados): 3021: Let integration tests write to the api server log before rotat...
Tom Clegg
10:27 am Revision a6969ab9 (arvados-dev): 3021: Let integration tests write to the api server log before r...
Tom Clegg
10:25 am Revision 3e70317d (arvados-dev): 3021: Try bundle install --local before resorting to downloading...
Tom Clegg
10:25 am Revision 3e70317d (arvados): 3021: Try bundle install --local before resorting to downloading the...
Tom Clegg
08:41 am Revision d01477c5 (arvados): 3021: gitignore **/vendor
Tom Clegg
08:10 am Revision 5c1cee51 (arvados): 3021: Use run_test_server.py instead of the special workbench way of...
Tom Clegg
08:05 am Revision 440a0665 (arvados): 3021: Leave an API server running while test suites run.
Tom Clegg
08:05 am Revision 440a0665 (arvados-dev): 3021: Leave an API server running while test suites run.
Tom Clegg
08:04 am Revision 8ea68a13 (arvados): 3021: Use run_test_server.py instead of the special workbench way of...
Tom Clegg
05:42 am Revision 73d8ff76 (arvados): 2659: slightly improved test flows
Radhika Chippada
05:29 am Revision 13181107 (arvados): 3021: Refactor run_test_server.
* Always start API server with both https:// and wss:// enabled. Use
mocks to test the websocket-not-available case...
Tom Clegg
05:29 am Revision a1ad1f1d (arvados): 3021: Round up various implementations of "run test servers" into an...
* Get the API host, port, and admin token from the run_test_server.py
--auth output, instead of guessing localhost:...
Tom Clegg
05:11 am Revision 62eaf394 (arvados): 2659: add completed job fixture in publicly accessible project and t...
Radhika Chippada
03:01 am Revision 3ffc4fd3 (arvados): 3021: Do not start a test server if ARVADOS_TEST_API_HOST is set.
Tom Clegg
02:56 am Revision 1aa04543 (arvados-dev): 3021: Set ARVADOS_TEST_API_INSTALLED so workbench doesn't try to...
Tom Clegg
02:15 am Revision c4320ec0 (arvados-dev): 3021: Leave an API server running while test suites run.
Tom Clegg
02:11 am Revision c3086805 (arvados): 3021: Round up various implementations of "run test servers" into an...
* Get the API host, port, and admin token from the run_test_server.py
--auth output, instead of guessing localhost:...
Tom Clegg
01:59 am Revision 68f0e2be (arvados): 3021: Refactor run_test_server.
* Always start API server with both https:// and wss:// enabled. Use
mocks to test the websocket-not-available case...
Tom Clegg
01:22 am Revision 2c447c25 (arvados): 2659: (1) Update link_to_if_arvados_object method to display an obje...
Otherwise, an anonymous user will always see 404 when such a link is clicked.
(2) In the unlikely event of an anonymo...
Radhika Chippada
12:21 am Revision 48580ba7 (arvados): 3021: Propagate unhandled exceptions back to the caller instead of r...
Tom Clegg
12:15 am Revision 0d32948a (arvados): 3021: Add comment about IPv4/IPv6 trap in websocket client.
Tom Clegg

02/01/2015

08:09 pm Revision 1a462bc4 (arvados): 2659: It appears that a job's log file is stored in a user's Home pr...
Due to this, when an anonymous user accesses the job from the publicly accessible project, the Log tab is failing.
He...
Radhika Chippada
05:42 pm Revision 6b972e17 (arvados): 2659: show job cancel button only when user is_active.
Radhika Chippada
05:15 pm Revision 9f931ff8 (arvados): 2659: more asserts in dashboard testing
Radhika Chippada
04:40 pm Revision 4d1e5c05 (arvados): 2659: trailing white space
Radhika Chippada
04:38 pm Revision 7f6d2dbe (arvados): Merge branch 'master' into 2659-anonymous-share-projects
Radhika Chippada
04:30 pm Revision c8f0f0c5 (arvados): 2659: Collection show_files shows selection dropdown (which has only...
Also, dashboard displays the 'Run a pipeline' selector for active users. Upated anonymous user test to verify dashboa... Radhika Chippada
04:22 pm Revision 487dc409 (arvados): 5037: Fix tearDown error handling in PySDK Websockets test.
I accidentally broke this in 51f9e6cb. That version would crash if
the test failed to assign self.ws. Refactor to b...
Brett Smith
04:01 am Revision b6ca3da4 (arvados): 2659: hide job re-run button when user is inactive and add fixtures ...
Radhika Chippada
01:35 am Revision a2e9008a (arvados): 5011: 3410: Export client-specified redundancy as replication_desired.
Tom Clegg
01:35 am Revision 0507f73c (arvados): 5011: Fix run_and_find_collection so it works without --portable-dat...
Tom Clegg
01:34 am Revision cb6a13cd (arvados): 5011: Use replication=2 if unspecified.
Tom Clegg

01/31/2015

10:42 pm Revision 934fa5ac (arvados): 2659: show tab buttons, selection actions etc only when the current_...
Radhika Chippada
06:06 pm Revision 71d9ea52 (arvados): 2659: when an anonymous user is accessing public data, offer "Log in...
Radhika Chippada
05:45 pm Revision 94a3addb (arvados): 2659: add text message "You are viewing public data" to top nav when...
Radhika Chippada
03:38 pm Revision 5dbde597 (arvados): 2659: add permit_anonymous_browsing_for_public_data
Radhika Chippada
07:21 am Revision f9a0cb85 (arvados): 3021: gitignore rotated log files.
Tom Clegg

01/30/2015

10:21 pm Task #5124 (Resolved): Use server-provided default replication level as default in arv-put and Co...
Tom Clegg
10:20 pm Task #5123 (Resolved): Review 5011-arv-put-replication
Tom Clegg
10:20 pm Revision 655b69e4 (arvados): 5011: Add --replication option to CLI docs.
Tom Clegg
10:19 pm Task #5122 (Resolved): Update docs
Tom Clegg
10:12 pm Task #5122 (Resolved): Update docs
Tom Clegg
10:12 pm Task #5120 (Resolved): Add --replication arg to arv-put
Tom Clegg
10:12 pm Task #5120 (Resolved): Add --replication arg to arv-put
Tom Clegg
10:12 pm Revision 774bc42d (arvados): 5011: Add --replication argument to arv-put.
Tom Clegg
10:12 pm Revision bed95fb1 (arvados): 5011: Add replication argument to CollectionWriter.
Tom Clegg
10:12 pm Task #5121 (Resolved): Add replication=X kwarg to CollectionWriter and friends
Tom Clegg
10:12 pm Task #5121 (Resolved): Add replication=X kwarg to CollectionWriter and friends
Tom Clegg
09:51 pm Story #2659: [Workbench] Anonymous user can access publicly shared data using Workbench and curl
To make projects#show work for anonymous users:
* ApplicationController#check_user_agreements should return true if ...
Tom Clegg
09:40 pm Revision facbf48d (arvados): Merge branch 'master' into 4823-python-sdk-writable-collection-api
Peter Amstutz
09:28 pm Task #5117 (Resolved): Review 5037-python-sdk-thread-safe
Tom Clegg
08:29 pm Task #5117 (In Progress): Review 5037-python-sdk-thread-safe
Brett Smith
06:28 pm Task #5117 (Resolved): Review 5037-python-sdk-thread-safe
Tom Clegg
08:42 pm Revision 9af0808e (arvados): Merge branch '5037-python-sdk-thread-safe' refs #5037
Tom Clegg
08:40 pm Revision 9fb82043 (arvados): 5037: Mention where this cache is, instead of describing what a cach...
Tom Clegg
08:28 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Now we're at commit:1eeb668. My commits add a test for the new behavior, fix a Websockets test that broke for me (al... Brett Smith
07:32 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
commit:ae7a6c9 on 5037-python-sdk-thread-safe Tom Clegg
05:38 pm Bug #5037 (In Progress): [SDKs] Improve Python SDK thread safety and document pitfalls
Tom Clegg
03:25 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
We just got a report that the GATK-merge-call Crunch script, included with Arvados, is failing because of this issue.... Brett Smith
08:24 pm Revision 44cbe230 (arvados): 5037: Add test for new PySDK API cache behavior.
Brett Smith
08:24 pm Revision 51f9e6cb (arvados): 5037: Fix race condition in PySDK Websockets test.
This might just be bad luck, but for some reason when testing Tom's
changes I ran into a situation where this test fa...
Brett Smith
08:24 pm Revision 1eeb6688 (arvados): 5037: Remove unnecessary cache=False from arv-copy.
Brett Smith
08:15 pm Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
Related work from wikifarm
* "Google login button":https://github.com/tomclegg/wikifarm/blob/master/src/web/login.ph...
Tom Clegg
07:56 pm Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
Updated strategy
# Change API server:
#* If SSO provider gives us an identity_url field, log in the same way we've ...
Tom Clegg
07:15 pm Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
Some thoughts:
* SSO migration: Start Using multiple authorizations feature of SSO server in order to support not...
Peter Amstutz
07:00 pm Task #5015 (Resolved): Review branch 4562-crunch-tools-docs-wip
Applied in changeset arvados|commit:088bc7b980536ee2b27c8abf4bfc09c348000589. Brett Smith
07:00 pm Bug #4562 (Resolved): [Documentation] Wiki page: explain appropriate use cases for arv-run vs. ru...
Applied in changeset arvados|commit:088bc7b980536ee2b27c8abf4bfc09c348000589. Brett Smith
04:28 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
Peter Amstutz wrote:
> My concern with the current draft is that is a bit too wordy to be a "brief" summary, while a...
Brett Smith
06:58 pm Revision 088bc7b9 (arvados): Merge branch '4562-crunch-tools-docs-wip'
Closes #4562, #5015. Brett Smith
06:57 pm Revision 4215621e (arvados): 4562: Add Crunch tools overview to the documentation.
Brett Smith
06:46 pm Feature #5119 (New): [OPS] Write a wrapper script that calls packer to generate customized docker...
Ward Vandewege
06:46 pm Revision 0882568e (arvados): 4562: Fixups suggested by office discussion.
Brett Smith
06:45 pm Feature #5118 (In Progress): [OPS] Use packer to generate docker images for our various services
Ward Vandewege
06:28 pm Task #5116 (Resolved): Remove connection pooling feature from arvados.api()
Tom Clegg
05:37 pm Task #5116 (In Progress): Remove connection pooling feature from arvados.api()
Tom Clegg
05:37 pm Task #5116 (Resolved): Remove connection pooling feature from arvados.api()
Tom Clegg
06:22 pm Task #4959 (Resolved): Write up [[Authentication]] page
Tom Clegg
06:20 pm Revision ae7a6c9a (arvados): 5037: Remove connection pool. Now, api(cache=False) refers only to t...
Tom Clegg
04:58 pm Revision 8233babd (arvados): 4904: Fix documentation issues. Add comments to arv-web.py.
Peter Amstutz
04:23 pm Revision e72f4e3b (arvados): 4562: Add Crunch tools overview to the documentation.
Brett Smith
04:10 pm Revision 29e2e288 (arvados): 4904: Handle failure to delete non-existent cidfile. Fix docker_ima...
Peter Amstutz
04:03 pm Revision 63ea99a3 (arvados): 4904: Finally figured out a (hopefully) reliable way of sending SIGH...
service inside Docker container to get it to refresh. Peter Amstutz
03:41 pm Revision ef91d974 (arvados-dev): add missing include path to GL_LIBDIR
In src/triggers/post-compile/update-description-file and
src/triggers/post-compile/update-gitweb-daemon-from-options ...
Robert Schiele
03:01 pm Bug #4922 (Resolved): [Crunch] google-api-python-client fails to install
The original job didn't specify an arvados_sdk_version, so changing crunch-job's install process for that would not c... Brett Smith
07:26 am Revision 5ae2677e (arvados): 4472: Include output of failed tasks when generating job output mani...
Tom Clegg
01:38 am Story #3408: [Keep] Implement Production Data Manager
Peter Amstutz wrote:
> * the keep servers report should include number of blocks on the service, disk space in use...
Misha Zatsman
01:32 am Revision c37ed03a (arvados): Renamed timestamp fields to begin with "time_"
Misha Zatsman
01:25 am Revision af0728d3 (arvados): Now fetch Keep Server Status and record it to the log. Renamed some ...
Misha Zatsman

01/29/2015

10:13 pm Revision 04a8e038 (arvados): 4904: Eliminate downtime switching collections.
* Now re-uses CollectionDirectory and loads new collection contents instead of
unmounting and remounting. Now sends ...
Peter Amstutz
09:38 pm Task #5012 (Closed): Confirm fix
Brett Smith
09:37 pm Bug #4922 (New): [Crunch] google-api-python-client fails to install
qr1hi-8i9sb-o9719vud1ro9wzh successfully reproduced the issue. Unfortunately this is not fixed. Brett Smith
09:30 pm Feature #5034: [Workbench] Show content statistics/summary (total size, number of files) at top o...
In "This collection was the output of:" maybe change this to "This collection was uploaded by" if its not an output o... Bryan Cosca
08:31 pm Task #5114 (Resolved): Fix
Peter Amstutz
08:11 pm Story #4930 (Resolved): [FUSE] Design: specify behavior for writable arv-mount
Tom Clegg
05:53 pm Story #4930 (In Progress): [FUSE] Design: specify behavior for writable arv-mount
Tom Clegg
07:59 pm Feature #5110 (Resolved): [Workbench] Use full text search instead of 'ilike' when searching with...
Tom Clegg
07:55 pm Task #5109 (Resolved): Add "import files from another collection" API to Ruby SDK
Tom Clegg
07:54 pm Task #3736 (Closed): [SDKs] Document Python Crunch SDK
I'm unhooking this from #3603, now that that has become more focused on design specifically. Documentation should ha... Brett Smith
07:54 pm Task #5108 (Resolved): Implement internal representation for collections in Ruby SDK (analogous t...
Tom Clegg
07:53 pm Task #5107 (Resolved): Add collections#rename and collections#delete methods to Ruby SDK
Tom Clegg
07:41 pm Bug #4174 (Resolved): [Documentation] Write a wiki page describing desired bug workflow
Ward Vandewege
07:41 pm Bug #4174: [Documentation] Write a wiki page describing desired bug workflow
Now done on
https://arvados.org/projects/orvos-private/wiki/Support_team
Ward Vandewege
07:39 pm Task #4580 (Closed): Review 4138-node-manager-google-cloud
Brett Smith
07:19 pm Story #3410: [API] Rename collection "desired replication" attributes, add model constraints
Peter Amstutz wrote:
> What's the difference between @redundancy_confirmed@ and @redundancy_confirmed_at@ ? If @red...
Tom Clegg
06:31 pm Story #4927 (Resolved): [SSO] Decide overall single sign-on strategy
Tom Clegg
06:21 pm Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
Priorities for this story, in order:
# allow existing users (who signed up using Google OpenID) to log in after logi...
Tom Clegg
06:17 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Tom,
* Added the ArgumentError when individual columns are used in filter
* Added tests to cover this condition
* ...
Radhika Chippada
03:52 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Looking at 4523-full-text-search at commit:316eca14...
Currently, the filter attribute(s) provided by the client a...
Tom Clegg
06:13 pm Revision 7d76a3fb (arvados): 4523: full-text search is not supported for individual columns and o...
Radhika Chippada
04:41 pm Bug #4562 (In Progress): [Documentation] Wiki page: explain appropriate use cases for arv-run vs....
Ward Vandewege
03:37 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
I don't want to spend a lot of time wrangling over this, so I'll try to make this the last round of comments.
My c...
Peter Amstutz
03:24 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
Peter Amstutz wrote:
> Here's a brainstorm, how about a table that provides some kind of brief side-by-side summary?...
Brett Smith
04:41 pm Story #3603 (In Progress): [Crunch] Design good Crunch task API, including considerations about "...
Ward Vandewege
04:36 pm Story #4687 (Resolved): [Crunch] Support Brad Chapman to port bcbio tools and workflows to CWL
Ward Vandewege
04:35 pm Support #4929 (Resolved): [Support] Fix bugs and write tests (second half)
Ward Vandewege
03:36 pm Bug #5105 (Resolved): [Workbench] AJAX content loaders should not follow a redirect to the welcom...
!login_bug.png!
this happens when I have >2 tabs of curoverse open and then I log out in one of the tabs. I've see...
Bryan Cosca
03:09 pm Feature #4727: [Workbench] Feature requests/suggestions for shared collection download page
Brett Smith wrote:
> For what it's worth, we will probably be reluctant to add links to the page that point to anyth...
Tom Clegg
03:08 pm Revision 1060cff7 (arvados): Merge branch 'master' into 4904-arv-web
Peter Amstutz
02:59 am Revision a533cde8 (arvados): 4523: full-text search migration script renamed
Radhika Chippada
02:56 am Revision 981c7264 (arvados): Merge branch 'master' into 4523-full-text-search
Radhika Chippada
02:56 am Revision 9fbf8925 (arvados): 4523: prepare to merge master into branch
Radhika Chippada
01:50 am Feature #3686 (Resolved): [Workbench] Provide a sharing tab for repositories similar to setting u...
Applied in changeset arvados|commit:2717e707ce048dd9b47754d620663a76256958cf. Radhika Chippada
01:46 am Feature #3686: [Workbench] Provide a sharing tab for repositories similar to setting up sharing f...
Thanks Brett. Addressed all of these suggestions and merged into master. Radhika Chippada
01:48 am Feature #5104 (Resolved): [SDKs] Add Ruby SDK methods for manipulating collection contents (renam...
Tom Clegg
01:46 am Task #5088 (Resolved): Review branch: 3686-sharing-repositories (one more time, for repository li...
Radhika Chippada
01:45 am Revision 2717e707 (arvados): closes #3686
Merge branch '3686-sharing-repositories' Radhika Chippada
01:43 am Revision 390d1935 (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
01:41 am Revision c67f0508 (arvados): 3686: correct one test assertion and refine some other assertions.
Radhika Chippada

01/28/2015

11:10 pm Bug #4918 (Resolved): [Workbench] Input chooser for new pipelines hides the "file choose" menu on...
Applied in changeset arvados|commit:a51da9f0338017a7c193dcb36fc957b9ab71e4b1. Anonymous
06:42 pm Bug #4918 (In Progress): [Workbench] Input chooser for new pipelines hides the "file choose" menu...
Tom Clegg
11:08 pm Feature #3686: [Workbench] Provide a sharing tab for repositories similar to setting up sharing f...
Reviewing commit:1ceddc7. This is very nice; thanks very much for following up on everything.
* If I'm following ...
Brett Smith
10:11 pm Feature #3686: [Workbench] Provide a sharing tab for repositories similar to setting up sharing f...
Made all suggested enhancements. In addition, added an exclusive Share link instead of making the name clickable for ... Radhika Chippada
03:47 pm Feature #3686 (In Progress): [Workbench] Provide a sharing tab for repositories similar to settin...
Reviewing commit:194eaad
* For the repository link, I don't see a need to use @raw()@ to escape the repository nam...
Brett Smith
10:51 pm Revision a51da9f0 (arvados): Fix preview pane disappearing on narrow displays. closes #4918
Tom Clegg
10:40 pm Bug #5074 (Resolved): [SDKs] CLI client and Ruby SDK should recover from (and avoid creating) unr...
Applied in changeset arvados|commit:0fb26747fa229d6b19ec911b907259a8e84acd83. Brett Smith
08:20 pm Bug #5074: [SDKs] CLI client and Ruby SDK should recover from (and avoid creating) unreadable dis...
LGTM Peter Amstutz
08:12 pm Bug #5074: [SDKs] CLI client and Ruby SDK should recover from (and avoid creating) unreadable dis...
Peter Amstutz wrote:
> Consider not reporting an error in this case, because it is nonfatal and the user probably ca...
Brett Smith
07:05 pm Bug #5074: [SDKs] CLI client and Ruby SDK should recover from (and avoid creating) unreadable dis...
The code looks good. I appreciate that you moved the logic to the Ruby SDK.
So I intentionally corrupted the cach...
Peter Amstutz
10:37 pm Revision 0fb26747 (arvados): Merge branch '5074-ruby-sdk-discovery-cache-wip'
Closes #5074, #5091. Brett Smith
10:36 pm Revision 14b6221c (arvados): 5074: CLI SDK uses Google API client extensions from Ruby SDK.
Brett Smith
10:35 pm Revision d2299e01 (arvados): 5074: Improve discovery document caching in Ruby SDK.
* Report a warning if there's an error reading or parsing a cached
discovery document.
* Cache discovery documents ...
Brett Smith
10:32 pm Story #4904: [SDKs] Use websockets to restart/reconfigure a web service running on a VM whenever ...
Reviewing commit:b4fd2ab
h2. arv-web
I double-checked that I was running arvados_fuse from the branch, but I ge...
Brett Smith
05:21 pm Story #4904: [SDKs] Use websockets to restart/reconfigure a web service running on a VM whenever ...
commit:b4fd2ab4 looks pretty good.
I haven't scrutinized the code (or docs) as a proper review. I noticed a couple...
Tom Clegg
10:25 pm Feature #4905 (Closed): [Workbench] Make repository-sharing feature accessible from Manage Accoun...
Link was added to Manage Account page in #3686. Tom Clegg
09:52 pm Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
2. Instead of a URL to identify users, SSO server should assign user ids that are compatible with existing arvados us... Peter Amstutz
09:48 pm Revision 1ceddc71 (arvados): 3686: add unit and controller tests for repository updates
Radhika Chippada
09:43 pm Task #5103 (Resolved): Implement live sync, merge
Peter Amstutz
09:42 pm Task #5102 (Resolved): Try to reproduce
Peter Amstutz
09:41 pm Task #5101 (Resolved): Write tests
Peter Amstutz
09:41 pm Task #5100 (Resolved): Write migration
Peter Amstutz
09:40 pm Task #4947 (In Progress): Provide example to science team
Peter Amstutz
09:34 pm Story #3410: [API] Rename collection "desired replication" attributes, add model constraints
What's the difference between @redundancy_confirmed@ and @redundancy_confirmed_at@ ? If @redundancy_confirmed@ is ju... Peter Amstutz
09:22 pm Task #5091 (Resolved): Review 5074-ruby-sdk-discovery-cache-wip
Peter Amstutz
07:17 pm Task #5091 (In Progress): Review 5074-ruby-sdk-discovery-cache-wip
Peter Amstutz
09:13 pm Story #3408: [Keep] Implement Production Data Manager
In logger Update(), ForceUpdate() and several other places, prefer the following pattern (note the l.lock.Unlock() m... Peter Amstutz
08:46 pm Bug #4903 (Resolved): [Crunch] ensure that JOB_WORK and TASK_WORK directories exist for Docker jobs
Confirmed that the crunch-job fix is now effective. Tested in job qr1hi-4zz18-d2f9i56o1m9dkr7. Brett Smith
08:28 pm Story #5098 (Closed): [Keep] Design: using Arvados to browse, and run jobs on, input data that is...
See
* [[Keep service hints]]
* [[Keep S3 gateway]]
Tom Clegg
08:16 pm Task #5018 (In Progress): Review 4904-arv-web
Brett Smith
08:08 pm Revision d59deccc (arvados): 5074: Fixup Ruby SDK discovery cache warnings.
Brett Smith
07:39 pm Bug #5095: [FUSE] arv-mount takes up too much memory and occassionally crashes when listing large...
Possible problems/solutions:
* arv-mount is retrieving the manifest_text for all those collections, even though it d...
Tom Clegg
04:52 pm Bug #5095 (Resolved): [FUSE] arv-mount takes up too much memory and occassionally crashes when li...
On lightning-dev2 (qr1hi), in the home directory of my keep mount (/home/abram/keep/home), doing an 'ls' causes arv-m... Abram Connelly
07:34 pm Feature #5097 (New): [SDKs] CLI tools support project paths in addition to uuids
It's awkward and user-unfriendly to have to always copy and paste project UUIDs from the browser to the command line,... Peter Amstutz
07:27 pm Bug #5026: [API] Prohibit leaving jobs in an inconsistent state (e.g., state=queued with non-null...
Possible solution:
* Certain job attributes (output, log) should only be allowed to change (including from null to n...
Tom Clegg
07:25 pm Story #3198: [FUSE] Writable streaming arv-mount
Detailed semantics and discussion in #4930 Peter Amstutz
07:19 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Suggest:
* Ignore cache=False or cache=True
* Add new flag discoveryCache=False to turn off discovery doc caching (...
Tom Clegg
07:17 pm Task #4949 (Resolved): Sketch out how to port bcbio-nextgen StandardPipeline
Peter Amstutz
07:12 pm Bug #5030: [Workbench] Stats graph display for job without stats is confusing
Suggest:
* Make the graph div hidden by default. display:none or whatever.
* show() the graph using a cheesy[1] ani...
Tom Clegg
07:09 pm Bug #4805: [Workbench] Workbench provenance graph tabs appear empty when graph is very large
The "smart scroll" javascript is supposed to adjust the size of the DOM box that renders the SVG, so that you get act... Peter Amstutz
06:59 pm Bug #4991: [API] Make user.send_profile_created_notification detect preference changes better
Could add a comment about shortcomings of this trigger. API "update" call always replaces the hash with a new one. Tom Clegg
06:47 pm Bug #5096 (Resolved): [Workbench] Avoid passing manifest_text around the network too much when up...
Examples:
* Workbench should not send manifest_text to API in an update() request when only name/description is bein...
Tom Clegg
06:43 pm Revision 805ad01a (arvados): 3686: update the repository row to offer an exclusive Share link tha...
Radhika Chippada
06:43 pm Task #5044 (Resolved): Review 5010-trash-button-for-collections
Peter Amstutz
06:42 pm Task #5017 (Resolved): Review 5016-ctrl-c-arv-ws
Peter Amstutz
06:41 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
@01/22/2015 05:10 pm
Much better.
Here's a brainstorm, how about a table that provides some kind of brief side-...
Peter Amstutz
06:29 pm Revision e2999ea6 (arvados): 3686: verify repositories testing uses hard coded repo info.
Radhika Chippada
04:42 pm Bug #4399 (Resolved): [Tests] Fix whatever sometimes causes Jenkins tests to fail with ECONNREFUSED
We believe we've done this in the Workbench branch of #3021. If we see it happen again, let's reopen this. Brett Smith
04:30 pm Task #4902 (Resolved): Use a fixture instead of calling "run a pipeline" in the set of 8 "rerun p...
Applied in changeset arvados|commit:687f94f0e17dca2639ce1704b18f483f2e6bedb3. Radhika Chippada
04:16 pm Task #4902: Use a fixture instead of calling "run a pipeline" in the set of 8 "rerun pipeline ins...
Radhika,
commit:ddc4a3c is good to merge. Thanks.
Brett Smith
04:27 pm Task #5092 (Resolved): Review branch: 4902-use-fixture-to-rerun-pipelines
Brett reviewed this update. Radhika Chippada
04:14 pm Task #4939 (Resolved): Review and discuss
Peter Amstutz
04:11 pm Revision 7ee4b2b5 (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
04:07 pm Revision 687f94f0 (arvados): closes #4902
Merge branch '4902-use-fixture-to-rerun-pipelines' Radhika Chippada
04:07 pm Story #5094 (New): [Workbench] Make pipeline rerun UI more like jobs'
#4878 changed the Workbench interface for running jobs to better present and explain the different options. I think ... Brett Smith
04:06 pm Revision 4884240e (arvados): Merge branch 'master' into 4902-use-fixture-to-rerun-pipelines
Radhika Chippada
03:48 pm Revision c6c4e8a6 (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
02:54 pm Task #5088 (In Progress): Review branch: 3686-sharing-repositories (one more time, for repository...
Brett Smith
02:15 am Feature #4926 (Resolved): [Documentation] (recurring) Refresh user documentation
Radhika Chippada
12:42 am Revision 62028379 (arvados): refs #4878
Merge branch '4878-rerun-job' Radhika Chippada
12:40 am Revision a29c6fb9 (arvados): 4878: add back the tab buttons partial.
Radhika Chippada

01/27/2015

11:30 pm Task #5067 (Resolved): Review branch: 4878-rerun-job-bcs-wip
Applied in changeset arvados|commit:4926ecdc0ab989d329fbb75e447469ed4efee184. Brett Smith
11:30 pm Bug #4878 (Resolved): [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Applied in changeset arvados|commit:4926ecdc0ab989d329fbb75e447469ed4efee184. Brett Smith
11:11 pm Bug #4878: [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Brett Smith wrote:
> Because this branch is implementing a pure interface change, I don't believe it should be neces...
Brett Smith
07:46 pm Bug #4878: [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Radhika Chippada wrote:
> * I removed the “re-run using same version” button. In the re-run dialog, if a job has no ...
Brett Smith
05:40 pm Bug #4878: [Workbench] clarify purpose of "re-run latest" button on jobs#show.
* I removed the “re-run using same version” button. In the re-run dialog, if a job has no newer version, I am hiding ... Radhika Chippada
11:25 pm Revision 4926ecdc (arvados): Merge branch '4878-rerun-job-bcs-wip'
Closes #4878, #5067. Brett Smith
11:09 pm Revision 82955105 (arvados): 4878: Refactor Workbench "Re-run job" button for more code reuse.
* Avoid adding new routes: add the modal directly to the job show
page, and submit the new work with the existing j...
Brett Smith
09:47 pm Task #5092 (Resolved): Review branch: 4902-use-fixture-to-rerun-pipelines
Radhika Chippada
09:46 pm Task #4902 (In Progress): Use a fixture instead of calling "run a pipeline" in the set of 8 "reru...
Implemented in 4902-use-fixture-to-rerun-pipelines branch. Radhika Chippada
09:43 pm Revision ddc4a3cd (arvados): 4902: re-run pipeline instance tests use fixtures instead of creatin...
Radhika Chippada
09:29 pm Task #5091 (Resolved): Review 5074-ruby-sdk-discovery-cache-wip
Brett Smith
09:28 pm Revision 59adfc15 (arvados): 5074: CLI SDK uses Google API client extensions from Ruby SDK.
Brett Smith
09:22 pm Revision 0f556c8b (arvados): 5074: Improve discovery document caching in Ruby SDK.
* Report a warning if there's an error reading or parsing a cached
discovery document.
* Cache discovery documents ...
Brett Smith
08:59 pm Revision 77d1908a (arvados): 4878: update the popup display to not display radio button when only...
Radhika Chippada
08:55 pm Revision 6e43023a (arvados): Merge branch 'master' into 4878-rerun-job
Radhika Chippada
08:00 pm Bug #5074 (In Progress): [SDKs] CLI client and Ruby SDK should recover from (and avoid creating) ...
Brett Smith
06:43 pm Revision 643bf501 (arvados): refs #4523
Merge branch '4523-search-index' Radhika Chippada
06:30 pm Revision 194eaad9 (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
06:28 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Tom, addressed all your comments. I also simplified has_description check further. Thanks. Radhika Chippada
03:18 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
At commit:68bc991 on 4523-search-index, just a couple of minor suggestions:
* Instead of <code class="ruby">index_co...
Tom Clegg
06:20 pm Revision 1e133a2a (arvados): 4523: a little bit simpler script
Radhika Chippada
05:38 pm Revision 3957f3db (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
05:00 pm Revision ef2d3688 (arvados): Merge branch '5087-fix-crunch-sigpipe-wip'
Closes #5087, #5089. Brett Smith
05:00 pm Revision 99a25735 (arvados): 5087: crunch-job installer feeds tar incrementally.
When the input we give to tar is large enough (greater than 4-5MiB),
writing it all in one shot causes tar to die, an...
Brett Smith
02:54 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
But, if we can't schedule things perfectly up-front, we can patch things over after-the-fact. Here's one idea:
Pe...
Brett Smith
02:21 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Brett Smith wrote:
> This is the disconnect I probably spent the most time struggling with in the design: there is z...
Brett Smith
02:23 pm Revision 4a701056 (arvados): 4878: show only the re-run popup option
Radhika Chippada
01:27 am Revision 7079475c (arvados): Improved erorr message to make it clear what's a size and what's a t...
Misha Zatsman
01:06 am Revision 097d0c20 (arvados): Renamed BlockDigest's ToString() to String() to implement fmt.String...
Misha Zatsman

01/26/2015

10:51 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Tom Clegg wrote:
> Brett Smith wrote:
> > maybe raise an exception if a WorkMethod assigns an instance variable—"Ot...
Brett Smith
04:25 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Brett Smith wrote:
> maybe raise an exception if a WorkMethod assigns an instance variable—"Other WorkMethods won't ...
Tom Clegg
01:35 am Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Tom Clegg wrote:
> I think the question of what to put in @__main__@ is confusing in that we're putting a bunch of m...
Brett Smith
09:17 pm Revision 2cdf1644 (arvados): Merge branch 'master' into 4878-rerun-job
Radhika Chippada
08:54 pm Bug #4878: [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Radhika Chippada wrote:
> Branch 4878-rerun-job ready for review.
Reviewing commit:2926892
h2. The story
I ...
Brett Smith
08:51 pm Revision fcd5763d (arvados): Wording tweaks for doc.arvados.org.
No issue # Ward Vandewege
08:50 pm Story #2659: [Workbench] Anonymous user can access publicly shared data using Workbench and curl
There is now an active customer request around this. Customer would like to create a project to share with his team. ... Jonathan Sheffi
08:04 pm Feature #5090 (Resolved): [Documentation] Add some direct links on doc.arvados.org to the most us...
After this, the doc.arvados.org content can appear at the arvados.org root, and visitors will still be able to find a... Tom Clegg
07:43 pm Task #5067 (In Progress): Review branch: 4878-rerun-job-bcs-wip
Brett Smith
07:02 pm Revision 9b4131b9 (arvados): 5087: crunch-job installer feeds tar incrementally.
When the input we give to tar is large enough (greater than 4-5MiB),
writing it all in one shot causes tar to die, an...
Brett Smith
06:35 pm Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
Timed a few runs again. Here on the qr1hi shell:... Phil Hodgson
04:47 pm Revision a86762d9 (arvados): 4232: remove "dependencies" entries from examples in the tutorials i...
Phil Hodgson
04:05 pm Revision 0ba8a5a0 (arvados): Merge branch '4340-arv-ws-fix-ssl-warning'
Closes #4340 Ward Vandewege
04:04 pm Revision f5d68241 (arvados): Merge branch 'master' into 4340-arv-ws-fix-ssl-warning
Ward Vandewege
04:04 pm Revision 71a9cb71 (arvados): A few tweaks based on review feedback.
refs #4340 Ward Vandewege
04:03 pm Revision 9ac2a7d6 (arvados): 4232: remove uselessness (commented out code and other wastes of spa...
Phil Hodgson
03:55 pm Bug #5010 (Resolved): [Workbench] Trash button on collections lists should set expires_at instead...
Applied in changeset arvados|commit:e89251c160ae409f8af2f9ecae5ffb210ccd0a8d. Tim Pierce
03:53 pm Bug #5010: [Workbench] Trash button on collections lists should set expires_at instead of moving ...
Tim Pierce wrote:
> Thanks for checking the integration tests. I've removed those assertions at commit:ffa928f
T...
Brett Smith
03:27 pm Bug #5010: [Workbench] Trash button on collections lists should set expires_at instead of moving ...
Thanks for checking the integration tests. I've removed those assertions at commit:ffa928f
This code now passes a...
Tim Pierce
03:12 pm Bug #5010: [Workbench] Trash button on collections lists should set expires_at instead of moving ...
Tim Pierce wrote:
> Tests added at commit:6f3e7bf
These are great, thanks for following up on that. I like every...
Brett Smith
03:52 pm Revision e89251c1 (arvados): Merge branch '5010-trash-button-for-collections'
Fixes #5010. Tim Pierce
03:24 pm Revision ffa928f7 (arvados): 5010: fixed integration test
Fixed a failing integration test that checked for the presence of a
collection in the Home project after being delete...
Tim Pierce
03:08 pm Revision f8af0c6c (arvados): Merge branch 'master' into 4232-slow-pipes-n-jobs
Phil Hodgson
03:01 pm Story #3532: [Keep] Keepstore queries API server to verify tokens
After talking to Tim, I am assigning this to me. Tim will guide me through the development as needed. Radhika Chippada

01/25/2015

09:18 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Brett Smith wrote:
> When this file actually is the Crunch script named in a job, then the code under this condition...
Tom Clegg
03:05 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Let me talk about implementation concerns for a minute, because I think that's my main source of worry about the idea... Brett Smith
12:25 am Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Here's a strawman for "how modules call one another's methods":... Tom Clegg
08:04 am Revision e79f335b (arvados-dev): writable: 'status' subcommand changes...
- allow users with RW to use it
- fix bug where, when a repo's writable status is checked, the global status
...
Sitaram Chamarty
03:23 am Revision 16c5d87a (arvados): 3686: improve manage account page test to click on the repository link.
Radhika Chippada
02:50 am Revision 22ded15b (arvados): 3686: enhance manage account test to also verify a writable repository.
Radhika Chippada

01/24/2015

06:55 pm Task #5088 (Resolved): Review branch: 3686-sharing-repositories (one more time, for repository li...
Please see the details regarding this update in the story. Radhika Chippada
06:47 pm Feature #3686: [Workbench] Provide a sharing tab for repositories similar to setting up sharing f...
Updated the "3686-sharing-repositories" branch to add a link to Repository page in the Manage Account page. Details a... Radhika Chippada
06:40 pm Feature #3686: [Workbench] Provide a sharing tab for repositories similar to setting up sharing f...
From IRC conversation between Tom and Radhika on Jan 23rd regarding the missing repository link for non-admin users:
...
Radhika Chippada
06:36 pm Revision 2b9204f0 (arvados): 3686: repository.editable_attributes returns an empty array when the...
Radhika Chippada
06:07 pm Revision e9025ef3 (arvados): 3686: when a repository is manageable by a user, make repository nam...
Radhika Chippada
02:51 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Tom Clegg wrote:
> How about CrunchModule? Too vague?
Only slightly more than the others. I could go for it.
...
Brett Smith
09:42 am Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
How about CrunchModule? Too vague?
> The __main__ block doesn't choose a method to run.
I was just referring to...
Tom Clegg
05:00 am Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Tom Clegg wrote:
> I find the class name CrunchScript a little unsatisfying -- it seems weird to say you're "creatin...
Brett Smith
02:40 am Story #3408: [Keep] Implement Production Data Manager
Thanks Peter! I've responded to all your comments. I'm gonna work on you request for better keep stats now, but I jus... Misha Zatsman
02:22 am Revision c718d729 (arvados): A bunch of changes, most in response to Peter's review.
Logger:
Edit() and Record() have been replaced with the single Update() method which takes a function as input (sugge...
Misha Zatsman

01/23/2015

10:57 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
This looks really good.
It seems to me that Future is an appropriate term here: it's a placeholder for a value tha...
Tom Clegg
10:46 pm Feature #4138: [Node Manager] Support Google Cloud Platform in node manager
Ready for review at commit:5fd3e8c.
Notes on configuration settings:
* Cloud Credentials
** @json_credential_fil...
Tim Pierce
10:44 pm Revision 5fd3e8c6 (arvados): 4138: updated unit test
Corrected test_create_includes_ping_secret to account for delivering the
ping secret via metadata in GCE.
Tim Pierce
10:25 pm Revision 69099adf (arvados): 4138: GCE fixes
The 'network_id' parameter needs to be delivered as 'location' in GCE.
The ping_url parameter is now delivered in th...
Tim Pierce
10:00 pm Revision 4242f1ba (arvados): arv-ws should prefer system's CA certificates (if available).
closes #4340 Ward Vandewege
09:55 pm Revision 0dfab8a6 (arvados): Merge branch '0000-workbench-user-profile-wording-changes'
No issue # Ward Vandewege
09:23 pm Bug #5076 (New): [Workbench] Replace schizophrenic generic "groups" page with "roles" page that o...
This is happening because the /groups page is filtering out non-project (?) group class. However, the newly created g... Radhika Chippada
08:51 pm Bug #5074 (Resolved): [SDKs] CLI client and Ruby SDK should recover from (and avoid creating) unr...
The current code creates a race condition while writing a file. It should create a temp file, write it, flush/close i... Tom Clegg
08:29 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
It appears that we need the tsvector column to use setweight for ranking.
http://www.sai.msu.su/~megera/postgres/f...
Radhika Chippada
07:39 pm Bug #5073 (Resolved): [Documentation] List known limitations of docker install at doc.arvados.org...
Known limitations include:
* Web upload does not work.
* Websockets does not work.
* There are two compute nodes (...
Tom Clegg
07:27 pm Feature #5072 (Resolved): [Documentation] (recurring) Refresh user documentation
Ward Vandewege
07:26 pm Support #5071 (Resolved): [Support] Fix bugs and write tests (second half)
Ward Vandewege
07:25 pm Support #5070 (Resolved): [Support] Fix bugs and write tests (first half)
Ward Vandewege
07:24 pm Story #5069 (Resolved): [Documentation] (recurring) Write blog post in first three days of sprint
Ward Vandewege
07:24 pm Bug #4886: [Docker] Web upload stuck at "upload in progress"
Bugs to check for:
* Workbench uploader just gets lost / hangs (instead of throwing an error) if there is no Keep pr...
Tom Clegg
07:21 pm Task #5038 (Resolved): Review branch: 4926-getting-started
Nancy Ouyang
07:21 pm Revision 5799ec68 (arvados): Merge branch 'master' into 0000-workbench-user-profile-wording-changes
Ward Vandewege
07:17 pm Revision 32002eb6 (arvados): refs #4926 Merge branch '4926-getting-started'
Nancy Ouyang
07:12 pm Bug #4903: [Crunch] ensure that JOB_WORK and TASK_WORK directories exist for Docker jobs
crunch-job creates JOB_WORK and TASK_WORK in the docker container (as ephemeral docker volumes). It's possible this j... Tom Clegg
07:11 pm Revision 58e26628 (arvados): more typos
Nancy Ouyang
07:00 pm Bug #5068 (New): [Docker] fix @_NOT_FOUND_@ hack in config.rb
The @docker/build_tools/config.rb@ script substitutes the string @@_NOT_FOUND_@@ for any configuration variable requi... Tim Pierce
06:57 pm Revision 99ad69e4 (arvados-dev): Make the pip installs for PyYAML and docutils silent under norma...
This avoids spitting out a whole lot of useless libyaml compiler
warnings to the command line.
No issue #
Ward Vandewege
06:53 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
I made those changes, thanks. Nancy Ouyang
04:04 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Nancy,
Thanks for updating. Just a couple very minor comments about the branch.
In the 'Sharing Data' page:
* "C...
Radhika Chippada
06:50 pm Revision 8cd6bbad (arvados): minor typos
Nancy Ouyang
05:05 pm Task #5067 (Resolved): Review branch: 4878-rerun-job-bcs-wip
Radhika Chippada
05:04 pm Bug #4878: [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Branch 4878-rerun-job ready for review.
* I copied over 7 attributes from the current job instance (script, script...
Radhika Chippada
02:48 pm Bug #4878 (In Progress): [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Radhika Chippada
04:57 pm Bug #5010: [Workbench] Trash button on collections lists should set expires_at instead of moving ...
Brett Smith wrote:
> Tim Pierce wrote:
> > No unit test has been added to exercise this: I believe that the test _"...
Tim Pierce
03:23 pm Bug #5010: [Workbench] Trash button on collections lists should set expires_at instead of moving ...
Tim Pierce wrote:
> No unit test has been added to exercise this: I believe that the test _"project admin can remove...
Brett Smith
04:55 pm Revision 6f3e7bf1 (arvados): 5010: updated functional tests for new trash behavior
Renamed "project admin can remove items from the project" to "project
admin can remove collections from the project" ...
Tim Pierce
04:41 pm Revision 29268928 (arvados): 4878: now the test works!
Radhika Chippada
04:25 pm Revision e5025b6b (arvados): 4878: add integration test for Re-run job with options.
Radhika Chippada
04:17 pm Bug #4751: [Node Manager] Can erroneously pair cloud nodes with stale Arvados node records
I think there are basically two possible approaches:
* EC2 compute nodes, at least, put their EC2 id in the Arvado...
Brett Smith
02:47 pm Task #5044 (In Progress): Review 5010-trash-button-for-collections
Brett Smith
02:47 pm Task #5042 (Resolved): Review 4889-crunch-deadlock
Brett Smith
02:28 pm Revision 8caa085f (arvados): Merge branch 'master' into 4878-rerun-job
Radhika Chippada
02:28 pm Revision f8164fe9 (arvados): 4878: rerun job with options popup
Radhika Chippada
02:17 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Tom Clegg wrote:
> > Are there any critical use cases where we need to be able to introspect the object this way?
>...
Brett Smith
12:50 pm Revision 2b60134e (arvados): 4823: Bufferblocks are owned by a specific ArvadosFile
Peter Amstutz

01/22/2015

10:48 pm Story #3020 (Closed): [Deployment] Docker installation runs crunch-dispatch and worker nodes
Done in #3219. Brett Smith
10:45 pm Bug #3278 (Closed): [Crunch] crunch-dispatch should cache ApiClientAuthorizations it creates
Work done as part of #4297. Brett Smith
10:42 pm Bug #3774 (Closed): [Crunch] crunch-job tries to put non-scalar structures in the environment
Closing as a "duplicate" of #3097. That's not strictly true, but we'd rather do #3097 than this. Brett Smith
10:33 pm Story #4127: [API] Nodes have a method to request and record shutdowns
It's not clear that we need this now that #4380 is done. Brett Smith
10:33 pm Bug #4368 (Closed): [Crunch] Improve node failure detection and job retry logic
Now that #4380 is done and we've seen great results, I'm closing this issue. This issue's description is very focuse... Brett Smith
10:22 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
Peter Amstutz wrote:
> * Who is the audience? This should state that up front. Are readers expected to have alrea...
Brett Smith
10:10 pm Bug #4889 (Resolved): [Crunch] Logging with a progress bar deadlocks on output
Applied in changeset arvados|commit:38e27663cf656f0c9c443a2715f249afe39a8bfb. Anonymous
09:49 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
This fixes the "stderr goes silent" problem and (probably?) kills the child by closing the pipe, which is definitely ... Tom Clegg
08:50 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
Ready for review at commit:4c731f759.
It's a workaround, not a comprehensive fix: close the input pipe before retu...
Tim Pierce
10:08 pm Revision 38e27663 (arvados): Merge branch '4889-crunch-deadlock'
Fixes #4889. Tim Pierce
10:05 pm Revision 08671179 (arvados): 4889: improve error message, unit test
Per review in #4889-17:
Updated the CopyPipeToChan error message to be more descriptive, for the
benefit of anyone r...
Tim Pierce
09:37 pm Revision d446d49d (arvados): Merge branch 'master' into 0000-workbench-user-profile-wording-changes
Ward Vandewege
09:36 pm Task #5042 (In Progress): Review 4889-crunch-deadlock
Tom Clegg
09:18 pm Revision be13903b (arvados-dev): Initial version of the run-lightning-tests.sh script.
refs #4827 Ward Vandewege
09:10 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
Thoughts
Put all special magic files in a directory, @.arvados@ or @.arv-mount@ or whatever
* This way you can "l...
Tom Clegg
07:38 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
Tom Clegg wrote:
> h3. Snapshots / who sees buffered writes?
>
> After looking at @write(2)@, I don't think we ca...
Peter Amstutz
04:14 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
h3. Snapshots / who sees buffered writes?
After looking at @write(2)@, I don't think we can use the "snapshot read...
Tom Clegg
09:04 pm Bug #5010: [Workbench] Trash button on collections lists should set expires_at instead of moving ...
Ready for review at commit:89fbb8bf
No unit test has been added to exercise this: I believe that the test _"projec...
Tim Pierce
08:58 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Thanks, I updated the wiki. I also implemented most of your recommendations and pushed again. Nancy Ouyang
08:06 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Hi Nancy, sorry for using my old jira terminology. Yes, I meant task by subtask. I took another look at the wiki page... Radhika Chippada
07:46 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Thanks!
Radhika Chippada wrote:
> 1. *Comments about the wiki page (https://arvados.org/projects/arvados/wiki/Doc...
Nancy Ouyang
03:03 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Review comments for branch "4926-getting-started" and wiki page:
The "Getting started" guide looks awesome. Some m...
Radhika Chippada
08:56 pm Revision 5d61e1d5 (arvados): Merge branch 'master' into 4138-node-manager-google-cloud
Tim Pierce
08:52 pm Revision 045fc723 (arvados): 4926: typos & rewording
Nancy Ouyang
08:40 pm Revision 4c731f75 (arvados): 4889: added CopyPipeToChan unit test
Added TestCopyPipeToChanLongLines test to confirm that when
CopyPipeToChan attempts to read a line too long for bufio...
Tim Pierce
08:34 pm Bug #5046 (Closed): Jobs failing to start. Logs show "rm:cannot remove `/tmp/crunch-job/task/com...
qr1hi is deployed with the bugfix. Brett Smith
02:45 pm Bug #5046: Jobs failing to start. Logs show "rm:cannot remove `/tmp/crunch-job/task/compute19.1....
This is a duplicate of #4967. (The symptoms are more like #4970, but they have the same root cause.) We already hav... Brett Smith
08:30 pm Bug #5065: [Node Manager] EC2 driver creates nodes configured to terminate on shutdown
FWIW, cursory searching hasn't revealed how to do this. It doesn't correspond to any argument to create_node, and lo... Brett Smith
08:17 pm Bug #5065 (New): [Node Manager] EC2 driver creates nodes configured to terminate on shutdown
Brett Smith
08:08 pm Bug #5045: [Workbench] reports "oops, request failed" rendering projects with very large collections
Resolved on 4xphq with #3021. Moving this to Deferred on the expectation that this particular failure is unlikely to... Tim Pierce
08:07 pm Feature #5064 (New): [Crunch] Automatically restart jobs after internal/intermittent errors
After a customer meeting, they asked if a pipeline crashes halfway through based on a node failure or some random int... Bryan Cosca
08:02 pm Task #5038: Review branch: 4926-getting-started
Completed review and added feedback to the story. Radhika Chippada
02:44 pm Task #5038 (In Progress): Review branch: 4926-getting-started
Radhika Chippada
07:40 pm Revision ed6bd177 (arvados): 4138: general GCE fixes
* JSON credential file
** GCE credentials are delivered as a JSON string (and the key is formatted as a multi-line RS...
Tim Pierce
07:37 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Peter Amstutz wrote:
> Brett Smith wrote:
>
> > FutureOutput objects aren't futures, which is why I didn't just na...
Brett Smith
07:12 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Tim Pierce wrote:
> The notes on limiting concurrency remind me of one of the drums Peter's been beating for a while...
Brett Smith
06:40 pm Revision 68bc991c (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
06:37 pm Revision 3298dd77 (arvados): 4523: add a new migration script that invokes search_index migration...
Radhika Chippada
05:06 pm Revision 1fae5d56 (arvados): refs #4523
Merge branch '4523-search-index' Radhika Chippada
04:36 pm Revision 5c1db683 (arvados): 4523: do not include descriptions in search index and update tests a...
Radhika Chippada
04:29 pm Bug #4920 (Resolved): [Crunch] Installing Docker image from [...] exited 1
These happened during the time that compute nodes were registering themselves prematurely more often due to a configu... Brett Smith
04:20 pm Task #5031 (In Progress): Review/feedback
Tom Clegg
03:34 pm Bug #4805: [Workbench] Workbench provenance graph tabs appear empty when graph is very large
The graph is being generated fine, it's just so ginormous that the upper left part that you're viewing by default is ... Brett Smith
02:07 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Tom, please take another look at the 4523-full-text-search branch.
What is new:
* Updated the full-text migrati...
Radhika Chippada
01:55 pm Revision b4fd2ab4 (arvados): Merge branch 'master' into 4904-arv-web
Peter Amstutz
01:55 pm Revision 2ab024a3 (arvados): Revert "4838: Add --set-executable-bit option to make all files from...
This reverts commit b97ac7f96234cbbb491bdbaade840ab50802f357. Peter Amstutz
01:45 pm Revision 316eca14 (arvados): 4523: a few more test cases
Radhika Chippada
05:32 am Revision eeebd1e2 (arvados): Merge branch 'master' into 4523-full-text-search
Radhika Chippada
05:31 am Revision c430a289 (arvados): 4523: add full text search index to collections, groups, jobs, pipel...
Radhika Chippada
04:17 am Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
I think it's better to stay simple: offer a simple client object, and admit that it's not thread-safe, rather than of... Tom Clegg

01/21/2015

11:46 pm Bug #5046 (Closed): Jobs failing to start. Logs show "rm:cannot remove `/tmp/crunch-job/task/com...
On qr1hi, pipeline instance qr1hi-d1hrv-y4250viwnk8z966 fails quickly after being registered to start. From the logs... Abram Connelly
10:11 pm Revision 58d12cd8 (arvados): 4823: More docstrings for public Collection and ArvFile API
Peter Amstutz
09:26 pm Bug #5045 (New): [Workbench] reports "oops, request failed" rendering projects with very large co...
Viewing a project that contains many collections with extremely large manifests yields this response from the API ser... Tim Pierce
09:24 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
By the way, from the @write(2)@ man page:... Peter Amstutz
09:19 pm Bug #4805: [Workbench] Workbench provenance graph tabs appear empty when graph is very large
The graph generation code in the controller #show method is all wrapped in @rescue nil@. It seems likely that an exc... Brett Smith
07:41 pm Bug #4805: [Workbench] Workbench provenance graph tabs appear empty when graph is very large
Tim Pierce wrote:
> This behavior is consistent with a collection that has been uploaded but not used in any pipelin...
Brett Smith
09:05 pm Task #5044 (Resolved): Review 5010-trash-button-for-collections
Tim Pierce
09:03 pm Bug #4977: [Crunch] "stdbuf": executable not found in $PATH
Given that the bug has happened consistently with this one Docker image, and only with this one Docker image, I stron... Brett Smith
08:56 pm Bug #4954 (Closed): [Workbench] Revoke sharing rights to a user button missing
We believe there was a real issue here but it's hard to track down after-the-fact, and low priority. If you see it h... Brett Smith
08:51 pm Revision 89fbb8bf (arvados): 5010: remove_items sets the expired_at date if available
On objects which support expired_at, remove_items will set that date
rather than moving them out of the current project.
Tim Pierce
08:35 pm Bug #5043 (Resolved): [Crunch] accept arbitrarily long stderr lines in crunchstat
Crunchstat uses a @bufio.Scanner@ to read stderr lines, and as a consequence cannot process input lines longer than @... Tim Pierce
08:24 pm Task #5042 (Resolved): Review 4889-crunch-deadlock
Tim Pierce
08:18 pm Revision 27205826 (arvados): 4889: close the child stderr pipe before returning
Updated CopyPipeToChan to close the child's stderr pipe before
returning, so that even if it returns for some reason ...
Tim Pierce
08:14 pm Story #3408: [Keep] Implement Production Data Manager
I want to start by saying this is really great, we have been looking forward to having DataManager for a long time, s... Peter Amstutz
08:03 pm Revision 224701a0 (arvados): Merge branch '3021-api-performance' refs #3021
Tom Clegg
07:11 pm Revision 26119240 (arvados): 4967: Fix API server Gemfile.
I'm kind of at a loss to explain what happened here. Refs #4967. Brett Smith
06:52 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Brett Smith wrote:
> Right now a SafeApi object _acts_ a lot like the underlying Google API client object, but doe...
Peter Amstutz
06:51 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Tom Clegg wrote:
> SafeApi is only safe in a very specific way: you can call its methods from various threads and ge...
Peter Amstutz
04:45 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
SafeApi is only safe in a very specific way: you can call its methods from various threads and get a different underl... Tom Clegg
04:44 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Peter Amstutz wrote:
> Proposal:
>
> # Move SafeApi into the SDK
> # arvados.api() returns/caches SafeApi object...
Brett Smith
03:53 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
Proposal:
# Move SafeApi into the SDK
# arvados.api() returns/caches SafeApi objects
# Add a SafeApi.clone() met...
Peter Amstutz
02:46 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
The SafeApi class in the fuse driver handles this by allocating a separate api object per thread. This generally add... Peter Amstutz
02:19 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
I think I've convinced myself that we should just do away with the global API client cache. @cache=False@ should jus... Brett Smith
06:45 pm Bug #4967 (Resolved): [Crunch] Doesn't cope well with FUSE mounts left hanging around after killi...
Applied in changeset arvados|commit:ef969ca8dabe571a9866a7b3b7c39098785022fa. Brett Smith
06:37 pm Bug #4967: [Crunch] Doesn't cope well with FUSE mounts left hanging around after killing tasks wi...
reviewing commit:5754435 LGTM (tested the modified code on a compute node in this state, and it DTRT). Ward Vandewege
04:11 pm Bug #4967 (In Progress): [Crunch] Doesn't cope well with FUSE mounts left hanging around after ki...
I can locally reproduce #4967 and #4970 by sending the right signal to arv-mount:... Brett Smith
06:45 pm Bug #4970 (Resolved): [Crunch] Cannot create directory `/tmp/crunch-job/task/compute14.1.keep': F...
Applied in changeset arvados|commit:ef969ca8dabe571a9866a7b3b7c39098785022fa. Brett Smith
06:40 pm Revision 7c34347e (arvados): 4967: API server bundle uses bugfixed crunch-job.
Refs #4967, #4970. Brett Smith
06:39 pm Revision ef969ca8 (arvados): Merge branch '4967-crunch-mount-cleanup-wip'
Closes #4967, #4970, #5039. Brett Smith
06:36 pm Task #5039 (Resolved): Review 4967-crunch-mount-cleanup-wip
Ward Vandewege
04:40 pm Task #5039 (Resolved): Review 4967-crunch-mount-cleanup-wip
Brett Smith
06:14 pm Task #4975 (Resolved): Review 3021-api-performance
Tim Pierce
06:14 pm Story #3021: [Tests] Make jenkins tests run faster.
LGTM at commit:7eec2f4. Thanks for putting my mind at ease. Tim Pierce
05:15 pm Feature #5040 (Closed): Create crunch user in any docker image
Bryan Cosca
05:10 pm Feature #5040 (Closed): Create crunch user in any docker image
If I give arvados any docker image, it should be able to "(a) create the crunch user if it isn't there and (b) make s... Bryan Cosca
05:12 pm Feature #5041 (New): [Crunch] Set up crunch user automatically in docker container.
# Create the "crunch" user inside the container if it isn't there
# Make sure that the "crunch" user in the containe...
Peter Amstutz
04:42 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
And this looks likely to be the culprit: source:services/crunchstat/crunchstat.go@5870334b03237f04df6de35193f78b838f7... Tim Pierce
04:15 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
Successfully reproduced in "qr1hi-d1hrv-dftjw06d6rkjc2w":http://crvr.se/qr1hi-d1hrv-dftjw06d6rkjc2w. The problem is ... Tim Pierce
04:39 pm Revision 57544354 (arvados): 4967: crunch-job unmounts old Keep mounts more robustly.
The previous version looked for mounts under $JOB_WORK before
unmounting anything. We long ago started mounting unde...
Brett Smith
04:37 pm Task #5038 (Resolved): Review branch: 4926-getting-started
Nancy Ouyang
04:20 pm Feature #5036: [arv-mount] Change default mount type from "fuse" to "fuse.arvados"
"4967 note 6":https://arvados.org/issues/4967#note-6 decrees that the type name should be @fuse.keep@. Brett Smith
04:13 pm Revision dc32d190 (arvados): 4926: Added 'getting started' section with three image galleries.
Nancy Ouyang
03:51 pm Revision ffcfb73e (arvados): Merge branch '5016-ctrl-c-arv-ws' closes #5016
Peter Amstutz
03:50 pm Bug #5016 (Resolved): [SDKs] Should be able to use ^C to interrupt arv-ws.
Applied in changeset arvados|commit:ffcfb73e6a5dfd626b1d523accc42e7a6af5e8ed. Peter Amstutz
03:27 pm Bug #5016: [SDKs] Should be able to use ^C to interrupt arv-ws.
Okay, I see now that what's going on in my last comment is that the thread is blocking on the first large API respons... Brett Smith
03:22 pm Bug #5016: [SDKs] Should be able to use ^C to interrupt arv-ws.
commit:691d642 does the job, but it can be surprisingly sluggish. Here's a transcript where I hit ^C as soon as I sa... Brett Smith
02:23 pm Task #5017 (In Progress): Review 5016-ctrl-c-arv-ws
Brett Smith
04:15 am Revision 6d93d2ec (arvados): 4523: use file_names column instead of manifest_text column for full...
Radhika Chippada
03:25 am Feature #5033: [SDKs] `arv keep docker` should pipe the data directly to Keep instead of store-an...
It does store-and-forward specifically to allow it to resume the upload in case of interruption. See #4438 for more ... Brett Smith
01:34 am Revision fc696c2f (arvados): Added comment, ran gofmt.
Misha Zatsman
01:31 am Revision f48f9250 (arvados): Added Logger.MutateLog() on Tom's suggestion. Tried it out in one in...
Misha Zatsman

01/20/2015

11:02 pm Bug #5037: [SDKs] Improve Python SDK thread safety and document pitfalls
One issue: things like CollectionReader currently get their own API object with just @arvados.api('v1')@. They don't... Brett Smith
10:55 pm Bug #5037 (Resolved): [SDKs] Improve Python SDK thread safety and document pitfalls
One of our users wrote a Crunch script that, in part, does something like this:... Brett Smith
10:12 pm Bug #4471 (Resolved): [Crunch] srun: error: Application launch failed: Communication connection f...
Tom Clegg
10:10 pm Bug #4942 (Closed): [Workbench] Data Collections Tab in Projects takes too long to load or fails
Tom Clegg
10:06 pm Bug #4938: [Workbench] improve error reporting for failed AJAX calls
Specific improvements:
* Default fall-back error message should be more friendly than "error". Perhaps: "Sorry, I do...
Tom Clegg
09:34 pm Bug #4970: [Crunch] Cannot create directory `/tmp/crunch-job/task/compute14.1.keep': File exists
This seems to be what @mkdir@ says when you mkdir a stale fuse mount.... Tom Clegg
09:29 pm Feature #5036 (New): [arv-mount] Change default mount type from "fuse" to "fuse.arvados"
sshfs publishes its mounts as type @fuse.sshfs@. It would be cool if arv-mount published its mounts as @fuse.arvados... Brett Smith
09:28 pm Bug #4967: [Crunch] Doesn't cope well with FUSE mounts left hanging around after killing tasks wi...
Instead of @if mount|grep -q $JOB_WORK/; then ....@, we probably need something like... Tom Clegg
09:07 pm Bug #4967: [Crunch] Doesn't cope well with FUSE mounts left hanging around after killing tasks wi...
Recent example:
I started qr1hi-8i9sb-2dszutc1qfgz5lf, which began running on compute48 and then quickly cancelled...
Tim Pierce
09:23 pm Revision 80b809aa (arvados): Merge branch 'master' into 4138-node-manager-google-cloud
Tim Pierce
08:25 pm Bug #4889 (In Progress): [Crunch] Logging with a progress bar deadlocks on output
Tim Pierce
08:23 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
Job "qr1hi-8i9sb-7b7seh3jgk8zoe1":http://crvr.se/qr1hi-8i9sb-7b7seh3jgk8zoe1 doesn't deadlock either (Python script g... Tim Pierce
07:37 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
The original job continues to deadlock in production, e.g. "qr1hi-8i9sb-6ja93cyxd7mjm1r":http://crvr.se/qr1hi-8i9sb-6... Tim Pierce
08:24 pm Feature #5035 (New): [Documentation] Document the minimum docker image / Dockerfile that can be u...
This should be documented at http://doc.arvados.org/user/topics/arv-docker.html and it should be explained specifical... Tom Clegg
08:06 pm Feature #5034 (Resolved): [Workbench] Show content statistics/summary (total size, number of file...
The "summary" area at the top of the page should include:
* UUID (except in the special case where the page was load...
Tom Clegg
08:05 pm Revision 7349451e (arvados): Merge branch 'master' into 4523-full-text-search
Radhika Chippada
07:59 pm Feature #5033 (New): [SDKs] `arv keep docker` should pipe the data directly to Keep instead of st...
Tom Clegg
07:52 pm Revision 030e58ed (arvados): 5029: API server uses bugfixed crunch-job.
Refs #5029. Brett Smith
07:50 pm Bug #5029 (Resolved): [Crunch] Job specified SDK version; log reports it was packed, but not foun...
Applied in changeset arvados|commit:279c6f8bc69a3edfcf7213e0c1b7621f60a46c06. Brett Smith
07:39 pm Bug #5029: [Crunch] Job specified SDK version; log reports it was packed, but not found for insta...
The main reason the SDK wasn't installed was because virtualenv wasn't available in the Docker image. This got obscu... Brett Smith
07:38 pm Bug #5029 (In Progress): [Crunch] Job specified SDK version; log reports it was packed, but not f...
Brett Smith
03:49 pm Bug #5029 (Resolved): [Crunch] Job specified SDK version; log reports it was packed, but not foun...
See log for qr1hi-8i9sb-w3c5jkyq8vwi5k0. Brett Smith
07:42 pm Revision 279c6f8b (arvados): 5029: Fix crunch-job logging when SDK requested+virtualenv unavailable.
* Properly concatenate the message.
* Query and log installed SDK packages in this scenario, since we
might fall b...
Brett Smith
07:38 pm Revision 276ca380 (arvados): 4823: Working on method documentation and comments for arvfile
Peter Amstutz
07:27 pm Feature #5022 (Closed): [Workbench] User can navigate to git repository page in order to access r...
Tom Clegg
07:27 pm Feature #4905 (New): [Workbench] Make repository-sharing feature accessible from Manage Account page
(Reopening because #3686 didn't provide a way for the user to _find_ the sharing tab.) Tom Clegg
07:03 pm Feature #5032 (New): [Workbench] User can trash and un-trash items
When the Trash button on collections is used to move items into a "trash" folder, the user will need to have a way to... Tim Pierce
06:58 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Brett Smith wrote:
> FutureOutput objects aren't futures, which is why I didn't just name the class Future. It ho...
Peter Amstutz
06:39 pm Task #4955 (Resolved): Review branch: 4926-browser-based-upload
Radhika Chippada
06:37 pm Revision e6c0c056 (arvados): refs #4926
Merge branch '4926-browser-based-upload' Radhika Chippada
06:35 pm Revision aba42792 (arvados): 4926: move tutorial_expectations into sections that are describing c...
Radhika Chippada
05:40 pm Feature #4838 (Resolved): [Keep] FUSE driver should expose files with permissions mode 0555
Applied in changeset arvados|commit:9c569a32645164e99fa44867626bb5a11887c338. Peter Amstutz
05:06 pm Feature #4838: [Keep] FUSE driver should expose files with permissions mode 0555
Peter Amstutz wrote:
> Point taken. 4838-fuse-executable-files updated to just a one line fix.
Thanks. Please m...
Brett Smith
04:57 pm Feature #4838: [Keep] FUSE driver should expose files with permissions mode 0555
Point taken. 4838-fuse-executable-files updated to just a one line fix. Peter Amstutz
02:35 pm Feature #4838: [Keep] FUSE driver should expose files with permissions mode 0555
My perspective is that putting this behavior behind a command-line flag is a classic "'unbreak my software' option":h... Brett Smith
05:39 pm Task #5000 (Resolved): Review 4838-fuse-executable-files
Peter Amstutz
02:15 pm Task #5000 (In Progress): Review 4838-fuse-executable-files
Brett Smith
05:25 pm Revision 9c569a32 (arvados): Merge branch '4838-fuse-executable-files' closes #4838
Peter Amstutz
05:22 pm Bug #3691: [Workbench] Suppress "ajax failed" error messages when ajax fails due to browser navig...
#4776 illustrates a case where it would be preferable to just clean up, rather than displaying a more-specific error. Brett Smith
05:21 pm Bug #4776 (Closed): [Workbench] Pipeline pane load error when opening pipeline from home page in ...
This is a duplicate of #3691. What's happening is that the user clicks a pipeline link while the Dashboard is still ... Brett Smith
05:08 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
The "Note: This tutorial assumes either that you are logged into an Arvados VM..." is at the top of the page, but onl... Peter Amstutz
05:00 pm Bug #5026: [API] Prohibit leaving jobs in an inconsistent state (e.g., state=queued with non-null...
> twp: short answer: I ran that job almost certainly by copying out the job definition from a previous job of Bryan's... Brett Smith
03:09 pm Bug #5026: [API] Prohibit leaving jobs in an inconsistent state (e.g., state=queued with non-null...
qr1hi-57u5n-m61q51j3hx5kgzv is the first log entry for the job, on 19 January. It shows that the job was originally ... Brett Smith
02:54 pm Bug #5026: [API] Prohibit leaving jobs in an inconsistent state (e.g., state=queued with non-null...
Note that the lock failure log message is coming from crunch-job, not from crunch-dispatch. crunch-dispatch sees the... Brett Smith
02:36 pm Bug #5026 (New): [API] Prohibit leaving jobs in an inconsistent state (e.g., state=queued with no...

qr1hi-8i9sb-lxlj7ut2ynfk4nj is a run-command job. Workbench has some very weird start/stop information about this j...
Ward Vandewege
04:53 pm Task #5031 (Closed): Review/feedback
Tom Clegg
04:43 pm Bug #5030 (Resolved): [Workbench] Stats graph display for job without stats is confusing
See attached screenshot for how a job log tab looks when a job is in the install step but hasn't started actually run... Brett Smith
04:42 pm Revision f53484e4 (arvados): 4838: Set +x on all StreamReaderFiles
Peter Amstutz
04:34 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
More notes/discussion items:
If we want to approximate POSIX shared file system behavior, having "opportunities to...
Peter Amstutz
04:21 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Looking at commit:1b01104 -- this looks promising.
I think we should index the file_names column rather than the r...
Tom Clegg
02:45 pm Task #5027 (Resolved): [Workbench] Improve Content Address/UUID display on Collection page
All throughout the marketing literature and documentation we describe Keep as content addressable. Technically, I bel... Adam Berrey
08:08 am Story #3021: [Tests] Make jenkins tests run faster.
Tim Pierce wrote:
> Let's add a note that this should be fixed as of Rails 4.1.0 (according to the "merge commit":ht...
Tom Clegg
08:04 am Revision 7eec2f46 (arvados): 3021: Merge branch 'master' into 3021-api-performance
Tom Clegg
06:33 am Revision 9a4fa188 (arvados): 3021: Merge branch 'master' into 3021-api-performance
Tom Clegg
06:20 am Revision 9707b0c9 (arvados): 3021: Use Marshal dump/load to save @old_attributes. Otherwise, hashes
in @old_attributes can contain references to objects that can be
mutated by callers, which could result in the new at...
Tom Clegg
05:53 am Revision 47585fc7 (arvados): 3021: Replace more "render json:..." with faster Oj.
Tom Clegg
03:02 am Revision ef3c5ead (arvados): 4831: Rearrange classes more.
Tom Clegg
12:35 am Task #4746 (Resolved): Review branch: 4523-search-index
Radhika Chippada
12:35 am Task #4990 (Resolved): Review branch: 3686-sharing-repositories
Radhika Chippada
12:27 am Bug #4957: [SDKs] arv keep put blows up when trying to put a danging symlink
Brett Smith wrote:
> It does this if you specify any kind of nonexistent file, not just a dangling symlink. I assum...
Ward Vandewege

01/19/2015

11:54 pm Revision 3b621456 (arvados): 4831: Remove old reference to util namespace.
Tom Clegg
11:17 pm Revision e7c80567 (arvados): 4831: Unclassize some modules.
Tom Clegg
10:12 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
Tom Clegg wrote:
> > rename the remote version of the file as a "conflicted copy"
>
> Does this mean we save an e...
Peter Amstutz
08:29 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
> rename the remote version of the file as a "conflicted copy"
Does this mean we save an extra "conflicted collect...
Tom Clegg
10:03 pm Bug #5025 (New): [Docker] Make it easy to add data from the host system to containers
It often happens that someone wants to test the Docker functionality of Crunch by spinning up the Arvados containers,... Brett Smith
09:55 pm Bug #5021: [Workbench] Page for downloading collections with anonymous sharing link does not have...
Since we provide a sample @wget@ command line already, we could add "--follow-tags=a" so that it only looks at the an... Peter Amstutz
08:15 pm Bug #5021: [Workbench] Page for downloading collections with anonymous sharing link does not have...
FWIW, this was by spec. Including any CSS in the page would cause recursive wget to download it, cluttering the down... Brett Smith
03:50 pm Bug #5021 (New): [Workbench] Page for downloading collections with anonymous sharing link does no...
The anonymous sharing download page does not use any bootstrap styling, resulting in a totally inconsistent look from... Peter Amstutz
09:50 pm Task #4996 (Resolved): Review 4840-workbench-selections-action-forms-wip
Applied in changeset arvados|commit:570a38bc06cca2a2902f7da3d0a2b63709480845. Brett Smith
04:27 pm Task #4996 (In Progress): Review 4840-workbench-selections-action-forms-wip
Peter Amstutz
09:50 pm Bug #4840 (Resolved): 414 Request-URI Too Large after Selecting 300+ files to put into a new coll...
Applied in changeset arvados|commit:570a38bc06cca2a2902f7da3d0a2b63709480845. Brett Smith
07:59 pm Bug #4840: 414 Request-URI Too Large after Selecting 300+ files to put into a new collection
Looks good to me. Peter Amstutz
09:44 pm Bug #5024 (Resolved): [Workbench] Websocket integration test fails with Firefox 35: "arguments[0]...
The error is:... Brett Smith
09:42 pm Revision 692ecbf5 (arvados): 4926: add description with section links
Radhika Chippada
09:22 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
Have not been able to reproduce this problem by running a script generating 70MB of output without a newline as a loc... Tim Pierce
09:19 pm Revision d3be209f (arvados): 4831: Show logged-in email address on dashboard summary. Remove a le...
Tom Clegg
09:08 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
Some general comments:
* Who is the audience? This should state that up front. Are readers expected to have alr...
Peter Amstutz
08:51 pm Task #3302 (Closed): arv-mount doesn't display names of items correctly
Brett Smith
08:51 pm Task #3300 (Closed): arv-mount should consistently refer to projects as such
Brett Smith
08:47 pm Story #4932 (Closed): [Crunch] Turnaround time for altering docker image and running a job is too...
Closing in favor of #4833. Brett Smith
08:28 pm Revision 570a38bc (arvados): Merge branch '4840-workbench-selections-action-forms-wip'
Closes #4840, #4996. Brett Smith
08:18 pm Bug #5019 (Closed): [Workbench] Content hash should be updated after upload to collection
Dups #4771. Brett Smith
03:20 pm Bug #5019 (Closed): [Workbench] Content hash should be updated after upload to collection
After uploading a file through the "Upload" tab, the content hash in the "Details" box in the upper left should be up... Peter Amstutz
08:10 pm Task #5015 (In Progress): Review branch 4562-crunch-tools-docs-wip
Peter Amstutz
08:02 pm Revision ac8b77cf (arvados): 4840: All Workbench selection links toggle dropdown.
Brett Smith
08:02 pm Revision faf89f7e (arvados): 4840: Workbench selection actions are submitted by POST.
The previous implementation could get 414 Request URI Too Long
responses by stuffing a large number of selections int...
Brett Smith
08:02 pm Revision 420a4a72 (arvados): 4840: Restore checkbox to project Pipelines and Jobs tab.
Brett Smith
07:40 pm Bug #4882: [Crunch] crunchstat reports surprising CPU usage when container appears and disappears
The job in question is qr1hi-8i9sb-ajgkcn4cuk4cntm. At 2014-12-29_21:48:34, where previous CPU user values were 10 o... Brett Smith
07:35 pm Revision 6b27e59d (arvados): Merge branch 'master' into 4926-browser-based-upload
Radhika Chippada
07:32 pm Feature #4935: [Crunch] Choose worker nodes where the desired docker image is already available.
A really good example imo is this instance: qr1hi-d1hrv-sbjgb8za1dpp5kc. The first two jobs ran fine on compute16 and... Bryan Cosca
07:17 pm Bug #4954: [Workbench] Revoke sharing rights to a user button missing
I see the icon now too... I'm running windows 8.1 with google chrome Bryan Cosca
06:24 pm Bug #4954: [Workbench] Revoke sharing rights to a user button missing
qr1hi currently displays the trash icon fine for me. Bryan, what operating system and browser did you see this on? Brett Smith
06:45 pm Support #4929 (In Progress): [Support] Fix bugs and write tests (second half)
Brett Smith
06:39 pm Bug #4938: [Workbench] improve error reporting for failed AJAX calls
This is the same message seen in #4776, so addressing this will likely help that along. Brett Smith
06:20 pm Bug #4957: [SDKs] arv keep put blows up when trying to put a danging symlink
It does this if you specify any kind of nonexistent file, not just a dangling symlink. I assume you want nicer error... Brett Smith
05:57 pm Bug #4970: [Crunch] Cannot create directory `/tmp/crunch-job/task/compute14.1.keep': File exists
This looks very related to #4967. In this case, qr1hi-8i9sb-da6mla8d48nd631 was canceled, and the underlying process... Brett Smith
05:35 pm Feature #4802: [Workbench] UX of pipeline instance Inputs tab needs improvement
Some workarounds are available:
* Provide better "title" and "description" fields. For example, each "Version of Pic...
Tom Clegg
05:20 pm Revision a3a78746 (arvados): 4831: Add more error checking to mithril deferred.onerror.
Tom Clegg
04:39 pm Feature #5022 (Closed): [Workbench] User can navigate to git repository page in order to access r...
Peter Amstutz
04:32 pm Story #3021: [Tests] Make jenkins tests run faster.
Reviewing 3021-api-performance at commit:1974e0e33.
> We use the Oj and multi_json gems, which makes Oj the defaul...
Tim Pierce
04:28 pm Revision 003f0f21 (arvados): 4904: Inspect event type and only print collection create events.
Peter Amstutz
04:04 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Radhika Chippada wrote:
> Peter, I added additional details to the "Downloading data" page to talk about sharing and...
Peter Amstutz
03:52 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
> To upload a file, click on ...
Suggest "To upload files into a new collection, click on ..."
> You can select...
Peter Amstutz
03:35 pm Task #4975 (In Progress): Review 3021-api-performance
Tim Pierce
03:31 pm Bug #4922: [Crunch] google-api-python-client fails to install
Moved to state 'feedback' so we can confirm the fix once deployed. Tim Pierce
03:26 pm Support #4928 (Resolved): [Support] Fix bugs and write tests (first half)
Tim Pierce
03:22 pm Bug #5020 (New): [Workbench] File upload should start immediately, not wait for user to press "St...
To streamline uploading UX (one less mouse click) and reduce confusion (user are not left wondering why the upload ha... Peter Amstutz
03:08 pm Revision 1b01104f (arvados): 4523: some more test cases
Radhika Chippada
03:06 pm Revision fd6ae997 (arvados): 4838: Added --set-executable-bit to crunch-job so crunch scripts can...
files from collections. Peter Amstutz
03:05 pm Revision 353a188f (arvados): 4838: Added --set-excutable-bit to crunch-job so that files from col...
will be executable by default. Peter Amstutz
03:01 pm Revision 594a1e9e (arvados): 4904: Minimal event subscribe example.
Peter Amstutz
03:01 pm Bug #4988: [SDKs] Fix incompatibility between Python packages and newer virtualenv
I note that we try to tag our build version as @0.1.<git timestamp>+<git hash>@, but the @+@ is being transformed int... Brett Smith
03:01 pm Task #5018 (Resolved): Review 4904-arv-web
Peter Amstutz
02:49 pm Revision 691d6421 (arvados): 5016: PollClient.run_forever() polls self.stop() in order to have a ...
Peter Amstutz
02:48 pm Task #5017 (Resolved): Review 5016-ctrl-c-arv-ws
Peter Amstutz
02:44 pm Bug #5016 (Resolved): [SDKs] Should be able to use ^C to interrupt arv-ws.
Peter Amstutz
02:43 pm Feature #4002 (Resolved): [SDK] arv-ws should generate JSON encoded output
Fixed in commit:a606b9a9
Peter Amstutz
02:20 pm Revision 962ca370 (arvados): 4904: Added docker_image files to samples. Added discussion about u...
own docker image, and about benefits of immutable applications. Peter Amstutz
01:52 pm Revision d2dd8759 (arvados): 4904: Fix markup of links for phusion passenger and apache, and add ...
Peter Amstutz
09:39 am Revision c4a18f7a (arvados): 4831: Add morris graph of data manager log entries.
Tom Clegg
08:54 am Revision 3b8e03d5 (arvados): 4831: Rearrange some files.
Tom Clegg
08:50 am Revision 46b7efb1 (arvados): 4831: Simplify promise use.
Tom Clegg

01/18/2015

10:47 pm Revision 7631b2c9 (arvados): 4523: add full text search for collections and pipeline_instances.
Radhika Chippada

01/17/2015

06:43 pm Revision 4af2bd56 (arvados): Fix filename when compressing old test logs.
No issue # Ward Vandewege
06:43 pm Revision 4af2bd56 (arvados-dev): Fix filename when compressing old test logs.
No issue # Ward Vandewege
03:25 pm Revision 253673e8 (arvados-dev): Automatically rotate and compress the test.log files for the api...
and workbench.
No issue #
Ward Vandewege
03:25 pm Revision 253673e8 (arvados): Automatically rotate and compress the test.log files for the api server
and workbench.
No issue #
Ward Vandewege
03:08 am Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
Hm, are we using @communicate()@ someplace where this progress bar could be going? source:crunch_scripts/run-command#... Tom Clegg

01/16/2015

11:25 pm Feature #3686 (Resolved): [Workbench] Provide a sharing tab for repositories similar to setting u...
Applied in changeset arvados|commit:204c462041de0b063ed1169c0f600f082400815f. Radhika Chippada
09:08 pm Feature #3686 (In Progress): [Workbench] Provide a sharing tab for repositories similar to settin...
Radhika Chippada
07:07 pm Feature #3686: [Workbench] Provide a sharing tab for repositories similar to setting up sharing f...
Reviewing commit:752b916. This is very nice, thanks. Just a few small things.
* I think we always want the "Adva...
Brett Smith
11:25 pm Feature #4905 (Resolved): [Workbench] Make repository-sharing feature accessible from Manage Acco...
Applied in changeset arvados|commit:204c462041de0b063ed1169c0f600f082400815f. Radhika Chippada
11:20 pm Revision 204c4620 (arvados): closes #3686
Merge branch '3686-sharing-repositories' Radhika Chippada
11:18 pm Revision effc4bd7 (arvados): 3686: ensure Advanced is always the last pane even after adding the ...
Radhika Chippada
10:54 pm Bug #4889: [Crunch] Logging with a progress bar deadlocks on output
So @subprocess.Popen.communicate()@ has the interesting effect that it's really only intended to communicate with a s... Tim Pierce
10:36 pm Task #5015 (Resolved): Review branch 4562-crunch-tools-docs-wip
At https://arvados.org/projects/arvados/wiki/How_to_submit_compute_work_to_Arvados Brett Smith
10:35 pm Bug #4562: [Documentation] Wiki page: explain appropriate use cases for arv-run vs. run-command v...
"A draft wiki page":https://arvados.org/projects/arvados/wiki/How_to_submit_compute_work_to_Arvados is up. Right now... Brett Smith
09:57 pm Revision 91752781 (arvados): 4904: Moved to services/, finished first draft documentation.
Peter Amstutz
09:41 pm Task #5012 (Closed): Confirm fix
Rerun job once deployed on qr1hi Tim Pierce
09:40 pm Bug #4922 (Feedback): [Crunch] google-api-python-client fails to install
Tim Pierce
08:55 pm Bug #4922 (Resolved): [Crunch] google-api-python-client fails to install
Applied in changeset arvados|commit:59963e1ee432a51a3f7ae3d98068a541b2738879. Tim Pierce
09:29 pm Task #4974 (Resolved): Review 3021-workbench-perf
Tom Clegg
09:26 pm Feature #4901 (Closed): [Workbench] Allow overriding of favicon.ico with custom theme.
Tom Clegg
09:14 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
The notes on limiting concurrency remind me of one of the drums Peter's been beating for a while -- that Jobs and Tas... Tim Pierce
09:06 pm Revision 1ec89c1c (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
08:50 pm Revision 59963e1e (arvados): Merge branch '4922-google-api-client-force-install'
Fixes #4922. Tim Pierce
08:37 pm Feature #5011 (Resolved): [SDKs] arv-put accepts --replication argument (saved with collection re...
Tom Clegg
08:23 pm Bug #5010 (Resolved): [Workbench] Trash button on collections lists should set expires_at instead...
When a user clicks the trash icon next to a collection in the _Projects_ display, Workbench should ask for confirmati... Tom Clegg
07:51 pm Revision 904e7471 (arvados): 4922: force google-api-python-client install
Install google-api-python-client with 'pip install -I' to fix the case
where the Docker image already has an older ve...
Tim Pierce
07:43 pm Feature #4138: [Node Manager] Support Google Cloud Platform in node manager
Creating new nodes on GCE requires a valid "Project ID", which is apparently accessible only through the GCE console.... Tim Pierce
07:32 pm Story #3532 (New): [Keep] Keepstore queries API server to verify tokens
Tom Clegg
07:05 pm Revision 964ab3dd (arvados): Add 'apps/arv-web/' from commit 'f9732ad8460d013c2f28363655d0d1b9189...
git-subtree-dir: apps/arv-web
git-subtree-mainline: b97ac7f96234cbbb491bdbaade840ab50802f357
git-subtree-split: f9732...
Peter Amstutz
07:05 pm Revision f9732ad8 (arvados): 4904: Rename to arv-web.py to reflect a more general purpose tool.
Peter Amstutz
07:05 pm Story #5007 (New): [Workbench] Pilot material design theme
http://fezvrasta.github.io/bootstrap-material-design/ Tom Clegg
06:54 pm Revision 9d6e2ff4 (arvados): 4904: CGI sample works.
Peter Amstutz
06:34 pm Task #4990 (In Progress): Review branch: 3686-sharing-repositories
Brett Smith
06:30 pm Revision b97ac7f9 (arvados): 4838: Add --set-executable-bit option to make all files from mounted...
Peter Amstutz
06:29 pm Task #5000 (Resolved): Review 4838-fuse-executable-files
Peter Amstutz
06:22 pm Feature #4838 (In Progress): [Keep] FUSE driver should expose files with permissions mode 0555
Peter Amstutz
05:26 pm Revision 8d61b342 (arvados): Update bundle. refs #3021
Tom Clegg
05:02 pm Revision 7d4e2529 (arvados): Configure dockerfile with passenger. Add sample applications.
Peter Amstutz
04:37 pm Task #3718 (In Progress): Hash out desired API with science team
Brett Smith
06:37 am Revision 3fec99e7 (arvados): Merge branch '3021-workbench-perf' refs #3021
Tom Clegg
03:45 am Revision 616a9b2e (arvados): 4823: Add clone, synchronized writer
Peter Amstutz
03:22 am Revision f117f0a6 (arvados): 3021: Reset API fixtures before running the first test case.
Tom Clegg
02:22 am Revision c78e31f6 (arvados): 4823: Fixed stream reader test cases
Peter Amstutz
01:33 am Revision 33606c82 (arvados): Merge branch 'master' into origin-4823-python-sdk-writable-collectio...
Peter Amstutz
01:24 am Revision 5933c836 (arvados): 3021: Do not drop/create API database at startup if run-tests.sh has...
Tom Clegg
01:22 am Revision 432f7af8 (arvados): 3021: Revert "3021: Do not drop/create API database at startup: run-...
This reverts commit 591446b97754292031a4214f08039adebd56cfe8. Tom Clegg

01/15/2015

11:09 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Peter Amstutz wrote:
> # If data flow between tasks is intended to be controlled only by the start() process, that s...
Brett Smith
04:07 pm Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jo...
Comments on [[Python SDK]] @ 01/15/2015 10:08 am
I like the idea of tying together execution with iterables and fu...
Peter Amstutz
10:42 pm Story #3021: [Tests] Make jenkins tests run faster.
Tom Clegg wrote:
> Brett Smith wrote:
> > At commit:eb7dde7, I am consistently getting these test failures. It loo...
Brett Smith
09:54 pm Story #3021: [Tests] Make jenkins tests run faster.
Brett Smith wrote:
> At commit:eb7dde7, I am consistently getting these test failures. It looks like something is i...
Tom Clegg
08:24 pm Story #3021: [Tests] Make jenkins tests run faster.
At commit:eb7dde7, I am consistently getting these test failures. It looks like something is interfering with our te... Brett Smith
06:24 pm Story #3021: [Tests] Make jenkins tests run faster.
Brett Smith wrote:
> The first line of @each_file_spec@ refers to now-gone @speclist@ argument.
Oops. Fixed.
>...
Tom Clegg
10:31 pm Task #4996 (Resolved): Review 4840-workbench-selections-action-forms-wip
Brett Smith
10:30 pm Revision c368c5c3 (arvados): 4840: Workbench selection actions are submitted by POST.
The previous implementation could get 414 Request URI Too Long
responses by stuffing a large number of selections int...
Brett Smith
10:27 pm Revision c87318a4 (arvados): 4840: All Workbench selection links toggle dropdown.
Brett Smith
09:29 pm Revision 2ce797b9 (arvados): 3021: Merge branch 'master' into 3021-workbench-perf
Tom Clegg
07:59 pm Task #4993 (New): Implement test server service, and use it across test suites
Think of this as an independent, fuller-featured run_test_server.py: it knows how to bring up all the different serve... Brett Smith
07:17 pm Bug #4991 (New): [API] Make user.send_profile_created_notification detect preference changes better
In Rails 3.2.0, a serialized field (like @User.prefs@) is always written when the field is saved, and the synthetic @... Tim Pierce
06:42 pm Task #4966 (Resolved): Review branch: 3756-show-user-button
Radhika Chippada
06:41 pm Task #4990 (Resolved): Review branch: 3686-sharing-repositories
Radhika Chippada
05:50 pm Revision eb7dde72 (arvados): 3021: Do not show user notifications on error pages.
Tom Clegg
05:42 pm Revision c6667106 (arvados): 3021: Update Gemfile for Ruby SDK bugfix.
Tom Clegg
05:14 pm Revision 6325c0bc (arvados): 4840: Restore checkbox to project Pipelines and Jobs tab.
Brett Smith
05:05 pm Task #4972 (Resolved): Review 3835-pysdk-keep-exceptions-wip
Applied in changeset arvados|commit:952bfa87465a27f83dca7feca7d369fda4200eb5. Brett Smith
05:05 pm Bug #3835 (Resolved): [SDKs] Python and CLI tools should give more helpful error messages after a...
Applied in changeset arvados|commit:952bfa87465a27f83dca7feca7d369fda4200eb5. Brett Smith
04:54 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
Looks great, thanks. Tom Clegg
05:05 pm Bug #4884 (Resolved): keep write error (wanted 2 but wrote 0) arvados
Applied in changeset arvados|commit:952bfa87465a27f83dca7feca7d369fda4200eb5. Brett Smith
05:05 pm Bug #4885 (Resolved): keep write error (wanted 2 but wrote 0) arvados
Applied in changeset arvados|commit:952bfa87465a27f83dca7feca7d369fda4200eb5. Brett Smith
05:05 pm Bug #4661 (Resolved): [SDKs] Python Keep client's retry/rescue should not make an OOM exception l...
Applied in changeset arvados|commit:952bfa87465a27f83dca7feca7d369fda4200eb5. Brett Smith
05:05 pm Bug #4672 (Resolved): [SDKs] KeepClient.put raises an exception on a block larger than 64MB
Applied in changeset arvados|commit:952bfa87465a27f83dca7feca7d369fda4200eb5. Brett Smith
05:00 pm Revision 952bfa87 (arvados): Merge branch '3835-pysdk-keep-exceptions-wip'
Closes #3835, #4972. Brett Smith
04:59 pm Revision 51835046 (arvados): 3021: Remove reference to deleted speclist arg.
Tom Clegg
04:55 pm Revision 1acdfd97 (arvados): 3835: PySDK raises NotFoundError when all Keep services report such.
Previously, we raised this error when >= 75% of services reported
such, as the most reasonable available cutoff to ma...
Brett Smith
04:55 pm Revision 079a14eb (arvados): 3835: Improve error reporting in PySDK Keep client.
* Create a KeepRequestError base exception to store information about
errors encountered when talking to Keep servi...
Brett Smith
04:30 pm Bug #4953: [Workbench] [dup] Time out error for renaming a collection with a lot (300+?) files
First suspect: Workbench's Collection model should avoid sending the entire manifest_text in the @update@ call, if it... Tom Clegg
04:13 pm Revision 7ced7897 (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
04:11 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Peter, I added additional details to the "Downloading data" page to talk about sharing and downloading a collection w... Radhika Chippada
04:02 pm Revision cc13e1f6 (arvados): 4926: trailing white space
Radhika Chippada
04:02 pm Bug #4989 (New): [Deployment] Switchyard should behave correctly when one SSH key has access to m...
There's a lack of coordination between switchyard and the API server's authorized_keys table that can lead to a situa... Tim Pierce
04:00 pm Revision 9ca24247 (arvados): Merge branch 'master' into 4926-browser-based-upload
Radhika Chippada
03:59 pm Revision b83c44a8 (arvados): 4926: minor text update
Radhika Chippada
02:17 pm Bug #4988 (Closed): [SDKs] Fix incompatibility between Python packages and newer virtualenv
Jenkins runs our tests using the virtualenv package from wheezy. This works great.
If you have a newer virtualenv...
Brett Smith
02:12 pm Task #4987 (New): Refactor Python tests to use fewer servers as able
Many of our Python tests were written there was a lot more global state—a single API client, a single Keep client, et... Brett Smith
02:09 pm Task #4986 (Resolved): Refactor run_test_server.py to use API database reset rather than restarti...
Brett Smith

01/14/2015

10:33 pm Revision 212e68e9 (arvados): Reduce file_names limit to 2^12. refs #4523.
Tom Clegg
09:28 pm Bug #4977 (Resolved): [Crunch] "stdbuf": executable not found in $PATH
Job "qr1hi-8i9sb-awaor08g6odb1c2":http://crvr.se/qr1hi-8i9sb-awaor08g6odb1c2 failed with the following error message:... Tim Pierce
09:21 pm Revision 013c9575 (arvados): 4904: Renamed "runit.py" to "arv-web-example.py"
Peter Amstutz
09:21 pm Revision 306bd749 (arvados): 4926: improved image quality
Radhika Chippada
09:14 pm Revision ea84b1dc (arvados): 4904: Fixed event listening. Terminates properly on signals. Teste...
Peter Amstutz
08:41 pm Revision 0d2745ce (arvados): Merge branch 'master' into 4926-browser-based-upload
Radhika Chippada
08:40 pm Bug #4523 (Resolved): [Workbench] Search dialog giving error when searching in "All projects" in ...
Applied in changeset arvados|commit:cadb785fc63280862d71376def0128e4c70951f0. Radhika Chippada
06:55 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
At commit:57f1fd5 I see two of these:... Tom Clegg
03:13 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
I noticed @db/structure.sql@ has mixed up the columns of pipeline_instances again. The correct column order is whatev... Tom Clegg
07:38 am Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Thanks, I think commit:554728c is good to merge.
I notice the migration shows the entire list of files in the term...
Tom Clegg
08:37 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
Tom Clegg wrote:
> It seems perfectly reasonable to me to set the threshold at 100% and call it a day.
Done in co...
Brett Smith
08:08 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
Brett Smith wrote:
> I'm not sure what you mean when you say we "hide the (probably extremely helpful) information."...
Tom Clegg
07:07 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
Tom Clegg wrote:
> There is one error condition that I suspect will (still) give a misleading error message with the...
Brett Smith
06:09 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
The code at commit:d8148b7 looks good.
I'm having trouble installing/testing our Python packages, but that's a sep...
Tom Clegg
08:34 pm Revision cadb785f (arvados): closes #4523
Merge branch '4523-search-index' Radhika Chippada
08:33 pm Revision bd680fb1 (arvados): 3835: PySDK raises NotFoundError when all Keep services report such.
Previously, we raised this error when >= 75% of services reported
such, as the most reasonable available cutoff to ma...
Brett Smith
08:33 pm Revision e360b9a4 (arvados): 4926: download images
Radhika Chippada
08:32 pm Revision 9a894a1f (arvados): 4926: expand downloading data section
Radhika Chippada
08:21 pm Revision a91c9255 (arvados): 4904: Chooses most recently modified collection and runs web service...
Peter Amstutz
08:21 pm Revision 93e77cdf (arvados): Merge branch '4523-search-index-TC' into 4523-search-index
Conflicts:
services/api/test/integration/collections_api_test.rb
Radhika Chippada
07:59 pm Revision ddb2032b (arvados): 4904: Set up fuse, set up event bus, run docker
Peter Amstutz
07:41 pm Revision f5588e5c (arvados): 4523: Clear up manifest-signing vs. locator-signing.
Tom Clegg
07:20 pm Revision 1cb770f1 (arvados): 3835: Fixup unneeded commit.
Brett Smith
07:14 pm Revision dde9d284 (arvados): 4523: update signed_locator in test
Radhika Chippada
06:38 pm Revision 3e1af541 (arvados): Merge branch 'master' into 4926-browser-based-upload
Radhika Chippada
06:12 pm Revision 57f1fd52 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
06:11 pm Revision f880a22d (arvados): 4523: try to resolve column order by down and up migrations through ...
Radhika Chippada
06:06 pm Revision c4f571a3 (arvados): 4523: use filters instead of where for search
Radhika Chippada
05:54 pm Revision 927f9670 (arvados): 4523: check for a specific file name and stream names in file_names.
Radhika Chippada
05:47 pm Revision 9c2e673b (arvados): Python packages use python-daemon<2.
It's good to see python-daemon under active development, but they're
working out so many little issues so rapidly tha...
Brett Smith
04:24 pm Revision 3fa17931 (arvados): 4523: update migration script to use execute instead of update_sql s...
Radhika Chippada
04:20 pm Bug #3756 (Resolved): [Workbench] As an admin user, clicking 'Show' in the user list on your own ...
Applied in changeset arvados|commit:1371663d86021d17a218f7103871df0f80a3d356. Radhika Chippada
02:25 pm Bug #3756: [Workbench] As an admin user, clicking 'Show' in the user list on your own user record...
commit:0af4622 is good to merge. Thanks. Brett Smith
04:15 pm Revision ae23b377 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
04:14 pm Revision 1371663d (arvados): closes #3756
Merge branch '3756-show-user-button' Radhika Chippada
04:13 pm Revision 553276ad (arvados): Merge branch 'master' into 3756-show-user-button
Radhika Chippada
04:12 pm Revision cb833bd3 (arvados): Merge branch 'master' into 3686-sharing-repositories
Radhika Chippada
04:10 pm Revision 752b9167 (arvados): 3686: Support sharing pane in repository show page.
Refactor current project sharing work into application area and reuse it for sharing repositories.
Refactor methods u...
Radhika Chippada
03:59 pm Story #3021: [Tests] Make jenkins tests run faster.
Reviewing 3021-workbench-perf at commit:cd4f506.
Tom Clegg wrote:
> 3021-workbench-perf includes:
> * Optimize m...
Brett Smith
06:29 am Story #3021: [Tests] Make jenkins tests run faster.
3021-api-performance includes a few performance improvements whose commit messages are much bigger than their code ch... Tom Clegg
12:26 am Story #3021: [Tests] Make jenkins tests run faster.
3021-workbench-perf includes:
* Optimize manifest parsing in Ruby SDK (convert some big arrays to generators).
* Sk...
Tom Clegg
03:12 pm Story #4687 (In Progress): [Crunch] Support Brad Chapman to port bcbio tools and workflows to CWL
Peter Amstutz
03:12 pm Story #4904 (In Progress): [SDKs] Use websockets to restart/reconfigure a web service running on ...
Peter Amstutz
02:58 pm Task #4974 (In Progress): Review 3021-workbench-perf
Brett Smith
12:26 am Task #4974 (Resolved): Review 3021-workbench-perf
See #3021 note-19 Tom Clegg
02:51 pm Task #4972 (In Progress): Review 3835-pysdk-keep-exceptions-wip
Tom Clegg
02:28 pm Task #4933 (Resolved): Review 4924-arv-edit-error-handling
Peter Amstutz
02:28 pm Task #4969 (Resolved): Review 4968-refresh-project-dir
Peter Amstutz
02:13 pm Task #4966 (In Progress): Review branch: 3756-show-user-button
Brett Smith
06:30 am Task #4975 (Resolved): Review 3021-api-performance
See #3021 note-20 Tom Clegg
05:57 am Revision 1974e0e3 (arvados): 3021: Use Oj to encode API responses, and to decode them in tests.
* We use the Oj and multi_json gems, which makes Oj the default JSON
parser. However, Rails' ActiveRecord::Base ove...
Tom Clegg
05:52 am Revision f4cd3a98 (arvados): 3021: Do not compute etag for initial model state unless/until actua...
Profiling shows that making a copy of the attributes hash (which
modelinstance.attributes() does) is much faster than...
Tom Clegg
05:41 am Revision eec57e32 (arvados): 3021: Call Rails.application.eager_load! only once, not every single
time we use the uuid prefix cache, for two reasons:
* The reason it's here at all is to ensure that all descendant c...
Tom Clegg
05:41 am Revision f2834f44 (arvados): 3021: Add a performance test.
ActiveSupport doesn't seem to think its profiling code is compatible
with Ruby 2.1, but it seems to work if you patch...
Tom Clegg
05:41 am Revision 2d095685 (arvados): Fix crash on missing return_to param.
Tom Clegg
01:40 am Revision f1491aab (arvados): Finished adding logging to keep.GetServerContents but have not teste...
Misha Zatsman
12:50 am Revision 0856c530 (arvados): ran gofmt
Misha Zatsman
12:49 am Revision 70a227b4 (arvados): Broke keep.GetServerContents() into smaller functions.
Misha Zatsman
12:26 am Task #4971 (Resolved): Review 3021-test-perf on arvados-dev
Tom Clegg

01/13/2015

11:56 pm Revision a31092d0 (arvados): Removed channel awareness from keep.GetServerContents().
Misha Zatsman
11:27 pm Revision 439a4e1b (arvados): gofmt'd all my source code. No other changes.
Misha Zatsman
10:51 pm Bug #4967: [Crunch] Doesn't cope well with FUSE mounts left hanging around after killing tasks wi...
This was happening because compute16 had a bunch of stale mount points for FUSE. They were listed by @mount@, but th... Brett Smith
10:17 pm Bug #4967: [Crunch] Doesn't cope well with FUSE mounts left hanging around after killing tasks wi...
different day, still compute16 qr1hi-8i9sb-v78fsmqn3o24lua Bryan Cosca
10:10 pm Revision 20354a24 (arvados): Merge branch '3021-test-perf' refs #3021
Tom Clegg
10:10 pm Revision 20354a24 (arvados-dev): Merge branch '3021-test-perf' refs #3021
Tom Clegg
10:08 pm Revision 21bcc1b7 (arvados): 3021: Install docutils (unlisted dependency of python-daemon).
Tom Clegg
10:08 pm Revision 21bcc1b7 (arvados-dev): 3021: Install docutils (unlisted dependency of python-daemon).
Tom Clegg
09:49 pm Revision cd4f5063 (arvados): 3021: Merge branch 'master' into 3021-workbench-perf
Tom Clegg
09:43 pm Revision 960bdb27 (arvados-dev): 3021: Do not install *.egg after running tests: "pip install PyY...
Tom Clegg
09:43 pm Revision 960bdb27 (arvados): 3021: Do not install *.egg after running tests: "pip install PyYAML"...
Tom Clegg
09:42 pm Revision 351a497c (arvados): Merge branch 'master' into 0000-workbench-user-profile-wording-changes
Ward Vandewege
08:41 pm Bug #4954: [Workbench] Revoke sharing rights to a user button missing
I'm guessing the icon or button markup is broken (e.g., 'btn-default' without 'btn')... Tom Clegg
08:15 pm Revision fa82df2e (arvados): Merge branch '4968-refresh-project-dir' closes #4968
Peter Amstutz
08:15 pm Bug #4968 (Resolved): [FUSE] Project directories do not refresh.
Applied in changeset arvados|commit:fa82df2ec3cab51eaaadd2a31b457d0e2ceafbcb. Peter Amstutz
07:55 pm Bug #4968: [FUSE] Project directories do not refresh.
commit:2185f76a9 is good to merge, thanks. Brett Smith
04:59 pm Bug #4968: [FUSE] Project directories do not refresh.
The idea was something like this
# Program is listening to event bus
# Program gets an event indicating that the ...
Peter Amstutz
04:19 pm Bug #4968: [FUSE] Project directories do not refresh.
Reviewing commit:f4e61aa.
The polling-related changes are fine. The bit to have the directory refresh when .arvad...
Brett Smith
06:39 pm Revision 554728c2 (arvados): 4523: update migrate script to use batch size and instance method on...
Radhika Chippada
06:14 pm Revision 73b36155 (arvados): 3021: Add docutils to setup_requires.
Tom Clegg
06:08 pm Revision e1fc53f3 (arvados): 3021: Check for errors when installing PyYAML.
Tom Clegg
06:08 pm Revision e1fc53f3 (arvados-dev): 3021: Check for errors when installing PyYAML.
Tom Clegg
05:03 pm Revision e5ed7565 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
04:45 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Radhika Chippada wrote:
> Tom, thanks for clarifying about what streams are.
>
> I made the change (for the time ...
Tom Clegg
04:36 pm Story #3021: [Tests] Make jenkins tests run faster.
Reviewing arvados-dev commit:0a471810
Everything looks good, I just have one sort of tangential comment. The poin...
Brett Smith
04:22 pm Task #4971 (In Progress): Review 3021-test-perf on arvados-dev
Brett Smith
02:54 pm Task #4971 (Resolved): Review 3021-test-perf on arvados-dev
Tom Clegg
04:06 pm Story #4927: [SSO] Decide overall single sign-on strategy
Note decentralized/centralized is orthogonal to sso-provider/apiserver (N-1 apiserver instances could use one "centra... Tom Clegg
03:54 pm Task #4969 (In Progress): Review 4968-refresh-project-dir
Brett Smith
03:33 pm Revision 3e484562 (arvados): 3021: Do not check user notifications unless they are going to be di...
Tom Clegg
03:31 pm Bug #3835 (In Progress): [SDKs] Python and CLI tools should give more helpful error messages afte...
Brett Smith
03:31 pm Task #4972 (Resolved): Review 3835-pysdk-keep-exceptions-wip
Brett Smith
03:30 pm Revision d8148b70 (arvados): 3835: Improve error reporting in PySDK Keep client.
* Create a KeepRequestError base exception to store information about
errors encountered when talking to Keep servi...
Brett Smith
03:18 pm Revision 288d22d8 (arvados): 3021: Add web-inspectable profiling mode.
* Run Workbench with environment variable ENABLE_PROFILING=yes. Timing
figures should appear at the top left of eac...
Tom Clegg
02:53 pm Task #4896 (Resolved): Review 3021-more-phantomjs
Tom Clegg
01:15 am Revision 821f806a (arvados): Started logging in keep.go. More work to be done.
Misha Zatsman
12:49 am Revision e4b8d0b5 (arvados): Created loggerutil to hold common datamanager logger code. Moved Fat...
Misha Zatsman
12:23 am Revision e921c415 (arvados): Moved some logic from datamanager.go to keep.go.
Misha Zatsman

01/12/2015

11:20 pm Revision bc50ca69 (arvados): Started reading collections and keep data in parallel. Moved some lo...
Misha Zatsman
09:59 pm Bug #4970: [Crunch] Cannot create directory `/tmp/crunch-job/task/compute14.1.keep': File exists
now im consistently getting hit by it: qr1hi-8i9sb-6p0w9zkhy2brrb9 qr1hi-8i9sb-fbwxxfu3mtdbgd8 Bryan Cosca
09:56 pm Bug #4970 (Resolved): [Crunch] Cannot create directory `/tmp/crunch-job/task/compute14.1.keep': F...
qr1hi-8i9sb-wcsmjzy28gz9xf7
...not sure what this error is but I've gotten hit by it twice. even on a job that w...
Bryan Cosca
09:56 pm Revision 5f4ca24c (arvados): Explicitly specify ruby 2.1 in "rvm alias" no issue #
Peter Amstutz
09:54 pm Bug #4967: [Crunch] Doesn't cope well with FUSE mounts left hanging around after killing tasks wi...
more data points: qr1hi-8i9sb-14gstze8dil8c3e Bryan Cosca
07:51 pm Bug #4967 (Resolved): [Crunch] Doesn't cope well with FUSE mounts left hanging around after killi...
Taken from qr1hi-8i9sb-ve5v94njtcw66yw. I re-ran the job and it seemed to work fine, I just wanted to bring it to att... Bryan Cosca
09:50 pm Story #4940 (Resolved): [Documentation] (recurring) Write blog post in first three days of sprint
Published at https://arvados.org/blogs/26 Tim Pierce
09:47 pm Happy New Year from Curoverse!
!>{padding: 5px}dna_bridge.jpg!
Happy New Year, everyone! We're poking our heads up through the snow here in New En...
Tim Pierce
09:22 pm Revision f4e61aa0 (arvados): 4968: Can now read from .arvados#project to trigger update of projec...
contents. Peter Amstutz
09:22 pm Task #4969 (Resolved): Review 4968-refresh-project-dir
Peter Amstutz
09:22 pm Revision 2185f76a (arvados): 4968: Fix polling refresh on project directories
Peter Amstutz
09:19 pm Bug #4968 (Resolved): [FUSE] Project directories do not refresh.
Project directories are supposed to refresh every 60 seconds, but do not. Peter Amstutz
07:28 pm Story #4687: [Crunch] Support Brad Chapman to port bcbio tools and workflows to CWL
Bcbio "pipelines" are just Python methods called @run()@ that call each step in sequence, with the work of each step ... Peter Amstutz
07:12 pm Bug #4840: 414 Request-URI Too Large after Selecting 300+ files to put into a new collection
Tom Clegg wrote:
> # Build a form (somewhere hidden) and then submit it with @$('form#theformijustmade').submit()@.
...
Brett Smith
06:41 pm Bug #4840: 414 Request-URI Too Large after Selecting 300+ files to put into a new collection
h2. Option 1b: Build and submit a form from @dispatch_selection_action()@
Currently, @dispatch_selection_action()@...
Tom Clegg
07:11 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Also, the white background of the workbench screenshots bleeds into the white background of the documentation pages, ... Peter Amstutz
07:09 pm Feature #4926: [Documentation] (recurring) Refresh user documentation
Suggestions:
* Rename "Run a pipeline using Workbench" to "Using Workbench"
* Add a "Uploading data" section unde...
Peter Amstutz
07:11 pm Task #4950 (Resolved): Specify a fix implementation
Tom Clegg
07:09 pm Task #4950 (In Progress): Specify a fix implementation
Tom Clegg
07:06 pm Bug #3756 (In Progress): [Workbench] As an admin user, clicking 'Show' in the user list on your o...
Radhika Chippada
07:04 pm Bug #3756: [Workbench] As an admin user, clicking 'Show' in the user list on your own user record...
Branch 3756-show-user-button implements the simpler solution (hide Show button in admin user's own row). Radhika Chippada
07:01 pm Bug #3756: [Workbench] As an admin user, clicking 'Show' in the user list on your own user record...
Tomclegg said (IRC):
The longer solution is a waste of trouble if we decide to switch to the "special undeletable pr...
Radhika Chippada
07:03 pm Task #4966 (Resolved): Review branch: 3756-show-user-button
Radhika Chippada
07:02 pm Task #4955 (In Progress): Review branch: 4926-browser-based-upload
Peter Amstutz
07:01 pm Revision 0af46223 (arvados): 3756: do not show 'Show' button in admin user's own row.
Radhika Chippada
06:42 pm Task #4949 (In Progress): Sketch out how to port bcbio-nextgen StandardPipeline
Peter Amstutz
06:40 pm Bug #4924 (Resolved): [SDKs] Improve arv edit error handling UX
Applied in changeset arvados|commit:138a4b0a5de177faede5255841a5c6fca06b31f4. Peter Amstutz
06:26 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Peter Amstutz wrote:
> Brett Smith wrote:
> > * JSON parse errors aren't being retried, because Oj.parse raises an ...
Brett Smith
05:23 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Brett Smith wrote:
>
> * The @titleize@ is on the wrong side of the parentheses. When the API server returns a ...
Peter Amstutz
04:41 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Peter Amstutz wrote:
> Brett Smith wrote:
>
> > Pfft. We can require net/http and ask the standard library for t...
Brett Smith
04:03 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Brett Smith wrote:
> Pfft. We can require net/http and ask the standard library for the normal message, at least:...
Peter Amstutz
06:39 pm Revision 138a4b0a (arvados): Merge branch '4924-arv-edit-error-handling' closes #4924
Peter Amstutz
06:38 pm Revision cb15699a (arvados): 4924: Collapse JSON rescue blocks to reduce duplicate code.
Peter Amstutz
05:36 pm Bug #4878: [Workbench] clarify purpose of "re-run latest" button on jobs#show.
Proposal: Reformat the "re-run" choices to provide space to explain the options in sufficient detail.
"Repeat this...
Tom Clegg
05:23 pm Revision 9fea1c77 (arvados): 4924: Update prints uuid from results, not the uuid originally speci...
Catch Oj::ParseError as well as JSON::ParserError. Titleize only HTTP status
messages, not every error message.
Peter Amstutz
04:42 pm Task #4959 (In Progress): Write up [[Authentication]] page
Tom Clegg
04:42 pm Task #4959 (Resolved): Write up [[Authentication]] page
Tom Clegg
03:55 pm Story #4927 (In Progress): [SSO] Decide overall single sign-on strategy
Tom Clegg
03:33 pm Revision 5fa38c36 (arvados): 4924: Rename HTTPResponse to ArvadosAPIError. Use NET::HTTP Respons...
for error codes if no other error is available. Peter Amstutz
02:02 am Feature #4716 (Rejected): [Keep] Keepstore has read-only mode (deny all PUT or DELETE)
Tom Clegg
01:59 am Bug #3483: [Keep] Keep uses appropriate HTTP status codes for failed DELETE requests
commit:215372746216e1c348231b6585a6e0fb9c505af4 makes the HTTP status code (and error messages!) available to the cal... Tom Clegg
01:11 am Revision 0a471810 (arvados-dev): docutils is needed by nodemanager and fuse install recipes.
Fixes "ImportError: No module named docutils.core" during test suite. Tom Clegg
01:09 am Revision 82295301 (arvados-dev): 3021: Allow '--only X' to override '--skip X'.
Tom Clegg
01:09 am Revision 82295301 (arvados): 3021: Allow '--only X' to override '--skip X'.
Tom Clegg
01:08 am Revision 04a389ca (arvados-dev): 3021: Add workbench_profile target. Rename _performance to _benc...
These names match the rake tasks, test:benchmark and test:profile. Tom Clegg
01:08 am Revision 04a389ca (arvados): 3021: Add workbench_profile target. Rename _performance to _benchmark.
These names match the rake tasks, test:benchmark and test:profile. Tom Clegg
01:04 am Revision 5fb96486 (arvados-dev): 3021: Load test fixtures during api install.
Tom Clegg
01:04 am Revision 5fb96486 (arvados): 3021: Load test fixtures during api install.
Tom Clegg

01/11/2015

07:55 pm Revision 251cc49d (arvados): 3021: Optimize manifest parsing.
Tom Clegg
06:29 pm Revision aef8ae1e (arvados): Merge branch 'master' of git.curoverse.com:arvados into 3408-product...
Conflicts resolved:
services/api/Gemfile
services/api/Gemfile.lock
Misha Zatsman
08:01 am Revision 220be2d9 (arvados): 3021: Update bundle.
Tom Clegg
07:36 am Revision 591446b9 (arvados): 3021: Do not drop/create API database at startup: run-tests.sh does ...
Tom Clegg
07:35 am Revision 77d377e3 (arvados): 3021: Fix races in performance test.
Tom Clegg

01/10/2015

11:42 pm Bug #4958: [Workbench] Show an alert message below top nav when running in an unsupported browser.
Server logs show the "upload" tab has been tested by some rather old browsers:
|Browser|Released|EOL|Prognosis|
|...
Tom Clegg
07:53 pm Bug #4958 (Resolved): [Workbench] Show an alert message below top nav when running in an unsuppor...
We've had a user report:... Ward Vandewege
07:50 pm Bug #4957: [SDKs] arv keep put blows up when trying to put a danging symlink
<pre Ward Vandewege
07:49 pm Bug #4957 (New): [SDKs] arv keep put blows up when trying to put a danging symlink

For example:...
Ward Vandewege
08:50 am Revision 6b8e471d (arvados): 3021: Use Oj to encode/decode API responses.
Tom Clegg
08:50 am Revision e0d047ba (arvados): 3021: Do not compute etag for initial model state unless/until actua...
Tom Clegg
08:50 am Revision 5ebd32d6 (arvados): 3021: Add a performance test.
ActiveSupport doesn't seem to think its profiling code is compatible
with Ruby 2.1, but it seems to work if you patch...
Tom Clegg
08:50 am Revision cedde3e5 (arvados): Fix crash on missing return_to param.
Tom Clegg
08:50 am Revision 15ae2d2c (arvados): 3021: Call Rails.application.eager_load! only once, not every single
time we use the uuid prefix cache. Tom Clegg
02:46 am Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Tom, thanks for clarifying about what streams are.
I made the change (for the time being) to allow text attributes...
Radhika Chippada
02:28 am Revision a66a2656 (arvados): 4523: revert test update now that text attributes in non-collections...
Radhika Chippada
02:07 am Revision e95e66b8 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada

01/09/2015

11:11 pm Revision 5aacaabf (arvados): 4523: include stream names in file_names
Radhika Chippada
11:00 pm Revision 3c810267 (arvados): 4523: exclude manifest_text from collection -> searchable_columns an...
Radhika Chippada
10:46 pm Revision 61fdce2e (arvados): Add a magic pseudoclass to body, instead of appending a magic div. S...
Tom Clegg
10:45 pm Revision 2fad64f0 (arvados): Diagnostics really do need selenium. refs #3021
Tom Clegg
10:09 pm Revision f0ac035f (arvados): Make angular shim minify-safe. No issue #
Tom Clegg
10:04 pm Task #4893 (In Progress): Review 4823-python-sdk-writable-collection-api
Tim Pierce
10:02 pm Bug #4956 (Resolved): [API] cannot create collections with very large manifests
From #4621:
A job generating a manifest consisting of one 28MB line of text could not be saved.
The pipeline lo...
Tim Pierce
09:56 pm Feature #4823: [SDKs] Good Collection API for Python SDK
Review at commit:04f5f75659
This is some really excellent stuff, so please don't take the length of this review as...
Tim Pierce
09:49 pm Revision 5810ac27 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
09:46 pm Task #4955 (Resolved): Review branch: 4926-browser-based-upload
Radhika Chippada
09:45 pm Task #4787 (Resolved): [Documentation] Mention browser-based upload feature
Radhika Chippada
09:45 pm Feature #4926 (In Progress): [Documentation] (recurring) Refresh user documentation
Radhika Chippada
09:43 pm Revision 0f143ed9 (arvados-dev): Python version numbering is obscure. For our debianized Python p...
strip dashes and replace them with dots to match our other version
numbers. Cf. commit 4afcb8c in the arvados reposit...
Ward Vandewege
09:43 pm Revision 0f143ed9 (arvados): Python version numbering is obscure. For our debianized Python packa...
strip dashes and replace them with dots to match our other version
numbers. Cf. commit 4afcb8c in the arvados reposit...
Ward Vandewege
09:43 pm Revision feb8948b (arvados): 4926: add "upload using workbench"
Radhika Chippada
09:40 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Peter Amstutz wrote:
> Brett Smith wrote:
> > * If we keep retrying for any non-200 API response, perhaps the rest ...
Brett Smith
08:36 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Brett Smith wrote:
> Reviewing commit:8295ba7
>
> * If the API server goes away, I get this message:
> [...]
...
Peter Amstutz
07:42 pm Bug #4924: [SDKs] Improve arv edit error handling UX
Reviewing commit:8295ba7
* If the API server goes away, I get this message:
...
Brett Smith
08:58 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Radhika Chippada wrote:
> It does not appear that we have any other means of finding out an answer to this question ...
Tom Clegg
06:59 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
Tomclegg:
Some questions and comments about your comments.
Question 1:
> With the change to arvados_model.rb...
Radhika Chippada
08:37 pm Revision 198963ab (arvados): 4924: Distinguish between errors the user can do something about (sy...
or well-formed server errors) and errors that the user probably can't recover
from (everything else.) Prints "Update...
Peter Amstutz
07:46 pm Bug #4953: [Workbench] [dup] Time out error for renaming a collection with a lot (300+?) files
!unparsable-response-big-collection.png!
some more data points with this collection.
Bryan Cosca
07:22 pm Bug #4953: [Workbench] [dup] Time out error for renaming a collection with a lot (300+?) files
collection qr1hi-4zz18-tcnxylwkxg0nfhi Bryan Cosca
07:21 pm Bug #4953: [Workbench] [dup] Time out error for renaming a collection with a lot (300+?) files
It ends up working though by just refreshing the browser Bryan Cosca
07:19 pm Bug #4953 (Resolved): [Workbench] [dup] Time out error for renaming a collection with a lot (300+...
Renaming collection "qr1hi-4zz18-tcnxylwkxg0nfhi":http://crvr.se/qr1hi-4zz18-tcnxylwkxg0nfhi
!timeouterror.png!
...
Bryan Cosca
07:28 pm Bug #4954 (Closed): [Workbench] Revoke sharing rights to a user button missing
!revoke-rights-button-missing.gif! Bryan Cosca
06:42 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
Recording the errors in a dictionary for structured analysis makes a lot of sense to me. I don't feel strongly about... Tim Pierce
06:31 pm Bug #3835: [SDKs] Python and CLI tools should give more helpful error messages after a Keep failure
When Python writes tracebacks, the exception line is formatted like: @"error.__class__: str(__init__ arguments)"@. I... Brett Smith
06:15 pm Task #4933 (In Progress): Review 4924-arv-edit-error-handling
Brett Smith
04:59 pm Story #4927: [SSO] Decide overall single sign-on strategy
Some notes:
We need a unified notion of identity across multiple Arvados instances. Federated instances should be...
Peter Amstutz
03:59 pm Bug #4952 (New): [SDKs] [DRAFT] arv-get with just one locator argument should download the entire...
It may not be intuitive to some people to need the / char after the locator. I'm proposing being able to arv-get the ... Bryan Cosca
03:52 pm Feature #4951 (Resolved): [Workbench] When a user does not have access to a VM, provide a way to ...
For security reasons, auto-activated users are not granted access to VMs by default. This is confusing since the tut... Peter Amstutz
03:42 pm Task #4950 (Resolved): Specify a fix implementation
See "note 6 in the ticket":https://arvados.org/issues/4840#note-6 Brett Smith
03:08 pm Story #4687: [Crunch] Support Brad Chapman to port bcbio tools and workflows to CWL
Core of StandardPipeline with boilerplate stripped out:... Peter Amstutz
02:20 pm Task #4949 (Resolved): Sketch out how to port bcbio-nextgen StandardPipeline
Peter Amstutz
01:53 pm Task #4946 (Resolved): Fix project directory refresh bug in FUSE
Peter Amstutz
01:53 pm Task #4946 (Resolved): Fix project directory refresh bug in FUSE
Peter Amstutz
01:53 pm Task #4947 (Resolved): Provide example to science team
Peter Amstutz
04:53 am Revision 89ecce95 (arvados): Added recording of fatal errors to logger.
Misha Zatsman
04:11 am Revision ee278406 (arvados): Added ForceRecord() method to enable writing remaining log changes b...
Misha Zatsman
04:00 am Revision bd001d4c (arvados): Switched Logger edit hooks to write hooks so they'll trigger less of...
Misha Zatsman
02:52 am Revision a6441548 (arvados): 4904: Can now read from .arvados#project to trigger update of projec...
contents. Peter Amstutz
02:51 am Revision ec7cd27f (arvados): 4523: update migration script to use sql to set file_names
Radhika Chippada
02:26 am Revision d3c48a18 (arvados): 4904: Fix polling refresh on project directories
Peter Amstutz

01/08/2015

11:22 pm Revision dbeccd1b (arvados): Switched batch size to 50. Added logging of batch size.
Misha Zatsman
11:17 pm Revision fb76b0b8 (arvados): Added memory alloc in use to stats exported to log. Also added EditH...
Misha Zatsman
10:35 pm Revision eb5d5d99 (arvados): Added structure to data manager log entries, grouping similar fields.
Misha Zatsman
10:24 pm Revision 0c9832f8 (arvados): Added ability to turn off logging by passing an empty string as the ...
Misha Zatsman
10:16 pm Revision e94c6eb5 (arvados): Started using Logger in data manager and collections.
Misha Zatsman
09:35 pm Bug #4943 (New): [Workbench] [Performance] Combining big collections should start returning a res...
i.e. I combined qr1hi-4zz18-ms5x87xf1389ldv + qr1hi-4zz18-0q225z4ktr432mg + qr1hi-4zz18-i5o4ba4mmxub69b and encounter... Bryan Cosca
09:32 pm Revision 3e5e5fa6 (arvados): 4904: Add feature to arv-ws to run a command when something is added...
Peter Amstutz
09:22 pm Revision 3636b3a3 (arvados): 3021: Fix phantomjs races by waiting for pages to appear. refs #3021
Tom Clegg
09:13 pm Bug #4942 (Closed): [Workbench] Data Collections Tab in Projects takes too long to load or fails
i.e. this project: qr1hi-j7d0g-f70owdx86zs6tmk could take a couple minutes sometimes
or my home project, which fails...
Bryan Cosca
09:06 pm Revision 9f6c0943 (arvados): Added support for MinimumWriteInterval.
Misha Zatsman
09:04 pm Revision 15ffbb6d (arvados): Merge branch '3408-go-sdk-api-errors' refs #3408
Tom Clegg
09:01 pm Task #4941 (Resolved): Review 3408-go-sdk-api-errors
Looks good to me! Misha Zatsman
08:50 pm Task #4941 (Resolved): Review 3408-go-sdk-api-errors
Tom Clegg
08:50 pm Revision 21537274 (arvados): 3408: Propagate API error messages to caller.
Tom Clegg
08:14 pm Revision a50b8ad5 (arvados): Fixed bugs in logger, changed interface some, added documentation.
Still need to add support for MinimunWriteInterval. Misha Zatsman
07:57 pm Revision 226d028a (arvados): 4523: slightly improved large description
Radhika Chippada
07:45 pm Revision 42fec323 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
07:44 pm Revision 11c04627 (arvados): 4523: add a few functional tests for collections with file_names tes...
Radhika Chippada
07:40 pm Task #4925 (Resolved): Review 4312-crunch-report-sdk-version
Tom Clegg
02:43 pm Task #4925 (In Progress): Review 4312-crunch-report-sdk-version
Tom Clegg
07:21 pm Story #4940 (Resolved): [Documentation] (recurring) Write blog post in first three days of sprint
Tim Pierce
07:07 pm Task #4939 (Resolved): Review and discuss
Peter Amstutz
07:02 pm Bug #4922: [Crunch] google-api-python-client fails to install
Tom Clegg wrote:
> (This is probably fallout from changing the version format from worked-for-a-while 0.1.date.commi...
Tim Pierce
04:48 pm Bug #4922: [Crunch] google-api-python-client fails to install
(This is probably fallout from changing the version format from worked-for-a-while 0.1.date.commit to PEP440-complian... Tom Clegg
04:47 pm Bug #4922: [Crunch] google-api-python-client fails to install
Do we just need to add @"-I"@ here? source:sdk/cli/bin/crunch-job#L1849... Tom Clegg
06:52 pm Task #3786 (Resolved): [SDK] `arv edit` errors should be visible after failure, even if the edite...
Peter Amstutz
06:52 pm Task #3655 (Resolved): [SDKs] "arv edit" should not fail just because some special attribute (whi...
Peter Amstutz
06:50 pm Story #4312 (Resolved): [Crunch] crunch-job should report current Python SDK version at start of ...
Applied in changeset arvados|commit:5523be76b00bc58cf9568cf7a1353326c6795cac. Peter Amstutz
02:42 pm Story #4312: [Crunch] crunch-job should report current Python SDK version at start of each task
At commit:38891ae
* Seems wasteful to run the commands at all when task>0 and logging is disabled. But simpler=good,...
Tom Clegg
06:49 pm Revision 5523be76 (arvados): Merge branch '4312-crunch-report-sdk-version' closes #4312
Peter Amstutz
06:48 pm Revision 55fc92b5 (arvados): 4312: Remove redundant parenthesis.
Peter Amstutz
06:07 pm Bug #4938 (New): [Workbench] improve error reporting for failed AJAX calls
Example, after running pipeline https://workbench.qr1hi.arvadosapi.com/pipeline_instances/qr1hi-d1hrv-kg7ndj85njzpt1x... Tim Pierce
06:01 pm Revision a2806c0a (arvados): 4523: separate filename based tests and description based tests.
Radhika Chippada
04:48 pm Feature #4935 (New): [Crunch] Choose worker nodes where the desired docker image is already avail...
The scenario where user A is running jobs and debugging a pipeline to work on arvados. User A ran his job and it ran ... Bryan Cosca
04:34 pm Story #4930: [FUSE] Design: specify behavior for writable arv-mount
Keep FUSE mount will work on an eventual consistency model with specific, well defined commit points where the API se... Peter Amstutz
04:01 pm Bug #4523: [Workbench] Search dialog giving error when searching in "All projects" in qr1hi
At commit:cf67055
Workbench: Good catch. But I wonder whether/how we should communicate this distinction in the di...
Tom Clegg
03:26 pm Revision 8295ba72 (arvados): 4924: Refactor arv edit and arv create to improve error handling.
* Error messages are now added in a comment block at the top of the file, and
the file is re-opened in the user's e...
Peter Amstutz
03:25 pm Task #4933 (Resolved): Review 4924-arv-edit-error-handling
Peter Amstutz
02:45 pm Task #4617 (Closed): Update doc
Tom Clegg
02:44 pm Feature #4782 (Closed): [Documentation] (recurring) Refresh user documentation
Tom Clegg
02:03 am Task #4737 (Resolved): Add index on owner_uuid column for all data models that include the owner_...
Radhika Chippada
02:02 am Task #4740 (Resolved): Add search index on all data models
Radhika Chippada
01:47 am Revision 10fda8ea (arvados): Added logger to write log messages that grow over time. Not working ...
Misha Zatsman

01/07/2015

10:11 pm Story #4932 (Closed): [Crunch] Turnaround time for altering docker image and running a job is too...
I made a slight change in my 7GiB docker image file and I used arv keep docker to put it into keep, which took 20 min... Bryan Cosca
09:56 pm Task #3786 (In Progress): [SDK] `arv edit` errors should be visible after failure, even if the ed...
Peter Amstutz
09:56 pm Task #3655 (In Progress): [SDKs] "arv edit" should not fail just because some special attribute (...
Peter Amstutz
09:32 pm Revision 38891aed (arvados): 4312: Fix dpkg search to use dpkg-query.
Peter Amstutz
09:22 pm Bug #4922 (In Progress): [Crunch] google-api-python-client fails to install
Tim Pierce
06:39 pm Bug #4922 (Resolved): [Crunch] google-api-python-client fails to install
From qr1hi-8i9sb-wleo6rt176ublrc, using docker image bcosc/all-tools
1/7/2015 1:20:27 PM compute20 1 task-print 0 ...
Bryan Cosca
08:55 pm Support #4928 (In Progress): [Support] Fix bugs and write tests (first half)
Tim Pierce
08:32 pm Support #4928 (Resolved): [Support] Fix bugs and write tests (first half)
Tom Clegg
08:52 pm Story #4930 (Resolved): [FUSE] Design: specify behavior for writable arv-mount
To address:
* When do changes become visible to other Keep mounts? (what is the "commit" button?)
* When do changes...
Tom Clegg
08:42 pm Revision cf670551 (arvados): 4523: some more test assertions
Radhika Chippada
08:33 pm Support #4929 (Resolved): [Support] Fix bugs and write tests (second half)
Tom Clegg
08:22 pm Story #4927 (Resolved): [SSO] Decide overall single sign-on strategy
See [[Authentication]] Tom Clegg
08:05 pm Bug #4232 (In Progress): [Workbench] Pipeline instances with many components should render quickl...
Tom Clegg
08:03 pm Feature #4926 (Resolved): [Documentation] (recurring) Refresh user documentation
Tom Clegg
07:58 pm Feature #4823: [SDKs] Good Collection API for Python SDK
Notes for when you get to this:
@manifest_text() / portable_manifest_text()@:
* Current a single @manifest_text()...
Peter Amstutz
07:56 pm Bug #4358 (New): [Tests] When comparing pipelines, the graph should highlight the differences by ...
Tom Clegg
07:51 pm Revision 1ea32518 (arvados): 4312: Call virtualenv pip directly instead of using activate.
Peter Amstutz
07:39 pm Task #4900 (Resolved): Add a "file_names" column for collections data model
Radhika Chippada
07:38 pm Revision f15b2183 (arvados): 4312: Use "install" phase of bootstrap script to report the installe...
of any arvados pip or debian packages. Like virtualenv logic, only reports for
task 0 (since every task starts the s...
Peter Amstutz
07:38 pm Task #4925 (Resolved): Review 4312-crunch-report-sdk-version
Peter Amstutz
07:37 pm Task #4606 (Resolved): Report relevant package versions during install phase
Peter Amstutz
07:32 pm Bug #4924 (Resolved): [SDKs] Improve arv edit error handling UX
To do:
* Error messages should be visible after a failure.
* User should _always_ be given a chance to re-edit afte...
Tom Clegg
07:29 pm Story #4607 (Closed): [Crunch] Reusable task design doc
Obsolete / refactored as "jobs can queue other jobs" Tom Clegg
07:27 pm Revision 874f973f (arvados): 4523: exclude text type columns from searchable_columns for ilike op...
Radhika Chippada
06:46 pm Bug #4923 (Resolved): [Workbench] Editable "name" column is presented but not actually available ...
The name column does not exist for the data models "human" and "specimen". However, the UI still presents it and is e... Radhika Chippada
06:44 pm Bug #4921: [Workbench] In search dialog, the preview panel on right should get cleared when the s...
I executed the following steps in the search dialog:
- Enter a search filter (collection filename)
- I saw the ...
Radhika Chippada
06:37 pm Bug #4921 (Resolved): [Workbench] In search dialog, the preview panel on right should get cleared...
Radhika Chippada
06:16 pm Story #4312 (In Progress): [Crunch] crunch-job should report current Python SDK version at start ...
Peter Amstutz
06:13 pm Story #4919: [API] Arvados clients can use standard OAuth2 protocol instead of custom token handl...
Also, OAuth2 specifies that the Authorization header using access tokens is "Authorization: Bearer XYZ" (https://tool... Peter Amstutz
04:18 pm Story #4919: [API] Arvados clients can use standard OAuth2 protocol instead of custom token handl...
Proposed flow for browser based apps that talk to API server directly:
# Login button sends browser directly to SS...
Peter Amstutz
04:10 pm Story #4919: [API] Arvados clients can use standard OAuth2 protocol instead of custom token handl...
Proposed flow for workbench:
# Workbench login button sends browser directly to SSO for sign in (no redirects via ...
Peter Amstutz
03:51 pm Story #4919 (New): [API] Arvados clients can use standard OAuth2 protocol instead of custom token...
While the API server uses OAuth2 to authenticate with the SSO server, Workbench does not use OAuth2 to authenticate w... Peter Amstutz
06:02 pm Revision 35666864 (arvados): Merge branch 'master' into 4523-search-index
Radhika Chippada
05:59 pm Revision ea283284 (arvados): 4523: add tests to search for file name
Radhika Chippada
05:27 pm Bug #4780 (Resolved): [Support] Fix bugs and write tests (week 4)
Ward Vandewege
05:14 pm Revision b5213861 (arvados): Merge branch '3021-more-phantomjs' refs #3021
Tom Clegg
05:14 pm Revision 7c348e5f (arvados): 3021: Use selenium to land on #Advanced tab.
Tom Clegg
05:14 pm Revision 809a0b4c (arvados): 3021: Merge branch 'master' into 3021-more-phantomjs
Tom Clegg
05:10 pm Task #4883 (Resolved): Establish test suite
Tom Clegg
04:57 pm Story #3021: [Tests] Make jenkins tests run faster.
Tom Clegg wrote:
> Brett Smith wrote:
> > (My one bikesheddy comment is that it might be nice to generate @magic@ r...
Brett Smith
04:42 pm Story #3021: [Tests] Make jenkins tests run faster.
Brett Smith wrote:
> I feel a little uneasy about modifying the DOM while it's under testing. It feels a little lik...
Tom Clegg
02:06 pm Story #3021: [Tests] Make jenkins tests run faster.
Tom Clegg wrote:
> OK, I've added (in commit:76ab57b) a helper that waits for a @shown.bs.modal@ event after clickin...
Brett Smith
04:12 pm Bug #4920 (Resolved): [Crunch] Installing Docker image from [...] exited 1
examples: "qr1hi-8i9sb-8aaiz3f6ll1bx5z":http://crvr.se/qr1hi-8i9sb-8aaiz3f6ll1bx5z, "qr1hi-8i9sb-azre7zigwmyfsi3":htt... Bryan Cosca
03:47 pm Bug #4918 (Resolved): [Workbench] Input chooser for new pipelines hides the "file choose" menu on...
When choosing input files for a new pipeline, if the user's window is too narrow, the input chooser modal dialog will... Tim Pierce
03:20 pm Bug #4840: 414 Request-URI Too Large after Selecting 300+ files to put into a new collection
+1 for using real HTML forms and beating the bootstrap dropdown menu with a CSS stick until form buttons look the sam... Peter Amstutz
02:59 pm Bug #4840: 414 Request-URI Too Large after Selecting 300+ files to put into a new collection
Unfortunately, there's no trivial fix for this. Right now, all of our selection actions are links inside Bootstrap d... Brett Smith
03:01 pm Revision dea28585 (arvados): 3021: Add random part to magic string.
Tom Clegg
02:50 pm Task #4807 (Resolved): Review 4598-crunch-failure-stats
Tim Pierce
02:50 pm Feature #4598 (Resolved): [Crunch] [DRAFT] Classify job failures by type, report statistics
Applied in changeset arvados|commit:a32c4f9997a0c8941b62668c5e59941985359c05. Tim Pierce
02:48 pm Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
I made one last change: renaming @crunch-failure-report.py@ to @crunch_failure_report.py@, which at least permits imp... Tim Pierce
12:25 am Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
Looking good now. I think this can be merged. Thanks! Ward Vandewege
02:46 pm Revision a32c4f99 (arvados): Merge branch '4598-crunch-failure-stats'
Fixes #4598. Tim Pierce
02:45 pm Revision 31242cbe (arvados): 4598: actually rename this time
PEBCAK failure led to deleting the file without staging the new one. d'oh. Tim Pierce
02:43 pm Revision 7ee73a40 (arvados): 4598: rename script
Renamed crunch-failure-report.py to crunch_failure_report.py to permit
importing (and eventually testing).
Tim Pierce
02:23 pm Feature #4570 (Resolved): [SSO] Implement Google OAuth2 for new SSO installations
Peter Amstutz
04:49 am Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Peter Amstutz wrote:
> This innocent little line actually sets in motion a whole bunch of stuff which culminates in ...
Tom Clegg
02:23 pm Task #4639 (Resolved): Review 4570-support-google-oauth2 in the sso-provider repository
Peter Amstutz
02:21 pm Story #4784 (Resolved): CWL draft 1 tool description spec
Peter Amstutz
02:21 pm Story #4684 (Resolved): [Crunch] Participate in common-workflow-language discussion
Peter Amstutz
02:14 pm Revision 0cfe939f (sso-provider): Merge branch '4570-support-google-oauth2' closes #4570
Peter Amstutz
04:16 am Revision 1dd5156a (arvados): Started focusing on Keep Server responses again. Switched to using b...
Misha Zatsman
01:45 am Revision df69d7a5 (arvados): Fixed heap profile writing so that we overwrite previous heap profil...
Misha Zatsman

01/06/2015

10:58 pm Story #3021: [Tests] Make jenkins tests run faster.
Brett Smith wrote:
> If you can find a better alternative, great; but one way or another, I think we should replace ...
Tom Clegg
10:10 pm Story #3021: [Tests] Make jenkins tests run faster.
Tom Clegg wrote:
> This seems quite plausible. I still haven't seen any of these failures at my end, so I can only g...
Brett Smith
05:56 pm Story #3021: [Tests] Make jenkins tests run faster.
Brett Smith wrote:
> * The test clicks the modal button to create the new pipeline, then immediately asserts the URL...
Tom Clegg
05:08 pm Story #3021: [Tests] Make jenkins tests run faster.
Tom Clegg wrote:
> Brett Smith wrote:
> > First I ran all the tests, and got two failures, for active/true_false_in...
Brett Smith
03:00 pm Story #3021: [Tests] Make jenkins tests run faster.
Brett Smith wrote:
> First I ran all the tests, and got two failures, for active/true_false_in_false and active/true...
Tom Clegg
10:48 pm Revision 76ab57bb (arvados): 3021: Wait for shown.bs.modal before trying to click butttons in the...
Remove a stray Headless.new.start. Tom Clegg
09:27 pm Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
Updated at commit:4b9208f2b with more comprehensive exception handling. (If a failed pipeline instance has no pipelin... Tim Pierce
07:31 pm Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
Review comments:... Ward Vandewege
04:07 pm Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
Fixed at commit:a686dcb:
The script failed to take into account jobs in a Queued or Cancelled state. It now report...
Tim Pierce
09:21 pm Revision 4b9208f2 (arvados): 4598: catch exceptions more aggressively when looking up pipeline names
Added exception handling for cases where:
* job is not recorded as belonging to any pipeline instance
* pipeline inst...
Tim Pierce
08:37 pm Feature #4905: [Workbench] Make repository-sharing feature accessible from Manage Account page
# We can probably use the most of the existing UI for setting permissions on projects to set permissions on repositor... Peter Amstutz
06:18 pm Feature #4905 (Closed): [Workbench] Make repository-sharing feature accessible from Manage Accoun...
The scenario where Bryan wants to see some of Sally's example crunch scripts that she wrote and its currently in her ... Bryan Cosca
08:17 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Tom Clegg wrote:
> My only other comment on the 4570-support-google-oauth2 (sso) is that the use of @session[:auth_p...
Peter Amstutz
07:40 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
My only other comment on the 4570-support-google-oauth2 (sso) is that the use of @session[:auth_provider]@ is mysteri... Tom Clegg
06:59 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Peter Amstutz wrote:
> > Still tabs in apps/workbench/app/views/users/welcome.html.erb at commit:7b5729d...
>
> H...
Tom Clegg
06:24 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Tom Clegg wrote:
> Peter Amstutz wrote:
> > > Couple of tab characters in @apps/workbench/app/views/users/welcome.h...
Peter Amstutz
05:17 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Peter Amstutz wrote:
> > Couple of tab characters in @apps/workbench/app/views/users/welcome.html.erb@
> > * try co...
Tom Clegg
01:39 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Tom Clegg wrote:
> Notes on 4570-multi-auth-method at commit:ec33dfc
>
> Couple of tab characters in @apps/workbe...
Peter Amstutz
07:16 pm Task #4640 (Resolved): Review 4570-multi-auth-method
Peter Amstutz
07:06 pm Revision 8cf505f8 (arvados): Merge branch '4570-multi-auth-method' refs #4570
Peter Amstutz
06:52 pm Revision 33515b84 (arvados): 3021: Fix assertion broken in 9c10212.
Tom Clegg
06:45 pm Revision 0c5278fc (arvados-dev): Rename {workbench,apiserver}_test to {apps/workbench,services/ap...
to match help message and become more consistent with overall naming
scheme.
No issue #
Tom Clegg
06:45 pm Revision 0c5278fc (arvados): Rename {workbench,apiserver}_test to {apps/workbench,services/api}_t...
to match help message and become more consistent with overall naming
scheme.
No issue #
Tom Clegg
06:42 pm Feature #4906 (New): [Documentation/FUSE] Document '.arvados#collection' in shell VM keep mount
Provide documentation for the magic file '.arvados#collection' in the shell VM keep mount. As far as I know this is ... Abram Connelly
06:37 pm Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
Some other ideas:
# Collect user id on the workbench page. Pass this as @login_hint@ in the OAuth2 request. When...
Peter Amstutz
06:24 pm Revision d6392511 (arvados): 4570: Fix tabs, CSS on log in button.
Peter Amstutz
06:19 pm Revision 04f5f756 (arvados): 4823: Working on porting more StreamReader tests to ArvadosFile.
Peter Amstutz
05:46 pm Revision d5774ee9 (arvados): Make sure to build a new package for keepproxy if the go SDK has bee...
No issue # Ward Vandewege
05:46 pm Revision d5774ee9 (arvados-dev): Make sure to build a new package for keepproxy if the go SDK has...
No issue # Ward Vandewege
05:26 pm Revision 9c102127 (arvados): 3021: Wait for dialog to close before asserting page transition.
Tom Clegg
05:25 pm Revision bff57ea5 (arvados): Merge branch 'master' into 4138-node-manager-google-cloud
Tim Pierce
05:15 pm Task #4870 (Resolved): Review 4836-first-tab-load-wip and merge if good
Applied in changeset arvados|commit:1a72b1b7b46d771129c1ec93221a5934fa33ef75. Brett Smith
05:15 pm Bug #4836 (Resolved): [Workbench] Ensure first tab content loads when shown, even if location has...
Applied in changeset arvados|commit:1a72b1b7b46d771129c1ec93221a5934fa33ef75. Brett Smith
04:58 pm Bug #4836: [Workbench] Ensure first tab content loads when shown, even if location hash indicated...
commit:ab6840d1 LGTM, thanks. Tom Clegg
02:47 pm Bug #4836: [Workbench] Ensure first tab content loads when shown, even if location hash indicated...
Tom Clegg wrote:
> Would something like this address the issue, without causing invisible content to be loaded?
T...
Brett Smith
05:12 pm Revision 1a72b1b7 (arvados): Merge branch '4836-first-tab-load-wip'
Closes #4836, #4870. Brett Smith
05:09 pm Revision edf4ea27 (arvados): 4836: Trigger Workbench infinite scroll load on tab show.
If an infinite scroller is in the first tab of a show page, but the
user is going to a different tab, we'll queue up ...
Brett Smith
04:41 pm Task #4816 (Resolved): Review 4358
Tom Clegg
04:40 pm Bug #4358 (In Progress): [Tests] When comparing pipelines, the graph should highlight the differe...
Tom Clegg
04:32 pm Revision 86f94e64 (arvados): Merge branch 'master' into 4823-python-sdk-writable-collection-api
Peter Amstutz
04:32 pm Story #4904 (Resolved): [SDKs] Use websockets to restart/reconfigure a web service running on a V...
# a really really short Python program that uses a super convenient SDK library call to listen to websockets, waits f... Tom Clegg
04:29 pm Feature #4823 (In Progress): [SDKs] Good Collection API for Python SDK
Peter Amstutz
04:27 pm Feature #4823: [SDKs] Good Collection API for Python SDK
Benchmark note: taking and releasing a lock on every read imposes an up to ~30% performance hit in a tight loop with ... Peter Amstutz
04:05 pm Revision 7ee837cb (sso-provider): 4570: Optionally enable legacy openid 2.0. Monkey patch rack-o...
"&openid_shutdown_ack=2015-04-20" Peter Amstutz
04:03 pm Revision a686dcbf (arvados): 4598: account for queued and cancelled jobs, fix sorting
Per code review:
* Updated report to include job states "Cancelled" and "Queued" as well
as Failed, Running and Com...
Tim Pierce
04:00 pm Bug #4903 (Resolved): [Crunch] ensure that JOB_WORK and TASK_WORK directories exist for Docker jobs
Stack trace from job "qr1hi-8i9sb-1fmcoid6lfess9g":https://crvr.se/qr1hi-8i9sb-1fmcoid6lfess9g:... Tim Pierce
03:48 pm Revision cac35f0e (arvados): 4523: Add test to create collection with large manifest text. This t...
the file_names column can have for successful search indexing is 2^13. Hence, setting the column
size to 2^12, so tha...
Radhika Chippada
03:47 pm Task #4902 (Resolved): Use a fixture instead of calling "run a pipeline" in the set of 8 "rerun p...
Tom Clegg
03:47 pm Feature #4901: [Workbench] Allow overriding of favicon.ico with custom theme.
Setting an alternate favicon using a meta tag in the theme's layout view should already work. Tom Clegg
03:17 pm Feature #4901 (Closed): [Workbench] Allow overriding of favicon.ico with custom theme.
Ward Vandewege
02:36 pm Revision 40bbccf9 (arvados): 4523: extract unique file names from manifest text and set as file_n...
Radhika Chippada
02:23 pm Revision ab6840d1 (arvados): 4836: Squash last commit based on Tom feedback.
Brett Smith
01:45 pm Revision 7b5729d9 (arvados): Merge branch 'master' into 4570-multi-auth-method
Peter Amstutz
01:44 pm Revision b4b8bac5 (arvados): 4570: Revert to links on log in page instead of form. Fixup documen...
to describe a production setup. Peter Amstutz
06:06 am Revision 7b5c84ea (arvados): 3021: Use headless helper in performance and diagnostics tests, too.
Tom Clegg
06:05 am Revision 412fdae0 (arvados): 3021: 4399: Refactor headless stuff into a module. Clear up new/star...
* Create one Headless per test process, when encountering the first
test case that needs one.
* Call headless.star...
Tom Clegg
05:11 am Revision 9b318db8 (arvados): 4523: update the collection file_names migration script to set the f...
Radhika Chippada
01:25 am Revision 840592d4 (arvados): 4523: add file_names searchable column to collections data model.
Radhika Chippada
01:05 am Revision 942cee20 (arvados): 4523: set description size back to 2**19
Radhika Chippada

01/05/2015

11:22 pm Task #4900 (Resolved): Add a "file_names" column for collections data model
Since searching "text" columns is too slow, we do not want to include text columns in searchable_columns.
However,...
Radhika Chippada
10:39 pm Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
Review comments:
Sorting is still not working in failures by class and failures by class (detail). For example, fr...
Ward Vandewege
07:28 pm Feature #4598: [Crunch] [DRAFT] Classify job failures by type, report statistics
Fixes at commit:e5dce69:
Bugs fixed:
* Correct counting and percentage calculation of job failures.
** Jobs were...
Tim Pierce
09:36 pm Revision 7d6b0f37 (arvados): 4523: set description size to 2**17, which seems to be the upper lim...
Radhika Chippada
09:02 pm Bug #4836: [Workbench] Ensure first tab content loads when shown, even if location hash indicated...
At commit:3233ded:
Diagnosis makes sense, thank you.
However, I suspect the @is(':visible')@ test is still need...
Tom Clegg
04:49 pm Bug #4836 (In Progress): [Workbench] Ensure first tab content loads when shown, even if location ...
Tom Clegg
08:02 pm Revision 34971328 (arvados): 4523: Come back down to earth enough to make tests pass.
Tom Clegg
07:40 pm Revision b910bb31 (arvados): 4523: Restore indexes accidentally deleted from structure.sql.
Tom Clegg
07:22 pm Revision e5dce693 (arvados): 4598: formatting and calculation fixes (code review)
Incorporating code review feedback from #4598-13.
Bugs fixed:
* Correct counting and percentage calculation of job f...
Tim Pierce
06:57 pm Story #3021: [Tests] Make jenkins tests run faster.
Reviewing commit:d43df86. The branch looks great overall, and I'm looking forward to seeing this merged. Thanks for... Brett Smith
06:06 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Notes on 4570-multi-auth-method at commit:ec33dfc
Couple of tab characters in @apps/workbench/app/views/users/welc...
Tom Clegg
04:23 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Tom Clegg wrote:
> At commit:sso-provider|26caf5a
>
> Suggest renaming @config.google_client_*@ to @config.google...
Peter Amstutz
04:22 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
Ward Vandewege wrote:
> Reviewing 4570-support-google-oauth2:
>
> - don't change environment.rb -- this stuff sho...
Peter Amstutz
02:58 pm Feature #4570: [SSO] Implement Google OAuth2 for new SSO installations
At commit:sso-provider|26caf5a
Suggest renaming @config.google_client_*@ to @config.google_oauth2_client_*@ to mat...
Tom Clegg
06:03 pm Task #4896 (In Progress): Review 3021-more-phantomjs
Brett Smith
03:54 pm Task #4896 (Resolved): Review 3021-more-phantomjs
Tom Clegg
04:49 pm Task #4870 (In Progress): Review 4836-first-tab-load-wip and merge if good
Tom Clegg
04:37 pm Revision 9013faf4 (arvados): Merge branch '4869-keepalive' refs #4869
Peter Amstutz
04:14 pm Bug #4840 (In Progress): 414 Request-URI Too Large after Selecting 300+ files to put into a new c...
Brett Smith
04:00 pm Revision fd93ec16 (sso-provider): 4570: Remove configuration from environment.rb, added to
environments/(development, production, test).rb.example, rename config
variables from google_client_* to google_oauth...
Peter Amstutz
03:54 pm Task #4895 (Resolved): Convert selenium tests to phantomjs where possible
Tom Clegg
03:53 pm Task #4895 (Resolved): Convert selenium tests to phantomjs where possible
Tom Clegg
03:47 pm Bug #4232: [Workbench] Pipeline instances with many components should render quickly (on pipeline...
Phil Hodgson wrote:
> Hmm... Right, so I'm also posting just below what I sent to you in an email. I was trying to f...
Brett Smith
03:34 pm Revision 46c68829 (arvados): 4523: Simplify migration.
Tom Clegg
03:34 pm Revision 164ebe21 (arvados): 4523: Do not search :text fields at all.
Tom Clegg
03:34 pm Revision 8714664e (arvados): 4523: Increase string length limit. (Postgres allows nearly 1MiB her...
Tom Clegg
03:29 pm Revision 67414a0a (arvados): 4523: Description is not unsearchable after all.
Tom Clegg
03:28 pm Revision 0e944367 (arvados): Merge branch 'master' into 4823-python-sdk-writable-collection-api
Peter Amstutz
03:25 pm Story #4788 (Resolved): Research git frontend and how to configure it
Peter Amstutz
03:22 pm Task #4837 (Resolved): [SDKs] Define API and in-memory data structure for collections in Python SDK
Peter Amstutz
03:22 pm Task #4893 (Resolved): Review 4823-python-sdk-writable-collection-api
Peter Amstutz
03:17 pm Revision 51698227 (arvados): 4869: Client.Timeout and Client.Transport are now correctly set in
DiscoverKeepServers(). Improved comments. Peter Amstutz
03:05 pm Revision b6f73f7a (arvados): 4523: Merge branch '4523-search-index' of git.curoverse.com:arvados ...
Conflicts:
services/api/test/unit/arvados_model_test.rb
Tom Clegg
02:48 pm Revision 49030c31 (arvados): Merge branch 'master' into 4523-search-index
Conflicts:
services/api/db/migrate/20141208164553_owner_uuid_index.rb
services/api/db/structure.sql
services/api/t...
Radhika Chippada
02:45 pm Task #4890 (Resolved): review 4887-invalidate-duplicate-ip-on-old-compute-nodes
Ward Vandewege
02:44 pm Bug #4779 (Resolved): [Support] Fix bugs and write tests (week 3)
Ward Vandewege
02:44 pm Bug #4780 (In Progress): [Support] Fix bugs and write tests (week 4)
Ward Vandewege
02:18 pm Task #4873 (In Progress): Review 4232
Brett Smith
02:09 pm Revision 3233ded0 (arvados): 4836: Fix infinite scroll loading in background tabs.
If an infinite scroller is in the first tab of a show page, but the
user is going to a different tab, we'll queue up ...
Brett Smith
02:00 pm Bug #4891 (Closed): [Node Manager] Should not associate node with incorrect arvados node object
Duplicates #4751. Brett Smith
01:57 pm Bug #4844 (Resolved): [Node Manager] Treats min_nodes as min_nodes_idle when job queue is empty
Brett Smith
02:52 am Feature #4601: [SSO] Migrate OpenId users to OAuth/Google+
Proposed migration strategy:
# Add &openid_shutdown_ack=2015-04-20 to existing OpenID request to temporarily disab...
Peter Amstutz
 

Also available in: Atom