https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422020-03-18T21:12:18ZArvadosArvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831582020-03-18T21:12:18ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Part of this story should be a user listing integration test that uses a similar arvados-boot setup to the new federation test.</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831592020-03-18T21:14:03ZLucas Di Pentimalucas.dipentima@curii.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831612020-03-19T19:29:31ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>A related error was reported:</p>
<p>error updating local user records: request failed: <a class="external" href="http://localhost:8000/arvados/v1/users/batch_update">http://localhost:8000/arvados/v1/users/batch_update</a>: 422 Unprocessable Entity: #<ActiveRecord::RecordInvalid: Validation failed: Modified by client uuid '<a href="https://arvadosapi.com/arlog-ozdt8-8bsvojxdycrr5qe">arlog-ozdt8-8bsvojxdycrr5qe</a>' not found> (req-54bqf3xe8p5y1sppyu4u)</p>
<p><code>modified_by_client_uuid</code> is a special field (I believe it is the client_uuid from token that last touched the record) and it doesn't really make sense to try and copy it to the local users table, because the client_uuid is cluster specific.</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831832020-03-23T17:30:54ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>Updates at <a class="changeset" title="16263: Adds nullify behavior to users's batch_update endpoint. Arvados-DCO-1.1-Signed-off-by: Lu..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/8ba91a5558a9fbb743c726a7e38f7e7dcd7bf8ee">8ba91a5558a9fbb743c726a7e38f7e7dcd7bf8ee</a> - branch <code>16263-logincluster-user-list-fix</code><br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests/1781/"<a href="https://ci.arvados.org/job/developer-run-tests/1781/">developer-run-tests: #1781 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1781" alt="" /></a></a></p>
<ul>
<li>Adds a hook to <code>create</code> and <code>update</code> calls so that every object can declare a list of fields that should be saved as nil when receiving an empty value.</li>
<li>Adds the same behavior to <code>batch_update</code> on <code>users</code>.</li>
<li>Adds tests.</li>
</ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831842020-03-23T18:41:55ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>Updates at <a class="changeset" title="16263: Don't cache modified_by_*_uuid fields when using LoginCluster. Arvados-DCO-1.1-Signed-off..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/9fb4398f258c39ac88aef0983de7692c048a2c9b">9fb4398f2</a><br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests/1782/"<a href="https://ci.arvados.org/job/developer-run-tests/1782/">developer-run-tests: #1782 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1782" alt="" /></a></a></p>
<ul>
<li>Removes <code>modified_by_*_uuid</code> fields to the user's cache field whitelist.</li>
</ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831852020-03-23T19:21:40ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>Updates at <a class="changeset" title="16263: Makes gofmt happy. Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>" href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/6004ef0180d72531d187d6c9df412f22bc8b3cf4">6004ef018</a><br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests-remainder/1855/"<a href="https://ci.arvados.org/job/developer-run-tests-remainder/1855/">developer-run-tests-remainder: #1855 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests-remainder&build=1855" alt="" /></a></a></p>
<ul>
<li>Fixes go formatting.</li>
</ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831912020-03-24T17:27:43ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Lucas Di Pentima wrote:</p>
<blockquote>
<p>Updates at <a class="changeset" title="16263: Don't cache modified_by_*_uuid fields when using LoginCluster. Arvados-DCO-1.1-Signed-off..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/9fb4398f258c39ac88aef0983de7692c048a2c9b">9fb4398f2</a><br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests/1782/"<a href="https://ci.arvados.org/job/developer-run-tests/1782/">developer-run-tests: #1782 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1782" alt="" /></a></a></p>
<ul>
<li>Removes <code>modified_by_*_uuid</code> fields to the user's cache field whitelist.</li>
</ul>
</blockquote>
<p>I noticed 'uuid' isn't in the whitelist. Does it get added in somewhere else?</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831922020-03-24T17:34:13ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Peter Amstutz wrote:</p>
<blockquote>
<p>Lucas Di Pentima wrote:</p>
<blockquote>
<p>Updates at <a class="changeset" title="16263: Don't cache modified_by_*_uuid fields when using LoginCluster. Arvados-DCO-1.1-Signed-off..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/9fb4398f258c39ac88aef0983de7692c048a2c9b">9fb4398f2</a><br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests/1782/"<a href="https://ci.arvados.org/job/developer-run-tests/1782/">developer-run-tests: #1782 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1782" alt="" /></a></a></p>
<ul>
<li>Removes <code>modified_by_*_uuid</code> fields to the user's cache field whitelist.</li>
</ul>
</blockquote>
<p>I noticed 'uuid' isn't in the whitelist. Does it get added in somewhere else?</p>
</blockquote>
<p>Actually I see now, the uuid is a dictionary key.</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831972020-03-24T18:58:33ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>I'm running the federation-migrate test (which tests the LoginCluster feature). It's getting an API error:</p>
<p>arvados.errors.ApiError: <HttpError 500 when requesting <a class="external" href="https://172.17.0.6:8000/arvados/v1/users?alt=json&limit=1&filters=%5B%5B%22email%22%2C+%22%3D%22%2C+%22test%40example.com%22%5D%2C+%5B%22is_active%22%2C+%22%3D%22%2C+true%5D%5D">https://172.17.0.6:8000/arvados/v1/users?alt=json&limit=1&filters=%5B%5B%22email%22%2C+%22%3D%22%2C+%22test%40example.com%22%5D%2C+%5B%22is_active%22%2C+%22%3D%22%2C+true%5D%5D</a> returned "invalid filter operand %!q(bool=true)"></p>
<p>Here's the error from controller (I think it fails in controller, it doesn't make it to the API server):</p>
<p>@400000005e7a57190e6981ac.s:2020-03-24_18:50:52.75547 {"PID":40,"RequestID":"req-5otj2n35rtxdh6x5bir3","level":"info","msg":"response","remoteAddr":"127.0.0.1:47752","reqBytes":0,"reqForwardedFor":"172.17.0.9","reqHost":"172.17.0.6:8000","reqMethod":"GET","reqPath":"arvados/v1/users","reqQuery":"alt=json\u0026limit=1\u0026filters=%5B%5B%22email%22%2C+%22%3D%22%2C+%22test%40example.com%22%5D%2C+%5B%22is_active%22%2C+%22%3D%22%2C+true%5D%5D","respBody":"{\"errors\":[\"invalid filter operand %!q(bool=true)\"]}\n","respBytes":53,"respStatus":"Internal Server Error","respStatusCode":500,"time":"2020-03-24T18:50:52.755416243Z","timeToStatus":0.000604,"timeTotal":0.000614,"timeWriteBody":0.000010}</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=831982020-03-24T19:23:47ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>This is the API call from Python:</p>
<pre>
existing = api.users().list(filters=[["email", "=", "test@example.com"],
["is_active", "=", True]], limit=1).execute()
</pre> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=832002020-03-24T21:08:25ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>Peter Amstutz wrote:</p>
<blockquote>
<p>I'm running the federation-migrate test (which tests the LoginCluster feature). It's getting an API error:</p>
<p>arvados.errors.ApiError: <HttpError 500 when requesting <a class="external" href="https://172.17.0.6:8000/arvados/v1/users?alt=json&limit=1&filters=%5B%5B%22email%22%2C+%22%3D%22%2C+%22test%40example.com%22%5D%2C+%5B%22is_active%22%2C+%22%3D%22%2C+true%5D%5D">https://172.17.0.6:8000/arvados/v1/users?alt=json&limit=1&filters=%5B%5B%22email%22%2C+%22%3D%22%2C+%22test%40example.com%22%5D%2C+%5B%22is_active%22%2C+%22%3D%22%2C+true%5D%5D</a> returned "invalid filter operand %!q(bool=true)"></p>
</blockquote>
<p>Fixed at <a class="changeset" title="16263: Bool filter bug fix. Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.co..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/5c941aa10b7b4bf9d0804f98eb93a8104bfb7658">5c941aa10b7b4bf9d0804f98eb93a8104bfb7658</a> (rebased branch)<br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests/1785/"<a href="https://ci.arvados.org/job/developer-run-tests/1785/">developer-run-tests: #1785 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1785" alt="" /></a></a></p>
<p>The problem was that the GoSDK wasn't supporting boolean operands on filters when unmarshalling from JSON. Added some tests.</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=832012020-03-24T21:18:09ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Now I'm getting this:</p>
<pre>
arvados.errors.ApiError: <HttpError 500 when requesting https://172.17.0.8:8000/arvados/v1/users?offset=0&limit=9223372036854775807&alt=json returned "request failed: https://172.17.0.6:8000/arvados/v1/users?cluster_id=&count=&limit=9223372036854776000&offset=0: 500 Internal Server Error: strconv.ParseInt: parsing "9223372036854776000": value out of range">
</pre>
<p>This is on this SDK call:</p>
<p>ul = arvados.util.list_all(arv.users().list)</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=832152020-03-25T13:42:54ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> changed from <i>2020-03-25 Sprint</i> to <i>2020-04-08 Sprint</i></li></ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=832802020-03-26T15:46:09ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>The above problem is related to the fact that <code>json.Unmarshal()</code> uses the <code>float64</code> type to decode JSON numbers, and when decoding really big numbers, it loses precision. See <a class="external" href="https://stackoverflow.com/questions/16946306/preserve-int64-values-when-parsing-json-in-go">https://stackoverflow.com/questions/16946306/preserve-int64-values-when-parsing-json-in-go</a></p>
<p>Fix with tests at <a class="changeset" title="16263: Decodes JSON numbers as strings instead of float64. Arvados-DCO-1.1-Signed-off-by: Lucas ..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/12b5341528770adc532b6c3e169036addd945d52">12b534152</a><br />Test run: <a class="external" href="https://ci.arvados.org/job/developer-run-tests/1786/"<a href="https://ci.arvados.org/job/developer-run-tests/1786/">developer-run-tests: #1786 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1786" alt="" /></a></a></p>
<p>I think changing controller's <code>requestAndDecode()</code> behavior is a bit overkill, I'm reading a bit about json's <code>Unmarshaler</code> interface to see if something more specific can be implemented: <a class="external" href="https://golang.org/pkg/encoding/json/#Unmarshaler">https://golang.org/pkg/encoding/json/#Unmarshaler</a></p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833022020-03-30T14:53:21ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Got another error while trying run the federation migrate test. I'm looking into this one.</p>
<p>(case3@test) Error getting user info for <a href="https://arvadosapi.com/x31je-tpzed-kjnjvyl0m4n1n2i">x31je-tpzed-kjnjvyl0m4n1n2i</a> from x31je: <HttpError 401 when requesting <a class="external" href="https://172.17.0.4:8000/arvados/v1/users/current?alt=json">https://172.17.0.4:8000/arvados/v1/users/current?alt=json</a> returned "request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/current?forwarded_for=&remote=&uuid=">http://localhost:8004/arvados/v1/users/current?forwarded_for=&remote=&uuid=</a>: 401 Unauthorized: Not logged in (req-y6de37eqyvwzh16wbs37)"></p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833032020-03-30T15:12:23ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>(case3@test) No user listed with same email to migrate <a href="https://arvadosapi.com/xsdok-tpzed-0w3rz8pyzrgryxr">xsdok-tpzed-0w3rz8pyzrgryxr</a> to x31je, will create new user with username 'case3'<br />(case3@test) Error getting user info for <a href="https://arvadosapi.com/x31je-tpzed-o5zmv7q6i8cj5pq">x31je-tpzed-o5zmv7q6i8cj5pq</a> from x31je: <HttpError 401 when requesting <a class="external" href="https://172.17.0.4:8000/arvados/v1/users/current?alt=json">https://172.17.0.4:8000/arvados/v1/users/current?alt=json</a> returned "request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/current?forwarded_for=&remote=&uuid=">http://localhost:8004/arvados/v1/users/current?forwarded_for=&remote=&uuid=</a>: 401 Unauthorized: Not logged in (req-mfgs9p4efyof1honpt26)"><br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-0w3rz8pyzrgryxr">xsdok-tpzed-0w3rz8pyzrgryxr</a> to <a href="https://arvadosapi.com/x31je-tpzed-o5zmv7q6i8cj5pq">x31je-tpzed-o5zmv7q6i8cj5pq</a> on xqcb8<br />(case3@test) Error migrating user: <HttpError 422 when requesting <a class="external" href="https://172.17.0.6:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-0w3rz8pyzrgryxr&new_user_uuid=x31je-tpzed-o5zmv7q6i8cj5pq&new_owner_uuid=xqcb8-j7d0g-9m0sjeteyv2v88y&redirect_to_new_user=true&alt=json">https://172.17.0.6:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-0w3rz8pyzrgryxr&new_user_uuid=x31je-tpzed-o5zmv7q6i8cj5pq&new_owner_uuid=xqcb8-j7d0g-9m0sjeteyv2v88y&redirect_to_new_user=true&alt=json</a> returned "request failed: <a class="external" href="https://172.17.0.5:8000/arvados/v1/users/merge">https://172.17.0.5:8000/arvados/v1/users/merge</a>: 422 Unprocessable Entity: request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/merge">http://localhost:8004/arvados/v1/users/merge</a>: 422 Unprocessable Entity: User in new_user_uuid not found (req-ghtmi4tlfenkpp1u1ub4)"><br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-0w3rz8pyzrgryxr">xsdok-tpzed-0w3rz8pyzrgryxr</a> to <a href="https://arvadosapi.com/x31je-tpzed-o5zmv7q6i8cj5pq">x31je-tpzed-o5zmv7q6i8cj5pq</a> on xsdok<br />(case3@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-o5zmv7q6i8cj5pq">x31je-tpzed-o5zmv7q6i8cj5pq</a> to 'case3' on xsdok</p>
<p>2020-03-30_15:04:25.82187 {"PID":9470,"RequestID":"req-mfgs9p4efyof1honpt26","level":"info","msg":"request","remoteAddr":"127.0.0.1:35268","reqBytes":0,"reqForwardedFor":"172.17.0.1","reqHost":"172.17.0.4:8000","reqMethod":"GET","reqPath":"arvados/v1/users/current","reqQuery":"alt=json","time":"2020-03-30T15:04:25.821786163Z"}</p>
<p>2020-03-30_15:04:25.83428 {"PID":9470,"RequestID":"req-mfgs9p4efyof1honpt26","level":"info","msg":"response","remoteAddr":"127.0.0.1:35268","reqBytes":0,"reqForwardedFor":"172.17.0.1","reqHost":"172.17.0.4:8000","reqMethod":"GET","reqPath":"arvados/v1/users/current","reqQuery":"alt=json","respBody":"{\"errors\":[\"request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/current?forwarded_for=\\u0026remote=\\u0026uuid=">http://localhost:8004/arvados/v1/users/current?forwarded_for=\\u0026remote=\\u0026uuid=</a>: 401 Unauthorized: Not logged in (req-mfgs9p4efyof1honpt26)\"]}\n","respBytes":177,"respStatus":"Unauthorized","respStatusCode":401,"time":"2020-03-30T15:04:25.834223741Z","timeToStatus":0.012422,"timeTotal":0.012436,"timeWriteBody":0.000013}</p>
<p>ESC[1mESC[36mApiClientAuthorization Load (0.4ms)ESC[0m ESC[1mESC[34mSELECT "api_client_authorizations".* FROM "api<br />_client_authorizations" WHERE (uuid='<a href="https://arvadosapi.com/x31je-gj3su-9zgjsz5tpyw1ewx">x31je-gj3su-9zgjsz5tpyw1ewx</a>' and (expires_at is null or expires_at > CURRENT_TIME<br />STAMP)) ORDER BY "api_client_authorizations"."id" ASC LIMIT $1ESC[0m <a class="wiki-page new" href="https://dev.arvados.org/projects/arvados/wiki/%22LIMIT%22_1">"LIMIT", 1</a><br /> ESC[1mESC[36mUser Load (0.6ms)ESC[0m ESC[1mESC[34mSELECT "users".* FROM "users" WHERE (redirect_to_user_uuid is nul<br />l) AND "users"."id" = 13ESC[0m<br /> ESC[1mESC[36mApiClient Load (0.5ms)ESC[0m ESC[1mESC[34mSELECT "api_clients".* FROM "api_clients" WHERE "api_clients<br />"."id" = 1ESC[0m<br />[req-mfgs9p4efyof1honpt26] Error 1585580665+9a33fe5f: 401
{"method":"GET","path":"/arvados/v1/users/current","format":"html","controller":"Arvados::V1::UsersController","action<br />":"current","status":401,"duration":0.87,"view":0.29,"db":0.0,"request_id":"req-mfgs9p4efyof1honpt26","client_ipaddr":<br />"127.0.0.1","client_auth":null,"params":{"forwarded_for":"","remote":"","uuid":""},"@timestamp":"2020-03-30T15:04:25.8<br />33481839Z","@version":"1","message":"[401] GET /arvados/v1/users/current (Arvados::V1::UsersController#current)"}</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833062020-03-30T19:04:22ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Fixed previous error by adding omitempty to fields of GetOptions.</p>
<p>Next thing failing:</p>
<p>(case3@test) No user listed with same email to migrate <a href="https://arvadosapi.com/xsdok-tpzed-5wtzbkn5iw66h8g">xsdok-tpzed-5wtzbkn5iw66h8g</a> to x31je, will create new user with username 'case3'<br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-5wtzbkn5iw66h8g">xsdok-tpzed-5wtzbkn5iw66h8g</a> to <a href="https://arvadosapi.com/x31je-tpzed-2ss1g6pqjxhcg9d">x31je-tpzed-2ss1g6pqjxhcg9d</a> on x31je<br />(case3@test) Error migrating user: <HttpError 403 when requesting <a class="external" href="https://172.17.0.4:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-5wtzbkn5iw66h8g&new_user_uuid=x31je-tpzed-2ss1g6pqjxhcg9d&new_owner_uuid=x31je-j7d0g-njks8t4fmc96e5r&redirect_to_new_user=true&alt=json">https://172.17.0.4:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-5wtzbkn5iw66h8g&new_user_uuid=x31je-tpzed-2ss1g6pqjxhcg9d&new_owner_uuid=x31je-j7d0g-njks8t4fmc96e5r&redirect_to_new_user=true&alt=json</a> returned "request failed: <a class="external" href="https://172.17.0.5:8000/arvados/v1/users/merge">https://172.17.0.5:8000/arvados/v1/users/merge</a>: 403 Forbidden: request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/merge">http://localhost:8004/arvados/v1/users/merge</a>: 403 Forbidden: cannot move objects into supplied new_owner_uuid: new user does not have write permission (req-qwbqtchw2ubsk3a57g41)"><br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-5wtzbkn5iw66h8g">xsdok-tpzed-5wtzbkn5iw66h8g</a> to <a href="https://arvadosapi.com/x31je-tpzed-2ss1g6pqjxhcg9d">x31je-tpzed-2ss1g6pqjxhcg9d</a> on xqcb8<br />(case3@test) Error migrating user: <HttpError 403 when requesting <a class="external" href="https://172.17.0.6:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-5wtzbkn5iw66h8g&new_user_uuid=x31je-tpzed-2ss1g6pqjxhcg9d&new_owner_uuid=xqcb8-j7d0g-wr33pehajc1edr8&redirect_to_new_user=true&alt=json">https://172.17.0.6:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-5wtzbkn5iw66h8g&new_user_uuid=x31je-tpzed-2ss1g6pqjxhcg9d&new_owner_uuid=xqcb8-j7d0g-wr33pehajc1edr8&redirect_to_new_user=true&alt=json</a> returned "request failed: <a class="external" href="https://172.17.0.5:8000/arvados/v1/users/merge">https://172.17.0.5:8000/arvados/v1/users/merge</a>: 403 Forbidden: request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/merge">http://localhost:8004/arvados/v1/users/merge</a>: 403 Forbidden: cannot move objects into supplied new_owner_uuid: new user does not have write permission (req-mxz2gnky6zk8lswzw5em)"><br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-5wtzbkn5iw66h8g">xsdok-tpzed-5wtzbkn5iw66h8g</a> to <a href="https://arvadosapi.com/x31je-tpzed-2ss1g6pqjxhcg9d">x31je-tpzed-2ss1g6pqjxhcg9d</a> on xsdok<br />(case3@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-2ss1g6pqjxhcg9d">x31je-tpzed-2ss1g6pqjxhcg9d</a> to 'case3' on xsdok</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833072020-03-30T21:26:59ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> deleted (<del><i>2020-04-08 Sprint</i></del>)</li></ul><p>Fix that error (it was incorrectly federating the user merge call) and now it's failing for a new reason!</p>
<p>(case3@test) No user listed with same email to migrate <a href="https://arvadosapi.com/xsdok-tpzed-gotqha27ntc2769">xsdok-tpzed-gotqha27ntc2769</a> to x31je, will create new user with username 'case3'<br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-gotqha27ntc2769">xsdok-tpzed-gotqha27ntc2769</a> to <a href="https://arvadosapi.com/x31je-tpzed-u6nq17m7h5j5vfd">x31je-tpzed-u6nq17m7h5j5vfd</a> on x31je<br />(case3@test) Error migrating user: <HttpError 422 when requesting <a class="external" href="https://172.17.0.4:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-gotqha27ntc2769&new_user_uuid=x31je-tpzed-u6nq17m7h5j5vfd&new_owner_uuid=x31je-j7d0g-kld2rcfg7nqvjz3&redirect_to_new_user=true&alt=json">https://172.17.0.4:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-gotqha27ntc2769&new_user_uuid=x31je-tpzed-u6nq17m7h5j5vfd&new_owner_uuid=x31je-j7d0g-kld2rcfg7nqvjz3&redirect_to_new_user=true&alt=json</a> returned "request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/merge">http://localhost:8004/arvados/v1/users/merge</a>: 422 Unprocessable Entity: User in old_user_uuid not found (req-orhh7a1czbrzv1752oq0)"><br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-gotqha27ntc2769">xsdok-tpzed-gotqha27ntc2769</a> to <a href="https://arvadosapi.com/x31je-tpzed-u6nq17m7h5j5vfd">x31je-tpzed-u6nq17m7h5j5vfd</a> on xqcb8<br />(case3@test) Error migrating user: <HttpError 422 when requesting <a class="external" href="https://172.17.0.6:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-gotqha27ntc2769&new_user_uuid=x31je-tpzed-u6nq17m7h5j5vfd&new_owner_uuid=xqcb8-j7d0g-x21c9ws4bh9279p&redirect_to_new_user=true&alt=json">https://172.17.0.6:8000/arvados/v1/users/merge?old_user_uuid=xsdok-tpzed-gotqha27ntc2769&new_user_uuid=x31je-tpzed-u6nq17m7h5j5vfd&new_owner_uuid=xqcb8-j7d0g-x21c9ws4bh9279p&redirect_to_new_user=true&alt=json</a> returned "request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/merge">http://localhost:8004/arvados/v1/users/merge</a>: 422 Unprocessable Entity: User in old_user_uuid not found (req-g8nv9uhzj95c5i957zqu)"><br />(case3@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-gotqha27ntc2769">xsdok-tpzed-gotqha27ntc2769</a> to <a href="https://arvadosapi.com/x31je-tpzed-u6nq17m7h5j5vfd">x31je-tpzed-u6nq17m7h5j5vfd</a> on xsdok<br />(case3@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-u6nq17m7h5j5vfd">x31je-tpzed-u6nq17m7h5j5vfd</a> to 'case3' on xsdok</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833082020-03-31T01:03:19ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> set to <i>2020-04-08 Sprint</i></li></ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833102020-03-31T15:59:04ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>Fixed the error (it was trying to migrate users that didn't exist and didn't need to be migrated, fixed the existence check).</p>
<p>Next error:</p>
<p>(case7@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> to 'case7' on x31je<br />(case7@test) Error updating username of <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> to 'case7' on x31je: <HttpError 422 when requesting <a class="external" href="https://172.17.0.4:8000/arvados/v1/users/x31je-tpzed-89a34lxw5j0v92d?alt=json">https://172.17.0.4:8000/arvados/v1/users/x31je-tpzed-89a34lxw5j0v92d?alt=json</a> returned "request failed: <a class="external" href="http://localhost:8004/arvados/v1/users/x31je-tpzed-89a34lxw5j0v92d">http://localhost:8004/arvados/v1/users/x31je-tpzed-89a34lxw5j0v92d</a>: 422 Unprocessable Entity: Username has already been taken (req-10dasoeab3iw7ifi1p9h)"><br />(case7@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-os46kennicy3vp6">xsdok-tpzed-os46kennicy3vp6</a> to <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> on x31je<br />(case7@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> to 'case7' on x31je<br />(case7@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-os46kennicy3vp6">xsdok-tpzed-os46kennicy3vp6</a> to <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> on xqcb8<br />(case7@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> to 'case7' on xqcb8<br />(case7@test) Migrating <a href="https://arvadosapi.com/xsdok-tpzed-os46kennicy3vp6">xsdok-tpzed-os46kennicy3vp6</a> to <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> on xsdok<br />(case7@test) Updating username of <a href="https://arvadosapi.com/x31je-tpzed-89a34lxw5j0v92d">x31je-tpzed-89a34lxw5j0v92d</a> to 'case7' on xsdok</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833832020-04-02T14:56:53ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>16263-logincluster-user-list-fix @ <a class="changeset" title="16263: User migration test also checks federated user behavior Arvados-DCO-1.1-Signed-off-by: Pe..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/5efed8f05e4616ed423124544e5b021e2c8d5a6f">5efed8f05e4616ed423124544e5b021e2c8d5a6f</a></p>
<p><a class="external" href="https://ci.arvados.org/view/Developer/job/developer-run-tests/1795/"<a href="https://ci.arvados.org/view/Developer/job/developer-run-tests/1795/">developer-run-tests: #1795 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1795" alt="" /></a></a></p>
<ul>
<li>Adds bypass_federation flag, only usable by admins, to disable federation behavior and get responses only from the local cluster database</li>
<li>arv-federation-migrate uses bypass_federation flag.</li>
<li>passes federation migrate test and federated workflow tests. the federation migrate test also tests federated user listing.</li>
<li>Bumped API revision. arv-federation-migrate checks for new API revision.</li>
</ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=833972020-04-03T22:19:10ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>After lots of struggling, was able to run the federation tests locally, but wasn't able to run the fed migration tests, I think because of OOM issues.</p>
<p>Code looks good, just one comment: <code>bypass_federation</code> param access test is OK, but it doesn’t test the param behavior. It's now possible to make a federation integration test to confirm that the flag works as intended. The federation migrate tests indirectly check this feature but I think a proper specific test would be needed.</p>
<p>Other than that, it LGTM.</p> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=834222020-04-08T12:40:05ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> changed from <i>2020-04-08 Sprint</i> to <i>2020-04-22</i></li></ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=836092020-04-22T13:44:19ZLucas Di Pentimalucas.dipentima@curii.com
<ul><li><strong>Target version</strong> changed from <i>2020-04-22</i> to <i>2020-05-06 Sprint</i></li></ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=836432020-04-22T15:03:29ZLucas Di Pentimalucas.dipentima@curii.com
<ul><li><strong>Assigned To</strong> changed from <i>Lucas Di Pentima</i> to <i>Peter Amstutz</i></li></ul> Arvados - Bug #16263: Cannot list users on federated cluster with LoginCluster sethttps://dev.arvados.org/issues/16263?journal_id=837722020-04-27T13:21:35ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul>