https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422015-01-07T21:22:20ZArvadosArvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=198152015-01-07T21:22:20ZTim Piercetwp@curoverse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Assigned To</strong> set to <i>Tim Pierce</i></li><li><strong>Target version</strong> set to <i>2015-01-28 Sprint</i></li><li><strong>Story points</strong> set to <i>0.5</i></li></ul> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=198382015-01-08T16:47:09ZTom Cleggtom@curii.com
<ul></ul><p>Do we just need to add <code>"-I"</code> here? <a class="source" href="https://dev.arvados.org/projects/arvados/repository/arvados/entry/sdk/cli/bin/crunch-job#L1849">source:sdk/cli/bin/crunch-job#L1849</a><br /><pre><code class="perl syntaxhl"><span class="nv">shell_or_die</span><span class="p">("</span><span class="si">$venv_dir</span><span class="s2">/bin/pip</span><span class="p">",</span> <span class="p">"</span><span class="s2">--quiet</span><span class="p">",</span> <span class="p">"</span><span class="s2">install</span><span class="p">",</span> <span class="nv">$python_src</span><span class="p">);</span>
</code></pre></p> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=198392015-01-08T16:48:40ZTom Cleggtom@curii.com
<ul></ul><p>(This is probably fallout from changing the version format from worked-for-a-while 0.1.date.commit to PEP440-compliant 0.1.date+commit.)</p> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=198452015-01-08T19:02:36ZTim Piercetwp@curoverse.com
<ul></ul><p>Tom Clegg wrote:</p>
<blockquote>
<p>(This is probably fallout from changing the version format from worked-for-a-while 0.1.date.commit to PEP440-compliant 0.1.date+commit.)</p>
</blockquote>
<p>It's not the arvados-python-client version number that it's whinging about, it's google-api-python-client. (Or do you mean that because we're using a properly formatted version number now for Arvados, it's better able to handle client dependencies and therefore exposing cases like this that would not have otherwise seen daylight? I guess something like that is possible?)</p>
<p>Either way -- I can't think of any reason I wouldn't use <code>pip install -I</code> any time I encounter this by hand, so I can't see any reason not to make that the default.</p> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=200982015-01-16T20:55:09ZTim Piercetwp@curoverse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li></ul><p>Applied in changeset arvados|commit:59963e1ee432a51a3f7ae3d98068a541b2738879.</p> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=201042015-01-16T21:29:56ZTim Piercetwp@curoverse.com
<ul><li><strong>Subject</strong> changed from <i>google-api-python-client fails to install</i> to <i>[Crunch] google-api-python-client fails to install</i></li><li><strong>Category</strong> set to <i>Crunch</i></li></ul> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=201052015-01-16T21:40:59ZTim Piercetwp@curoverse.com
<ul><li><strong>Status</strong> changed from <i>Resolved</i> to <i>Feedback</i></li></ul> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=201342015-01-19T15:31:05ZTim Piercetwp@curoverse.com
<ul></ul><p>Moved to state 'feedback' so we can confirm the fix once deployed.</p> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=207072015-01-29T19:41:11ZTom Cleggtom@curii.com
<ul><li><strong>Assigned To</strong> changed from <i>Tim Pierce</i> to <i>Brett Smith</i></li></ul> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=207502015-01-29T21:37:55ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>New</i></li><li><strong>Target version</strong> changed from <i>2015-01-28 Sprint</i> to <i>2015-02-18 sprint</i></li></ul><p><a href="https://arvadosapi.com/qr1hi-8i9sb-o9719vud1ro9wzh">qr1hi-8i9sb-o9719vud1ro9wzh</a> successfully reproduced the issue. Unfortunately this is not fixed.</p> Arvados - Bug #4922: [Crunch] google-api-python-client fails to installhttps://dev.arvados.org/issues/4922?journal_id=207532015-01-30T15:01:40ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Resolved</i></li></ul><p>The original job didn't specify an arvados_sdk_version, so changing crunch-job's install process for that would not change anything. My reproducing job did specify an arvados_sdk_version, but <code>pip -I</code> was still a noop because the Docker image doesn't include virtualenv.</p>
<p>The problem is simply that the Docker image has both the <code>apiclient</code> and <code>googleapiclient</code> modules installed. As long as that's true, this exception will be raised on import. There's nothing we can do about it on the Crunch level.</p>
<p>Bryan, I believe you've effectively worked around this by adding virtualenv to the image and using <code>arvados_sdk_version</code>, but next time you're in there, you might want to clean up by removing the old <code>apiclient</code> Python module (<code>pip uninstall apiclient</code>) in favor of <code>googleapiclient</code>. Let me know if you have any questions about it.</p>