https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422015-09-16T15:02:50ZArvadosArvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=302892015-09-16T15:02:50ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Target version</strong> set to <i>Arvados Future Sprints</i></li></ul> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=304052015-09-22T18:13:29ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Story points</strong> set to <i>0.5</i></li></ul><p>Believe this can be done in half a point. Please do investigate why fpm isn't picking up the dependencies, but if that starts taking a while, go ahead and use the fpm-info solution, which should be straightforward.</p>
<p>Separate question: why are we even backporting this? It's widely available, and AFAIK we don't have any dependency on a specific version of virtualenv.</p> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=304072015-09-22T18:19:49ZWard Vandewegeward@curii.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/30407/diff?detail_id=29797">diff</a>)</li></ul> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=304092015-09-22T18:24:12ZWard Vandewegeward@curii.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/30409/diff?detail_id=29798">diff</a>)</li></ul> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=304722015-09-23T21:18:21ZBrett Smithbrett.smith@curii.com
<ul></ul><p>Answers to outstanding questions:</p>
<p>Brett Smith wrote:</p>
<blockquote>
<p>Fix this one way or another. I'm surprised fpm isn't picking them up; it might be worth spending a little time to investigate why that is.</p>
</blockquote>
<p>virtualenv's setup.py can work with either setuptools or distutils. It assumes you're running it on the same system you're building it, so when it builds with setuptools, it doesn't declare its own dependency on setuptools. The bug is virtualenv's.</p>
<blockquote>
<p>We only backport the virtualenv package for debian7, debian8 and ubuntu1204. Looks like this backport was introduced in the very first checkin of the run-build-packages.sh script. Do we even need this backport?</p>
</blockquote>
<p>The Arvados code itself needs virtualenv 1.7. crunch-job uses the <code>--system-site-packages</code> switch, which was added then. At least 1.7 is shipped with all of the distros we support, so a backport doesn't seem to be necessary.</p>
<p>run-tests.sh uses the <code>--setuptools</code> switch, which was added in 1.8.3, which is newer than what's in Debian 7 or Ubuntu 12.04. But this is more of a development dependency than a runtime dependency. We might want to install an fpm-built package on, e.g., our ci server, but I don't see much reason to publish it through our package repositories.</p> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=304962015-09-24T15:59:27ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Assigned To</strong> set to <i>Brett Smith</i></li><li><strong>Target version</strong> changed from <i>Arvados Future Sprints</i> to <i>2015-09-30 sprint</i></li></ul><p>Brett Smith wrote:</p>
<blockquote>
<p>run-tests.sh uses the <code>--setuptools</code> switch, which was added in 1.8.3, which is newer than what's in Debian 7 or Ubuntu 12.04. But this is more of a development dependency than a runtime dependency. We might want to install an fpm-built package on, e.g., our ci server, but I don't see much reason to publish it through our package repositories.</p>
</blockquote>
<p>We're agreed that we're going to do this, so we need to remove the virtualenv packages from our repositories.</p> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=305792015-09-25T14:58:29ZBrett Smithbrett.smith@curii.com
<ul></ul><p>Brett Smith wrote:</p>
<blockquote>
<p>run-tests.sh uses the <code>--setuptools</code> switch, which was added in 1.8.3, which is newer than what's in Debian 7 or Ubuntu 12.04.</p>
</blockquote>
<p>What I said about versions is true, but it looks like Debian patched this switch in earlier and then upstreamed it. Both distros have that <code>--setuptools</code> switch, so the versions of virtualenv they include are good enough for our purposes. Since that means virtualenv works for both running and developing Arvados out of the box, we can just pull the packages without, e.g., testing for this feature in run-tests, or configuring a specific version on our ci server.</p> Arvados - Bug #7322: [Deployment] python-virtualenv backport is missing its dependencieshttps://dev.arvados.org/issues/7322?journal_id=305822015-09-25T15:11:11ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>We no longer build virtualenv packages, and I just pulled the old ones, so this is done.</p>