Bug #16151

Python SDK dependency rule sabotages tests

Added by Tom Clegg over 1 year ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-
Release relationship:
Auto

Description

source:sdk/cwl and other arvados packages that import the python SDK have a dynamic dependency rule in setup.py (when not building a released package like 1.4.3), arvados-python-client <= V where V is the prerelease version of the importing package, corresponding to the latest commit in that package.

Meanwhile, run-tests uses the following approach:
  • install the current python sdk to virtualenv
  • install the other python packages (and their dependencies) to virtualenv
  • now that all dependencies are installed, test all python packages

The desired result is that the latest versions of all python packages are tested with the latest python SDK.

When the importing package is newer than the python SDK, it works:
  • install sdk/python, 1.5.0.dev20200212153748
  • install sdk/cwl, requires arvados-python-client <= 1.5.0.dev20200213025007, already satisfied
When the python SDK is newer than the importing package, it breaks:
  • install sdk/python, 1.5.0.dev20200212153748
  • install sdk/cwl, requires arvados-python-client <= 1.5.0.dev20200123220959, not satisfied by the installed version 1.5.0.dev20200212153748, so pip downgrades to the latest qualifying version from pypi, which is 1.4.3
  • sdk/cwl, sdk/pam, tools/crunchstat-summary test suites run with python sdk 1.4.3, instead of the current version

Associated revisions

Revision 41a79db7 (diff)
Added by Peter Amstutz over 1 year ago

Nodemanager and crunchstat-summary sync with pysdk version

refs #16151

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

Revision 318a73e6
Added by Peter Amstutz over 1 year ago

Merge branch '16177-trust-all-content'

refs #16177
refs #16151

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

Revision 7658be24 (diff)
Added by Peter Amstutz over 1 year ago

Nodemanager and crunchstat-summary sync with pysdk version

refs #16151

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

History

#1 Updated by Peter Amstutz over 1 year ago

  • Target version set to 2020-03-11 Sprint
  • Assigned To set to Peter Amstutz

#2 Updated by Peter Amstutz over 1 year ago

  • Status changed from New to Resolved

#3 Updated by Peter Amstutz over 1 year ago

  • Release set to 29

Also available in: Atom PDF