Bug #15080

Installing arvados-cwl-runner==1.3.1 from PyPi is broken

Added by Peter Amstutz about 2 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Lucas Di Pentima
Category:
-
Target version:
2019-05-08 Sprint
Start date:
04/10/2019
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
-
Release:
Arvados 1.3.2
Release relationship:
Auto

Description

arvados-cwl-runner==1.3.1 depends on ciso8601 < 2.0.0 but has an open-ended dependency on arvados-python-client, so by default pip installs the latest arvados-python-client which depends on ciso8601 >= 2.0.0, resulting in a broken install due to the package version conflict.

Solutions:

  • Make a point release to PyPi of arvados-cwl-runner==1.3.1.1 which has an added version pin to arvados-python-client==1.3.1
  • Stop uploading dev versions to PyPi
  • Future stable releases have corresponding dependencies pinned

Subtasks

Task #15095: Review 15080-acr131-deps-fixResolvedEric Biagiotti

Related issues

Related to Arvados - Bug #15209: Arvados Python packages have corresponding dependencies pinnedResolved05/17/2019

Associated revisions

Revision eab2d735
Added by Lucas Di Pentima about 2 years ago

Merge branch '15080-acr131-deps-fix' into 1.3-dev
Refs #15080

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <>

Revision 72ef9770 (diff)
Added by Peter Amstutz about 2 years ago

Change arvados-python-client to >=1.3.1, <=1.3.99

refs #15080

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

History

#1 Updated by Peter Amstutz about 2 years ago

  • Status changed from New to In Progress

#2 Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)
  • Status changed from In Progress to New
  • Subject changed from Installing arvados-cwl-runner from PyPi is broken to Installing arvados-cwl-runner==1.3.1 from PyPi is broken

#3 Updated by Peter Amstutz about 2 years ago

  • Target version changed from 2019-04-10 Sprint to 2019-04-24 Sprint

#4 Updated by Tom Morris about 2 years ago

  • Assigned To set to Lucas Di Pentima

#6 Updated by Lucas Di Pentima about 2 years ago

  • Status changed from New to In Progress

#7 Updated by Lucas Di Pentima about 2 years ago

Updates at e823102cc - branch 15080-acr131-deps-fix

Branched off 1.3.1 & updated the python client dependency to arvados-python-client==1.3.1. This branch should be the hotfix for a-c-r 1.3.1.1

#8 Updated by Lucas Di Pentima about 2 years ago

I'm having issues with using corresponding versions on dependencies. For example: making arvados-cwl-runner 1.3.1.20190404204419 ask for arvados-python-client 1.3.1.20190404204419 because when trying to build the package using virtualenv, pip tries to download the dependency that it isn't uploaded yet on PyPi.

I suppose it may be possible to ask pip to pre-install the dependency (arvados-python-client) from a local source, but I'm not sure yet if this means having to fiddle with docker volumes, to grant the docker container access to the .tar.gz file

#9 Updated by Lucas Di Pentima about 2 years ago

Regarding not uploading dev versions to PyPi, isn't that detrimental to our dev workflow?

#10 Updated by Tom Morris about 2 years ago

  • Release set to 23

#11 Updated by Lucas Di Pentima about 2 years ago

  • Target version changed from 2019-04-24 Sprint to 2019-05-08 Sprint

#12 Updated by Lucas Di Pentima about 2 years ago

  • Target version changed from 2019-05-08 Sprint to 2019-05-22 Sprint

#13 Updated by Lucas Di Pentima about 2 years ago

  • Status changed from In Progress to Resolved
  • Target version changed from 2019-05-22 Sprint to 2019-05-08 Sprint

Resolving this ticket -- The last bulletpoint will be done on another.

#14 Updated by Lucas Di Pentima about 2 years ago

  • Related to Bug #15209: Arvados Python packages have corresponding dependencies pinned added

Also available in: Atom PDF