Bug #11973

[CWL] package-builder fails on schema-salad>=2.6

Added by Tom Clegg 6 months ago. Updated 6 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
07/14/2017
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Short version:

error in schema-salad setup command: Invalid environment marker: python_version>="3" 

Long version:

$ docker run -it --rm arvados/build:debian8  bash -c "/usr/local/rvm/bin/rvm-exec default fpm --debug --maintainer='Ward Vandewege <ward@curoverse.com>' -s python -t deb --deb-ignore-iteration-in-dependencies -v 2.6.20170630075932 --iteration 2 --depends 'python-lockfile >= 1:0.12.2-2' --python-bin python2.7 --python-easyinstall easy_install-2.7 --python-package-name-prefix python --prefix /usr --python-install-lib lib/python2.7/dist-packages --python-install-data . --exclude lib/python2.7/dist-packages/tests --depends python2.7 schema_salad" 

...

Running command {:args=>["/bin/sh", "-c", "python2.7 -c 'try:\n  import json\nexcept ImportError:\n  import simplejson as json'"], :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"144", :method=>"execmd"}
Process is running {:pid=>185, :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"162", :method=>"execmd"}
Running command {:args=>["/bin/sh", "-c", "python2.7 -c 'import pkg_resources'"], :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"144", :method=>"execmd"}
Process is running {:pid=>189, :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"162", :method=>"execmd"}
fetching package metadata {:setup_cmd=>"env PYTHONPATH=/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package python2.7 setup.py --command-packages=pyfpm get_metadata --output=/tmp/package-python-build20170714-1-x1pfj4/metadata.json", :level=>:info, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package/python.rb", :line=>"196", :method=>"block in load_package_info"}
Running command {:args=>["/bin/sh", "-c", "env PYTHONPATH=/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package python2.7 setup.py --command-packages=pyfpm get_metadata --output=/tmp/package-python-build20170714-1-x1pfj4/metadata.json"], :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"144", :method=>"execmd"}
Process is running {:pid=>193, :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"162", :method=>"execmd"}
error in schema-salad setup command: Invalid environment marker: python_version>="3" {:level=>:info, :file=>"cabin/mixins/pipe.rb", :line=>"47", :method=>"block in pipe"}
Process failed: /bin/sh failed (exit code 1). Full command was:["/bin/sh", "-c", "env PYTHONPATH=/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package python2.7 setup.py --command-packages=pyfpm get_metadata --output=/tmp/package-python-build20170714-1-x1pfj4/metadata.json"] {:level=>:error, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/command.rb", :line=>"498", :method=>"rescue in execute"}
Cleaning up staging path {:path=>"/tmp/package-python-staging20170714-1-1og11j1", :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package.rb", :line=>"279", :method=>"cleanup_staging"}
Cleaning up build path {:path=>"/tmp/package-python-build20170714-1-x1pfj4", :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package.rb", :line=>"286", :method=>"cleanup_build"}

Associated revisions

Revision 96ae27be (diff)
Added by Tom Clegg 6 months ago

11973: Upgrade setuptools in package-builder images.

Old versions of setuptools cannot build a schema-salad package.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 6ff6c7a3 (diff)
Added by Tom Clegg 6 months ago

11973: Set DEBIAN_FRONTEND=noninteractive in pkg-build/test images.

Clean up some unnecessary inconsistencies in Dockerfiles.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 41f48ea2 (diff)
Added by Tom Clegg 6 months ago

11973: Build avro 1.8.1 for ubuntu1604 and add to schema-salad deps.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision bf87f4ab (diff)
Added by Tom Clegg 6 months ago

11973: Tweak fpm dependency spec.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

History

#1 Updated by Tom Clegg 6 months ago

  • Description updated (diff)

Upgrading setuptools helps:

$ docker run -it --rm arvados/build:debian8  bash -c "pip install --upgrade setuptools; /usr/local/rvm/bin/rvm-exec default fpm --debug --maintainer='Ward Vandewege <ward@curoverse.com>' -s python -t deb --deb-ignore-iteration-in-dependencies -v 2.6.20170630075932 --iteration 2 --depends 'python-lockfile >= 1:0.12.2-2' --python-bin python2.7 --python-easyinstall easy_install-2.7 --python-package-name-prefix python --prefix /usr --python-install-lib lib/python2.7/dist-packages --python-install-data . --exclude lib/python2.7/dist-packages/tests --depends python2.7 schema_salad" 

...

Created package {:path=>"python-schema-salad_2.6.20170630075932-2_all.deb", :file=>"clamp/command.rb", :line=>"68", :method=>"run"}

#2 Updated by Tom Clegg 6 months ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF