Bug #11973

[CWL] package-builder fails on schema-salad>=2.6

Added by Tom Clegg 4 months ago. Updated 4 months ago.

Status:ResolvedStart date:07/14/2017
Priority:NormalDue date:
Assignee:Tom Clegg% Done:

0%

Category:-
Target version:2017-07-19 sprint
Story points-
Velocity based estimate-

Description

Short version:

error in schema-salad setup command: Invalid environment marker: python_version>="3" 

Long version:

$ docker run -it --rm arvados/build:debian8  bash -c "/usr/local/rvm/bin/rvm-exec default fpm --debug --maintainer='Ward Vandewege <ward@curoverse.com>' -s python -t deb --deb-ignore-iteration-in-dependencies -v 2.6.20170630075932 --iteration 2 --depends 'python-lockfile >= 1:0.12.2-2' --python-bin python2.7 --python-easyinstall easy_install-2.7 --python-package-name-prefix python --prefix /usr --python-install-lib lib/python2.7/dist-packages --python-install-data . --exclude lib/python2.7/dist-packages/tests --depends python2.7 schema_salad" 

...

Running command {:args=>["/bin/sh", "-c", "python2.7 -c 'try:\n  import json\nexcept ImportError:\n  import simplejson as json'"], :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"144", :method=>"execmd"}
Process is running {:pid=>185, :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"162", :method=>"execmd"}
Running command {:args=>["/bin/sh", "-c", "python2.7 -c 'import pkg_resources'"], :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"144", :method=>"execmd"}
Process is running {:pid=>189, :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"162", :method=>"execmd"}
fetching package metadata {:setup_cmd=>"env PYTHONPATH=/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package python2.7 setup.py --command-packages=pyfpm get_metadata --output=/tmp/package-python-build20170714-1-x1pfj4/metadata.json", :level=>:info, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package/python.rb", :line=>"196", :method=>"block in load_package_info"}
Running command {:args=>["/bin/sh", "-c", "env PYTHONPATH=/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package python2.7 setup.py --command-packages=pyfpm get_metadata --output=/tmp/package-python-build20170714-1-x1pfj4/metadata.json"], :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"144", :method=>"execmd"}
Process is running {:pid=>193, :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/util.rb", :line=>"162", :method=>"execmd"}
error in schema-salad setup command: Invalid environment marker: python_version>="3" {:level=>:info, :file=>"cabin/mixins/pipe.rb", :line=>"47", :method=>"block in pipe"}
Process failed: /bin/sh failed (exit code 1). Full command was:["/bin/sh", "-c", "env PYTHONPATH=/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package python2.7 setup.py --command-packages=pyfpm get_metadata --output=/tmp/package-python-build20170714-1-x1pfj4/metadata.json"] {:level=>:error, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/command.rb", :line=>"498", :method=>"rescue in execute"}
Cleaning up staging path {:path=>"/tmp/package-python-staging20170714-1-1og11j1", :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package.rb", :line=>"279", :method=>"cleanup_staging"}
Cleaning up build path {:path=>"/tmp/package-python-build20170714-1-x1pfj4", :level=>:debug, :file=>"/usr/local/rvm/gems/ruby-2.3.3/gems/cure-fpm-1.6.0b/lib/fpm/package.rb", :line=>"286", :method=>"cleanup_build"}

Associated revisions

Revision 96ae27be
Added by Tom Clegg 4 months ago

11973: Upgrade setuptools in package-builder images.

Old versions of setuptools cannot build a schema-salad package.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 6ff6c7a3
Added by Tom Clegg 4 months ago

11973: Set DEBIAN_FRONTEND=noninteractive in pkg-build/test images.

Clean up some unnecessary inconsistencies in Dockerfiles.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 41f48ea2
Added by Tom Clegg 4 months ago

11973: Build avro 1.8.1 for ubuntu1604 and add to schema-salad deps.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision bf87f4ab
Added by Tom Clegg 4 months ago

11973: Tweak fpm dependency spec.

refs #11973

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

History

#1 Updated by Tom Clegg 4 months ago

  • Description updated (diff)

Upgrading setuptools helps:

$ docker run -it --rm arvados/build:debian8  bash -c "pip install --upgrade setuptools; /usr/local/rvm/bin/rvm-exec default fpm --debug --maintainer='Ward Vandewege <ward@curoverse.com>' -s python -t deb --deb-ignore-iteration-in-dependencies -v 2.6.20170630075932 --iteration 2 --depends 'python-lockfile >= 1:0.12.2-2' --python-bin python2.7 --python-easyinstall easy_install-2.7 --python-package-name-prefix python --prefix /usr --python-install-lib lib/python2.7/dist-packages --python-install-data . --exclude lib/python2.7/dist-packages/tests --depends python2.7 schema_salad" 

...

Created package {:path=>"python-schema-salad_2.6.20170630075932-2_all.deb", :file=>"clamp/command.rb", :line=>"68", :method=>"run"}

#2 Updated by Tom Clegg 4 months ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF