Project

General

Profile

Actions

Support #20838

open

Discontinue OS packages of client tools in favor of pypi/rubygems only

Added by Peter Amstutz 4 months ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Deployment
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

End users generally install from PyPi or Rubygems instead of using OS packages for client tools. This is because the OS packages have more friction: they require setting up the Arvados package repository and being root in order to install.

Meanwhile, building client packages for older OS versions with older Python/Ruby interpreters is a hassle. For example, a Python dependency drops support for an out-of-support Python (e.g. 3.6) then we have to pin an older version, fork the package, or resolve it some other way.

This is less of a problem for services -- we don't have any services that use Python, and our installer installs a specific Ruby version using rvm.

Specifically, this includes

  • python3-arvados-python-client
  • python3-arvados-cwl-runner
  • python3-arvados-fuse
  • python3-crunchstat-summary
  • python3-arvados-user-activity (I don't think this one is on PyPi yet)
  • python3-cwltest (IDK why we are packaging this in the first place)

Tasks:

  1. Announce that the client OS packages will no longer be published
  2. Remove them from the build scripts
  3. Update the documentation to only provide instructions to install from PyPi

Related issues

Related to Arvados - Story #20727: Publish standalone binaries for arvados-client, other Go client toolsNew

Actions
Related to Arvados Epics - Story #20344: Arvados 3.0New08/01/202312/31/2023

Actions
Related to Arvados - Bug #21087: Python 3.7 deprecationNew

Actions
Blocked by Arvados - Support #20875: Deprecate OS packages for client toolsFeedbackPeter Amstutz

Actions
Actions #1

Updated by Peter Amstutz 4 months ago

  • Category set to Deployment
Actions #2

Updated by Peter Amstutz 4 months ago

  • Related to Story #20727: Publish standalone binaries for arvados-client, other Go client tools added
Actions #3

Updated by Peter Amstutz 4 months ago

Actions #4

Updated by Peter Amstutz 4 months ago

  • Description updated (diff)
Actions #5

Updated by Peter Amstutz 4 months ago

  • Description updated (diff)
Actions #6

Updated by Peter Amstutz 4 months ago

  • Blocked by Support #20875: Deprecate OS packages for client tools added
Actions #7

Updated by Brett Smith 4 months ago

What is the plan for installing shell nodes after this ticket is done? If these tools get installed via pip/gem there now too, how do the tools get into users' $PATH?

What about arvados-docker-cleaner? That's a Python service, installed on compute nodes.

Actions #8

Updated by Brett Smith 16 days ago

  • Related to Bug #21087: Python 3.7 deprecation added
Actions

Also available in: Atom PDF