Project

General

Profile

Actions

Idea #17246

closed

Single node salt install improvements

Added by Peter Amstutz almost 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Javier Bértoli
Category:
-
Start date:
03/31/2021
Due date:
Story points:
-
Release relationship:
Auto

Description

From discussion 7 January 2021

  • Instead of arva2, choose a random cluster id or get one from the user
  • Instead of using arva2.arv.local the provision script should use the host's FQDN or get the hostname from the user
  • To avoid the need for virtual hosts, put workbench (1 or 2) on the https port and put other services on alternate ports
  • Confirm that running the provision script on an basic EC2 instance results in an arvados install with a workbench that can be logged into & can run stuff

Subtasks 1 (0 open1 closed)

Task #17509: review 17246-salt-install-improvementsResolvedLucas Di Pentima03/31/2021Actions

Related issues 2 (1 open1 closed)

Blocked by Arvados - Bug #17398: [crunch-dispatch-local] [crunch-run] error starting gateway server: missing port in addressResolvedTom Clegg02/18/2021Actions
Blocks Arvados - Support #17320: Explain what additonal configuration is needed for provision.sh to go to productionNewPeter AmstutzActions
Actions #1

Updated by Peter Amstutz almost 4 years ago

  • Status changed from New to In Progress
Actions #2

Updated by Peter Amstutz almost 4 years ago

  • Description updated (diff)
Actions #3

Updated by Peter Amstutz almost 4 years ago

  • Description updated (diff)
Actions #4

Updated by Peter Amstutz almost 4 years ago

  • Description updated (diff)
Actions #5

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2021-01-20 Sprint to 2021-02-03 Sprint
Actions #6

Updated by Peter Amstutz almost 4 years ago

  • Description updated (diff)
Actions #7

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2021-02-03 Sprint to 2021-02-17 sprint
Actions #8

Updated by Javier Bértoli almost 4 years ago

  • % Done changed from 0 to 80

Uploaded code, commit dda765028@arvados, branch 17246-salt-install-improvements.

The script expects the user to create a local.params file where these parameters can be set.

Added support to specify individual 'arvados roles' to deploy to a node, allowing to use this script to do a multi-hosts deploy.

Actions #9

Updated by Javier Bértoli almost 4 years ago

  • Blocked by Bug #17398: [crunch-dispatch-local] [crunch-run] error starting gateway server: missing port in address added
Actions #10

Updated by Javier Bértoli almost 4 years ago

  • Blocks Support #17320: Explain what additonal configuration is needed for provision.sh to go to production added
Actions #11

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2021-02-17 sprint to 2021-03-03 sprint
Actions #12

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2021-03-03 sprint to 2021-03-17 sprint
Actions #13

Updated by Javier Bértoli almost 4 years ago

  • Target version changed from 2021-03-17 sprint to 2021-03-31 sprint
Actions #14

Updated by Javier Bértoli almost 4 years ago

Updated code and documentation for multi-host installation (commit e7d596806@arvados, branch 17246-salt-install-improvements)

Actions #15

Updated by Javier Bértoli over 3 years ago

  • % Done changed from 80 to 100
  • Target version changed from 2021-03-31 sprint to 2021-04-14 sprint
  • Status changed from In Progress to Resolved

Single node install works correctly, expecting review.

Actions #16

Updated by Javier Bértoli over 3 years ago

  • Status changed from Resolved to In Progress
Actions #17

Updated by Lucas Di Pentima over 3 years ago

Reviewing 6587faf - branch 17246-salt-install-improvements

Tried to follow the instructions for a single host / single hostname install by creating a new debian 10 VM.

  • In file doc/install/salt.html.textile.liquid there's a mention of arvados-formula URL from the arvados repo, but in the README.md file still points to the saltstack-formulas repo.
  • There's a typo at doc/install/salt-single-host.html.textile.liquid line 40: 'asigning'
  • Instructions say to run the provision.sh script without any param, but I found that I needed to add -c local.params for it to run. At least I think the script should error out when the CONFIG_FILE var is empty string instead of just trying to run source ''
  • Eventually I got the following error:
...
[INFO    ] Fetching file from saltenv 'base', ** done ** 'arvados/dispatcher/service/file.sls'
[INFO    ] Fetching file from saltenv 'base', ** done ** 'arvados/dispatcher/service/running.sls'
local:
    Data failed to compile:
----------
    No matching sls found for 'nginx.passenger' in env 'base'
+ '[' xyes = xyes ']'
+ echo 'Removing .psql file'
Removing .psql file
+ rm /root/.psqlrc
+ '[' x = xyes ']'
+ echo 'Copying the Arvados CA certificate to the installer dir, so you can import it'
Copying the Arvados CA certificate to the installer dir, so you can import it
+ '[' x = xyes ']'
+ cp /etc/ssl/certs/arvados-snakeoil-ca.pem /home/lucas/arvados/tools/salt-install/lucas.arvados.local-arvados-snakeoil-ca.pem
cp: cannot stat '/etc/ssl/certs/arvados-snakeoil-ca.pem': No such file or directory
+ '[' x = xyes ']'
Actions #18

Updated by Javier Bértoli over 3 years ago

commit dde8a2e6a, branch 17246-salt-install-improvements

Actions #19

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2021-04-14 sprint to 2021-04-28 bughunt sprint
Actions #20

Updated by Lucas Di Pentima over 3 years ago

17246-salt-install-improvements LGTM, thanks!

Actions #21

Updated by Javier Bértoli over 3 years ago

  • Status changed from In Progress to Resolved

Merged

Actions #22

Updated by Peter Amstutz over 3 years ago

  • Release set to 38
Actions

Also available in: Atom PDF