Feature #16319

packer build for jenkins images updated to use arvados-server install

Added by Peter Amstutz about 2 months ago. Updated 13 days ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
05/20/2020
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
-

Description

The gist of this is that the installation steps in:

packer/jenkins/run_jenkins-slave-image-run-tests.sh

should (as much as possible) be replaced with something like:

git clone https://git.arvados.org/arvados.git
cd arvados
go mod download
go run ./cmd/arvados-server install -type development

Subtasks

Task #16320: ReviewResolvedWard Vandewege

Associated revisions

Revision 988181fd
Added by Tom Clegg 14 days ago

Merge branch '16319-set-test-db-collation'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 8fde8543 (diff)
Added by Tom Clegg 14 days ago

Restart postgresql before trying to create missing collation.

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 37e9825a
Added by Tom Clegg 13 days ago

Merge branch '16319-set-test-db-collation'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

Revision 82357c20
Added by Tom Clegg 13 days ago

Merge branch '16319-timestamp-precision'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

History

#1 Updated by Peter Amstutz about 2 months ago

  • Assigned To set to Javier Bértoli

#2 Updated by Peter Amstutz about 1 month ago

  • Target version changed from 2020-04-22 to 2020-05-06 Sprint

#3 Updated by Peter Amstutz about 1 month ago

  • Description updated (diff)

#4 Updated by Peter Amstutz 27 days ago

  • Target version changed from 2020-05-06 Sprint to 2020-05-20 Sprint

#5 Updated by Peter Amstutz 19 days ago

  • Assigned To changed from Javier Bértoli to Ward Vandewege

#6 Updated by Ward Vandewege 13 days ago

  • Status changed from New to In Progress

Ready for review at commit:1a330c6a87b93349fabe10789f287707e3bab7ad on branch 16319-unify-build-dependencies in the packer repo.

#7 Updated by Peter Amstutz 13 days ago

  • Target version changed from 2020-05-20 Sprint to 2020-06-03 Sprint

#8 Updated by Tom Clegg 13 days ago

In jenkins/node-ready.sh
  • should probably add "set -eo pipefail", even if it means ignoring errors explicitly in some places (perhaps "systemctl enable ... || true" ?)
  • the "nc" loop with RETVAL looks like it could be simplified to something like
    while ! nc -w1 -z git.arvados.org 22; do
      echo "..." 
      sleep 1
    done
    echo "connected!" 
    
  • could DRY the /tmp/boot-wait.log stuff (copy all stdout and stderr to log) by putting this delightful bit of bash at the top:
    exec > >(tee -a /tmp/boot-wait.log) 2>&1
    
In jenkins/run_jenkins-slave-image-run-tests.sh
  • sudo go run ./cmd/arvados-server install -type development should be -type test (although they currently do the same thing)
  • Does "chown jenkins:jenkins arvados.git" really do anything useful, without -R?
  • arvados-server install installs go binaries to /usr/local/bin/ so having a possibly-different version in /usr/bin/go might get confusing one day. Maybe delete "ln -s /usr/lib/go-1.14/bin/go /usr/bin/go" here, and invoke it explicitly as "/usr/lib/go-1.14/bin/go run ./cmd/arvados-server ..." instead?

#9 Updated by Ward Vandewege 13 days ago

Tom Clegg wrote:

In jenkins/node-ready.sh
  • should probably add "set -eo pipefail", even if it means ignoring errors explicitly in some places (perhaps "systemctl enable ... || true" ?)
  • the "nc" loop with RETVAL looks like it could be simplified to something like
    [...]
  • could DRY the /tmp/boot-wait.log stuff (copy all stdout and stderr to log) by putting this delightful bit of bash at the top:
    [...]
In jenkins/run_jenkins-slave-image-run-tests.sh
  • sudo go run ./cmd/arvados-server install -type development should be -type test (although they currently do the same thing)
  • Does "chown jenkins:jenkins arvados.git" really do anything useful, without -R?
  • arvados-server install installs go binaries to /usr/local/bin/ so having a possibly-different version in /usr/bin/go might get confusing one day. Maybe delete "ln -s /usr/lib/go-1.14/bin/go /usr/bin/go" here, and invoke it explicitly as "/usr/lib/go-1.14/bin/go run ./cmd/arvados-server ..." instead?

OK, everything incorporated at commit:14b4c53c0f4ae577da2c3b7ba71b824dfc05963d

#10 Updated by Ward Vandewege 13 days ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF