Project

General

Profile

Actions

Bug #16916

closed

Refactor Workbench 2 testing

Added by Daniel Kutyła about 4 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Tests
Target version:
Story points:
-

Description

There are some strange failures:

to see more details please see
developer-tests-workbench2: #104 /console

The WB2 tests still run on the main CI server. Move this to a Jenkins Satellite, which means build a docker image. Will need some refactoring so we don't rebuild the world every time the tests run.


Subtasks 1 (0 open1 closed)

Task #16961: Review 16916-move-wb2-tests-to-jenkins-satellitesResolvedWard Vandewege01/08/2021Actions
Actions #1

Updated by Ward Vandewege about 4 years ago

  • Target version set to 2020-10-07 Sprint
  • Assigned To set to Ward Vandewege
  • Status changed from New to In Progress

The integration tests are failing, somewhere inside the

/root/go/bin/arvados-server boot -type test -config /tmp/workbench2/tools/arvados_config.yml -own-temporary-database -timeout 20m

command. Perhaps some sort of race condition. It shouldn't have errored out in the cleanup function though, I've pushed a patch that resets the pipefail and error mode on the script in the cleanup function.

Actions #2

Updated by Ward Vandewege about 4 years ago

This test is running on the jenkins master. Todo: build a packer image and move it to the satellites.

Actions #3

Updated by Peter Amstutz about 4 years ago

  • Target version changed from 2020-10-07 Sprint to 2020-10-21 Sprint
Actions #4

Updated by Ward Vandewege about 4 years ago

  • Description updated (diff)
  • Subject changed from Workbench 2 cypress test fail before starting to Refactor Workbench 2 testing
Actions #5

Updated by Ward Vandewege about 4 years ago

  • Target version changed from 2020-10-21 Sprint to 2020-11-04 Sprint
Actions #6

Updated by Peter Amstutz about 4 years ago

  • Target version changed from 2020-11-04 Sprint to 2020-11-18
Actions #7

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-11-18 to 2020-12-02 Sprint
Actions #8

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-12-02 Sprint to 2020-12-16 Sprint
Actions #9

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-12-16 Sprint to 2021-01-06 Sprint
Actions #10

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2021-01-06 Sprint to 2021-01-20 Sprint
Actions #11

Updated by Ward Vandewege almost 4 years ago

  • Description updated (diff)
Actions #12

Updated by Ward Vandewege almost 4 years ago

As a first step, I'm moving these tests off to a Jenkins satellite. Packer image generation ready for review at commit:22d40663a3664b5f5e47d37c9b58a20165737c5c on branch 16916-move-wb2-tests-to-jenkins-satellites in the arvados-dev repository.

A build with this image ran at workbench2-run-tests: #591 . It has one error, which I can reproduce locally, so I assume that's a real bug.

Actions #13

Updated by Lucas Di Pentima almost 4 years ago

Ok, I've read a little packer documentation and can say this LGTM. I'm not clear on how these provisioner scripts are called (I guess through google's platform) and if you need me to try this I should make my GCP account ready in terms of permission roles and such, but as you already tested it I suppose further testing isn't needed. :)

In summary, looks good to merge!

Actions #14

Updated by Ward Vandewege almost 4 years ago

Lucas Di Pentima wrote:

Ok, I've read a little packer documentation and can say this LGTM. I'm not clear on how these provisioner scripts are called (I guess through google's platform) and if you need me to try this I should make my GCP account ready in terms of permission roles and such, but as you already tested it I suppose further testing isn't needed. :)

In summary, looks good to merge!

Thanks, will merge. I've added the corresponding Jenkins job to build the image; it's at https://ci.arvados.org/view/Packer%20Images/job/packer-build-jenkins-image-workbench2-tests/

Actions #15

Updated by Ward Vandewege almost 4 years ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF