Bug #16916

Refactor Workbench 2 testing

Added by Daniel KutyƂa about 1 year ago. Updated 9 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Tests
Target version:
Start date:
01/08/2021
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
-

Description

There are some strange failures:

to see more details please see
https://ci.arvados.org/job/developer-tests-workbench2/104/console

The WB2 tests still run on the main CI server. Move this to a Jenkins Satellite, which means build a docker image. Will need some refactoring so we don't rebuild the world every time the tests run.


Subtasks

Task #16961: Review 16916-move-wb2-tests-to-jenkins-satellitesResolvedWard Vandewege

Associated revisions

Revision 34d0c5b9
Added by Ward Vandewege 9 months ago

Merge branch '16916-move-wb2-tests-to-jenkins-satellites'

closes #16916

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

History

#1 Updated by Ward Vandewege about 1 year ago

  • Target version set to 2020-10-07 Sprint
  • Assigned To set to Ward Vandewege
  • Status changed from New to In Progress

The integration tests are failing, somewhere inside the

/root/go/bin/arvados-server boot -type test -config /tmp/workbench2/tools/arvados_config.yml -own-temporary-database -timeout 20m

command. Perhaps some sort of race condition. It shouldn't have errored out in the cleanup function though, I've pushed a patch that resets the pipefail and error mode on the script in the cleanup function.

#2 Updated by Ward Vandewege about 1 year ago

This test is running on the jenkins master. Todo: build a packer image and move it to the satellites.

#3 Updated by Peter Amstutz about 1 year ago

  • Target version changed from 2020-10-07 Sprint to 2020-10-21 Sprint

#4 Updated by Ward Vandewege about 1 year ago

  • Description updated (diff)
  • Subject changed from Workbench 2 cypress test fail before starting to Refactor Workbench 2 testing

#5 Updated by Ward Vandewege 12 months ago

  • Target version changed from 2020-10-21 Sprint to 2020-11-04 Sprint

#6 Updated by Peter Amstutz 12 months ago

  • Target version changed from 2020-11-04 Sprint to 2020-11-18

#7 Updated by Peter Amstutz 11 months ago

  • Target version changed from 2020-11-18 to 2020-12-02 Sprint

#8 Updated by Peter Amstutz 11 months ago

  • Target version changed from 2020-12-02 Sprint to 2020-12-16 Sprint

#9 Updated by Peter Amstutz 10 months ago

  • Target version changed from 2020-12-16 Sprint to 2021-01-06 Sprint

#10 Updated by Peter Amstutz 9 months ago

  • Target version changed from 2021-01-06 Sprint to 2021-01-20 Sprint

#11 Updated by Ward Vandewege 9 months ago

  • Description updated (diff)

#12 Updated by Ward Vandewege 9 months ago

As a first step, I'm moving these tests off to a Jenkins satellite. Packer image generation ready for review at commit:22d40663a3664b5f5e47d37c9b58a20165737c5c on branch 16916-move-wb2-tests-to-jenkins-satellites in the arvados-dev repository.

A build with this image ran at https://ci.arvados.org/job/workbench2-run-tests/591. It has one error, which I can reproduce locally, so I assume that's a real bug.

#13 Updated by Lucas Di Pentima 9 months ago

Ok, I've read a little packer documentation and can say this LGTM. I'm not clear on how these provisioner scripts are called (I guess through google's platform) and if you need me to try this I should make my GCP account ready in terms of permission roles and such, but as you already tested it I suppose further testing isn't needed. :)

In summary, looks good to merge!

#14 Updated by Ward Vandewege 9 months ago

Lucas Di Pentima wrote:

Ok, I've read a little packer documentation and can say this LGTM. I'm not clear on how these provisioner scripts are called (I guess through google's platform) and if you need me to try this I should make my GCP account ready in terms of permission roles and such, but as you already tested it I suppose further testing isn't needed. :)

In summary, looks good to merge!

Thanks, will merge. I've added the corresponding Jenkins job to build the image; it's at https://ci.arvados.org/view/Packer%20Images/job/packer-build-jenkins-image-workbench2-tests/

#15 Updated by Ward Vandewege 9 months ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF