Project

General

Profile

Actions

Support #20544

closed

Give more resources to the cypress wb2 test runner

Added by Peter Amstutz about 1 year ago. Updated 10 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Tests
Target version:
Due date:
Story points:
-
Actions #1

Updated by Peter Amstutz about 1 year ago

  • Target version changed from Development 2023-06-07 to Development 2023-06-21 sprint
Actions #2

Updated by Peter Amstutz 12 months ago

  • Assigned To set to Lucas Di Pentima
Actions #3

Updated by Peter Amstutz 11 months ago

  • Target version changed from Development 2023-06-21 sprint to Development 2023-07-05 sprint
Actions #4

Updated by Peter Amstutz 11 months ago

  • Target version changed from Development 2023-07-05 sprint to Development 2023-07-19 sprint
Actions #5

Updated by Peter Amstutz 11 months ago

  • Target version changed from Development 2023-07-19 sprint to Development 2023-08-02 sprint
Actions #6

Updated by Peter Amstutz 10 months ago

  • Target version changed from Development 2023-08-02 sprint to Development 2023-08-16
Actions #7

Updated by Peter Amstutz 10 months ago

  • Target version changed from Development 2023-08-16 to Development 2023-08-30
Actions #8

Updated by Peter Amstutz 10 months ago

  • Target version changed from Development 2023-08-30 to Development 2023-08-16
Actions #9

Updated by Lucas Di Pentima 10 months ago

  • Status changed from New to In Progress
Actions #10

Updated by Lucas Di Pentima 10 months ago

Baseline data

Current instance types for wb2 cypress tests at https://ci.arvados.org/view/Developer/job/developer-tests-workbench2/ are: n2-standard-4
Last runs took around 25 minutes to succeed.

Tests performed

VM Type name Run time Time savings Standard price Spot price
n2-standard-4 25 mins 0% $0.1942/h $0.04708/h
n2d-standard-4 22 mins 8% $0.1690/h $0.025488/h
n2d-highcpu-8 20 mins 20% $0.249504/h $0.037632/h
t2d-standard-4 20 mins 20% $0.168984/h $0.026764/h
t2d-standard-8 18 mins 28% $0.337968/h $0.053528/h
t2d-standard-16 18 mins 28% $0.675936/h $0.107056/h

Notes:

For the t2d-standard-8 case, I tested normal and spot instances. Spot instances worked ok, I think it's worth trying them.
If we want to save time while not spending more money, we should use the t2d-standard-4 instances.

The t2d types assign 1 whole core per vCPU, while the n2d types assign 1 core thread per vCPU, so multithreaded apps benefit from t2d instances.

I've also tried to run the pipeline using c2 and c3 instance types, but they failed to even start, I haven't found any information about their architecture but maybe they're not x86 compatible?

Actions #11

Updated by Lucas Di Pentima 10 months ago

I left Jenkins configured so that it uses t2d-standard-8 Spot instances.

Actions #12

Updated by Lucas Di Pentima 10 months ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF