Support #20544
closed
Give more resources to the cypress wb2 test runner
Updated by Peter Amstutz 11 months ago
- Target version changed from Development 2023-06-07 to Development 2023-06-21 sprint
Updated by Peter Amstutz 10 months ago
- Target version changed from Development 2023-06-21 sprint to Development 2023-07-05 sprint
Updated by Peter Amstutz 10 months ago
- Target version changed from Development 2023-07-05 sprint to Development 2023-07-19 sprint
Updated by Peter Amstutz 10 months ago
- Target version changed from Development 2023-07-19 sprint to Development 2023-08-02 sprint
Updated by Peter Amstutz 9 months ago
- Target version changed from Development 2023-08-02 sprint to Development 2023-08-16
Updated by Peter Amstutz 9 months ago
- Target version changed from Development 2023-08-16 to Development 2023-08-30
Updated by Peter Amstutz 9 months ago
- Target version changed from Development 2023-08-30 to Development 2023-08-16
Updated by Lucas Di Pentima 8 months ago
Baseline data¶
Current instance types for wb2 cypress tests at https://ci.arvados.org/view/Developer/job/developer-tests-workbench2/ are: n2-standard-4
Last runs took around 25 minutes to succeed.
Tests performed¶
| VM Type name | Run time | Time savings | Standard price | Spot price |
| n2-standard-4 | 25 mins | 0% | $0.1942/h | $0.04708/h |
| n2d-standard-4 | 22 mins | 8% | $0.1690/h | $0.025488/h |
| n2d-highcpu-8 | 20 mins | 20% | $0.249504/h | $0.037632/h |
| t2d-standard-4 | 20 mins | 20% | $0.168984/h | $0.026764/h |
| t2d-standard-8 | 18 mins | 28% | $0.337968/h | $0.053528/h |
| t2d-standard-16 | 18 mins | 28% | $0.675936/h | $0.107056/h |
Notes:
- Run times are approximates, can vary a bit from run to run.
- Prices from https://cloud.google.com/compute/vm-instance-pricing)
- Instance types data: https://cloud.google.com/compute/docs/general-purpose-machines
For the t2d-standard-8 case, I tested normal and spot instances. Spot instances worked ok, I think it's worth trying them.
If we want to save time while not spending more money, we should use the t2d-standard-4 instances.
The t2d types assign 1 whole core per vCPU, while the n2d types assign 1 core thread per vCPU, so multithreaded apps benefit from t2d instances.
I've also tried to run the pipeline using c2 and c3 instance types, but they failed to even start, I haven't found any information about their architecture but maybe they're not x86 compatible?
Updated by Lucas Di Pentima 8 months ago
I left Jenkins configured so that it uses t2d-standard-8 Spot instances.
Updated by Lucas Di Pentima 8 months ago
- Status changed from In Progress to Resolved