Project

General

Profile

Actions

Bug #22483

closed

Flaky workbench tests 2025-01

Added by Peter Amstutz 2 months ago. Updated 25 days ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Workbench2
Target version:
Story points:
-
Release relationship:
Auto

Description

Workbench 2 tests failing on apparently unrelated branches:

run-tests-services-workbench2-integration: #118

12:23:49 1) Registered workflow panel tests
12:23:49 can delete a workflow:
12:23:49 AssertionError: Timed out retrying after 4000ms: Expected to find content: 'Delete Workflow' within the element: <ul.MuiList-root.MuiList-padding.MuiList-dense.css-1fg51bw-MuiList-root> but never did.
12:23:49 at Context.eval (webpack://arvados-workbench-2/./cypress/e2e/workflow.cy.js:244:49)

run-tests-remainder: #4900

17:45:24 Running: components/dropdown-menu/dropdown-menu.cy.js (18 of 78)
17:45:26
17:45:26
17:45:26 1) An uncaught error was detected outside of a test
17:45:26
17:45:26 0 passing (244ms)
17:45:26 1 failing
17:45:26
17:45:26 1) An uncaught error was detected outside of a test:
17:45:26 ChunkLoadError: The following error originated from your test code, not from Cypress.
17:45:26
17:45:26 > Loading chunk cypress-support-file failed.
17:45:26 (error: http://localhost:8080/__cypress/src/cypress-support-file.js)
17:45:26
17:45:26 When Cypress detects uncaught errors originating from your test code it will automatically fail the current test.
17:45:26
17:45:26 Cypress could not associate this error to any specific test.
17:45:26
17:45:26 We dynamically generated a new test to display this failure.
17:45:26 at webpack_require.f.j (http://localhost:8080/__cypress/src/main.js:10652:29)
17:45:26 at <unknown> (http://localhost:8080/__cypress/src/main.js:10440:40)
17:45:26 at Array.reduce (<anonymous>)
17:45:26 at webpack_require.e (http://localhost:8080/__cypress/src/main.js:10439:67)
17:45:26 at Object.load (http://localhost:8080/__cypress/src/main.js:496:526)
17:45:26 at <unknown> (http://localhost:8080/__cypress/runner/cypress_runner.js:110836:21)
17:45:26 at tryCatcher (http://localhost:8080/__cypress/runner/cypress_runner.js:1807:23)
17:45:26 at Object.gotValue (http://localhost:8080/__cypress/runner/cypress_runner.js:6476:18)
17:45:26 at Object.gotAccum (http://localhost:8080/__cypress/runner/cypress_runner.js:6465:25)
17:45:26 at Object.tryCatcher (http://localhost:8080/__cypress/runner/cypress_runner.js:1807:23)


Subtasks 1 (0 open1 closed)

Task #22505: Review 22483-tests-25-01ResolvedStephen Smith02/26/2025Actions
Actions #1

Updated by Peter Amstutz 2 months ago

  • Position changed from -934194 to -934191
Actions #2

Updated by Peter Amstutz 2 months ago

  • Description updated (diff)
Actions #3

Updated by Peter Amstutz 2 months ago

  • Assigned To set to Lisa Knox
Actions #4

Updated by Peter Amstutz 2 months ago

  • Subtask #22505 added
Actions #5

Updated by Lisa Knox about 2 months ago

  • Status changed from New to In Progress
Actions #6

Updated by Peter Amstutz about 2 months ago

  • Target version changed from Development 2025-02-12 to Development 2025-02-26
Actions #7

Updated by Lisa Knox about 1 month ago

22483-tests-25-01 @ d4cf3ec62de5d7897fb9ec60ade52932b595c6f8

developer-run-tests-services-workbench2: #1445

  • ✅ All agreed upon points are implemented / addressed.
  • - Anything not implemented (discovered or discussed during work) has a follow-up story.
    • n/a
  • ✅ Code is tested and passing, both automated and manual, what manual testing was done is described
  • ✅ New or changed UX/UX and has gotten feedback from stakeholders.
  • ✅ Documentation has been updated.
  • ✅ Behaves appropriately at the intended scale (describe intended scale).
  • ✅ Considered backwards and forwards compatibility issues between client and server.
  • ✅ Follows our coding standards and GUI style guidelines.
Notes:
  • The chunk loading error is a known cypress bug (https://github.com/cypress-io/cypress/issues/28644) that has yet to be fixed (even though the issue is marked as closed).
    • A user in thread suggested a method of ignoring the failure by restarting the test whenever it is encountered, so this is the stopgap we'll use for now. The bug is supposed to occur about a 3rd of the time, only in Component Tests running on Chromium in CI environments. I ran tests 10 times in a row on Jenkins and had zero failures.
    • Cypress supposedly made a fix in Cypress ^14.0.2 by setting the flag justInTimeCompile=true but users in thread report that the bug persists, so I didn't bother.
Actions #8

Updated by Stephen Smith about 1 month ago

This lgtm!

Actions #9

Updated by Lisa Knox about 1 month ago

  • Status changed from In Progress to Resolved
Actions #10

Updated by Peter Amstutz 25 days ago

  • Release set to 75
Actions

Also available in: Atom PDF