Skip to content
This repository has been archived by the owner on Oct 22, 2024. It is now read-only.

End to End Tests

End to End Tests #237

Triggered via merge group September 19, 2024 09:39
Status Success
Total duration 15m 58s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
2m 17s
Build Element-Web
Matrix: playwright
end-to-end-tests
28s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

4 errors, 30 warnings, and 6 notices
read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart: matrix-react-sdk/playwright/e2e/read-receipts/index.ts#L453
1) read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" - locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" at read-receipts/index.ts:453 451 | async assertRead(room: string | { name: string }) { 452 | const tile = this.getRoomListTile(room); > 453 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); | ^ 454 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); 455 | } 456 | at Helpers.assertRead (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/index.ts:453:69) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/read-receipts/redactions-in-threads.spec.ts:440:28
crypto/crypto.spec.ts:92:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code: matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts#L115
1) crypto/crypto.spec.ts:92:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 113 | if (!isDeviceVerified) { 114 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 115 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 116 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 117 | } 118 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts:115:79
crypto/event-shields.spec.ts:262:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted: matrix-react-sdk/playwright/e2e/crypto/event-shields.spec.ts#L288
2) crypto/event-shields.spec.ts:262:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: locator('.mx_EventTile_last') Expected string: "test encrypted from unverified" Received string: "A09:51Alice invited Bob" Call log: - expect.toContainText with timeout 5000ms - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A09:51Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" data-scroll-tokens="$LeLSuLa0RPZXLeR-XZRIrjXTRxO-yvnVCUNXkhhf4V4" class="mx_EventTi
crypto/event-shields.spec.ts:262:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted: matrix-react-sdk/http:/localhost:8080/bundles/552d813846233fbdddf5/771.js#L3262
2) crypto/event-shields.spec.ts:262:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: jsHandle.evaluate: Error: Cannot encrypt event in unconfigured room !SnUyFCcJSSwFnZYELL:localhost at RustCrypto.encryptEvent (http://localhost:8080/bundles/552d813846233fbdddf5/771.js:3262:13) at MatrixClient.encryptEventIfNeeded (http://localhost:8080/bundles/552d813846233fbdddf5/init.js:9402:30) at async MatrixClient.encryptAndSendEvent (http://localhost:8080/bundles/552d813846233fbdddf5/init.js:9334:9) at async <anonymous>:260:30 at RustCrypto.encryptEvent (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/http:/localhost:8080/bundles/552d813846233fbdddf5/771.js:3262:13) at MatrixClient.encryptEventIfNeeded (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/http:/localhost:8080/bundles/552d813846233fbdddf5/init.js:9402:30) at async MatrixClient.encryptAndSendEvent (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/http:/localhost:8080/bundles/552d813846233fbdddf5/init.js:9334:9) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/async <anonymous>:260:30 at Bot.sendMessage (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/pages/client.ts:125:23) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/event-shields.spec.ts:272:13
Slow Test: matrix-react-sdk/spaces/spaces.spec.ts#L1
matrix-react-sdk/spaces/spaces.spec.ts took 54.7s
Slow Test: matrix-react-sdk/right-panel/right-panel.spec.ts#L1
matrix-react-sdk/right-panel/right-panel.spec.ts took 50.2s
Slow Test: matrix-react-sdk/right-panel/file-panel.spec.ts#L1
matrix-react-sdk/right-panel/file-panel.spec.ts took 35.5s
Slow Test: matrix-react-sdk/settings/account-user-settings-tab.spec.ts#L1
matrix-react-sdk/settings/account-user-settings-tab.spec.ts took 34.4s
Slow Test: matrix-react-sdk/read-receipts/room-list-order.spec.ts#L1
matrix-react-sdk/read-receipts/room-list-order.spec.ts took 28.7s
Slow Test: matrix-react-sdk/read-receipts/high-level.spec.ts#L1
matrix-react-sdk/read-receipts/high-level.spec.ts took 3.2m
Slow Test: matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts took 1.8m
Slow Test: matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts took 1.3m
Slow Test: matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts took 1.2m
Slow Test: matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts took 1.1m
Slow Test: matrix-react-sdk/messages/messages.spec.ts#L1
matrix-react-sdk/messages/messages.spec.ts took 2.2m
Slow Test: matrix-react-sdk/pinned-messages/pinned-messages.spec.ts#L1
matrix-react-sdk/pinned-messages/pinned-messages.spec.ts took 1.4m
Slow Test: matrix-react-sdk/login/login.spec.ts#L1
matrix-react-sdk/login/login.spec.ts took 42.5s
Slow Test: matrix-react-sdk/integration-manager/read_events.spec.ts#L1
matrix-react-sdk/integration-manager/read_events.spec.ts took 37.6s
Slow Test: matrix-react-sdk/knock/knock-into-room.spec.ts#L1
matrix-react-sdk/knock/knock-into-room.spec.ts took 37.2s
Slow Test: matrix-react-sdk/timeline/timeline.spec.ts#L1
matrix-react-sdk/timeline/timeline.spec.ts took 2.9m
Slow Test: matrix-react-sdk/spotlight/spotlight.spec.ts#L1
matrix-react-sdk/spotlight/spotlight.spec.ts took 2.2m
Slow Test: matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.8m
Slow Test: matrix-react-sdk/threads/threads.spec.ts#L1
matrix-react-sdk/threads/threads.spec.ts took 37.7s
Slow Test: matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts#L1
matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts took 33.1s
Slow Test: matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts took 2.1m
Slow Test: matrix-react-sdk/read-receipts/read-receipts.spec.ts#L1
matrix-react-sdk/read-receipts/read-receipts.spec.ts took 1.2m
Slow Test: matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts#L1
matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts took 1.0m
Slow Test: matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts took 56.8s
Slow Test: matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts#L1
matrix-react-sdk/read-receipts/new-messages-thread-roots.spec.ts took 55.1s
Slow Test: matrix-react-sdk/audio-player/audio-player.spec.ts#L1
matrix-react-sdk/audio-player/audio-player.spec.ts took 1.3m
Slow Test: matrix-react-sdk/composer/RTE.spec.ts#L1
matrix-react-sdk/composer/RTE.spec.ts took 1.2m
Slow Test: matrix-react-sdk/crypto/decryption-failure-messages.spec.ts#L1
matrix-react-sdk/crypto/decryption-failure-messages.spec.ts took 53.8s
Slow Test: matrix-react-sdk/crypto/device-verification.spec.ts#L1
matrix-react-sdk/crypto/device-verification.spec.ts took 49.3s
Slow Test: matrix-react-sdk/integration-manager/kick.spec.ts#L1
matrix-react-sdk/integration-manager/kick.spec.ts took 40.8s
🎭 Playwright Run Summary
9 skipped 64 passed (7.8m)
🎭 Playwright Run Summary
32 skipped 50 passed (9.6m)
🎭 Playwright Run Summary
1 skipped 74 passed (9.9m)
🎭 Playwright Run Summary
4 skipped 67 passed (10.2m)
🎭 Playwright Run Summary
1 flaky read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart 15 skipped 59 passed (10.5m)
🎭 Playwright Run Summary
2 flaky crypto/crypto.spec.ts:92:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code crypto/event-shields.spec.ts:262:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted 1 skipped 74 passed (12.2m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
6.28 MB
all-blob-reports-2 Expired
448 KB
all-blob-reports-3 Expired
512 KB
all-blob-reports-4 Expired
4.37 MB
all-blob-reports-5 Expired
766 KB
all-blob-reports-6 Expired
862 KB
html-report Expired
10.9 MB
webapp Expired
38.1 MB