1) [Chrome] › read-receipts/editing-messages-thread-roots.spec.ts:145:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root that is a reply leaves it read Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts:153:17

2) [Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:58:17

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Test timeout of 90000ms exceeded.

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38

2) [Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('menuitem', { name: 'Pinned messages' }) Expected string: "Pinned messages3" Received string: "Pinned messages2" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('menuitem', { name: 'Pinned messages' }) 9 × locator resolved to <button role="menuitem" data-kind="primary" class="_item_8j2l6_17 _interactive_8j2l6_35">…</button> - unexpected value "Pinned messages2" at pinned-messages/index.ts:157 155 | */ 156 | async assertPinnedCountInRoomInfo(count: number) { > 157 | await expect(this.page.getByRole("menuitem", { name: "Pinned messages" })).toHaveText( | ^ 158 | `Pinned messages${count}`, 159 | ); 160 | } at Helpers.assertPinnedCountInRoomInfo (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:157:84) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:52:20

3) [Chrome] › pinned-messages/pinned-messages.spec.ts:55:9 › Pinned messages › should pin messages and show them in the pinned message panel Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('#mx_RightPanel').getByRole('heading', { name: 'Pinned messages' }) Expected string: "3 Pinned messages" Received string: "2 Pinned messages" Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('#mx_RightPanel').getByRole('heading', { name: 'Pinned messages' }) 9 × locator resolved to <p role="heading" class="_typography_yh5dq_162 _font-body-md-medium_yh5dq_69 mx_BaseCard_header_title_heading">2 Pinned messages</p> - unexpected value "2 Pinned messages" at pinned-messages/index.ts:182 180 | async assertPinnedMessagesList(messages: string[]) { 181 | const rightPanel = this.getRightPanel(); > 182 | await expect(rightPanel.getByRole("heading", { name: "Pinned messages" })).toHaveText( | ^ 183 | `${messages.length} Pinned messages`, 184 | ); 185 | at Helpers.assertPinnedMessagesList (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:182:84) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:63:20

4) [Chrome] › pinned-messages/pinned-messages.spec.ts:66:9 › Pinned messages › should unpin one message Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('#mx_RightPanel').getByRole('heading', { name: 'Pinned messages' }) Expected string: "2 Pinned messages" Received: <element(s) not found> Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('#mx_RightPanel').getByRole('heading', { name: 'Pinned messages' }) at pinned-messages/index.ts:182 180 | async assertPinnedMessagesList(messages: string[]) { 181 | const rightPanel = this.getRightPanel(); > 182 | await expect(rightPanel.getByRole("heading", { name: "Pinned messages" })).toHaveText( | ^ 183 | `${messages.length} Pinned messages`, 184 | ); 185 | at Helpers.assertPinnedMessagesList (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:182:84) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:74:20

5) [Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot Error: expect(locator).toHaveScreenshot(expected) 436 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-banner-4-Msg4-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome/pinned-message-banner-4-Msg4-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome/pinned-message-banner-4-Msg4-diff.png Call log: - expect.toHaveScreenshot(pinned-message-banner-4-Msg4.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 436 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 436 pixels (ratio 0.01 of all image pixels) are different. 134 | for (const msg of ["Msg4", "Msg3", "Msg2", "Msg1"]) { 135 | await util.assertMessageInBanner(msg); > 136 | await expect(util.getBanner()).toMatchScreenshot(`pinned-message-banner-4-${msg}.png`); | ^ 137 | await util.getBanner().click(); 138 | } 139 | }); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:136:44

5) [Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 436 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-banner-4-Msg4-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome-retry1/pinned-message-banner-4-Msg4-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome-retry1/pinned-message-banner-4-Msg4-diff.png Call log: - expect.toHaveScreenshot(pinned-message-banner-4-Msg4.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 436 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 436 pixels (ratio 0.01 of all image pixels) are different. 134 | for (const msg of ["Msg4", "Msg3", "Msg2", "Msg1"]) { 135 | await util.assertMessageInBanner(msg); > 136 | await expect(util.getBanner()).toMatchScreenshot(`pinned-message-banner-4-${msg}.png`); | ^ 137 | await util.getBanner().click(); 138 | } 139 | }); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:136:44

6) [Chrome] › pinned-messages/pinned-messages.spec.ts:152:9 › Pinned messages › banner should listen to pinned message list Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('button', { name: 'View all' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('button', { name: 'View all' }) 155 | await util.pinMessages(["Msg1", "Msg2"]); 156 | > 157 | await expect(util.getViewAllButton()).toBeVisible(); | ^ 158 | 159 | await util.openRoomInfo(); 160 | await util.openPinnedMessagesList(); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:157:47

6) [Chrome] › pinned-messages/pinned-messages.spec.ts:152:9 › Pinned messages › banner should listen to pinned message list Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('button', { name: 'View all' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('button', { name: 'View all' }) 155 | await util.pinMessages(["Msg1", "Msg2"]); 156 | > 157 | await expect(util.getViewAllButton()).toBeVisible(); | ^ 158 | 159 | await util.openRoomInfo(); 160 | await util.openPinnedMessagesList(); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:157:47

[Chrome] › composer/RTE.spec.ts took 1.3m

[Chrome] › audio-player/audio-player.spec.ts took 1.2m

[Chrome] › crypto/event-shields.spec.ts took 1.2m

[Chrome] › crypto/crypto.spec.ts took 1.1m

[Chrome] › crypto/decryption-failure-messages.spec.ts took 53.6s

[Chrome] › read-receipts/redactions-in-threads.spec.ts took 2.6m

[Chrome] › read-receipts/high-level.spec.ts took 3.3m

[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 2.0m

[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 1.7m

[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 1.3m

[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m

[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 1.2m

[Chrome] › read-receipts/reactions-in-threads.spec.ts took 59.2s

[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 55.4s

[Chrome] › spaces/spaces.spec.ts took 1.1m

[Chrome] › right-panel/right-panel.spec.ts took 57.1s

[Chrome] › settings/account-user-settings-tab.spec.ts took 46.0s

[Chrome] › right-panel/file-panel.spec.ts took 40.0s

[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 33.1s

[Chrome] › timeline/timeline.spec.ts took 2.8m

[Chrome] › spotlight/spotlight.spec.ts took 2.3m

[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.7m

[Chrome] › threads/threads.spec.ts took 35.1s

[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 35.0s

[Chrome] › messages/messages.spec.ts took 2.3m

[Chrome] › login/login.spec.ts took 1.0m

[Chrome] › integration-manager/read_events.spec.ts took 40.5s

[Chrome] › knock/knock-into-room.spec.ts took 39.7s

[Chrome] › polls/polls.spec.ts took 35.5s

79 passed (11.9m)

2 flaky [Chrome] › read-receipts/editing-messages-thread-roots.spec.ts:145:17 › Read receipts › editing messages › thread roots › Marking a room as read after an edit of a thread root that is a reply leaves it read [Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread 32 skipped 48 passed (10.2m)

15 skipped 60 passed (9.9m)

9 skipped 68 passed (9.2m)

3 skipped 69 passed (10.1m)