Run Playwright tests on Firefox & "Safari" #3295
t3chguyend-to-end-tests.yaml
on: pull_request
Build Element-Web
1m 42s
Matrix: playwright
end-to-end-tests
1m 25s
Annotations
36 errors, 28 warnings, and 6 notices
|
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
1) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
|
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account:
playwright/e2e/oidc/oidc-native.spec.ts#L1
1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account
Test timeout of 90000ms exceeded.
|
|
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account:
playwright/e2e/oidc/oidc-native.spec.ts#L23
1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account
Error: page.waitForRequest: Test timeout of 90000ms exceeded.
21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => {
22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`;
> 23 | const tokenApiPromise = page.waitForRequest(
| ^
24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code",
25 | );
26 |
at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38
|
|
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory:
playwright/e2e/room-directory/room-directory.spec.ts#L31
2) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
Expected string: "mx_EditableItem_item"
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
29 | await localAddresses.getByRole("textbox").fill("gaming");
30 | await localAddresses.getByRole("button", { name: "Add" }).click();
> 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item");
| ^
32 |
33 | // Publish into the public rooms directory
34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" });
at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69
|
|
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory:
playwright/e2e/room-directory/room-directory.spec.ts#L31
2) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
Expected string: "mx_EditableItem_item"
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
29 | await localAddresses.getByRole("textbox").fill("gaming");
30 | await localAddresses.getByRole("button", { name: "Add" }).click();
> 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item");
| ^
32 |
33 | // Publish into the public rooms directory
34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" });
at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69
|
|
[Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L29
1) [Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot
Error: expect(locator).toHaveScreenshot(expected)
14287 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Firefox/General-room-settings-tab-should-be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Firefox/General-room-settings-tab-should-be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(General-room-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 14287 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 14287 pixels (ratio 0.03 of all image pixels) are different.
27 | await expect(settings.getByText("Show less")).toBeVisible();
28 |
> 29 | await expect(settings).toMatchScreenshot("General-room-settings-tab-should-be-rendered-properly-1.png");
| ^
30 |
31 | // Click the "Show less" details element
32 | await settings.getByText("Show less").click();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:29:32
|
|
[Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L29
1) [Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
14287 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Firefox-retry1/General-room-settings-tab-should-be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Firefox-retry1/General-room-settings-tab-should-be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(General-room-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 14287 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 14287 pixels (ratio 0.03 of all image pixels) are different.
27 | await expect(settings.getByText("Show less")).toBeVisible();
28 |
> 29 | await expect(settings).toMatchScreenshot("General-room-settings-tab-should-be-rendered-properly-1.png");
| ^
30 |
31 | // Click the "Show less" details element
32 | await settings.getByText("Show less").click();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:29:32
|
|
[Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L29
1) [Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
14287 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Firefox-retry2/General-room-settings-tab-should-be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Firefox-retry2/General-room-settings-tab-should-be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(General-room-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 14287 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 14287 pixels (ratio 0.03 of all image pixels) are different.
27 | await expect(settings.getByText("Show less")).toBeVisible();
28 |
> 29 | await expect(settings).toMatchScreenshot("General-room-settings-tab-should-be-rendered-properly-1.png");
| ^
30 |
31 | // Click the "Show less" details element
32 | await settings.getByText("Show less").click();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:29:32
|
|
[Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L31
2) [Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
Error: expect(locator).toHaveScreenshot(expected)
33433 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Firefox/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Firefox/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 33433 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 33433 pixels (ratio 0.02 of all image pixels) are different.
29 | // Assert that the top heading is rendered
30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible();
> 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png");
| ^
32 | });
33 |
34 | test("should be able to change the app language", async ({ uut, user }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27
|
|
[Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L31
2) [Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
33433 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Firefox-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Firefox-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 33433 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 33433 pixels (ratio 0.02 of all image pixels) are different.
29 | // Assert that the top heading is rendered
30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible();
> 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png");
| ^
32 | });
33 |
34 | test("should be able to change the app language", async ({ uut, user }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27
|
|
[Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L31
2) [Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
33433 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Firefox-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Firefox-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 33433 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') })
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 33433 pixels (ratio 0.02 of all image pixels) are different.
29 | // Assert that the top heading is rendered
30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible();
> 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png");
| ^
32 | });
33 |
34 | test("should be able to change the app language", async ({ uut, user }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27
|
|
[Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L44
3) [Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Language Dropdown' }).getByRole('option', { name: /Albanian/ })
Expected pattern: /mx_Dropdown_option_highlight/
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Language Dropdown' }).getByRole('option', { name: /Albanian/ })
42 | // Assert that the default option is rendered and highlighted
43 | languageInput.getByRole("option", { name: /Albanian/ });
> 44 | await expect(languageInput.getByRole("option", { name: /Albanian/ })).toHaveClass(
| ^
45 | /mx_Dropdown_option_highlight/,
46 | );
47 | await expect(languageInput.getByRole("option", { name: /Deutsch/ })).toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:44:79
|
|
[Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L44
3) [Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Language Dropdown' }).getByRole('option', { name: /Albanian/ })
Expected pattern: /mx_Dropdown_option_highlight/
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Language Dropdown' }).getByRole('option', { name: /Albanian/ })
42 | // Assert that the default option is rendered and highlighted
43 | languageInput.getByRole("option", { name: /Albanian/ });
> 44 | await expect(languageInput.getByRole("option", { name: /Albanian/ })).toHaveClass(
| ^
45 | /mx_Dropdown_option_highlight/,
46 | );
47 | await expect(languageInput.getByRole("option", { name: /Deutsch/ })).toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:44:79
|
|
[Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language:
playwright/e2e/settings/preferences-user-settings-tab.spec.ts#L44
3) [Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Language Dropdown' }).getByRole('option', { name: /Albanian/ })
Expected pattern: /mx_Dropdown_option_highlight/
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }).getByRole('button', { name: 'Language Dropdown' }).getByRole('option', { name: /Albanian/ })
42 | // Assert that the default option is rendered and highlighted
43 | languageInput.getByRole("option", { name: /Albanian/ });
> 44 | await expect(languageInput.getByRole("option", { name: /Albanian/ })).toHaveClass(
| ^
45 | /mx_Dropdown_option_highlight/,
46 | );
47 | await expect(languageInput.getByRole("option", { name: /Deutsch/ })).toBeVisible();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:44:79
|
|
[Firefox] › settings/security-user-settings-tab.spec.ts:39:17 › Security user settings tab › with posthog enabled › AnalyticsLearnMoreDialog › should be rendered properly @screenshot:
playwright/e2e/settings/security-user-settings-tab.spec.ts#L42
4) [Firefox] › settings/security-user-settings-tab.spec.ts:39:17 › Security user settings tab › with posthog enabled › AnalyticsLearnMoreDialog › should be rendered properly @screenshot
Error: expect(locator).toHaveScreenshot(expected)
2065 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/security-user-settings-tab.spec.ts/Security-user-settings-tab-with-posthog-enable-b5d89-csLearnMoreDialog-should-be-rendered-properly-1-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-security-user-set-aade3-should-be-rendered-properly-Firefox/Security-user-settings-tab-6fba6--be-rendered-properly-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-security-user-set-aade3-should-be-rendered-properly-Firefox/Security-user-settings-tab-6fba6--be-rendered-properly-1-diff.png
Call log:
- expect.toHaveScreenshot(Security-user-settings-tab-with-posthog-enable-b5d89-csLearnMoreDialog-should-be-rendered-properly-1.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_AnalyticsLearnMoreDialog_wrapper .mx_Dialog')
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 2065 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_AnalyticsLearnMoreDialog_wrapper .mx_Dialog')
- locator resolved to <div class="mx_Dialog">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 2065 pixels (ratio 0.01 of all image pixels) are different.
40 | const tab = await app.settings.openUserSettings("Security");
41 | await tab.getByRole("button", { name: "Learn more" }).click();
> 42 | await expect(page.locator(".mx_AnalyticsLearnMoreDialog_wrapper .mx_Dialog")).toMatchScreenshot(
| ^
43 | "Security-user-settings-tab-with-posthog-enable-b5d89-csLearnMoreDialog-should-be-rendered-properly-1.png",
44 | );
45 | });
at /home/runner/work/element-web/element-web/playwright/e2e/settings/security-user-settings-tab.spec.ts:42:95
|
|
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully:
playwright/e2e/location/location.spec.ts#L1
1) [Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
Test timeout of 30000ms exceeded.
|
|
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully:
playwright/e2e/location/location.spec.ts#L41
1) [Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('#mx_LocationPicker_map')
39 | await selectLocationShareTypeOption(page, "Pin").click();
40 |
> 41 | await page.locator("#mx_LocationPicker_map").click();
| ^
42 |
43 | await submitShareLocation(page);
44 |
at /home/runner/work/element-web/element-web/playwright/e2e/location/location.spec.ts:41:54
|
|
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully:
playwright/e2e/location/location.spec.ts#L1
1) [Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully:
playwright/e2e/location/location.spec.ts#L41
1) [Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('#mx_LocationPicker_map')
39 | await selectLocationShareTypeOption(page, "Pin").click();
40 |
> 41 | await page.locator("#mx_LocationPicker_map").click();
| ^
42 |
43 | await submitShareLocation(page);
44 |
at /home/runner/work/element-web/element-web/playwright/e2e/location/location.spec.ts:41:54
|
|
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully:
playwright/e2e/location/location.spec.ts#L1
1) [Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully:
playwright/e2e/location/location.spec.ts#L41
1) [Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('#mx_LocationPicker_map')
39 | await selectLocationShareTypeOption(page, "Pin").click();
40 |
> 41 | await page.locator("#mx_LocationPicker_map").click();
| ^
42 |
43 | await submitShareLocation(page);
44 |
at /home/runner/work/element-web/element-web/playwright/e2e/location/location.spec.ts:41:54
|
|
[Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails:
playwright/e2e/login/soft_logout.spec.ts#L1
2) [Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails, and allows a re-login
Test timeout of 30000ms exceeded.
|
|
[Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails:
playwright/e2e/login/soft_logout.spec.ts#L113
2) [Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails, and allows a re-login
Error: page.waitForResponse: Test timeout of 30000ms exceeded.
111 | });
112 |
> 113 | const promise = page.waitForResponse((resp) => resp.url().includes("/sync") && resp.status() === 401);
| ^
114 |
115 | // do something to make the active /sync return: create a new room
116 | await page.evaluate(() => {
at interceptRequestsWithSoftLogout (/home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout.spec.ts:113:26)
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout.spec.ts:28:13
|
|
[Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails:
playwright/e2e/login/soft_logout.spec.ts#L1
2) [Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails, and allows a re-login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
[Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails:
playwright/e2e/login/soft_logout.spec.ts#L113
2) [Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails, and allows a re-login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForResponse: Test timeout of 30000ms exceeded.
111 | });
112 |
> 113 | const promise = page.waitForResponse((resp) => resp.url().includes("/sync") && resp.status() === 401);
| ^
114 |
115 | // do something to make the active /sync return: create a new room
116 | await page.evaluate(() => {
at interceptRequestsWithSoftLogout (/home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout.spec.ts:113:26)
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout.spec.ts:28:13
|
|
[Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot:
playwright/e2e/app-loading/feature-detection.spec.ts#L21
1) [Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
Error: expect(page).toHaveScreenshot(expected)
14392 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Firefox/unsupported-browser-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Firefox/unsupported-browser-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 14392 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 14392 pixels (ratio 0.02 of all image pixels) are different.
19 | await expect(header).toBeVisible();
20 |
> 21 | await expect(page).toMatchScreenshot("unsupported-browser.png");
| ^
22 | });
23 |
24 | test(`shows error page if browser lacks WebAssembly support`, { tag: "@screenshot" }, async ({ page }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:21:24
|
|
[Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot:
playwright/e2e/app-loading/feature-detection.spec.ts#L21
1) [Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
14392 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Firefox-retry1/unsupported-browser-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Firefox-retry1/unsupported-browser-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 14392 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 14392 pixels (ratio 0.02 of all image pixels) are different.
19 | await expect(header).toBeVisible();
20 |
> 21 | await expect(page).toMatchScreenshot("unsupported-browser.png");
| ^
22 | });
23 |
24 | test(`shows error page if browser lacks WebAssembly support`, { tag: "@screenshot" }, async ({ page }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:21:24
|
|
[Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot:
playwright/e2e/app-loading/feature-detection.spec.ts#L21
1) [Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
14392 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Firefox-retry2/unsupported-browser-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-Firefox-retry2/unsupported-browser-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 14392 pixels (ratio 0.02 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 14392 pixels (ratio 0.02 of all image pixels) are different.
19 | await expect(header).toBeVisible();
20 |
> 21 | await expect(page).toMatchScreenshot("unsupported-browser.png");
| ^
22 | });
23 |
24 | test(`shows error page if browser lacks WebAssembly support`, { tag: "@screenshot" }, async ({ page }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:21:24
|
|
[Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot:
playwright/e2e/app-loading/feature-detection.spec.ts#L33
2) [Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot
Error: expect(page).toHaveScreenshot(expected)
4543 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-CompatibilityView-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-Firefox/unsupported-browser-CompatibilityView-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-Firefox/unsupported-browser-CompatibilityView-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser-CompatibilityView.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4543 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4543 pixels (ratio 0.01 of all image pixels) are different.
31 | await expect(header).toBeVisible();
32 |
> 33 | await expect(page).toMatchScreenshot("unsupported-browser-CompatibilityView.png");
| ^
34 | });
35 |
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:33:24
|
|
[Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot:
playwright/e2e/app-loading/feature-detection.spec.ts#L33
2) [Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4543 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-CompatibilityView-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-Firefox-retry1/unsupported-browser-CompatibilityView-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-Firefox-retry1/unsupported-browser-CompatibilityView-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser-CompatibilityView.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4543 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4543 pixels (ratio 0.01 of all image pixels) are different.
31 | await expect(header).toBeVisible();
32 |
> 33 | await expect(page).toMatchScreenshot("unsupported-browser-CompatibilityView.png");
| ^
34 | });
35 |
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:33:24
|
|
[Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot:
playwright/e2e/app-loading/feature-detection.spec.ts#L33
2) [Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4543 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-CompatibilityView-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-Firefox-retry2/unsupported-browser-CompatibilityView-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-Firefox-retry2/unsupported-browser-CompatibilityView-diff.png
Call log:
- expect.toHaveScreenshot(unsupported-browser-CompatibilityView.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4543 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4543 pixels (ratio 0.01 of all image pixels) are different.
31 | await expect(header).toBeVisible();
32 |
> 33 | await expect(page).toMatchScreenshot("unsupported-browser-CompatibilityView.png");
| ^
34 | });
35 |
at /home/runner/work/element-web/element-web/playwright/e2e/app-loading/feature-detection.spec.ts:33:24
|
|
[Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L37
3) [Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
35 | .last()
36 | .filter({ hasText: file.split("/").at(-1) }),
> 37 | ).toBeVisible();
| ^
38 | };
39 |
40 | /**
at uploadFile (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:37:11)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:138:9
|
|
[Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L37
3) [Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
35 | .last()
36 | .filter({ hasText: file.split("/").at(-1) }),
> 37 | ).toBeVisible();
| ^
38 | };
39 |
40 | /**
at uploadFile (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:37:11)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:138:9
|
|
[Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L37
3) [Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
35 | .last()
36 | .filter({ hasText: file.split("/").at(-1) }),
> 37 | ).toBeVisible();
| ^
38 | };
39 |
40 | /**
at uploadFile (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:37:11)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:138:9
|
|
[Firefox] › audio-player/audio-player.spec.ts:142:9 › Audio player › should be correctly rendered - light theme with monospace font @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L37
4) [Firefox] › audio-player/audio-player.spec.ts:142:9 › Audio player › should be correctly rendered - light theme with monospace font @screenshot
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for locator('.mx_AudioPlayer_mediaName').last().filter({ hasText: '1sec-long-name-audio-file.ogg' })
35 | .last()
36 | .filter({ hasText: file.split("/").at(-1) }),
> 37 | ).toBeVisible();
| ^
38 | };
39 |
40 | /**
at uploadFile (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:37:11)
at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:146:13
|
|
end-to-end-tests
Process completed with exit code 1.
|
|
Slow Test:
[Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.7m
|
|
Slow Test:
[Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
|
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.5m
|
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 59.6s
|
|
Slow Test:
[Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 35.2s
|
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
|
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.2m
|
|
Slow Test:
[Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 1.2m
|
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 60.0s
|
|
Slow Test:
[Chrome] › crypto/device-verification.spec.ts#L1
[Chrome] › crypto/device-verification.spec.ts took 43.7s
|
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.2m
|
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.7m
|
|
Slow Test:
[Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.0m
|
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 53.0s
|
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 42.8s
|
|
Slow Test:
[Firefox] › spotlight/spotlight.spec.ts#L1
[Firefox] › spotlight/spotlight.spec.ts took 2.9m
|
|
Slow Test:
[Firefox] › sliding-sync/sliding-sync.spec.ts#L1
[Firefox] › sliding-sync/sliding-sync.spec.ts took 34.0s
|
|
Slow Test:
[Firefox] › widgets/widget-pip-close.spec.ts#L1
[Firefox] › widgets/widget-pip-close.spec.ts took 29.0s
|
|
Slow Test:
[Firefox] › widgets/stickers.spec.ts#L1
[Firefox] › widgets/stickers.spec.ts took 28.4s
|
|
Slow Test:
[Firefox] › toasts/analytics-toast.spec.ts#L1
[Firefox] › toasts/analytics-toast.spec.ts took 23.3s
|
|
Slow Test:
[Firefox] › login/login.spec.ts#L1
[Firefox] › login/login.spec.ts took 1.4m
|
|
Slow Test:
[Firefox] › room/room.spec.ts#L1
[Firefox] › room/room.spec.ts took 29.0s
|
|
Slow Test:
[Firefox] › oidc/oidc-native.spec.ts#L1
[Firefox] › oidc/oidc-native.spec.ts took 15.9s
|
|
Slow Test:
[Firefox] › crypto/event-shields.spec.ts#L1
[Firefox] › crypto/event-shields.spec.ts took 1.8m
|
|
Slow Test:
[Firefox] › composer/RTE.spec.ts#L1
[Firefox] › composer/RTE.spec.ts took 1.7m
|
|
Slow Test:
[Firefox] › crypto/device-verification.spec.ts#L1
[Firefox] › crypto/device-verification.spec.ts took 1.1m
|
|
Slow Test:
[Firefox] › crypto/decryption-failure-messages.spec.ts#L1
[Firefox] › crypto/decryption-failure-messages.spec.ts took 55.7s
|
|
Slow Test:
[Firefox] › knock/knock-into-room.spec.ts#L1
[Firefox] › knock/knock-into-room.spec.ts took 52.8s
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
12 skipped
93 passed (13.0m)
|
|
🎭 Playwright Run Summary
104 passed (14.6m)
|
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory
2 skipped
100 passed (15.3m)
|
|
🎭 Playwright Run Summary
39 failed
[Firefox] › settings/general-room-settings-tab.spec.ts:23:9 › General room settings tab › should be rendered properly @screenshot
[Firefox] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot
[Firefox] › settings/preferences-user-settings-tab.spec.ts:34:9 › Preferences user settings tab › should be able to change the app language
[Firefox] › settings/security-user-settings-tab.spec.ts:39:17 › Security user settings tab › with posthog enabled › AnalyticsLearnMoreDialog › should be rendered properly @screenshot
[Firefox] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
[Firefox] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
[Firefox] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot
[Firefox] › spaces/spaces.spec.ts:58:9 › Spaces › should allow user to create public space @screenshot
[Firefox] › spaces/spaces.spec.ts:91:9 › Spaces › should allow user to create private space @screenshot
[Firefox] › spaces/spaces.spec.ts:219:9 › Spaces › should render subspaces in the space panel only when expanded @screenshot
[Firefox] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:19:9 › Threads Activity Centre › should have the button correctly aligned and displayed in the space panel when expanded @screenshot
[Firefox] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:67:9 › Threads Activity Centre › should show the rooms with unread threads @screenshot
[Firefox] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:84:9 › Threads Activity Centre › should update with a thread is read @screenshot
[Firefox] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:107:9 › Threads Activity Centre › should order by recency after notification level
[Firefox] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts:133:9 › Threads Activity Centre › should have the correct hover state @screenshot
[Firefox] › threads/threads.spec.ts:327:13 › Threads › with larger viewport › can send voice messages
[Firefox] › threads/threads.spec.ts:354:9 › Threads › should send location and reply to the location on ThreadView @screenshot
[Firefox] › timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot
[Firefox] › timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot
[Firefox] › timeline/timeline.spec.ts:192:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on compact modern/group layout @screenshot
[Firefox] › timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
[Firefox] › timeline/timeline.spec.ts:277:13 › Timeline › configure room › should add inline start margin to an event line on IRC layout @screenshot
[Firefox] › timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot
[Firefox] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout @screenshot
[Firefox] › timeline/timeline.spec.ts:647:13 › Timeline › message displaying › should click view source event toggle @screenshot
[Firefox] › timeline/timeline.spec.ts:745:13 › Timeline › message displaying › should render url previews @screenshot
[Firefox] › timeline/timeline.spec.ts:809:17 › Timeline › message displaying › on search results panel › should highlight search result words regardless of formatting @screenshot
[Firefox] › timeline/timeline.spec.ts:835:17 › Timeline › message displaying › on search results panel
|
|
🎭 Playwright Run Summary
58 failed
[Firefox] › location/location.spec.ts:32:9 › Location sharing › sends and displays pin drop location message successfully
[Firefox] › login/soft_logout.spec.ts:27:13 › Soft logout › with password user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › login/soft_logout.spec.ts:38:13 › Soft logout › with password user › still shows the soft-logout page when the page is reloaded after a soft-logout
[Firefox] › login/soft_logout.spec.ts:64:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › messages/messages.spec.ts:75:17 › Message rendering › with ltr display name › should render a basic LTR text message @screenshot @screenshot
[Firefox] › messages/messages.spec.ts:88:17 › Message rendering › with ltr display name › should render an LTR emote @screenshot
[Firefox] › messages/messages.spec.ts:95:17 › Message rendering › with ltr display name › should render an LTR rich text emote @screenshot
[Firefox] › messages/messages.spec.ts:102:17 › Message rendering › with ltr display name › should render an edited LTR message @screenshot
[Firefox] › messages/messages.spec.ts:114:17 › Message rendering › with ltr display name › should render a reply of a LTR message @screenshot
[Firefox] › messages/messages.spec.ts:130:17 › Message rendering › with ltr display name › should render a basic RTL text message @screenshot
[Firefox] › messages/messages.spec.ts:139:17 › Message rendering › with ltr display name › should render an RTL emote @screenshot
[Firefox] › messages/messages.spec.ts:146:17 › Message rendering › with ltr display name › should render a richtext RTL emote @screenshot
[Firefox] › messages/messages.spec.ts:153:17 › Message rendering › with ltr display name › should render an edited RTL message @screenshot
[Firefox] › messages/messages.spec.ts:165:17 › Message rendering › with ltr display name › should render a reply of a RTL message @screenshot
[Firefox] › messages/messages.spec.ts:75:17 › Message rendering › with rtl display name › should render a basic LTR text message @screenshot @screenshot
[Firefox] › messages/messages.spec.ts:88:17 › Message rendering › with rtl display name › should render an LTR emote @screenshot
[Firefox] › messages/messages.spec.ts:95:17 › Message rendering › with rtl display name › should render an LTR rich text emote @screenshot
[Firefox] › messages/messages.spec.ts:102:17 › Message rendering › with rtl display name › should render an edited LTR message @screenshot
[Firefox] › messages/messages.spec.ts:114:17 › Message rendering › with rtl display name › should render a reply of a LTR message @screenshot
[Firefox] › messages/messages.spec.ts:130:17 › Message rendering › with rtl display name › should render a basic RTL text message @screenshot
[Firefox] › messages/messages.spec.ts:139:17 › Message rendering › with rtl display name › should render an RTL emote @screenshot
[Firefox] › messages/messages.spec.ts:146:17 › Message rendering › with rtl display name › should render a richtext RTL emote @screenshot
[Firefox] › messages/messages.spec.ts:153:17 › Message rendering › with rtl display name › should render an edited RTL message @screenshot
[Firefox] › messages/messages.spec.ts:165:17 › Message rendering › with rtl display name › should render a reply of a RTL message @screenshot
[Firefox] › oidc/oidc-aware.spec.ts:16:9 › OIDC Aware › can register an account and manage it ──
[Firefox] › permalinks/permalinks.spec.ts:27:9 › permalinks › shoud render permalinks as expected @screenshot
[Firefox] › pinned-messages/pinned-messages.spec.ts:13:9 › Pinned messages › should show the empty state when there are no pinned messages @screenshot
[Firefox] › pinned-messages/pinned-messages.spec.ts:25:9 › Pinned messages › should pin one message and to have the pinned message badge in the timeline @screenshot
[Firefox] › pinned-messages/pinned-messages.spec.ts
|
|
🎭 Playwright Run Summary
36 failed
[Firefox] › app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support @screenshot
[Firefox] › app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support @screenshot
[Firefox] › audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme @screenshot
[Firefox] › audio-player/audio-player.spec.ts:142:9 › Audio player › should be correctly rendered - light theme with monospace font @screenshot
[Firefox] › audio-player/audio-player.spec.ts:152:9 › Audio player › should be correctly rendered - high contrast theme @screenshot
[Firefox] › audio-player/audio-player.spec.ts:168:9 › Audio player › should be correctly rendered - dark theme @screenshot
[Firefox] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file ─
[Firefox] › audio-player/audio-player.spec.ts:199:9 › Audio player › should support downloading an audio file
[Firefox] › audio-player/audio-player.spec.ts:214:9 › Audio player › should support replying to audio file with another audio file @screenshot
[Firefox] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @screenshot
[Firefox] › audio-player/audio-player.spec.ts:310:9 › Audio player › should be rendered, play, and support replying on a thread
[Firefox] › chat-export/html-export.spec.ts:92:9 › HTML Export › should export html successfully and match screenshot @screenshot
[Firefox] › crypto/backups.spec.ts:26:12 › Encryption state after registration › Key backup is enabled by default
[Firefox] › crypto/backups.spec.ts:35:12 › Encryption state after registration › user is prompted to set up recovery
[Firefox] › crypto/crypto.spec.ts:207:9 › Cryptography › creating a DM should work, being e2e-encrypted / user verification @screenshot
[Firefox] › crypto/dehydration.spec.ts:52:5 › Dehydration › Create dehydrated device ───────────
[Firefox] › editing/editing.spec.ts:69:9 › Editing › should render and interact with the message edit history dialog @screenshot
[Firefox] › file-upload/image-upload.spec.ts:28:9 › Image Upload › should show image preview when uploading an image @screenshot
[Firefox] › forgot-password/forgot-password.spec.ts:29:9 › Forgot Password › renders properly @screenshot
[Firefox] › forgot-password/forgot-password.spec.ts:42:9 › Forgot Password › renders email verification dialog properly @screenshot
[Firefox] › integration-manager/get-openid-token.spec.ts:113:9 › Integration Manager: Get OpenID Token › should successfully obtain an openID token
[Firefox] › integration-manager/kick.spec.ts:157:9 › Integration Manager: Kick › should kick the target
[Firefox] › integration-manager/kick.spec.ts:168:9 › Integration Manager: Kick › should not kick the target if lacking permissions
[Firefox] › integration-manager/kick.spec.ts:186:9 › Integration Manager: Kick › should no-op if the target already left
[Firefox] › integration-manager/kick.spec.ts:198:9 › Integration Manager: Kick › should no-op if the target was banned
[Firefox] › integration-manager/kick.spec.ts:210:9 › Integration Manager: Kick › should no-op if the target was never a room member
[Firefox] › integration-manager/read_events.spec.ts:128:9 › Integration Manager: Read Events › should read a state event by state key
[Firefox] › integration-manager/read_events.spec.ts:148:9 › Integration Manager: Read Events › should read a state event with empty state key
[Firefox] › integration-manager/read_events.spec.ts:168:9 › Integration Manager: Read Events › should read state events with any state key
[Firefox] › integration-manager/read_events.spec.ts:212:9 › Integration Manager: Read Events › should fail to read an event type which is not allowed
[Firefox] › integration-manager/send_event.spec.ts:135:9 › Integration Manager: Send Event › should send a state event
[Firefox] › i
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
all-blob-reports-1
|
786 KB |
|
|
all-blob-reports-2
|
10.9 MB |
|
|
all-blob-reports-3
|
4.7 MB |
|
|
all-blob-reports-4
|
287 MB |
|
|
all-blob-reports-5
|
424 MB |
|
|
all-blob-reports-6
|
238 MB |
|
|
html-report
|
944 MB |
|
|
webapp
|
29.2 MB |
|