1) [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#loremIpsumDolorSitAmetConsecteturAdipisicingElitSedDoEiusmodTemporIncididuntUtLaboreEtDoloreMagnaAliqua:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#loremIpsumDolorSitAmetConsecteturAdipisicingElitSedDoEiusmodTemporIncididuntUtLaboreEtDoloreMagnaAliqua:localhost') 49 | await localAddresses.getByRole("textbox").fill(ROOM_ADDRESS_LONG); 50 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 51 | await expect(localAddresses.getByText(`#${ROOM_ADDRESS_LONG}:localhost`)).toHaveClass( | ^ 52 | "mx_EditableItem_item", 53 | ); 54 | at /home/runner/work/element-web/element-web/playwright/e2e/right-panel/right-panel.spec.ts:51:87

1) [Chrome] › spotlight/spotlight.spec.ts:362:5 › Spotlight › should be able to navigate results via keyboard Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 2 Received: 31 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 1 element - unexpected value "1" 7 × locator resolved to 31 elements - unexpected value "31" 367 | 368 | let resultLocator = spotlight.results; > 369 | await expect(resultLocator).toHaveCount(2); | ^ 370 | await expect(resultLocator.first()).toHaveAttribute("aria-selected", "true"); 371 | await expect(resultLocator.last()).toHaveAttribute("aria-selected", "false"); 372 | at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:369:37

1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 32 | await localAddresses.getByRole("textbox").fill("gaming"); 33 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 35 | 36 | // Publish into the public rooms directory 37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73

1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 32 | await localAddresses.getByRole("textbox").fill("gaming"); 33 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 35 | 36 | // Publish into the public rooms directory 37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73

1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 32 | await localAddresses.getByRole("textbox").fill("gaming"); 33 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 35 | 36 | // Publish into the public rooms directory 37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73

2) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot Error: expect(locator).toHaveScreenshot(expected) 265 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/share-dialog/share-dialog.spec.ts/share-dialog-event-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/share-dialog-share-dialog-Share-dialog-should-share-an-event-Chrome/share-dialog-event-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/share-dialog-share-dialog-Share-dialog-should-share-an-event-Chrome/share-dialog-event-diff.png Call log: - expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 265 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 265 pixels (ratio 0.01 of all image pixels) are different. 58 | const dialog = page.getByRole("dialog", { name: "Share Room Message" }); 59 | await expect(dialog.getByRole("checkbox", { name: "Link to selected message" })).toBeChecked(); > 60 | await expect(dialog).toMatchScreenshot("share-dialog-event.png", { | ^ 61 | // QRCode and url changes at every run 62 | mask: [page.locator(".mx_QRCode"), page.locator(".mx_ShareDialog_top > span")], 63 | }); at /home/runner/work/element-web/element-web/playwright/e2e/share-dialog/share-dialog.spec.ts:60:30

2) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 265 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/share-dialog/share-dialog.spec.ts/share-dialog-event-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/share-dialog-share-dialog-Share-dialog-should-share-an-event-Chrome-retry1/share-dialog-event-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/share-dialog-share-dialog-Share-dialog-should-share-an-event-Chrome-retry1/share-dialog-event-diff.png Call log: - expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 265 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 265 pixels (ratio 0.01 of all image pixels) are different. 58 | const dialog = page.getByRole("dialog", { name: "Share Room Message" }); 59 | await expect(dialog.getByRole("checkbox", { name: "Link to selected message" })).toBeChecked(); > 60 | await expect(dialog).toMatchScreenshot("share-dialog-event.png", { | ^ 61 | // QRCode and url changes at every run 62 | mask: [page.locator(".mx_QRCode"), page.locator(".mx_ShareDialog_top > span")], 63 | }); at /home/runner/work/element-web/element-web/playwright/e2e/share-dialog/share-dialog.spec.ts:60:30

2) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 265 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/share-dialog/share-dialog.spec.ts/share-dialog-event-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/share-dialog-share-dialog-Share-dialog-should-share-an-event-Chrome-retry2/share-dialog-event-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/share-dialog-share-dialog-Share-dialog-should-share-an-event-Chrome-retry2/share-dialog-event-diff.png Call log: - expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 265 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 265 pixels (ratio 0.01 of all image pixels) are different. 58 | const dialog = page.getByRole("dialog", { name: "Share Room Message" }); 59 | await expect(dialog.getByRole("checkbox", { name: "Link to selected message" })).toBeChecked(); > 60 | await expect(dialog).toMatchScreenshot("share-dialog-event.png", { | ^ 61 | // QRCode and url changes at every run 62 | mask: [page.locator(".mx_QRCode"), page.locator(".mx_ShareDialog_top > span")], 63 | }); at /home/runner/work/element-web/element-web/playwright/e2e/share-dialog/share-dialog.spec.ts:60:30

3) [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread Error: expect(locator).toBeVisible() Locator: getByLabel('The mark unread test room Unread messages.') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('The mark unread test room Unread messages.') 49 | await page.getByRole("menuitem", { name: "Mark as unread" }).click(); 50 | > 51 | expect(page.getByLabel(TEST_ROOM_NAME + " Unread messages.")).toBeVisible(); | ^ 52 | }); 53 | }); 54 | at /home/runner/work/element-web/element-web/playwright/e2e/room_options/marked_unread.spec.ts:51:71

4) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected) Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost" Received string: "" Call log: - expect.toHaveValue with timeout 5000ms - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') 9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select> - unexpected value "" 45 | 46 | // 2. wait for the new setting to apply ... > 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`); | ^ 48 | 49 | // 3. Check if the dialog overflows 50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59

5) [Chrome] › sliding-sync/sliding-sync.spec.ts:191:5 › Sliding Sync › should not show unread indicators Test timeout of 30000ms exceeded while running "beforeEach" hook. 84 | 85 | // Load the user fixture for all tests > 86 | test.beforeEach(({ user }) => {}); | ^ 87 | 88 | test("should render the Rooms list in reverse chronological order by default and allowing sorting A-Z", async ({ 89 | page, at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:86:10

5) [Chrome] › sliding-sync/sliding-sync.spec.ts:191:5 › Sliding Sync › should not show unread indicators Error: page.waitForSelector: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_MatrixChat') to be visible at ../element-web-test.ts:191 189 | user: async ({ pageWithCredentials: page, credentials }, use) => { 190 | await page.goto("/"); > 191 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 }); | ^ 192 | await use(credentials); 193 | }, 194 | at Object.user (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:191:20)

1) [Chrome] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:38 36 | 37 | // Synapse prompts us to pick a user ID > 38 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 39 | await page.getByRole("textbox", { name: "Username (required)" }).fill(`alice_${testInfo.testId}`); 40 | 41 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/element-web/element-web/playwright/e2e/login/utils.ts:38:78) at Object.user (/home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:30:26)

2) [Chrome] › oidc/oidc-native.spec.ts:20:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Error: expect(received).toHaveLength(expected) Expected length: 1 Received length: 0 Received array: [] Call Log: - Test timeout of 90000ms exceeded at oidc/index.ts:34 32 | messages = await mailhog.messages(); 33 | expect(messages.items).toHaveLength(1); > 34 | }).toPass(); | ^ 35 | expect(messages.items[0].to).toEqual(`${username} <${email}>`); 36 | const [, code] = messages.items[0].text.match(/Your verification code to confirm this email address is: (\d{6})/); 37 | at registerAccountMas (/home/runner/work/element-web/element-web/playwright/e2e/oidc/index.ts:34:8) at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:38:9

2) [Chrome] › oidc/oidc-native.spec.ts:20:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Error: page.waitForRequest: Test ended. 28 | 29 | const tokenUri = `${mas.baseUrl}/oauth2/token`; > 30 | const tokenApiPromise = page.waitForRequest( | ^ 31 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 32 | ); 33 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:30:38

Process completed with exit code 1.

[Chrome] › pinned-messages/pinned-messages.spec.ts took 59.9s

[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts took 27.8s

[Chrome] › polls/polls.spec.ts took 19.5s

[Chrome] › right-panel/file-panel.spec.ts took 19.4s

[Chrome] › messages/messages.spec.ts took 57.7s

[Chrome] › crypto/invisible-crypto.spec.ts took 29.6s

[Chrome] › knock/knock-into-room.spec.ts took 18.7s

[Chrome] › integration-manager/kick.spec.ts took 18.6s

[Chrome] › editing/editing.spec.ts took 15.9s

[Chrome] › crypto/event-shields.spec.ts took 52.9s

[Chrome] › audio-player/audio-player.spec.ts took 40.1s

[Chrome] › composer/RTE.spec.ts took 36.6s

[Chrome] › crypto/crypto.spec.ts took 34.6s

[Chrome] › accessibility/keyboard-navigation.spec.ts took 30.9s

[Chrome] › timeline/timeline.spec.ts took 1.3m

[Chrome] › spaces/spaces.spec.ts took 54.5s

[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 48.4s

[Chrome] › threads/threads.spec.ts took 19.4s

[Chrome] › room/room-header.spec.ts took 34.6s

[Chrome] › settings/account-user-settings-tab.spec.ts took 17.4s

[Chrome] › login/login-consent.spec.ts took 45.3s

[Chrome] › crypto/backups-mas.spec.ts took 30.9s

[Chrome] › app-loading/guest-registration.spec.ts took 26.0s

[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 23.9s

[Chrome] › register/register.spec.ts took 16.2s

1 flaky [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot 1 skipped 34 passed (3.3m)

1 skipped 65 passed (4.5m)

56 passed (5.0m)

1 flaky [Chrome] › spotlight/spotlight.spec.ts:362:5 › Spotlight › should be able to navigate results via keyboard 3 skipped 56 passed (5.2m)

2 failed [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot 3 flaky [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit [Chrome] › sliding-sync/sliding-sync.spec.ts:191:5 › Sliding Sync › should not show unread indicators 1 skipped 44 passed (5.8m)