Skip to content

Bump to JupyterLab 4.1.0a4 #1684

Bump to JupyterLab 4.1.0a4

Bump to JupyterLab 4.1.0a4 #1684

Triggered via pull request December 1, 2023 08:58
Status Failure
Total duration 12m 23s
Artifacts 8

ui-tests.yml

on: pull_request
Matrix: ui-tests
Fit to window
Zoom out
Zoom in

Annotations

27 errors and 4 notices
[chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory: ui-tests/test/links.spec.ts#L1
1) [chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory ─────────────── Test timeout of 60000ms exceeded.
[chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory: ui-tests/test/links.spec.ts#L25
1) [chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory ─────────────── Error: proxy.waitForEvent: Page closed =========================== logs =========================== waiting for event "popup" ============================================================ 23 | 24 | const [current] = await Promise.all([ > 25 | page.waitForEvent('popup'), | ^ 26 | page.getByText('Current Directory').last().click(), 27 | ]); 28 | at /home/runner/work/notebook/notebook/ui-tests/test/links.spec.ts:25:12
[chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory: ui-tests/test/links.spec.ts#L1
1) [chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory ─────────────── Pending operations: - locator.click at test/links.spec.ts:26:50
[chromium] › test/general.spec.ts:13:7 › General › The notebook should render: ui-tests/test/general.spec.ts#L52
1) [chromium] › test/general.spec.ts:13:7 › General › The notebook should render ───────────────── Error: Screenshot comparison failed: 11366 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-chromium/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-chromium/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-chromium/notebook-diff.png 50 | } 51 | > 52 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 53 | }); 54 | }); 55 | at /home/runner/work/notebook/notebook/ui-tests/test/general.spec.ts:52:37
[chromium] › test/general.spec.ts:13:7 › General › The notebook should render: ui-tests/test/general.spec.ts#L52
1) [chromium] › test/general.spec.ts:13:7 › General › The notebook should render ───────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 11366 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-chromium-retry1/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-chromium-retry1/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-chromium-retry1/notebook-diff.png 50 | } 51 | > 52 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 53 | }); 54 | }); 55 | at /home/runner/work/notebook/notebook/ui-tests/test/general.spec.ts:52:37
[chromium] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area: ui-tests/test/layout.spec.ts#L42
2) [chromium] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area Error: Screenshot comparison failed: 4735 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-chromium/debugger-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-chromium/debugger-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-chromium/debugger-diff.png 40 | expect(await panel.isVisible()).toBe(true); 41 | > 42 | expect(await panel.screenshot()).toMatchSnapshot('debugger.png'); | ^ 43 | }); 44 | }); 45 | at /home/runner/work/notebook/notebook/ui-tests/test/layout.spec.ts:42:38
[chromium] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area: ui-tests/test/layout.spec.ts#L42
2) [chromium] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4735 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-chromium-retry1/debugger-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-chromium-retry1/debugger-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-chromium-retry1/debugger-diff.png 40 | expect(await panel.isVisible()).toBe(true); 41 | > 42 | expect(await panel.screenshot()).toMatchSnapshot('debugger.png'); | ^ 43 | }); 44 | }); 45 | at /home/runner/work/notebook/notebook/ui-tests/test/layout.spec.ts:42:38
[chromium] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page: ui-tests/test/mobile.spec.ts#L27
3) [chromium] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page Error: Screenshot comparison failed: 4591 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-chromium/tree-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-chromium/tree-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-chromium/tree-diff.png 25 | await page.waitForSelector('#top-panel-wrapper', { state: 'hidden' }); 26 | > 27 | expect(await page.screenshot()).toMatchSnapshot('tree.png'); | ^ 28 | }); 29 | 30 | test('The layout should be more compact on the notebook page', async ({ at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:27:37
[chromium] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page: ui-tests/test/mobile.spec.ts#L27
3) [chromium] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4591 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-chromium-retry1/tree-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-chromium-retry1/tree-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-chromium-retry1/tree-diff.png 25 | await page.waitForSelector('#top-panel-wrapper', { state: 'hidden' }); 26 | > 27 | expect(await page.screenshot()).toMatchSnapshot('tree.png'); | ^ 28 | }); 29 | 30 | test('The layout should be more compact on the notebook page', async ({ at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:27:37
[chromium] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page: ui-tests/test/mobile.spec.ts#L59
4) [chromium] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page Error: Screenshot comparison failed: 4252 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-chromium/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-chromium/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-chromium/notebook-diff.png 57 | } 58 | > 59 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 60 | }); 61 | }); 62 | at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:59:37
[chromium] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page: ui-tests/test/mobile.spec.ts#L59
4) [chromium] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4252 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-chromium-retry1/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-chromium-retry1/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-chromium-retry1/notebook-diff.png 57 | } 58 | > 59 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 60 | }); 61 | }); 62 | at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:59:37
[chromium] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel: ui-tests/test/notebook.spec.ts#L132
5) [chromium] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel ──────── Error: Screenshot comparison failed: 1234 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-chromium/toc-left-panel-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-chromium/toc-left-panel-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-chromium/toc-left-panel-diff.png 130 | const imageName = 'toc-left-panel.png'; 131 | > 132 | expect(await panel.screenshot()).toMatchSnapshot(imageName); | ^ 133 | }); 134 | 135 | test('Open notebook tools right panel', async ({ page, tmpPath }) => { at /home/runner/work/notebook/notebook/ui-tests/test/notebook.spec.ts:132:38
[chromium] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel: ui-tests/test/notebook.spec.ts#L132
5) [chromium] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel ──────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1234 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-chromium-retry1/toc-left-panel-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-chromium-retry1/toc-left-panel-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-chromium-retry1/toc-left-panel-diff.png 130 | const imageName = 'toc-left-panel.png'; 131 | > 132 | expect(await panel.screenshot()).toMatchSnapshot(imageName); | ^ 133 | }); 134 | 135 | test('Open notebook tools right panel', async ({ page, tmpPath }) => { at /home/runner/work/notebook/notebook/ui-tests/test/notebook.spec.ts:132:38
[firefox] › test/filebrowser.spec.ts:31:7 › File Browser › Select one file: ui-tests/test/filebrowser.spec.ts#L39
1) [firefox] › test/filebrowser.spec.ts:31:7 › File Browser › Select one file ──────────────────── Error: expect(received).toBeVisible() Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('toolbar').getByText('Open') 37 | 38 | ['Rename', 'Delete', 'Open', 'Download', 'Delete'].forEach(async (text) => { > 39 | expect(toolbar.getByText(text)).toBeVisible(); | ^ 40 | }); 41 | }); 42 | at forEach (/home/runner/work/notebook/notebook/ui-tests/test/filebrowser.spec.ts:39:39) at /home/runner/work/notebook/notebook/ui-tests/test/filebrowser.spec.ts:38:56
[firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory: ui-tests/test/links.spec.ts#L1
2) [firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory ──────────────── Test timeout of 60000ms exceeded.
[firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory: ui-tests/test/links.spec.ts#L25
2) [firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory ──────────────── Error: proxy.waitForEvent: Page closed =========================== logs =========================== waiting for event "popup" ============================================================ 23 | 24 | const [current] = await Promise.all([ > 25 | page.waitForEvent('popup'), | ^ 26 | page.getByText('Current Directory').last().click(), 27 | ]); 28 | at /home/runner/work/notebook/notebook/ui-tests/test/links.spec.ts:25:12
[firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory: ui-tests/test/links.spec.ts#L1
2) [firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory ──────────────── Pending operations: - locator.click at test/links.spec.ts:26:50
[firefox] › test/general.spec.ts:13:7 › General › The notebook should render: ui-tests/test/general.spec.ts#L52
1) [firefox] › test/general.spec.ts:13:7 › General › The notebook should render ────────────────── Error: Screenshot comparison failed: 11379 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-firefox/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-firefox/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-firefox/notebook-diff.png 50 | } 51 | > 52 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 53 | }); 54 | }); 55 | at /home/runner/work/notebook/notebook/ui-tests/test/general.spec.ts:52:37
[firefox] › test/general.spec.ts:13:7 › General › The notebook should render: ui-tests/test/general.spec.ts#L52
1) [firefox] › test/general.spec.ts:13:7 › General › The notebook should render ────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 11389 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-firefox-retry1/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-firefox-retry1/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-general-General-The-notebook-should-render-firefox-retry1/notebook-diff.png 50 | } 51 | > 52 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 53 | }); 54 | }); 55 | at /home/runner/work/notebook/notebook/ui-tests/test/general.spec.ts:52:37
[firefox] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area: ui-tests/test/layout.spec.ts#L42
2) [firefox] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area Error: Screenshot comparison failed: 5021 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-firefox/debugger-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-firefox/debugger-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-firefox/debugger-diff.png 40 | expect(await panel.isVisible()).toBe(true); 41 | > 42 | expect(await panel.screenshot()).toMatchSnapshot('debugger.png'); | ^ 43 | }); 44 | }); 45 | at /home/runner/work/notebook/notebook/ui-tests/test/layout.spec.ts:42:38
[firefox] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area: ui-tests/test/layout.spec.ts#L42
2) [firefox] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 5021 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-firefox-retry1/debugger-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-firefox-retry1/debugger-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-layout-Layout-Customization-The-Debugger--4f80d--respect-the-settings-and-open-in-the-left-area-firefox-retry1/debugger-diff.png 40 | expect(await panel.isVisible()).toBe(true); 41 | > 42 | expect(await panel.screenshot()).toMatchSnapshot('debugger.png'); | ^ 43 | }); 44 | }); 45 | at /home/runner/work/notebook/notebook/ui-tests/test/layout.spec.ts:42:38
[firefox] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page: ui-tests/test/mobile.spec.ts#L27
3) [firefox] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page Error: Screenshot comparison failed: 4747 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-firefox/tree-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-firefox/tree-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-firefox/tree-diff.png 25 | await page.waitForSelector('#top-panel-wrapper', { state: 'hidden' }); 26 | > 27 | expect(await page.screenshot()).toMatchSnapshot('tree.png'); | ^ 28 | }); 29 | 30 | test('The layout should be more compact on the notebook page', async ({ at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:27:37
[firefox] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page: ui-tests/test/mobile.spec.ts#L27
3) [firefox] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4747 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-firefox-retry1/tree-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-firefox-retry1/tree-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-file-browser-page-firefox-retry1/tree-diff.png 25 | await page.waitForSelector('#top-panel-wrapper', { state: 'hidden' }); 26 | > 27 | expect(await page.screenshot()).toMatchSnapshot('tree.png'); | ^ 28 | }); 29 | 30 | test('The layout should be more compact on the notebook page', async ({ at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:27:37
[firefox] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page: ui-tests/test/mobile.spec.ts#L59
4) [firefox] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page Error: Screenshot comparison failed: 4262 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-firefox/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-firefox/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-firefox/notebook-diff.png 57 | } 58 | > 59 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 60 | }); 61 | }); 62 | at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:59:37
[firefox] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page: ui-tests/test/mobile.spec.ts#L59
4) [firefox] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 4262 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-firefox-retry1/notebook-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-firefox-retry1/notebook-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-mobile-Mobile-The-layout-should-be-more-compact-on-the-notebook-page-firefox-retry1/notebook-diff.png 57 | } 58 | > 59 | expect(await page.screenshot()).toMatchSnapshot('notebook.png'); | ^ 60 | }); 61 | }); 62 | at /home/runner/work/notebook/notebook/ui-tests/test/mobile.spec.ts:59:37
[firefox] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel: ui-tests/test/notebook.spec.ts#L132
5) [firefox] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel ───────── Error: Screenshot comparison failed: 1236 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-firefox/toc-left-panel-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-firefox/toc-left-panel-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-firefox/toc-left-panel-diff.png 130 | const imageName = 'toc-left-panel.png'; 131 | > 132 | expect(await panel.screenshot()).toMatchSnapshot(imageName); | ^ 133 | }); 134 | 135 | test('Open notebook tools right panel', async ({ page, tmpPath }) => { at /home/runner/work/notebook/notebook/ui-tests/test/notebook.spec.ts:132:38
[firefox] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel: ui-tests/test/notebook.spec.ts#L132
5) [firefox] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel ───────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1236 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-firefox-retry1/toc-left-panel-expected.png Received: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-firefox-retry1/toc-left-panel-actual.png Diff: /home/runner/work/notebook/notebook/ui-tests/test-results/test-notebook-Notebook-Open-table-of-content-left-panel-firefox-retry1/toc-left-panel-diff.png 130 | const imageName = 'toc-left-panel.png'; 131 | > 132 | expect(await panel.screenshot()).toMatchSnapshot(imageName); | ^ 133 | }); 134 | 135 | test('Open notebook tools right panel', async ({ page, tmpPath }) => { at /home/runner/work/notebook/notebook/ui-tests/test/notebook.spec.ts:132:38
🎭 Playwright Run Summary
1 flaky [chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory ──────────────── 34 passed (2.0m)
🎭 Playwright Run Summary
6 failed [chromium] › test/general.spec.ts:13:7 › General › The notebook should render ────────────────── [chromium] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area [chromium] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page [chromium] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page [chromium] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel ───────── [chromium] › test/settings.spec.ts:11:7 › Settings › Should be persisted after reloading the page 1 flaky [chromium] › test/links.spec.ts:21:7 › Local Links › Open the current directory ──────────────── 28 passed (2.5m)
🎭 Playwright Run Summary
2 flaky [firefox] › test/filebrowser.spec.ts:31:7 › File Browser › Select one file ───────────────────── [firefox] › test/links.spec.ts:21:7 › Local Links › Open the current directory ───────────────── 33 passed (2.3m)
🎭 Playwright Run Summary
6 failed [firefox] › test/general.spec.ts:13:7 › General › The notebook should render ─────────────────── [firefox] › test/layout.spec.ts:24:7 › Layout Customization › The Debugger panel should respect the settings and open in the left area [firefox] › test/mobile.spec.ts:15:7 › Mobile › The layout should be more compact on the file browser page [firefox] › test/mobile.spec.ts:30:7 › Mobile › The layout should be more compact on the notebook page [firefox] › test/notebook.spec.ts:103:7 › Notebook › Open table of content left panel ────────── [firefox] › test/settings.spec.ts:11:7 › Settings › Should be persisted after reloading the page 1 flaky [firefox] › test/filebrowser.spec.ts:31:7 › File Browser › Select one file ───────────────────── 28 passed (2.9m)

Artifacts

Produced during runtime
Name Size
notebook-chromium-test-assets Expired
9.37 MB
notebook-chromium-test-report Expired
10.6 MB
notebook-chromium-updated-snapshots Expired
429 KB
notebook-dist-1684 Expired
9.4 MB
notebook-firefox-test-assets Expired
11.8 MB
notebook-firefox-test-report Expired
13 MB
notebook-firefox-updated-snapshots Expired
458 KB
notebook-pkgs-1684 Expired
53.6 KB