Dmitry Gozman 3e73a6ce69

feat(test runner): show multiple errors, at most one per stage (#30024) ...

Previously, there was at most one "hard error", as opposite to multiple
"soft errors". This was done to preserve the historic behavior at the
time of introducing multiple `TestInfo.errors`.

With this change, every user callback that is executed `withRunnable()`
can throw an error and/or timeout, and both of these will end up in
`TestInfo.errors`.

Additionally, there is at most one "unhandled exception" error, to avoid
flooding the report with mass failures.

Drive-by: remove boolean arguments from `_failWithError()`.

Fixes #29876.

2024-03-20 21:01:30 -07:00

..

__screenshots__/playwright.artifacts.spec.ts

feat: allow options in automatic screenshots (#19143)

2022-12-07 08:45:33 -08:00

assets

chore: allow calling spawnSync on Node.js file inside test (#26429)

2023-08-11 18:37:14 +02:00

stable-test-runner

chore: roll stable runner to 1.42.0-beta-1708998235000 (#29675)

2024-02-27 08:36:03 -08:00

access-data.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

babel.spec.ts

chore: allow marking scripts as external for transform (#23449)

2023-06-01 20:28:49 -07:00

basic.spec.ts

chore: rewrite worker main through TestInfoImpl._runAsStage (#29644)

2024-03-04 19:36:58 -08:00

command-line-filter.spec.ts

chore: remove unnecessary args in ttest (#21012)

2023-02-18 13:08:17 -08:00

config.spec.ts

chore: remove --project-grep, add wildcard support (#29537)

2024-02-16 19:18:00 -08:00

decorators.spec.ts

chore: allow ts decorators (#22080)

2023-03-29 20:43:08 -07:00

deps.spec.ts

chore(test runner): do not produce some of the fake skipped test results (#27730)

2023-10-20 17:01:46 -07:00

esm.spec.ts

feat: always enable ESM loader with the new API (#29991)

2024-03-18 21:54:25 -07:00

exit-code.spec.ts

fix: collect stdio from forked processes (#27074)

2023-09-14 18:34:26 +02:00

expect-configure.spec.ts

chore: populate matcherResult in web assertions (#27133)

2023-09-16 14:24:10 -07:00

expect-poll.spec.ts

chore: show last poller error on test timeout (#24292)

2023-07-18 17:03:26 -07:00

expect-soft.spec.ts

docs: do not call custom expect message an "error message" (#29390)

2024-02-06 12:12:45 -08:00

expect-to-pass.spec.ts

feat(expect): Make toPass's option configurable by TestConfig (#28231)

2024-01-16 12:28:38 +01:00

expect.spec.ts

docs: do not call custom expect message an "error message" (#29390)

2024-02-06 12:12:45 -08:00

find-related-tests.spec.ts

chore: rename find-related-tests to find-related-test-files (#29483)

2024-02-13 15:40:49 -08:00

fixture-errors.spec.ts

feat(test runner): show multiple errors, at most one per stage (#30024)

2024-03-20 21:01:30 -07:00

fixtures.spec.ts

fix(test runner): make sure auto worker fixtures run before auto test fixtures (#27131)

2023-09-15 14:51:31 -07:00

gitignore.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

global-setup.spec.ts

chore: pass the private data to the runner via config (#29467)

2024-02-13 09:34:03 -08:00

golden.spec.ts

chore: separate results for repeated snapshot names (#29880)

2024-03-12 16:10:43 -07:00

hooks.spec.ts

chore(test runner): move timeout handling to the top, stop inheriting runnable (#29857)

2024-03-08 15:19:36 -08:00

list-files.spec.ts

chore: implement server-based list files (#29633)

2024-02-23 08:29:44 -08:00

list-mode.spec.ts

Revert "fix: respect .only in --list mode" (#28770)

2023-12-22 11:03:30 -08:00

loader.spec.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

match-grep.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

max-failures.spec.ts

chore(test runner): do not produce some of the fake skipped test results (#27730)

2023-10-20 17:01:46 -07:00

override-timeout.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

playwright-test-fixtures.ts

feat: exposes tags in testInfo (#29794)

2024-03-06 08:33:06 -08:00

playwright.artifacts.spec.ts

feat(trace mode): add on-first-failure mode for traces (#29647)

2024-02-28 14:39:18 -08:00

playwright.config.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

playwright.config.ts

devops: custom blob report name for test runner tests (#29280)

2024-02-01 09:17:48 -08:00

playwright.connect.spec.ts

Fix various typos (Fixes #27396) (#27391)

2023-10-04 19:56:42 -07:00

playwright.ct-build.spec.ts

fix(ct): resolve components used in tests during the vite build (#29407)

2024-02-07 20:39:45 -08:00

playwright.ct-react.spec.ts

fix(ct): stop-gap for shared file import (#29744)

2024-02-29 19:13:32 -08:00

playwright.fetch.spec.ts

test: unflake "should stop tracing on requestContext.dispose()" (#23489)

2023-06-02 16:37:50 -07:00

playwright.reuse.browser.spec.ts

fix: encode launch options correctly when reusing browser (#24174)

2023-07-12 16:40:55 +02:00

playwright.reuse.spec.ts

fix(reuse): reset Origin Private File System API (#29921)

2024-03-15 17:40:46 +01:00

playwright.spec.ts

chore: delete store.ts (#29423)

2024-02-08 12:55:18 -08:00

playwright.trace.spec.ts

chore(test runner): move timeout handling to the top, stop inheriting runnable (#29857)

2024-03-08 15:19:36 -08:00

playwright.unhandled.spec.ts

fix(test runner): properly handle uncaught errors in test.fail() (#27734)

2023-10-23 09:14:31 -07:00

repeat-each.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

reporter-attachment.spec.ts

fix: quote trace file path when printing error message (#29052)

2024-01-18 14:23:12 -08:00

reporter-base.spec.ts

chore(test runner): do not produce some of the fake skipped test results (#27730)

2023-10-20 17:01:46 -07:00

reporter-blob.spec.ts

chore: do not use project id in telereporter (#29776)

2024-03-01 21:44:08 -08:00

reporter-dot.spec.ts

chore: run more reporter tests through blob report, some fixes (#23765)

2023-06-16 21:30:55 -07:00

reporter-github.spec.ts

chore: run more reporter tests through blob report, some fixes (#23765)

2023-06-16 21:30:55 -07:00

reporter-html.spec.ts

chore: separate results for repeated snapshot names (#29880)

2024-03-12 16:10:43 -07:00

reporter-json.spec.ts

chore: remove --tag and tagFilter (#29468)

2024-02-15 11:37:16 -08:00

reporter-junit.spec.ts

fix: render JUnit attachment paths relative to outputFile (#27024)

2023-09-14 12:58:09 -07:00

reporter-line.spec.ts

chore: run more reporter tests through blob report, some fixes (#23765)

2023-06-16 21:30:55 -07:00

reporter-list.spec.ts

chore: more network panel polish (#26780)

2023-08-29 22:20:28 -07:00

reporter-markdown.spec.ts

fix(merge): normalize path separators when merging across platforms (#28227)

2023-11-27 12:43:56 -08:00

reporter-onend.spec.ts

feat(onEnd): allow overriding the exit code (#27010)

2023-09-12 13:37:30 -07:00

reporter.spec.ts

chore(test runner): move timeout handling to the top, stop inheriting runnable (#29857)

2024-03-08 15:19:36 -08:00

resolver.spec.ts

fix(tsconfig): when extending, retain pathsBasePath from the original config (#29822)

2024-03-05 16:34:39 -08:00

retry.spec.ts

Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360)

2023-11-27 16:08:20 -08:00

runner.spec.ts

chore: pass the private data to the runner via config (#29467)

2024-02-13 09:34:03 -08:00

shard.spec.ts

Fix various typos (Fixes #27396) (#27391)

2023-10-04 19:56:42 -07:00

snapshot-path-template.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

stdio.spec.ts

fix: tty.WriteStream method stubs for process.stdout/stderr (#29865)

2024-03-11 10:11:16 -07:00

test-extend.spec.ts

chore: composed->merge (#27555)

2023-10-11 13:56:27 -07:00

test-grep.spec.ts

Fix various typos (Fixes #27396) (#27391)

2023-10-04 19:56:42 -07:00

test-ignore.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

test-info.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

test-modifiers.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

test-output-dir.spec.ts

chore: trim file names longer than 60 chars (was 100) (#29725)

2024-03-18 12:53:15 -07:00

test-parallel.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

test-serial.spec.ts

Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360)

2023-11-27 16:08:20 -08:00

test-step.spec.ts

chore(test runner): move timeout handling to the top, stop inheriting runnable (#29857)

2024-03-08 15:19:36 -08:00

test-tag.spec.ts

feat: exposes tags in testInfo (#29794)

2024-03-06 08:33:06 -08:00

test-use.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

timeout.spec.ts

chore(test runner): move timeout handling to the top, stop inheriting runnable (#29857)

2024-03-08 15:19:36 -08:00

to-have-screenshot.spec.ts

fix(toHaveScreenshot): stylePath as first arg (#29372)

2024-02-05 22:52:16 +01:00

types-2.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

types.spec.ts

fix(components): make sure defineConfig(c1, c2) works (#28608)

2023-12-12 14:01:01 -08:00

ui-mode-fixtures.ts

chore: get rid of rimraf package (#27790)

2023-10-26 19:41:00 +02:00

ui-mode-test-attachments.spec.ts

fix(trace-viewer): encode attachment filenames as UTF-8 (#29993)

2024-03-18 21:26:45 +01:00

ui-mode-test-ct.spec.ts

chore: automatically detect the dev server (#29176)

2024-01-25 11:46:47 -08:00

ui-mode-test-filters.spec.ts

feat(ui mode): text filter should filter by explicit tags (#29821)

2024-03-05 10:58:55 -08:00

ui-mode-test-output.spec.ts

chore: implement faster ansi2html format for console (#26826)

2023-09-01 09:09:47 -07:00

ui-mode-test-progress.spec.ts

fix(test runner): make TestTracing responsible for trace management (#29181)

2024-01-26 15:52:25 -08:00

ui-mode-test-run.spec.ts

chore: fix total progress reporting w/ deps (#27716)

2023-10-19 20:07:47 -07:00

ui-mode-test-screencast.spec.ts

chore: do not select after hooks automatically (#27805)

2023-10-25 17:05:06 -07:00

ui-mode-test-setup.spec.ts

chore: prepare to reuse test server from ui mode (4) (#29995)

2024-03-19 13:00:49 -07:00

ui-mode-test-shortcut.spec.ts

feat(ui-mode): add key shortcuts for playwright uI test runner (#29868)

2024-03-19 12:36:42 +01:00

ui-mode-test-source.spec.ts

chore: do not lose error name for js errors (#28177)

2023-11-15 18:27:32 -08:00

ui-mode-test-tree.spec.ts

fix(ui): do not fail on clashing groups (#27943)

2023-11-02 20:50:08 -07:00

ui-mode-test-update.spec.ts

chore: prepare to reuse test server from ui mode (5) (#30005)

2024-03-19 14:08:21 -07:00

ui-mode-test-watch.spec.ts

chore: prepare to reuse test server from ui mode (2) (#29966)

2024-03-18 09:59:02 -07:00

ui-mode-trace.spec.ts

chore(test runner): move timeout handling to the top, stop inheriting runnable (#29857)

2024-03-08 15:19:36 -08:00

watch.spec.ts

fix(test runner): avoid dependency tracking colliding between esm and cjs (#29994)

2024-03-18 17:17:58 -07:00

web-server.spec.ts

fix(HEAD): revert GET->HEAD migration, net-effect was negative (#29738)

2024-02-29 09:02:05 -08:00

worker-index.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00