Dmitry Gozman 3331a40647

feat(test runner): tags/annotations (#29248) ...

API changes:
- `test(title, details, body)` where details contain `tag` and
`annotation`.
- similar `details` property added to `test.skip`, `test.fail`,
`test.fixme`, `test.only`, `test.describe` and other `test.describe.*`
variations.
- `TestProject.tagFilter`/`TestConfig.tagFilter` that supports logical
tag expressions with `(`, `)`, `and`, `or` and `not`.
- `--tag` CLI option to filter by tags.
- New annotations are available in `TestInfo.annotations` and
`TestCase.annotations`.
- New tags are available in `TestCase.tags`.
    
Reporter changes:
- `json` reporter includes new tags in addition to old `@smoke`-style
tags. **Breaking**: tags are now listed with the leading `@` symbol.
- `html` reporter filters by old and new tags with the same `@smoke`
token.

Fixes #29229, fixes #23180.

2024-02-07 16:31:25 -08:00

..

__screenshots__/playwright.artifacts.spec.ts

feat: allow options in automatic screenshots (#19143)

2022-12-07 08:45:33 -08:00

assets

chore: allow calling spawnSync on Node.js file inside test (#26429)

2023-08-11 18:37:14 +02:00

stable-test-runner

chore: roll stable-test-runner to 1.41.0-beta-1705101589000 (#28993)

2024-01-16 08:59:55 -08:00

access-data.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

babel.spec.ts

chore: allow marking scripts as external for transform (#23449)

2023-06-01 20:28:49 -07:00

basic.spec.ts

fix(test): do not allow mixing tests from different types (#29284)

2024-02-01 11:59:56 -08:00

command-line-filter.spec.ts

chore: remove unnecessary args in ttest (#21012)

2023-02-18 13:08:17 -08:00

config.spec.ts

feat: parse projects option as RegExp (#29327)

2024-02-02 23:05:20 +01:00

decorators.spec.ts

chore: allow ts decorators (#22080)

2023-03-29 20:43:08 -07:00

deps.spec.ts

chore(test runner): do not produce some of the fake skipped test results (#27730)

2023-10-20 17:01:46 -07:00

esm.spec.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

exit-code.spec.ts

fix: collect stdio from forked processes (#27074)

2023-09-14 18:34:26 +02:00

expect-configure.spec.ts

chore: populate matcherResult in web assertions (#27133)

2023-09-16 14:24:10 -07:00

expect-poll.spec.ts

chore: show last poller error on test timeout (#24292)

2023-07-18 17:03:26 -07:00

expect-soft.spec.ts

docs: do not call custom expect message an "error message" (#29390)

2024-02-06 12:12:45 -08:00

expect-to-pass.spec.ts

feat(expect): Make toPass's option configurable by TestConfig (#28231)

2024-01-16 12:28:38 +01:00

expect.spec.ts

docs: do not call custom expect message an "error message" (#29390)

2024-02-06 12:12:45 -08:00

fixture-errors.spec.ts

fix(fixtures): tear down base fixture after error in derived (#29337)

2024-02-05 16:47:15 -08:00

fixtures.spec.ts

fix(test runner): make sure auto worker fixtures run before auto test fixtures (#27131)

2023-09-15 14:51:31 -07:00

gitignore.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

global-setup.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

golden.spec.ts

fix: Add support for exif jpeg file formats (#29208)

2024-01-29 14:58:13 -08:00

hooks.spec.ts

Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360)

2023-11-27 16:08:20 -08:00

list-files.spec.ts

chore: do not lose error name for js errors (#28177)

2023-11-15 18:27:32 -08:00

list-mode.spec.ts

Revert "fix: respect .only in --list mode" (#28770)

2023-12-22 11:03:30 -08:00

loader.spec.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

match-grep.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

max-failures.spec.ts

chore(test runner): do not produce some of the fake skipped test results (#27730)

2023-10-20 17:01:46 -07:00

override-timeout.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

playwright-test-fixtures.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

playwright.artifacts.spec.ts

chore: get rid of rimraf package (#27790)

2023-10-26 19:41:00 +02:00

playwright.config.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

playwright.config.ts

devops: custom blob report name for test runner tests (#29280)

2024-02-01 09:17:48 -08:00

playwright.connect.spec.ts

Fix various typos (Fixes #27396) (#27391)

2023-10-04 19:56:42 -07:00

playwright.ct-build.spec.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

playwright.ct-react.spec.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

playwright.fetch.spec.ts

test: unflake "should stop tracing on requestContext.dispose()" (#23489)

2023-06-02 16:37:50 -07:00

playwright.reuse.browser.spec.ts

fix: encode launch options correctly when reusing browser (#24174)

2023-07-12 16:40:55 +02:00

playwright.reuse.spec.ts

fix(trace): render items under expect.toPass (#24016)

2023-07-05 11:20:28 -07:00

playwright.spec.ts

chore: get rid of rimraf package (#27790)

2023-10-26 19:41:00 +02:00

playwright.trace.spec.ts

fix(test runner): make TestTracing responsible for trace management (#29181)

2024-01-26 15:52:25 -08:00

playwright.unhandled.spec.ts

fix(test runner): properly handle uncaught errors in test.fail() (#27734)

2023-10-23 09:14:31 -07:00

repeat-each.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

reporter-attachment.spec.ts

fix: quote trace file path when printing error message (#29052)

2024-01-18 14:23:12 -08:00

reporter-base.spec.ts

chore(test runner): do not produce some of the fake skipped test results (#27730)

2023-10-20 17:01:46 -07:00

reporter-blob.spec.ts

fix: make TeleSuite.project work for all suites (#29177)

2024-01-25 13:44:08 -08:00

reporter-dot.spec.ts

chore: run more reporter tests through blob report, some fixes (#23765)

2023-06-16 21:30:55 -07:00

reporter-github.spec.ts

chore: run more reporter tests through blob report, some fixes (#23765)

2023-06-16 21:30:55 -07:00

reporter-html.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

reporter-json.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

reporter-junit.spec.ts

fix: render JUnit attachment paths relative to outputFile (#27024)

2023-09-14 12:58:09 -07:00

reporter-line.spec.ts

chore: run more reporter tests through blob report, some fixes (#23765)

2023-06-16 21:30:55 -07:00

reporter-list.spec.ts

chore: more network panel polish (#26780)

2023-08-29 22:20:28 -07:00

reporter-markdown.spec.ts

fix(merge): normalize path separators when merging across platforms (#28227)

2023-11-27 12:43:56 -08:00

reporter-onend.spec.ts

feat(onEnd): allow overriding the exit code (#27010)

2023-09-12 13:37:30 -07:00

reporter.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

resolver.spec.ts

feat(tsconfig): respect tsconfig references (#29330)

2024-02-02 16:18:44 -08:00

retry.spec.ts

Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360)

2023-11-27 16:08:20 -08:00

runner.spec.ts

Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360)

2023-11-27 16:08:20 -08:00

shard.spec.ts

Fix various typos (Fixes #27396) (#27391)

2023-10-04 19:56:42 -07:00

snapshot-path-template.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

stdio.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

store.spec.ts

chore: hide store from public (#21763)

2023-03-17 11:50:44 -07:00

test-extend.spec.ts

chore: composed->merge (#27555)

2023-10-11 13:56:27 -07:00

test-grep.spec.ts

Fix various typos (Fixes #27396) (#27391)

2023-10-04 19:56:42 -07:00

test-ignore.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

test-info.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

test-modifiers.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

test-output-dir.spec.ts

chore: do not lose error name for js errors (#28177)

2023-11-15 18:27:32 -08:00

test-parallel.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

test-serial.spec.ts

Revert "chore(test runner): remove fake skipped test results (#27762)" (#28360)

2023-11-27 16:08:20 -08:00

test-step.spec.ts

chore: box step w/o modifying runtime errors (#28762)

2023-12-22 12:00:17 -08:00

test-tag.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

test-use.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00

timeout.spec.ts

chrome: improve error messages on vscode side (#27521)

2023-10-09 19:55:24 -07:00

to-have-screenshot.spec.ts

fix(toHaveScreenshot): stylePath as first arg (#29372)

2024-02-05 22:52:16 +01:00

types-2.spec.ts

feat(test runner): tags/annotations (#29248)

2024-02-07 16:31:25 -08:00

types.spec.ts

fix(components): make sure defineConfig(c1, c2) works (#28608)

2023-12-12 14:01:01 -08:00

ui-mode-fixtures.ts

chore: get rid of rimraf package (#27790)

2023-10-26 19:41:00 +02:00

ui-mode-test-attachments.spec.ts

chore: fix ui mode to show screenshots (#26563)

2023-08-20 14:47:18 -07:00

ui-mode-test-ct.spec.ts

chore: automatically detect the dev server (#29176)

2024-01-25 11:46:47 -08:00

ui-mode-test-filters.spec.ts

test(ui-mode): make retries (#23136)

2023-05-18 11:28:28 -07:00

ui-mode-test-output.spec.ts

chore: implement faster ansi2html format for console (#26826)

2023-09-01 09:09:47 -07:00

ui-mode-test-progress.spec.ts

fix(test runner): make TestTracing responsible for trace management (#29181)

2024-01-26 15:52:25 -08:00

ui-mode-test-run.spec.ts

chore: fix total progress reporting w/ deps (#27716)

2023-10-19 20:07:47 -07:00

ui-mode-test-screencast.spec.ts

chore: do not select after hooks automatically (#27805)

2023-10-25 17:05:06 -07:00

ui-mode-test-setup.spec.ts

fix(ui-mode): run teardown handlers with Command + C (#24267)

2023-07-19 17:50:25 +02:00

ui-mode-test-source.spec.ts

chore: do not lose error name for js errors (#28177)

2023-11-15 18:27:32 -08:00

ui-mode-test-tree.spec.ts

fix(ui): do not fail on clashing groups (#27943)

2023-11-02 20:50:08 -07:00

ui-mode-test-update.spec.ts

test(ui-mode): make retries (#23136)

2023-05-18 11:28:28 -07:00

ui-mode-test-watch.spec.ts

chore(ui): do not watch output folders (#27694)

2023-10-19 15:53:57 -07:00

ui-mode-trace.spec.ts

fix(trace viewer): reveal error location when it comes from the test (#29268)

2024-02-01 08:23:07 -08:00

watch.spec.ts

chore: unconflict ct test ports (#29332)

2024-02-05 16:47:39 -08:00

web-server.spec.ts

chore: automatically detect the dev server (#29176)

2024-01-25 11:46:47 -08:00

worker-index.spec.ts

test: remove magic headers in ttest (#20867)

2023-02-14 19:20:56 -08:00