384 Commits

Author SHA1 Message Date
yuyutaotao
cd00680b76
fix: make puppeteer external in web-integration (#208)
* fix: make puppeteer external in web-integration

* fix: import path of yaml player

* fix: import path of yaml player
2024-12-25 23:53:11 +08:00
yuyutaotao
05dad23bfd
chore: print yaml file in chrome extension (#205) 2024-12-25 20:23:12 +08:00
github-actions[bot]
a5066d2f58 release: v0.8.9 2024-12-24 14:45:57 +00:00
github-actions[bot]
1e76905b5f release: v0.8.8 2024-12-23 07:08:16 +00:00
yuyutaotao
e6343b63f4
fix: keypress issue in chrome extension (#201)
* fix: keypress issue in chrome extension

* fix: keypress issue in chrome extension

* fix: connectivity

* doc: update readme
2024-12-23 14:38:07 +08:00
yuyutaotao
21b3574280
fix: fix scroll action in chrome extension (#194) 2024-12-23 12:11:10 +08:00
yuyutaotao
f3d46b504d
feat: invoke anthropic SDK to call Claude (#197)
* feat: invoke anthropic SDK

* chore: set response format for extract

* fix: do not throw if waitUntilNetworkIdle failed in aiAction

* fix: timeout config for Puppeteer

* chore: add instruction for connectivity test
2024-12-23 12:03:05 +08:00
github-actions[bot]
48fa8a56a8 release: v0.8.7 2024-12-19 08:27:51 +00:00
yuyutaotao
523adab12f
feat: support the if-statement in planning prompt (#184) 2024-12-19 10:44:08 +08:00
github-actions[bot]
3dc57eef32 release: v0.8.6 2024-12-16 07:41:16 +00:00
yuyutaotao
537a5c43d0
feat: add a real-time progress indicator for playground (#177) 2024-12-16 15:04:21 +08:00
yuyutaotao
863e5a54d0
fix: sandbox issue of puppeteer in Ubuntu (#176)
* fix: disable setuid sandbox in cli

* fix: disable setuid sandbox in cli
2024-12-10 09:24:43 +08:00
github-actions[bot]
91896c421a release: v0.8.5 2024-12-09 09:11:52 +00:00
yuyutaotao
082e347da9
feat: replanning before locating (#167) 2024-12-08 20:12:17 +08:00
Zhou xiao
ebc88adc07
feat(core): Enhance environment logic and introduce MIDSCENE_REPORT_TAG_NAME for customizable report name prefixes (#168) 2024-11-26 16:23:04 +08:00
yuyutaotao
e7a58b3b24
faet: support yaml style scripts (#165) 2024-11-25 16:05:01 +08:00
yuyutaotao
4282e7bf07
feat: lower the cost of page description (#159) 2024-11-20 16:00:34 +08:00
github-actions[bot]
27ca8f9271 release: v0.8.4 2024-11-19 10:08:44 +00:00
github-actions[bot]
3dd487467b release: v0.8.3 2024-11-19 08:05:50 +00:00
Zhou xiao
845fb41b9a
chore: add configuration for uploading report information (#166)
* chore: add repo upload logic

* chore: add report upload logic

* chore: delete unless env
2024-11-19 16:01:13 +08:00
github-actions[bot]
d4cd844a67 release: v0.8.2 2024-11-18 09:35:14 +00:00
github-actions[bot]
4972d22ec4 release: v0.8.1 2024-11-15 08:41:21 +00:00
yuyutaotao
94b5189187
chore: build extension in release action (#158)
* chore: build extension in release action

* fix: always use the latest config in UI

* fix: workflow

* fix: workflow

* fix: workflow

* fix: release workflow
2024-11-15 06:51:24 +08:00
yuyutaotao
26779cf082
fix: fix some extraction bug in extension (#157) 2024-11-14 19:29:22 +08:00
yuyutaotao
48fa92f037
workflow(ci): AI test cases (#154)
* fix: AI test

* chore: add more links in README
2024-11-13 15:01:21 +08:00
github-actions[bot]
3117584e57 release: v0.8.0 2024-11-11 10:39:38 +00:00
Zhou xiao
08d46becf1
feat(cache): optimize cache logic id and export overrideAIConfig (#148)
* chore(cache): optimize cache logic id and export overrideAIConfig

* chore: use cache logic
2024-11-07 21:06:01 +08:00
yuyutaotao
f8507efd50
chore: some minor bug fixes (#146)
* feat: always use latest process.env as fallback

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-11-07 11:29:50 +08:00
yuyutaotao
198172dc4e
feat: optimize the speed of screenshot in browser (#144)
* feat: optimize the speed of screenshot in browser

* feat: remove unnecessary context call

* fix: CI
2024-11-05 14:28:16 +08:00
yuyutaotao
9e1eef5cfd
feat: Build a chrome extension for playground (#140) 2024-11-05 11:49:21 +08:00
Zhou xiao
1eb4c8de9f
workflow(ci): fix ci error (#142) 2024-11-04 17:14:14 +08:00
Zhou xiao
adb9b58879
feat(ai-model): add claude computer ablity (#136)
* Add new changes

* Add computer test results and update AI evaluation tests

* chore: Update build outputs and configurations

* feat(ai-model): support claude computer ability use position replace element id

* feat: generate add and commit

* feat: implement computer ability test for Claude

* chore: fix build Lose

* chore: Add and commit changes

* chore: optimize ai position

* chore: optimize ai position

* Add AI evaluation results and update tests

* chore: optimize ai test

* chore: add and commit changes

* chore: optimize ai test content

* chore: fix test case

* chore: fix e2e test
2024-10-31 18:18:31 +08:00
yuyutaotao
c288baa448
feat: make playground working in the browser (#135)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-28 11:04:40 +08:00
github-actions[bot]
617f2213cf release: v0.7.2 2024-10-24 07:21:00 +00:00
yuyutaotao
2060c0e6ef
fix: Playwright fixture fail to run (#137) 2024-10-24 14:37:48 +08:00
github-actions[bot]
0199719e44 release: v0.7.1 2024-10-22 07:43:31 +00:00
github-actions[bot]
ab815fef56 release: v0.7.0 2024-10-21 08:34:43 +00:00
yuyutaotao
7d4f9847f5
feat: add a playground page to debug (#131)
* fix: fix the Player style when the locator is failed

* feat: add Playground UI

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-21 16:30:07 +08:00
Zhou xiao
f312cecbac
refactor(extract): optimize image box selection (#130)
* refactor(extract): optimize image box selection

* chore: Optimize the logic for generating AI test data to avoid producing duplicate data

* Update code and configurations

* Update code and configurations

* chore: fix lint error
2024-10-17 14:58:19 +08:00
yuyutaotao
ee521e31e0
fix: fix the Player style when the locator is failed (#129)
* fix: fix the Player style when the locator is failed

* fix: add marker image into UIContext
2024-10-17 10:44:30 +08:00
github-actions[bot]
9f44eedfd9 release: v0.6.2 2024-10-15 03:26:29 +00:00
yuyutaotao
f715a2709e
docs: add repository and homepage in package.json (#122) 2024-10-15 11:22:21 +08:00
github-actions[bot]
de6aa6dcaa release: v0.6.1 2024-10-12 08:25:42 +00:00
github-actions[bot]
bdf4fb3ed1 release: v0.6.0 2024-10-12 08:10:00 +00:00
Zhou xiao
3b24df1ec0
workflow(ci): fix ai test error (#113)
* chore: update element inspector prompt and schema

* test: update snapshots for planning-input tests
2024-10-12 16:01:07 +08:00
github-actions[bot]
e2f5e114a7 release: v0.5.2 2024-10-12 06:37:01 +00:00
yuyutaotao
f9dc0f698e
feat(ai-model): merge ai planning and insight call to accelerate the aiAction (#97)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>

* feat(ai-model): optimize AI model for element inspection

* feat(ai-model): optimize AI model and add quick answer functionality

---------

Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>

* feat(ai-model): implement quick answer functionality for element inspection

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-12 12:09:25 +08:00
Zhou xiao
8ec5622342
chore: optimize ai e2e test (#99) 2024-09-29 17:51:59 +08:00
Zhou xiao
10757a8ba1
refacotr(ai-model): optimize model evalution method (#98) 2024-09-29 17:16:07 +08:00
github-actions[bot]
032b505d8e release: v0.5.1 2024-09-26 07:41:19 +00:00