Zhou Xiao
f8744e441a
fix(prompt): resolve the llm-planning format error ( #341 )
2025-01-30 14:14:14 +08:00
Zhou Xiao
e8a3ea4464
workflow(ci): optimize ai test workflow ( #336 )
2025-01-27 17:17:02 +08:00
github-actions[bot]
8eacc354a7
release: v0.10.3
2025-01-27 08:21:33 +00:00
Zhou Xiao
b4a6b6f44d
chore: change default model name ( #333 )
2025-01-27 14:05:42 +08:00
Zhou Xiao
02ad84cf6f
chore: fix ai test ( #332 )
2025-01-27 10:22:56 +08:00
github-actions[bot]
e6fc69eb81
release: v0.10.2
2025-01-26 12:39:17 +00:00
Zhou Xiao
9c88186540
feat(ui-tars): enhance the UI-TARS keyboard event handling and optimize parser logic ( #330 )
2025-01-26 20:34:56 +08:00
yuyutaotao
6d924e267f
feat(puppeteer): allow tracking new tab in puppeteer agent ( #310 )
2025-01-26 16:49:32 +08:00
Zhou Xiao
839dc6c799
feat(browser-event): support drag event ( #321 )
2025-01-26 12:00:55 +08:00
Zhou xiao
2811f15da0
chore: refine AI test for failures ( #323 )
2025-01-25 11:14:15 +08:00
Zhou xiao
4c82eff526
chore: fix e2e test ( #316 )
...
* chore: fix e2e test
* chore: ignore todo test
* chore: fix e2e test
* chore: upgrade gpt api version
* chore: fix e2e test
* chore: fix e2e test
* chore: fix direction
* chore: fix direction
* chore: split test
* chore: split test
* chore: modify input info
* fix: scroll param in ci
* fix: lint
* fix: ai test
* fix: ai test
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
2025-01-24 15:02:50 +08:00
github-actions[bot]
0f92941f54
release: v0.10.1
2025-01-23 07:15:56 +00:00
yuyutaotao
57f6786628
feat(extract-data): extract data from same-origin iframe ( #258 )
...
* feat: extract data from same-origin iframe
* fix: ci snapshot
* fix: extracting timeout error
* fix: ci timeout
* fix: update assets
* feat: set default size of yaml as 1920x1080
* chore: update default viewport size
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 20:52:11 +08:00
Zhou xiao
6c188d09e8
fix(e2e): optimize e2e error ( #307 )
...
* fix(e2e): optimize e2e error
* chore: ignore unless e2e
2025-01-22 13:51:40 +08:00
yuyutaotao
3d95460f44
docs(ai-model): update docs for ui-tars ( #305 )
...
* feat: update docs for ui-tars
* doc: update
* doc: update
* doc: update
* chore: update readme
* fix: ci
* docs: upgrade video
* chore: modify huagging face icon
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 09:24:29 +08:00
yuyutaotao
ed45cfab6c
fix(action): keyboard and div extracting ( #304 )
...
* fix: clearInput in browser
* fix: input issue on mac
* fix: playwright input
* fix: issue when collecting fixed item
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* fix: extract fixed style content
* fix: extract fixed style content
* fix: customize window size in yaml
2025-01-21 19:21:09 +08:00
yuyutaotao
f68b6f3139
feat(chrome-devtool): allow tracking active tab in bridge mode ( #282 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:54:03 +08:00
github-actions[bot]
d580bd02fe
release: v0.9.2
2025-01-15 03:22:10 +00:00
Zhou xiao
56845b75ba
chore: fix planning typo ( #269 )
2025-01-13 14:52:15 +08:00
Zhou xiao
2b18ed55de
feat(ai-model): support vlm ( #262 )
...
* feat(ai-model): support plan to target
* chore: modify test
* chore: modify test
* chore: fix env config
* chore: unify the action logic
* chore: optimize type hint
* chore: optimize type hint
* chore: fix type hint
* chore: fix build type error
* chore: support open new tab
* feat: support auto complete element
* chore: add sleep event
* chore: add ai cost time
* chore: optimize prompt
* chore: optimize report prompt
* chore: optimize vlm name
* chore: fix command
* chore: optimize error handle and use check debugger list replace last tab id
* chore: fix chrome debugger attach logic
* chore: fix unit test
2025-01-13 14:32:17 +08:00
George Lei
fe5f7eed20
feat: add environment variable interpolation to YAML script parser ( #226 )
...
* feat: add environment variable interpolation to YAML script parser
* Update environment variable interpolation syntax in YAML utils
---------
Co-authored-by: George Lei <george.lei@lesmills.com>
2025-01-10 12:03:56 +08:00
yuyutaotao
8479bcb652
feat: bridge mode - phase 2 ( #257 )
...
* feat: allow auto reconnect in bridge mode after disconnect
* feat: show agent progress in extension
* feat: allow using bridge mode in yaml
* doc: add doc for bridge mode
* doc: add doc for bridge mode
* docs: update screenshot
2025-01-10 10:55:41 +08:00
yuyutaotao
c91da56431
feat: allow continue-on-error in yaml ( #254 )
...
* feat: allow continue on error in yaml #252
* doc: update doc for new param
* fix: ignore yaml file in node-modules
2025-01-08 20:59:54 +08:00
yuyutaotao
ae49685348
feat: add bridge mode for extension ( #228 )
2025-01-07 11:10:28 +08:00
Zhou xiao
691eb6ef0a
feat(ai-model): support Image positioning and integrate langchain ( #230 )
...
* feat: add point img logic
* feat: migrate prompt to langchain
* chore: delete unless log
* chore: optimize test case
* chore: fix lint error
* chore: delete httpAgent logic
* chore: delete unless fn
* chore: fix some comment
* chore: fix ci error
* chore: delete unless fn
* chore: update prompt
* chore: delete unless language
2025-01-02 21:23:30 +08:00
yuyutaotao
4a82e9bda9
feat: let max_tokens configurable ( #212 )
...
* feat: let max_tokens configurable
* fix: update ci test case
2024-12-26 13:24:21 +08:00
yuyutaotao
05dad23bfd
chore: print yaml file in chrome extension ( #205 )
2024-12-25 20:23:12 +08:00
yuyutaotao
523adab12f
feat: support the if-statement in planning prompt ( #184 )
2024-12-19 10:44:08 +08:00
github-actions[bot]
3dc57eef32
release: v0.8.6
2024-12-16 07:41:16 +00:00
yuyutaotao
537a5c43d0
feat: add a real-time progress indicator for playground ( #177 )
2024-12-16 15:04:21 +08:00
yuyutaotao
863e5a54d0
fix: sandbox issue of puppeteer in Ubuntu ( #176 )
...
* fix: disable setuid sandbox in cli
* fix: disable setuid sandbox in cli
2024-12-10 09:24:43 +08:00
github-actions[bot]
91896c421a
release: v0.8.5
2024-12-09 09:11:52 +00:00
yuyutaotao
082e347da9
feat: replanning before locating ( #167 )
2024-12-08 20:12:17 +08:00
yuyutaotao
e7a58b3b24
faet: support yaml style scripts ( #165 )
2024-11-25 16:05:01 +08:00
yuyutaotao
4282e7bf07
feat: lower the cost of page description ( #159 )
2024-11-20 16:00:34 +08:00
github-actions[bot]
4972d22ec4
release: v0.8.1
2024-11-15 08:41:21 +00:00
yuyutaotao
26779cf082
fix: fix some extraction bug in extension ( #157 )
2024-11-14 19:29:22 +08:00
yuyutaotao
48fa92f037
workflow(ci): AI test cases ( #154 )
...
* fix: AI test
* chore: add more links in README
2024-11-13 15:01:21 +08:00
github-actions[bot]
3117584e57
release: v0.8.0
2024-11-11 10:39:38 +00:00
Zhou xiao
08d46becf1
feat(cache): optimize cache logic id and export overrideAIConfig ( #148 )
...
* chore(cache): optimize cache logic id and export overrideAIConfig
* chore: use cache logic
2024-11-07 21:06:01 +08:00
yuyutaotao
f8507efd50
chore: some minor bug fixes ( #146 )
...
* feat: always use latest process.env as fallback
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-11-07 11:29:50 +08:00
yuyutaotao
198172dc4e
feat: optimize the speed of screenshot in browser ( #144 )
...
* feat: optimize the speed of screenshot in browser
* feat: remove unnecessary context call
* fix: CI
2024-11-05 14:28:16 +08:00
yuyutaotao
9e1eef5cfd
feat: Build a chrome extension for playground ( #140 )
2024-11-05 11:49:21 +08:00
Zhou xiao
1eb4c8de9f
workflow(ci): fix ci error ( #142 )
2024-11-04 17:14:14 +08:00
Zhou xiao
adb9b58879
feat(ai-model): add claude computer ablity ( #136 )
...
* Add new changes
* Add computer test results and update AI evaluation tests
* chore: Update build outputs and configurations
* feat(ai-model): support claude computer ability use position replace element id
* feat: generate add and commit
* feat: implement computer ability test for Claude
* chore: fix build Lose
* chore: Add and commit changes
* chore: optimize ai position
* chore: optimize ai position
* Add AI evaluation results and update tests
* chore: optimize ai test
* chore: add and commit changes
* chore: optimize ai test content
* chore: fix test case
* chore: fix e2e test
2024-10-31 18:18:31 +08:00
yuyutaotao
c288baa448
feat: make playground working in the browser ( #135 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-28 11:04:40 +08:00
github-actions[bot]
ab815fef56
release: v0.7.0
2024-10-21 08:34:43 +00:00
yuyutaotao
7d4f9847f5
feat: add a playground page to debug ( #131 )
...
* fix: fix the Player style when the locator is failed
* feat: add Playground UI
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-21 16:30:07 +08:00
yuyutaotao
ee521e31e0
fix: fix the Player style when the locator is failed ( #129 )
...
* fix: fix the Player style when the locator is failed
* fix: add marker image into UIContext
2024-10-17 10:44:30 +08:00
github-actions[bot]
bdf4fb3ed1
release: v0.6.0
2024-10-12 08:10:00 +00:00
