133 Commits

Author SHA1 Message Date
yuyutaotao
a6ffbd07b7
fix: over planning for Qwen in page with form (#429) 2025-02-27 16:44:01 +08:00
Zhou Xiao
881adab4fc
feat(yaml): Add cache support for yaml files, allowing file-level caching to improve execution speed and stability. Cache ID is automatically set to yaml filename. (#430) 2025-02-27 11:33:49 +08:00
yuyutaotao
d0a3d86e22
docs: update instruction for bridge mode (#428)
* docs: update instruction for bridge mode

* fix: ai test
2025-02-26 17:06:14 +08:00
yuyutaotao
724a2c7230
fix(core): the prompt of qwen (#427)
* fix: fix the  prompt of qwen

* docs: update debugging config

* fix: sleep in qwen

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-26 15:04:28 +08:00
yuyutaotao
8be082e308
feat(chrome-devtool): allow longer connection of chrome bridge (#416) 2025-02-26 14:20:27 +08:00
yuyutaotao
610b265cd4
docs: fix markdown content of quick-experience (#424)
* docs: fix markdown content of quick-experience

* fix: lint
2025-02-25 16:34:49 +08:00
yuyutaotao
8d602caa89
docs: update faq (#422)
* docs: update faq

* docs: update faq
2025-02-25 14:47:56 +08:00
yuyutaotao
29a6c33f80
fix: print warning for oversized input (#414) 2025-02-24 16:53:06 +08:00
Zhou Xiao
8d99389957
docs: optimize bridge api structure (#417)
* docs: optimize bridge api structure

* docs: optimize bridge api structure
2025-02-24 14:45:41 +08:00
Zhou Xiao
1eefad4422
docs: optimize agent api doc (#415)
* docs: optimize agent api doc

* docs: optimize runyaml link

* docs: optimize prompt
2025-02-24 14:29:17 +08:00
yuyutaotao
3f438f6c0c
fix: ci of qwen model (#410) 2025-02-21 16:15:51 +08:00
yuyutaotao
59ce2d0140
feat: locate by coord (#383)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-21 09:56:09 +08:00
Zhou Xiao
edf0871fea
feat(browser): Add the forceSameTabNavigation configuration to prevent AI from opening new pages during operations, thus avoiding task interruptions. (#389)
* feat(tab-control): enhance the configuration to limit AI from opening new tabs during operations, preventing failures.

* chore: optimize evaluate error

* chore: resolve navigation error

* fix(browser): add forceSameTabNavigation config toe limit open new tab

* chore: upgrade vitest version

* fix: typo (#390)

---------

Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
2025-02-14 21:54:47 +08:00
yuyutaotao
2b1c5c0c33
fix: update discord links #375 (#379) 2025-02-12 09:11:32 +08:00
yuyutaotao
efa4263b06
feat: export yaml runner in javascipt (#368)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-10 20:00:14 +08:00
yuyutaotao
01b2461027
fix: upgrade langsmith sdk (#374)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-10 19:55:52 +08:00
Zhou Xiao
195eaad903
feat(cache): supports ui-tars model caching capability (#361) 2025-02-08 13:05:17 +08:00
yuyutaotao
6d924e267f
feat(puppeteer): allow tracking new tab in puppeteer agent (#310) 2025-01-26 16:49:32 +08:00
yuyutaotao
57e8b485a8
docs: add comparison for different model (#329)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-26 15:16:35 +08:00
yuyutaotao
6d2abd955d
docs: update discord link (#317)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-24 10:54:36 +08:00
yuyutaotao
57f6786628
feat(extract-data): extract data from same-origin iframe (#258)
* feat: extract data from same-origin iframe

* fix: ci snapshot

* fix: extracting timeout error

* fix: ci timeout

* fix: update assets

* feat: set default size of yaml as 1920x1080

* chore: update default viewport size

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 20:52:11 +08:00
J Mad
37d8aad4fb
docs: update wording in index.mdx (#311) 2025-01-22 19:20:20 +08:00
yuyutaotao
35bf713f83
docs: update comparing section (#308) 2025-01-22 15:56:57 +08:00
yuyutaotao
3d95460f44
docs(ai-model): update docs for ui-tars (#305)
* feat: update docs for ui-tars

* doc: update

* doc: update

* doc: update

* chore: update readme

* fix: ci

* docs: upgrade video

* chore: modify huagging face icon

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 09:24:29 +08:00
EAGzzyCSL
30cbd173fb
fix: bing-search.yaml add tasks (#303) 2025-01-20 20:47:55 +08:00
yuyutaotao
a114e707d1
feat: show pointer position in chrome extension (#286)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-17 18:19:22 +08:00
yuyutaotao
9633017e00
docs: add doc about data privacy (#291) 2025-01-16 21:00:09 +08:00
yuyutaotao
f68b6f3139
feat(chrome-devtool): allow tracking active tab in bridge mode (#282)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:54:03 +08:00
yuyutaotao
fb2b9d123f
feat(chrome-devtool): add 'stop' button in extension (#281)
* feat: add 'stop' to playground

* feat: make extension stopable

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:18:26 +08:00
yuyutaotao
afd0934c4f
doc: update the instructions to configure the model service (#274)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 10:14:36 +08:00
yuyutaotao
857c411d67
feat: allow tracking newly-opened tabs in Chrome extension (#272) 2025-01-14 11:22:20 +08:00
yuyutaotao
88fd4ed52a
fix: a more friendly error code for extension (#260) 2025-01-10 12:45:10 +08:00
yuyutaotao
8479bcb652
feat: bridge mode - phase 2 (#257)
* feat: allow auto reconnect in bridge mode after disconnect

* feat: show agent progress in extension

* feat: allow using bridge mode in yaml

* doc: add doc for bridge mode

* doc: add doc for bridge mode

* docs: update screenshot
2025-01-10 10:55:41 +08:00
yuyutaotao
c91da56431
feat: allow continue-on-error in yaml (#254)
* feat: allow continue on error in yaml #252

* doc: update doc for new param

* fix: ignore yaml file in node-modules
2025-01-08 20:59:54 +08:00
yuyutaotao
ae49685348
feat: add bridge mode for extension (#228) 2025-01-07 11:10:28 +08:00
Zhou xiao
f798f27c8b
docs: update video url and update slogn (#235) 2025-01-02 10:24:26 +08:00
yuyutaotao
37ccdf55d7
feat: support keyless auth mode for azure (#227)
* feat: support keyless auth mode for azure

* feat: support keyless auth mode for azure

* fix: remove default scope config
2024-12-31 18:00:20 +08:00
yuyutaotao
8042bcc7df
fix: typo in model name (#223) 2024-12-29 22:19:53 +08:00
yuyutaotao
4a82e9bda9
feat: let max_tokens configurable (#212)
* feat: let max_tokens configurable

* fix: update ci test case
2024-12-26 13:24:21 +08:00
yuyutaotao
e3481dc119
fix: show error message when aiAction fails in extension (#210) 2024-12-26 10:19:16 +08:00
yuyutaotao
05dad23bfd
chore: print yaml file in chrome extension (#205) 2024-12-25 20:23:12 +08:00
yuyutaotao
e6343b63f4
fix: keypress issue in chrome extension (#201)
* fix: keypress issue in chrome extension

* fix: keypress issue in chrome extension

* fix: connectivity

* doc: update readme
2024-12-23 14:38:07 +08:00
yuyutaotao
f3d46b504d
feat: invoke anthropic SDK to call Claude (#197)
* feat: invoke anthropic SDK

* chore: set response format for extract

* fix: do not throw if waitUntilNetworkIdle failed in aiAction

* fix: timeout config for Puppeteer

* chore: add instruction for connectivity test
2024-12-23 12:03:05 +08:00
yuyutaotao
f1b73b28eb
feat: update the Azure OpenAI integration, add instruction for other models (#193) 2024-12-20 15:18:52 +08:00
yuyutaotao
5c7090bdfb
docs: add docs for customize model and endpoint (#190)
* docs: add docs for customize model and endpoint

* doc: update docs
2024-12-19 15:49:06 +08:00
yuyutaotao
523adab12f
feat: support the if-statement in planning prompt (#184) 2024-12-19 10:44:08 +08:00
yuyutaotao
2a73bcfc20
feat: support socks proxy for OpenAI SDK (#175)
* feat: support socks proxy https://github.com/web-infra-dev/midscene-example/issues/14

* feat: show error for invalid json
2024-12-10 09:24:21 +08:00
yuyutaotao
082e347da9
feat: replanning before locating (#167) 2024-12-08 20:12:17 +08:00
yuyutaotao
e7a58b3b24
faet: support yaml style scripts (#165) 2024-11-25 16:05:01 +08:00
yuyutaotao
b8abc08464
chore: use 1080p as default in homepage (#162) 2024-11-18 17:30:18 +08:00