Leyang
934a1e2b5d
use adb instead of appium ( #483 )
...
* feat: enable search area for locate
* fix: update evaluation
* fix: locator
* feat: show searchArea in report
* chore: add yaml support for aiTap
* feat: use adb instead appium
* feat: Adds debugging information and reconstructs input text capabilities
* feat: refactoring Android related functions and adding android modules
* feat: update the image scaling algorithm, adjust the Android page class to support device scaling, and remove test files that are no longer needed
* feat: adjust the Android page class to support device scaling, and remove test files that are no longer needed
* feat: use appium-adb instead of bare command
* fix: update entry for @midscene/android
* feat: optimize the screenshot processing logic, add a backup mechanism when screenshots fail, and update test cases to accommodate new features
* fix: rethrow error
* feat: add Android debug configuration options and update documentation
* chore: fix code style in #483 (#492 )
* fix: remove try for error handle by outside
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
Co-authored-by: linyibing <linyibing@bytedance.com>
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
2025-03-25 22:45:05 +08:00
yuyutaotao
f5049f556d
docs: docs for new API ( #499 )
2025-03-25 17:16:07 +08:00
Zhou Xiao
45ddfa5ee6
chore: use cdn replace netlify ( #496 )
2025-03-25 11:10:23 +08:00
github-actions[bot]
291f8e1a4b
release: v0.13.0
2025-03-24 12:32:05 +00:00
Zhou Xiao
36d47e4aef
feat(playwright): add aiTap/aiInput and other AI actions for Playwright integration ( #489 )
...
* feat(playwright): add aiTap/aiInput and other AI actions for Playwright integration
* chore: update doc
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
2025-03-24 19:30:53 +08:00
yuyutaotao
649aeceb43
feat: enable search area for locate ( #473 )
...
* feat: enable search area for locate
* fix: update evaluation
* fix: build error
* fix: ci
* fix: locator
* feat: show searchArea in report
* chore: add yaml support for aiTap
* feat: update status tip
* fix : #473 (#484 )
* chore: optimize unit test list
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-03-24 09:50:27 +08:00
github-actions[bot]
df16339e08
release: v0.12.8
2025-03-19 08:16:01 +00:00
Zhou Xiao
73bf80261c
chore: fix lint error ( #477 )
...
* chore: fix lint error
* chore: fix lint error
* chore: fix lint error
2025-03-19 16:11:04 +08:00
Zhou Xiao
47cb015c90
refactor(chrome-devtool): extract the chrome-devtool logic into an application, support local development debugging, and add contribution guidelines. ( #476 )
...
* chore: add chrome devtools app
* chore: resolve import error
* chore: support visualizer css
* add build logic
* chore: add build extension zip file script
* chore: migrate part of chrome extension content to app
* chore: delete unless file
* chore: optimize chrome devtool build script
* chore: optimize chrome devtool build script
* fix: resolve bridge mode test issues
* chore: optimize chrome devtool build script
* chore: optimize chrome devtool build script
* chore: optimize chrome devtool build script
* chore: update chrome devtools build process
* chore: optimize chrome devtool build script
* chore: optimize chrome devtool build script
* chore: optimize chrome devtool build script
* chore: optimize chrome devtool build script
2025-03-19 15:22:17 +08:00
yuyutaotao
8e1ba565d0
feat: optimize locator ( #456 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-03-17 19:19:54 +08:00
yuyutaotao
2c5ea87131
fix: ai test ( #460 )
...
* fix: ai test
* fix: ci test
* fix: evaluation test
* fix: test
* fix: test
* fix: ai test
* fix: ai test
2025-03-12 13:49:50 +08:00
yuyutaotao
212e4e3725
fix: planning prompt ( #448 )
...
* feat: add more case for llm planning
* fix: ai e2e
* chore: use debug to print log
* chore: fix error in gpt mode
2025-03-10 16:50:43 +08:00
yuyutaotao
726a3a70dd
fix: always use the connected tab in extension ( #439 )
...
* fix: always use the connected tab in extension
* fix: always use the connected tab in extension
2025-03-06 17:08:11 +08:00
yuyutaotao
a6ffbd07b7
fix: over planning for Qwen in page with form ( #429 )
2025-02-27 16:44:01 +08:00
Zhou Xiao
881adab4fc
feat(yaml): Add cache support for yaml files, allowing file-level caching to improve execution speed and stability. Cache ID is automatically set to yaml filename. ( #430 )
2025-02-27 11:33:49 +08:00
yuyutaotao
d0a3d86e22
docs: update instruction for bridge mode ( #428 )
...
* docs: update instruction for bridge mode
* fix: ai test
2025-02-26 17:06:14 +08:00
yuyutaotao
724a2c7230
fix(core): the prompt of qwen ( #427 )
...
* fix: fix the prompt of qwen
* docs: update debugging config
* fix: sleep in qwen
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-26 15:04:28 +08:00
yuyutaotao
8be082e308
feat(chrome-devtool): allow longer connection of chrome bridge ( #416 )
2025-02-26 14:20:27 +08:00
yuyutaotao
610b265cd4
docs: fix markdown content of quick-experience ( #424 )
...
* docs: fix markdown content of quick-experience
* fix: lint
2025-02-25 16:34:49 +08:00
yuyutaotao
8d602caa89
docs: update faq ( #422 )
...
* docs: update faq
* docs: update faq
2025-02-25 14:47:56 +08:00
yuyutaotao
29a6c33f80
fix: print warning for oversized input ( #414 )
2025-02-24 16:53:06 +08:00
Zhou Xiao
8d99389957
docs: optimize bridge api structure ( #417 )
...
* docs: optimize bridge api structure
* docs: optimize bridge api structure
2025-02-24 14:45:41 +08:00
Zhou Xiao
1eefad4422
docs: optimize agent api doc ( #415 )
...
* docs: optimize agent api doc
* docs: optimize runyaml link
* docs: optimize prompt
2025-02-24 14:29:17 +08:00
yuyutaotao
3f438f6c0c
fix: ci of qwen model ( #410 )
2025-02-21 16:15:51 +08:00
yuyutaotao
59ce2d0140
feat: locate by coord ( #383 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-21 09:56:09 +08:00
Zhou Xiao
edf0871fea
feat(browser): Add the forceSameTabNavigation configuration to prevent AI from opening new pages during operations, thus avoiding task interruptions. ( #389 )
...
* feat(tab-control): enhance the configuration to limit AI from opening new tabs during operations, preventing failures.
* chore: optimize evaluate error
* chore: resolve navigation error
* fix(browser): add forceSameTabNavigation config toe limit open new tab
* chore: upgrade vitest version
* fix: typo (#390 )
---------
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
2025-02-14 21:54:47 +08:00
yuyutaotao
2b1c5c0c33
fix: update discord links #375 ( #379 )
2025-02-12 09:11:32 +08:00
yuyutaotao
efa4263b06
feat: export yaml runner in javascipt ( #368 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-10 20:00:14 +08:00
yuyutaotao
01b2461027
fix: upgrade langsmith sdk ( #374 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-02-10 19:55:52 +08:00
Zhou Xiao
195eaad903
feat(cache): supports ui-tars model caching capability ( #361 )
2025-02-08 13:05:17 +08:00
yuyutaotao
175a8957ab
doc: enable code search in rspress ( #356 )
...
* doc: enable code search in rspress
* fix: lint
* chore: update lockfile
2025-02-06 17:19:27 +08:00
yuyutaotao
6d924e267f
feat(puppeteer): allow tracking new tab in puppeteer agent ( #310 )
2025-01-26 16:49:32 +08:00
yuyutaotao
57e8b485a8
docs: add comparison for different model ( #329 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-26 15:16:35 +08:00
yuyutaotao
6d2abd955d
docs: update discord link ( #317 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-24 10:54:36 +08:00
yuyutaotao
57f6786628
feat(extract-data): extract data from same-origin iframe ( #258 )
...
* feat: extract data from same-origin iframe
* fix: ci snapshot
* fix: extracting timeout error
* fix: ci timeout
* fix: update assets
* feat: set default size of yaml as 1920x1080
* chore: update default viewport size
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 20:52:11 +08:00
J Mad
37d8aad4fb
docs: update wording in index.mdx ( #311 )
2025-01-22 19:20:20 +08:00
yuyutaotao
35bf713f83
docs: update comparing section ( #308 )
2025-01-22 15:56:57 +08:00
yuyutaotao
3d95460f44
docs(ai-model): update docs for ui-tars ( #305 )
...
* feat: update docs for ui-tars
* doc: update
* doc: update
* doc: update
* chore: update readme
* fix: ci
* docs: upgrade video
* chore: modify huagging face icon
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 09:24:29 +08:00
EAGzzyCSL
30cbd173fb
fix: bing-search.yaml add tasks ( #303 )
2025-01-20 20:47:55 +08:00
yuyutaotao
a114e707d1
feat: show pointer position in chrome extension ( #286 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-17 18:19:22 +08:00
yuyutaotao
9633017e00
docs: add doc about data privacy ( #291 )
2025-01-16 21:00:09 +08:00
Cheung丶
69ce6ec235
feat: fix doc content ( #285 )
...
Co-authored-by: 章璋 <zhangzhang.11@bytedance.com>
2025-01-16 12:27:56 +08:00
yuyutaotao
f68b6f3139
feat(chrome-devtool): allow tracking active tab in bridge mode ( #282 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:54:03 +08:00
yuyutaotao
fb2b9d123f
feat(chrome-devtool): add 'stop' button in extension ( #281 )
...
* feat: add 'stop' to playground
* feat: make extension stopable
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:18:26 +08:00
yuyutaotao
afd0934c4f
doc: update the instructions to configure the model service ( #274 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 10:14:36 +08:00
yuyutaotao
68b4004861
chore: rename files in core module ( #277 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-14 21:07:03 +08:00
yuyutaotao
857c411d67
feat: allow tracking newly-opened tabs in Chrome extension ( #272 )
2025-01-14 11:22:20 +08:00
yuyutaotao
db70ae28b0
feat: add more social links ( #270 )
...
* feat: add more social links
* doc: update link
2025-01-13 18:52:16 +08:00
yuyutaotao
88fd4ed52a
fix: a more friendly error code for extension ( #260 )
2025-01-10 12:45:10 +08:00
yuyutaotao
8479bcb652
feat: bridge mode - phase 2 ( #257 )
...
* feat: allow auto reconnect in bridge mode after disconnect
* feat: show agent progress in extension
* feat: allow using bridge mode in yaml
* doc: add doc for bridge mode
* doc: add doc for bridge mode
* docs: update screenshot
2025-01-10 10:55:41 +08:00
