611 Commits

Author SHA1 Message Date
yuyutaotao
a114e707d1
feat: show pointer position in chrome extension (#286)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-17 18:19:22 +08:00
yuyutaotao
918e6a3ec3
chore: move ai test into example repo (#293)
* chore: move ai test into example repo

* chore: update readme
2025-01-17 00:05:23 +08:00
Zhou xiao
2a174e5914
chore: use pr labeler (#292) 2025-01-16 21:23:13 +08:00
yuyutaotao
9633017e00
docs: add doc about data privacy (#291) 2025-01-16 21:00:09 +08:00
Zhou xiao
836768878e
fix(extract-data): position ignore container element (#290) 2025-01-16 15:01:28 +08:00
yuyutaotao
4cad2e13eb
feat(ai-model): remove dom info in assertion to make it reliable (#284)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-16 14:37:35 +08:00
Cheung丶
69ce6ec235
feat: fix doc content (#285)
Co-authored-by: 章璋 <zhangzhang.11@bytedance.com>
2025-01-16 12:27:56 +08:00
yuyutaotao
f68b6f3139
feat(chrome-devtool): allow tracking active tab in bridge mode (#282)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:54:03 +08:00
yuyutaotao
fb2b9d123f
feat(chrome-devtool): add 'stop' button in extension (#281)
* feat: add 'stop' to playground

* feat: make extension stopable

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:18:26 +08:00
Zhou xiao
ff9ef70941
chore(prompt): switch thought language according to timezone in vlm mode (#283)
* chore: switch Thought Language to english

* chore: use timezone to select language
2025-01-15 18:54:23 +08:00
github-actions[bot]
d580bd02fe release: v0.9.2 v0.9.2 2025-01-15 03:22:10 +00:00
Zhou xiao
38c844cd9c
fix(extract-data): resolve match multiple element (#280) 2025-01-15 11:09:54 +08:00
yuyutaotao
afd0934c4f
doc: update the instructions to configure the model service (#274)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 10:14:36 +08:00
Zhou xiao
beb74f12e8
chore: optimize devtool tab connect (#279) 2025-01-14 21:31:33 +08:00
yuyutaotao
68b4004861
chore: rename files in core module (#277)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-14 21:07:03 +08:00
yuyutaotao
74774c6588
fix: memory leak in report file (#275)
* fix: memory leak in report file

* chore: remove unused console.log

* chore: set default value of TRACKING_ACTIVE_TAB_KEY into true

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-14 17:48:39 +08:00
Zhou xiao
cb52da2ffd
chore: Avoid obscuring the entire page content while optimizing the execution process of DevTools (#276) 2025-01-14 17:05:56 +08:00
zhouxiao.shaw
ea4ee5f976 chore: enhance the execution spped of chrome devtools 2025-01-14 15:04:24 +08:00
Zhou xiao
0cf9a71940
feat(chrome-devtool): water flow animation on the target page (#271)
* feat(chrome-devtool): support water flow animation

* chore: optimize debugger cause window resize

* chore: optimize dynamic script inject

* chore: optimize report error
2025-01-14 14:13:50 +08:00
yuyutaotao
857c411d67
feat: allow tracking newly-opened tabs in Chrome extension (#272) 2025-01-14 11:22:20 +08:00
yuyutaotao
db70ae28b0
feat: add more social links (#270)
* feat: add more social links

* doc: update link
2025-01-13 18:52:16 +08:00
Zhou xiao
56845b75ba
chore: fix planning typo (#269) 2025-01-13 14:52:15 +08:00
Zhou xiao
2b18ed55de
feat(ai-model): support vlm (#262)
* feat(ai-model): support plan to target

* chore: modify test

* chore: modify test

* chore: fix env config

* chore: unify the action logic

* chore: optimize type hint

* chore: optimize type hint

* chore: fix type hint

* chore: fix build type error

* chore: support open new tab

* feat: support auto complete element

* chore: add sleep event

* chore: add ai cost time

* chore: optimize prompt

* chore: optimize report prompt

* chore: optimize vlm name

* chore: fix command

* chore: optimize error handle and use check debugger list replace last tab id

* chore: fix chrome debugger attach logic

* chore: fix unit test
2025-01-13 14:32:17 +08:00
github-actions[bot]
d92bfa8987 release: v0.9.1 v0.9.1 2025-01-11 05:17:05 +00:00
yuyutaotao
88fd4ed52a
fix: a more friendly error code for extension (#260) 2025-01-10 12:45:10 +08:00
George Lei
fe5f7eed20
feat: add environment variable interpolation to YAML script parser (#226)
* feat: add environment variable interpolation to YAML script parser

* Update environment variable interpolation syntax in YAML utils

---------

Co-authored-by: George Lei <george.lei@lesmills.com>
2025-01-10 12:03:56 +08:00
yuyutaotao
8479bcb652
feat: bridge mode - phase 2 (#257)
* feat: allow auto reconnect in bridge mode after disconnect

* feat: show agent progress in extension

* feat: allow using bridge mode in yaml

* doc: add doc for bridge mode

* doc: add doc for bridge mode

* docs: update screenshot
2025-01-10 10:55:41 +08:00
github-actions[bot]
bc9542d8df release: v0.9.0 v0.9.0 2025-01-09 07:06:20 +00:00
yuyutaotao
c91da56431
feat: allow continue-on-error in yaml (#254)
* feat: allow continue on error in yaml #252

* doc: update doc for new param

* fix: ignore yaml file in node-modules
2025-01-08 20:59:54 +08:00
github-actions[bot]
de92f3fc13 release: v0.8.18 v0.8.18 2025-01-07 11:53:17 +00:00
yuyutaotao
13069875a1
fix: lazy close for puppeteer (#255) 2025-01-07 19:48:20 +08:00
yuyutaotao
fb222b19db
fix: yaml scripts issue in windows (#251) 2025-01-07 15:30:10 +08:00
github-actions[bot]
4fd930340c release: v0.8.17 v0.8.17 2025-01-07 03:54:08 +00:00
yuyutaotao
ae49685348
feat: add bridge mode for extension (#228) 2025-01-07 11:10:28 +08:00
yuyutaotao
bacfef0749
fix: allow claude in extension #241 (#246) 2025-01-06 10:17:15 +08:00
Zhou xiao
a1042c8bd6
chore: remove coze logic (#240) 2025-01-03 21:50:25 +08:00
Zhou xiao
9076662743
fix(prompt): optimize plan prompt (#239)
* fix(prompt): fix plan prompt and optimize task background content

* fix(prompt): optimize plan prompt
2025-01-03 16:30:55 +08:00
Zhou xiao
190846f156
fix(prompt): fix plan prompt and optimize task background content (#238) 2025-01-03 14:44:30 +08:00
Zhou xiao
691eb6ef0a
feat(ai-model): support Image positioning and integrate langchain (#230)
* feat: add point img logic

* feat: migrate prompt to langchain

* chore: delete unless log

* chore: optimize test case

* chore: fix lint error

* chore: delete httpAgent logic

* chore: delete unless fn

* chore: fix some comment

* chore: fix ci error

* chore: delete unless fn

* chore: update prompt

* chore: delete unless language
2025-01-02 21:23:30 +08:00
Zhou xiao
6af7d21c3d
docs: update the midscene introduction (#236) 2025-01-02 10:58:43 +08:00
github-actions[bot]
1e7c9caf1a release: v0.8.16 v0.8.16 2025-01-02 02:38:32 +00:00
Zhou xiao
f798f27c8b
docs: update video url and update slogn (#235) 2025-01-02 10:24:26 +08:00
yuyutaotao
3c9418c264
fix: use some default param in scroll (#232)
* fix: use some default param in scroll

* fix: update param description
2025-01-02 10:19:22 +08:00
yuyutaotao
8d83debd13
fix: add some default value for tmp dir #231 (#233) 2025-01-02 10:18:44 +08:00
Zhou xiao
db3ccde418
docs: update lark group share img (#234) 2025-01-02 09:23:44 +08:00
github-actions[bot]
85cb87f1ec release: v0.8.15 v0.8.15 2025-01-01 13:15:36 +00:00
yuyutaotao
f9f4718ee6
feat: use our new version of logo (#229)
* feat: use our new version of logo

* fix: lint

* feat: update extension screenshot

* feat: update video cover

* feat: readme
2025-01-01 09:09:09 +08:00
github-actions[bot]
3b696033e8 release: v0.8.14 v0.8.14 2024-12-31 14:04:23 +00:00
yuyutaotao
37ccdf55d7
feat: support keyless auth mode for azure (#227)
* feat: support keyless auth mode for azure

* feat: support keyless auth mode for azure

* fix: remove default scope config
2024-12-31 18:00:20 +08:00
yuyutaotao
8042bcc7df
fix: typo in model name (#223) 2024-12-29 22:19:53 +08:00