226 Commits

Author SHA1 Message Date
github-actions[bot]
8eacc354a7 release: v0.10.3 2025-01-27 08:21:33 +00:00
github-actions[bot]
e6fc69eb81 release: v0.10.2 2025-01-26 12:39:17 +00:00
github-actions[bot]
0f92941f54 release: v0.10.1 2025-01-23 07:15:56 +00:00
yuyutaotao
3aa1b33955
feat: use jpeg as default image format (#301)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-20 20:02:49 +08:00
github-actions[bot]
9b86067ea6 release: v0.10.0 2025-01-17 10:31:04 +00:00
yuyutaotao
a114e707d1
feat: show pointer position in chrome extension (#286)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-17 18:19:22 +08:00
yuyutaotao
fb2b9d123f
feat(chrome-devtool): add 'stop' button in extension (#281)
* feat: add 'stop' to playground

* feat: make extension stopable

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-15 19:18:26 +08:00
github-actions[bot]
d580bd02fe release: v0.9.2 2025-01-15 03:22:10 +00:00
Zhou xiao
beb74f12e8
chore: optimize devtool tab connect (#279) 2025-01-14 21:31:33 +08:00
yuyutaotao
74774c6588
fix: memory leak in report file (#275)
* fix: memory leak in report file

* chore: remove unused console.log

* chore: set default value of TRACKING_ACTIVE_TAB_KEY into true

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-14 17:48:39 +08:00
Zhou xiao
cb52da2ffd
chore: Avoid obscuring the entire page content while optimizing the execution process of DevTools (#276) 2025-01-14 17:05:56 +08:00
Zhou xiao
0cf9a71940
feat(chrome-devtool): water flow animation on the target page (#271)
* feat(chrome-devtool): support water flow animation

* chore: optimize debugger cause window resize

* chore: optimize dynamic script inject

* chore: optimize report error
2025-01-14 14:13:50 +08:00
yuyutaotao
857c411d67
feat: allow tracking newly-opened tabs in Chrome extension (#272) 2025-01-14 11:22:20 +08:00
Zhou xiao
2b18ed55de
feat(ai-model): support vlm (#262)
* feat(ai-model): support plan to target

* chore: modify test

* chore: modify test

* chore: fix env config

* chore: unify the action logic

* chore: optimize type hint

* chore: optimize type hint

* chore: fix type hint

* chore: fix build type error

* chore: support open new tab

* feat: support auto complete element

* chore: add sleep event

* chore: add ai cost time

* chore: optimize prompt

* chore: optimize report prompt

* chore: optimize vlm name

* chore: fix command

* chore: optimize error handle and use check debugger list replace last tab id

* chore: fix chrome debugger attach logic

* chore: fix unit test
2025-01-13 14:32:17 +08:00
github-actions[bot]
d92bfa8987 release: v0.9.1 2025-01-11 05:17:05 +00:00
yuyutaotao
88fd4ed52a
fix: a more friendly error code for extension (#260) 2025-01-10 12:45:10 +08:00
yuyutaotao
8479bcb652
feat: bridge mode - phase 2 (#257)
* feat: allow auto reconnect in bridge mode after disconnect

* feat: show agent progress in extension

* feat: allow using bridge mode in yaml

* doc: add doc for bridge mode

* doc: add doc for bridge mode

* docs: update screenshot
2025-01-10 10:55:41 +08:00
github-actions[bot]
bc9542d8df release: v0.9.0 2025-01-09 07:06:20 +00:00
github-actions[bot]
de92f3fc13 release: v0.8.18 2025-01-07 11:53:17 +00:00
github-actions[bot]
4fd930340c release: v0.8.17 2025-01-07 03:54:08 +00:00
yuyutaotao
ae49685348
feat: add bridge mode for extension (#228) 2025-01-07 11:10:28 +08:00
Zhou xiao
691eb6ef0a
feat(ai-model): support Image positioning and integrate langchain (#230)
* feat: add point img logic

* feat: migrate prompt to langchain

* chore: delete unless log

* chore: optimize test case

* chore: fix lint error

* chore: delete httpAgent logic

* chore: delete unless fn

* chore: fix some comment

* chore: fix ci error

* chore: delete unless fn

* chore: update prompt

* chore: delete unless language
2025-01-02 21:23:30 +08:00
github-actions[bot]
1e7c9caf1a release: v0.8.16 2025-01-02 02:38:32 +00:00
github-actions[bot]
85cb87f1ec release: v0.8.15 2025-01-01 13:15:36 +00:00
yuyutaotao
f9f4718ee6
feat: use our new version of logo (#229)
* feat: use our new version of logo

* fix: lint

* feat: update extension screenshot

* feat: update video cover

* feat: readme
2025-01-01 09:09:09 +08:00
github-actions[bot]
3b696033e8 release: v0.8.14 2024-12-31 14:04:23 +00:00
github-actions[bot]
dea3479242 release: v0.8.13 2024-12-27 02:25:47 +00:00
yuyutaotao
b6f3a07c5f
fix: remove scripting permission from manifest (#219) 2024-12-27 10:00:56 +08:00
github-actions[bot]
a39684a8ff release: v0.8.12 2024-12-26 05:28:37 +00:00
github-actions[bot]
471e684a5d release: v0.8.11 2024-12-26 02:47:23 +00:00
yuyutaotao
e3481dc119
fix: show error message when aiAction fails in extension (#210) 2024-12-26 10:19:16 +08:00
github-actions[bot]
461a6a9dff release: v0.8.10 2024-12-25 16:11:46 +00:00
yuyutaotao
05dad23bfd
chore: print yaml file in chrome extension (#205) 2024-12-25 20:23:12 +08:00
github-actions[bot]
a5066d2f58 release: v0.8.9 2024-12-24 14:45:57 +00:00
yuyutaotao
5c582a8c6a
fix: unescaped scripts in report tpl (#204) 2024-12-24 19:36:28 +08:00
github-actions[bot]
1e76905b5f release: v0.8.8 2024-12-23 07:08:16 +00:00
github-actions[bot]
48fa8a56a8 release: v0.8.7 2024-12-19 08:27:51 +00:00
yuyutaotao
523adab12f
feat: support the if-statement in planning prompt (#184) 2024-12-19 10:44:08 +08:00
github-actions[bot]
3dc57eef32 release: v0.8.6 2024-12-16 07:41:16 +00:00
yuyutaotao
537a5c43d0
feat: add a real-time progress indicator for playground (#177) 2024-12-16 15:04:21 +08:00
yuyutaotao
863e5a54d0
fix: sandbox issue of puppeteer in Ubuntu (#176)
* fix: disable setuid sandbox in cli

* fix: disable setuid sandbox in cli
2024-12-10 09:24:43 +08:00
github-actions[bot]
91896c421a release: v0.8.5 2024-12-09 09:11:52 +00:00
yuyutaotao
082e347da9
feat: replanning before locating (#167) 2024-12-08 20:12:17 +08:00
Haomin Liu
fe2e13d1f7
fix: tooltip of env config (#169) 2024-11-27 17:49:14 +08:00
yuyutaotao
e7a58b3b24
faet: support yaml style scripts (#165) 2024-11-25 16:05:01 +08:00
github-actions[bot]
27ca8f9271 release: v0.8.4 2024-11-19 10:08:44 +00:00
github-actions[bot]
3dd487467b release: v0.8.3 2024-11-19 08:05:50 +00:00
github-actions[bot]
d4cd844a67 release: v0.8.2 2024-11-18 09:35:14 +00:00
yuyutaotao
fabe28b6d7
chore: adjust the report UI (#163) 2024-11-18 17:29:52 +08:00
Zhou xiao
d0bdd0cf50
workflow(cd): optimize chrome devtool release logic (#161)
* workflow(cd): optimize chrome devtool release logic

* chore: update midscene version
2024-11-15 17:25:57 +08:00