163 Commits

Author SHA1 Message Date
github-actions[bot]
f7c583cdf5 release: v0.11.1 2025-02-13 06:50:24 +00:00
yuyutaotao
2f2400dffa
fix: correctly collect elements in absolute container (#373) 2025-02-10 20:51:43 +08:00
github-actions[bot]
d1e2e2b560 release: v0.11.0 2025-02-10 10:35:13 +00:00
yuyutaotao
2a28472fa5
feat: use different color for annotations (#366) 2025-02-10 16:36:12 +08:00
Zhou Xiao
bdff171da6
fix(ui-tars): resolve page down and page up event error (#370) 2025-02-10 16:35:03 +08:00
yuyutaotao
9d5f2fbcac
feat(web-extract): extract web content as a tree (#337)
* feat: extract web content as a tree

* chore: update test data

* chore: update test data

* feat: update answer of evaluation

* chore: update test cases

* chore: remove focusing on cases

* fix: ci

* fix: put rect in html tree

* fix: CI

* fix: AI test

* fix: lint

* fix: CI

* fix: static-page compatibility

* fix: CI

* fix: map by markerId

* fix: llm planning prompt

* chore: update hash length

* chore: ignore writing dump file

* fix: lint

* fix: ci snapshot

* chore: snapshot tree in web extractor

* chore: export tree utils in core

* chore: export tree utils in core

* fix: CI

* fix: update test case and evaluation

* chore: remove unused file

* refactor(extract): modify dependencies (#358)

* refactor(extract): modify dependencies

* chore: modify files config

* chore: add indexId as key for map

---------

Co-authored-by: Zhou Xiao <zhouxiao.shaw@bytedance.com>
2025-02-07 14:55:52 +08:00
github-actions[bot]
e86021535a release: v0.10.5 2025-01-31 03:07:52 +00:00
github-actions[bot]
6c908842f9 release: v0.10.4 2025-01-30 06:18:36 +00:00
github-actions[bot]
8eacc354a7 release: v0.10.3 2025-01-27 08:21:33 +00:00
Zhou Xiao
e3eb6f6fbc
fix: resolve shared exports error (#335) 2025-01-27 16:16:42 +08:00
github-actions[bot]
e6fc69eb81 release: v0.10.2 2025-01-26 12:39:17 +00:00
Zhou Xiao
9c88186540
feat(ui-tars): enhance the UI-TARS keyboard event handling and optimize parser logic (#330) 2025-01-26 20:34:56 +08:00
github-actions[bot]
0f92941f54 release: v0.10.1 2025-01-23 07:15:56 +00:00
yuyutaotao
3aa1b33955
feat: use jpeg as default image format (#301)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-20 20:02:49 +08:00
github-actions[bot]
9b86067ea6 release: v0.10.0 2025-01-17 10:31:04 +00:00
github-actions[bot]
d580bd02fe release: v0.9.2 2025-01-15 03:22:10 +00:00
Zhou xiao
2b18ed55de
feat(ai-model): support vlm (#262)
* feat(ai-model): support plan to target

* chore: modify test

* chore: modify test

* chore: fix env config

* chore: unify the action logic

* chore: optimize type hint

* chore: optimize type hint

* chore: fix type hint

* chore: fix build type error

* chore: support open new tab

* feat: support auto complete element

* chore: add sleep event

* chore: add ai cost time

* chore: optimize prompt

* chore: optimize report prompt

* chore: optimize vlm name

* chore: fix command

* chore: optimize error handle and use check debugger list replace last tab id

* chore: fix chrome debugger attach logic

* chore: fix unit test
2025-01-13 14:32:17 +08:00
github-actions[bot]
d92bfa8987 release: v0.9.1 2025-01-11 05:17:05 +00:00
github-actions[bot]
bc9542d8df release: v0.9.0 2025-01-09 07:06:20 +00:00
github-actions[bot]
de92f3fc13 release: v0.8.18 2025-01-07 11:53:17 +00:00
github-actions[bot]
4fd930340c release: v0.8.17 2025-01-07 03:54:08 +00:00
Zhou xiao
691eb6ef0a
feat(ai-model): support Image positioning and integrate langchain (#230)
* feat: add point img logic

* feat: migrate prompt to langchain

* chore: delete unless log

* chore: optimize test case

* chore: fix lint error

* chore: delete httpAgent logic

* chore: delete unless fn

* chore: fix some comment

* chore: fix ci error

* chore: delete unless fn

* chore: update prompt

* chore: delete unless language
2025-01-02 21:23:30 +08:00
github-actions[bot]
1e7c9caf1a release: v0.8.16 2025-01-02 02:38:32 +00:00
yuyutaotao
8d83debd13
fix: add some default value for tmp dir #231 (#233) 2025-01-02 10:18:44 +08:00
github-actions[bot]
85cb87f1ec release: v0.8.15 2025-01-01 13:15:36 +00:00
github-actions[bot]
3b696033e8 release: v0.8.14 2024-12-31 14:04:23 +00:00
github-actions[bot]
dea3479242 release: v0.8.13 2024-12-27 02:25:47 +00:00
github-actions[bot]
a39684a8ff release: v0.8.12 2024-12-26 05:28:37 +00:00
github-actions[bot]
471e684a5d release: v0.8.11 2024-12-26 02:47:23 +00:00
github-actions[bot]
461a6a9dff release: v0.8.10 2024-12-25 16:11:46 +00:00
github-actions[bot]
a5066d2f58 release: v0.8.9 2024-12-24 14:45:57 +00:00
github-actions[bot]
1e76905b5f release: v0.8.8 2024-12-23 07:08:16 +00:00
github-actions[bot]
48fa8a56a8 release: v0.8.7 2024-12-19 08:27:51 +00:00
github-actions[bot]
3dc57eef32 release: v0.8.6 2024-12-16 07:41:16 +00:00
github-actions[bot]
91896c421a release: v0.8.5 2024-12-09 09:11:52 +00:00
github-actions[bot]
27ca8f9271 release: v0.8.4 2024-11-19 10:08:44 +00:00
github-actions[bot]
3dd487467b release: v0.8.3 2024-11-19 08:05:50 +00:00
github-actions[bot]
d4cd844a67 release: v0.8.2 2024-11-18 09:35:14 +00:00
github-actions[bot]
4972d22ec4 release: v0.8.1 2024-11-15 08:41:21 +00:00
yuyutaotao
26779cf082
fix: fix some extraction bug in extension (#157) 2024-11-14 19:29:22 +08:00
github-actions[bot]
3117584e57 release: v0.8.0 2024-11-11 10:39:38 +00:00
yuyutaotao
198172dc4e
feat: optimize the speed of screenshot in browser (#144)
* feat: optimize the speed of screenshot in browser

* feat: remove unnecessary context call

* fix: CI
2024-11-05 14:28:16 +08:00
yuyutaotao
9e1eef5cfd
feat: Build a chrome extension for playground (#140) 2024-11-05 11:49:21 +08:00
Zhou xiao
adb9b58879
feat(ai-model): add claude computer ablity (#136)
* Add new changes

* Add computer test results and update AI evaluation tests

* chore: Update build outputs and configurations

* feat(ai-model): support claude computer ability use position replace element id

* feat: generate add and commit

* feat: implement computer ability test for Claude

* chore: fix build Lose

* chore: Add and commit changes

* chore: optimize ai position

* chore: optimize ai position

* Add AI evaluation results and update tests

* chore: optimize ai test

* chore: add and commit changes

* chore: optimize ai test content

* chore: fix test case

* chore: fix e2e test
2024-10-31 18:18:31 +08:00
yuyutaotao
c288baa448
feat: make playground working in the browser (#135)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-28 11:04:40 +08:00
github-actions[bot]
617f2213cf release: v0.7.2 2024-10-24 07:21:00 +00:00
github-actions[bot]
0199719e44 release: v0.7.1 2024-10-22 07:43:31 +00:00
github-actions[bot]
ab815fef56 release: v0.7.0 2024-10-21 08:34:43 +00:00
Zhou xiao
f312cecbac
refactor(extract): optimize image box selection (#130)
* refactor(extract): optimize image box selection

* chore: Optimize the logic for generating AI test data to avoid producing duplicate data

* Update code and configurations

* Update code and configurations

* chore: fix lint error
2024-10-17 14:58:19 +08:00
github-actions[bot]
9f44eedfd9 release: v0.6.2 2024-10-15 03:26:29 +00:00