Zhou xiao
4c82eff526
chore: fix e2e test ( #316 )
...
* chore: fix e2e test
* chore: ignore todo test
* chore: fix e2e test
* chore: upgrade gpt api version
* chore: fix e2e test
* chore: fix e2e test
* chore: fix direction
* chore: fix direction
* chore: split test
* chore: split test
* chore: modify input info
* fix: scroll param in ci
* fix: lint
* fix: ai test
* fix: ai test
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
2025-01-24 15:02:50 +08:00
github-actions[bot]
0f92941f54
release: v0.10.1
2025-01-23 07:15:56 +00:00
yuyutaotao
57f6786628
feat(extract-data): extract data from same-origin iframe ( #258 )
...
* feat: extract data from same-origin iframe
* fix: ci snapshot
* fix: extracting timeout error
* fix: ci timeout
* fix: update assets
* feat: set default size of yaml as 1920x1080
* chore: update default viewport size
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-01-22 20:52:11 +08:00
yuyutaotao
ed45cfab6c
fix(action): keyboard and div extracting ( #304 )
...
* fix: clearInput in browser
* fix: input issue on mac
* fix: playwright input
* fix: issue when collecting fixed item
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* fix: extract fixed style content
* fix: extract fixed style content
* fix: customize window size in yaml
2025-01-21 19:21:09 +08:00
github-actions[bot]
d580bd02fe
release: v0.9.2
2025-01-15 03:22:10 +00:00
Zhou xiao
2b18ed55de
feat(ai-model): support vlm ( #262 )
...
* feat(ai-model): support plan to target
* chore: modify test
* chore: modify test
* chore: fix env config
* chore: unify the action logic
* chore: optimize type hint
* chore: optimize type hint
* chore: fix type hint
* chore: fix build type error
* chore: support open new tab
* feat: support auto complete element
* chore: add sleep event
* chore: add ai cost time
* chore: optimize prompt
* chore: optimize report prompt
* chore: optimize vlm name
* chore: fix command
* chore: optimize error handle and use check debugger list replace last tab id
* chore: fix chrome debugger attach logic
* chore: fix unit test
2025-01-13 14:32:17 +08:00
yuyutaotao
05dad23bfd
chore: print yaml file in chrome extension ( #205 )
2024-12-25 20:23:12 +08:00
github-actions[bot]
3dc57eef32
release: v0.8.6
2024-12-16 07:41:16 +00:00
yuyutaotao
537a5c43d0
feat: add a real-time progress indicator for playground ( #177 )
2024-12-16 15:04:21 +08:00
github-actions[bot]
91896c421a
release: v0.8.5
2024-12-09 09:11:52 +00:00
yuyutaotao
082e347da9
feat: replanning before locating ( #167 )
2024-12-08 20:12:17 +08:00
yuyutaotao
4282e7bf07
feat: lower the cost of page description ( #159 )
2024-11-20 16:00:34 +08:00
github-actions[bot]
4972d22ec4
release: v0.8.1
2024-11-15 08:41:21 +00:00
yuyutaotao
26779cf082
fix: fix some extraction bug in extension ( #157 )
2024-11-14 19:29:22 +08:00
github-actions[bot]
3117584e57
release: v0.8.0
2024-11-11 10:39:38 +00:00
yuyutaotao
c288baa448
feat: make playground working in the browser ( #135 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-28 11:04:40 +08:00
github-actions[bot]
ab815fef56
release: v0.7.0
2024-10-21 08:34:43 +00:00
yuyutaotao
7d4f9847f5
feat: add a playground page to debug ( #131 )
...
* fix: fix the Player style when the locator is failed
* feat: add Playground UI
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-21 16:30:07 +08:00
github-actions[bot]
bdf4fb3ed1
release: v0.6.0
2024-10-12 08:10:00 +00:00
Zhou xiao
3b24df1ec0
workflow(ci): fix ai test error ( #113 )
...
* chore: update element inspector prompt and schema
* test: update snapshots for planning-input tests
2024-10-12 16:01:07 +08:00
github-actions[bot]
e2f5e114a7
release: v0.5.2
2024-10-12 06:37:01 +00:00
yuyutaotao
f9dc0f698e
feat(ai-model): merge ai planning and insight call to accelerate the aiAction ( #97 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* feat(ai-model): optimize AI model for element inspection
* feat(ai-model): optimize AI model and add quick answer functionality
---------
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
* feat(ai-model): implement quick answer functionality for element inspection
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-12 12:09:25 +08:00
Zhou xiao
10757a8ba1
refacotr(ai-model): optimize model evalution method ( #98 )
2024-09-29 17:16:07 +08:00
github-actions[bot]
649d71d2ec
release: v0.5.0
2024-09-12 03:31:37 +00:00
yuyutaotao
5bd49852b8
feat(web-extract): collect svg elements on page, trim attribute values to save token ( #83 )
2024-09-10 07:04:27 +08:00
yuyutaotao
30dc7a3c22
chore(web): merge the Page implementation of Puppeteer and Playwright ( #87 )
2024-09-09 15:57:36 +08:00
Zhou xiao
eafa5bfa20
feat(cache): The cache is generalized to support puppeteers and mobile terminals ( #85 )
...
* feat(cache): The cache is generalized to support Puppeteers and mobile terminals
* chore: update cache test
* chore: update cache test
* chore: update cache test
* docs: update cache doc
* chore: update ai test command
* chore: update ai test command
* chore: update ai test command
* chore: optimize cache logic
* chore: update get dir path logic
* chore: update get dir path logic
2024-09-06 17:19:35 +08:00
Leyang
cfa92b3980
feat(app): supports control of iOS and Android devices through appium ( #82 )
...
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
Co-authored-by: linyibing <linyibing@bytedance.com>
2024-09-05 20:05:19 +08:00
yuyutaotao
704a0b8a52
feat(web-extract): extract some <div />s as container ( #80 )
2024-08-31 08:17:50 +08:00
Zhou xiao
84ee7130b8
feat(web): input supports additions, deletions, and changes ( #78 )
...
* feat(web): input supports additions, deletions, and changes
* chore: optimize unit test content
2024-08-28 19:31:59 +08:00
yuyutaotao
f8fdf60570
fix(web-extract): fix the extractor may fail if there is no <body/> ( #76 )
2024-08-28 19:21:32 +08:00
github-actions[bot]
952d13e8b0
release: v0.4.0
2024-08-27 00:29:53 +00:00
Zhou xiao
9a8be3e879
workflow(ci): optimize ci command ( #75 )
2024-08-27 08:18:33 +08:00
Zhou xiao
d2a5dbecba
refactor(shared): migrate sharp to jimp and migrate common img logci to shared lib ( #74 )
...
* fix(web): fix sharp deps
* chore: optimize sharp deps
* refactor(extract): migrate sharp to jimp
* refactor: migrate img common logic to shared lib
* chore: merge main branch
* chore: merge main branch
* chore: merge main branch
* chore: delete unless code
* chore: optimize code
* chore: optimize ai test branch trigger method
* chore: optimize ai test branch trigger method
* chore: optimize trigger method
2024-08-26 18:50:33 +08:00
yuyutaotao
52bda878aa
fix(web-extract): fix the extractor for form item like <input /> ( #65 )
2024-08-26 11:09:39 +08:00
github-actions[bot]
0be5bbcc54
release: v0.3.2
2024-08-23 03:02:14 +00:00
github-actions[bot]
5e79f960e8
release: v0.3.1
2024-08-22 23:05:02 +00:00
Zhou xiao
eb82d28082
feat(playwright): optimize the visualization and extraction of playwright ai process data ( #66 )
2024-08-22 18:12:01 +08:00
Zhou xiao
8815edfee5
workflow(ci): optimize web extract unit test ( #64 )
2024-08-21 17:24:32 +08:00
Zhou xiao
b07f83dee1
workflow(ci): optimize ai unit test ( #56 )
2024-08-20 07:41:08 +08:00
