yuyutaotao
9e1eef5cfd
feat: Build a chrome extension for playground ( #140 )
2024-11-05 11:49:21 +08:00
Zhou xiao
1eb4c8de9f
workflow(ci): fix ci error ( #142 )
2024-11-04 17:14:14 +08:00
Zhou xiao
adb9b58879
feat(ai-model): add claude computer ablity ( #136 )
...
* Add new changes
* Add computer test results and update AI evaluation tests
* chore: Update build outputs and configurations
* feat(ai-model): support claude computer ability use position replace element id
* feat: generate add and commit
* feat: implement computer ability test for Claude
* chore: fix build Lose
* chore: Add and commit changes
* chore: optimize ai position
* chore: optimize ai position
* Add AI evaluation results and update tests
* chore: optimize ai test
* chore: add and commit changes
* chore: optimize ai test content
* chore: fix test case
* chore: fix e2e test
2024-10-31 18:18:31 +08:00
yuyutaotao
c288baa448
feat: make playground working in the browser ( #135 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-28 11:04:40 +08:00
github-actions[bot]
617f2213cf
release: v0.7.2
2024-10-24 07:21:00 +00:00
yuyutaotao
2060c0e6ef
fix: Playwright fixture fail to run ( #137 )
2024-10-24 14:37:48 +08:00
github-actions[bot]
0199719e44
release: v0.7.1
2024-10-22 07:43:31 +00:00
github-actions[bot]
ab815fef56
release: v0.7.0
2024-10-21 08:34:43 +00:00
yuyutaotao
7d4f9847f5
feat: add a playground page to debug ( #131 )
...
* fix: fix the Player style when the locator is failed
* feat: add Playground UI
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-21 16:30:07 +08:00
Zhou xiao
f312cecbac
refactor(extract): optimize image box selection ( #130 )
...
* refactor(extract): optimize image box selection
* chore: Optimize the logic for generating AI test data to avoid producing duplicate data
* Update code and configurations
* Update code and configurations
* chore: fix lint error
2024-10-17 14:58:19 +08:00
yuyutaotao
ee521e31e0
fix: fix the Player style when the locator is failed ( #129 )
...
* fix: fix the Player style when the locator is failed
* fix: add marker image into UIContext
2024-10-17 10:44:30 +08:00
github-actions[bot]
9f44eedfd9
release: v0.6.2
2024-10-15 03:26:29 +00:00
yuyutaotao
f715a2709e
docs: add repository and homepage in package.json ( #122 )
2024-10-15 11:22:21 +08:00
github-actions[bot]
de6aa6dcaa
release: v0.6.1
2024-10-12 08:25:42 +00:00
github-actions[bot]
bdf4fb3ed1
release: v0.6.0
2024-10-12 08:10:00 +00:00
Zhou xiao
3b24df1ec0
workflow(ci): fix ai test error ( #113 )
...
* chore: update element inspector prompt and schema
* test: update snapshots for planning-input tests
2024-10-12 16:01:07 +08:00
github-actions[bot]
e2f5e114a7
release: v0.5.2
2024-10-12 06:37:01 +00:00
yuyutaotao
f9dc0f698e
feat(ai-model): merge ai planning and insight call to accelerate the aiAction ( #97 )
...
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* feat(ai-model): optimize AI model for element inspection
* feat(ai-model): optimize AI model and add quick answer functionality
---------
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
* feat(ai-model): implement quick answer functionality for element inspection
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-12 12:09:25 +08:00
Zhou xiao
8ec5622342
chore: optimize ai e2e test ( #99 )
2024-09-29 17:51:59 +08:00
Zhou xiao
10757a8ba1
refacotr(ai-model): optimize model evalution method ( #98 )
2024-09-29 17:16:07 +08:00
github-actions[bot]
032b505d8e
release: v0.5.1
2024-09-26 07:41:19 +00:00
Leyang
43bf165ddc
define appium export in package.json & encapsulated screenshot picture path generation ( #95 )
...
* feat: define appium export in package.json
* feat: encapsulated screenshot picture path generation
2024-09-23 10:57:19 +08:00
github-actions[bot]
649d71d2ec
release: v0.5.0
2024-09-12 03:31:37 +00:00
Zhou xiao
6b6f37a764
workflow(ci): fix ai e2e test ( #94 )
2024-09-12 11:03:42 +08:00
yuyutaotao
a2e4ff61b0
fix(cache): app should not crash when it fails to get the cache id ( #93 )
2024-09-11 10:22:57 +08:00
Zhou xiao
d481ea4201
feat(model): support azure open ai ( #90 )
...
* feat(model): support open ai azure methods
* chore: fix e2e test
* chore: add OPENAI_USE_AZURE env config
* docs: add openai azure env
2024-09-10 14:29:01 +08:00
yuyutaotao
9e29edc0c6
fix: type error in AI test ( #91 )
2024-09-10 11:21:44 +08:00
yuyutaotao
5bd49852b8
feat(web-extract): collect svg elements on page, trim attribute values to save token ( #83 )
2024-09-10 07:04:27 +08:00
yuyutaotao
7d9792c651
fix(ci): fix build error for Cli, remove used package ( #89 )
2024-09-09 18:07:22 +08:00
yuyutaotao
30dc7a3c22
chore(web): merge the Page implementation of Puppeteer and Playwright ( #87 )
2024-09-09 15:57:36 +08:00
Zhou xiao
eafa5bfa20
feat(cache): The cache is generalized to support puppeteers and mobile terminals ( #85 )
...
* feat(cache): The cache is generalized to support Puppeteers and mobile terminals
* chore: update cache test
* chore: update cache test
* chore: update cache test
* docs: update cache doc
* chore: update ai test command
* chore: update ai test command
* chore: update ai test command
* chore: optimize cache logic
* chore: update get dir path logic
* chore: update get dir path logic
2024-09-06 17:19:35 +08:00
Zhou xiao
c5077a255f
feat(ai-model): support JSON 100% limit capability for gpt-4o-2024-08-06 model ( #86 )
2024-09-05 20:05:42 +08:00
Leyang
cfa92b3980
feat(app): supports control of iOS and Android devices through appium ( #82 )
...
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
Co-authored-by: linyibing <linyibing@bytedance.com>
2024-09-05 20:05:19 +08:00
Zhou xiao
1c6237ae46
chore: delete unless debug code and fix ci cache logic ( #84 )
2024-09-02 14:09:56 +08:00
yuyutaotao
704a0b8a52
feat(web-extract): extract some <div />s as container ( #80 )
2024-08-31 08:17:50 +08:00
Zhou xiao
3769a559db
refactor(plan): optimize input prompt ( #81 )
2024-08-29 14:59:03 +08:00
Zhou xiao
3ad8e9cea2
fix(ai-plan): optimize KeyboardPress plan type reduce hallucinations ( #79 )
2024-08-29 14:34:07 +08:00
Zhou xiao
84ee7130b8
feat(web): input supports additions, deletions, and changes ( #78 )
...
* feat(web): input supports additions, deletions, and changes
* chore: optimize unit test content
2024-08-28 19:31:59 +08:00
yuyutaotao
f8fdf60570
fix(web-extract): fix the extractor may fail if there is no <body/> ( #76 )
2024-08-28 19:21:32 +08:00
Zhou xiao
e071adfa70
chore: optimize code style ( #77 )
2024-08-28 14:59:25 +08:00
github-actions[bot]
952d13e8b0
release: v0.4.0
2024-08-27 00:29:53 +00:00
Zhou xiao
9a8be3e879
workflow(ci): optimize ci command ( #75 )
2024-08-27 08:18:33 +08:00
Zhou xiao
d2a5dbecba
refactor(shared): migrate sharp to jimp and migrate common img logci to shared lib ( #74 )
...
* fix(web): fix sharp deps
* chore: optimize sharp deps
* refactor(extract): migrate sharp to jimp
* refactor: migrate img common logic to shared lib
* chore: merge main branch
* chore: merge main branch
* chore: merge main branch
* chore: delete unless code
* chore: optimize code
* chore: optimize ai test branch trigger method
* chore: optimize ai test branch trigger method
* chore: optimize trigger method
2024-08-26 18:50:33 +08:00
yuyutaotao
52bda878aa
fix(web-extract): fix the extractor for form item like <input /> ( #65 )
2024-08-26 11:09:39 +08:00
yuyutaotao
64244e871b
fix: the flashing issue in cli headed mode ( #73 )
2024-08-26 11:08:50 +08:00
github-actions[bot]
d5da9c5511
release: v0.3.4
2024-08-23 11:33:03 +00:00
Zhou xiao
be3725647d
fix(web): fix sharp deps ( #72 )
...
* fix(web): fix sharp deps
* chore: optimize sharp deps
2024-08-23 19:29:45 +08:00
github-actions[bot]
02d2dc9cec
release: v0.3.3
2024-08-23 10:12:47 +00:00
yuyutaotao
b351dbfb87
feat(web): export puppeteer and playwright separately ( #71 )
2024-08-23 15:57:39 +08:00
github-actions[bot]
0be5bbcc54
release: v0.3.2
2024-08-23 03:02:14 +00:00
