72 Commits

Author SHA1 Message Date
yuyutaotao
e7a58b3b24
faet: support yaml style scripts (#165) 2024-11-25 16:05:01 +08:00
yuyutaotao
4282e7bf07
feat: lower the cost of page description (#159) 2024-11-20 16:00:34 +08:00
yuyutaotao
48fa92f037
workflow(ci): AI test cases (#154)
* fix: AI test

* chore: add more links in README
2024-11-13 15:01:21 +08:00
Zhou xiao
08d46becf1
feat(cache): optimize cache logic id and export overrideAIConfig (#148)
* chore(cache): optimize cache logic id and export overrideAIConfig

* chore: use cache logic
2024-11-07 21:06:01 +08:00
yuyutaotao
f8507efd50
chore: some minor bug fixes (#146)
* feat: always use latest process.env as fallback

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-11-07 11:29:50 +08:00
yuyutaotao
9e1eef5cfd
feat: Build a chrome extension for playground (#140) 2024-11-05 11:49:21 +08:00
Zhou xiao
1eb4c8de9f
workflow(ci): fix ci error (#142) 2024-11-04 17:14:14 +08:00
Zhou xiao
adb9b58879
feat(ai-model): add claude computer ablity (#136)
* Add new changes

* Add computer test results and update AI evaluation tests

* chore: Update build outputs and configurations

* feat(ai-model): support claude computer ability use position replace element id

* feat: generate add and commit

* feat: implement computer ability test for Claude

* chore: fix build Lose

* chore: Add and commit changes

* chore: optimize ai position

* chore: optimize ai position

* Add AI evaluation results and update tests

* chore: optimize ai test

* chore: add and commit changes

* chore: optimize ai test content

* chore: fix test case

* chore: fix e2e test
2024-10-31 18:18:31 +08:00
yuyutaotao
c288baa448
feat: make playground working in the browser (#135)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-28 11:04:40 +08:00
yuyutaotao
7d4f9847f5
feat: add a playground page to debug (#131)
* fix: fix the Player style when the locator is failed

* feat: add Playground UI

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-21 16:30:07 +08:00
yuyutaotao
ee521e31e0
fix: fix the Player style when the locator is failed (#129)
* fix: fix the Player style when the locator is failed

* fix: add marker image into UIContext
2024-10-17 10:44:30 +08:00
Zhou xiao
3b24df1ec0
workflow(ci): fix ai test error (#113)
* chore: update element inspector prompt and schema

* test: update snapshots for planning-input tests
2024-10-12 16:01:07 +08:00
yuyutaotao
f9dc0f698e
feat(ai-model): merge ai planning and insight call to accelerate the aiAction (#97)
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>

* feat(ai-model): optimize AI model for element inspection

* feat(ai-model): optimize AI model and add quick answer functionality

---------

Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>

* feat(ai-model): implement quick answer functionality for element inspection

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2024-10-12 12:09:25 +08:00
Zhou xiao
8ec5622342
chore: optimize ai e2e test (#99) 2024-09-29 17:51:59 +08:00
Zhou xiao
10757a8ba1
refacotr(ai-model): optimize model evalution method (#98) 2024-09-29 17:16:07 +08:00
Leyang
43bf165ddc
define appium export in package.json & encapsulated screenshot picture path generation (#95)
* feat: define appium export in package.json

* feat: encapsulated screenshot picture path generation
2024-09-23 10:57:19 +08:00
Zhou xiao
6b6f37a764
workflow(ci): fix ai e2e test (#94) 2024-09-12 11:03:42 +08:00
Zhou xiao
d481ea4201
feat(model): support azure open ai (#90)
* feat(model): support open ai azure methods

* chore: fix e2e test

* chore: add OPENAI_USE_AZURE env config

* docs: add openai azure env
2024-09-10 14:29:01 +08:00
yuyutaotao
9e29edc0c6
fix: type error in AI test (#91) 2024-09-10 11:21:44 +08:00
yuyutaotao
7d9792c651
fix(ci): fix build error for Cli, remove used package (#89) 2024-09-09 18:07:22 +08:00
yuyutaotao
30dc7a3c22
chore(web): merge the Page implementation of Puppeteer and Playwright (#87) 2024-09-09 15:57:36 +08:00
Zhou xiao
eafa5bfa20
feat(cache): The cache is generalized to support puppeteers and mobile terminals (#85)
* feat(cache): The cache is generalized to support Puppeteers and mobile terminals

* chore: update cache test

* chore: update cache test

* chore: update cache test

* docs: update cache doc

* chore: update ai test command

* chore: update ai test command

* chore: update ai test command

* chore: optimize cache logic

* chore: update get dir path logic

* chore: update get dir path logic
2024-09-06 17:19:35 +08:00