21 Commits

Author	SHA1	Message	Date
Zhou xiao	2811f15da0	chore: refine AI test for failures (#323)	2025-01-25 11:14:15 +08:00
Zhou xiao	4c82eff526	chore: fix e2e test (#316) ... * chore: fix e2e test * chore: ignore todo test * chore: fix e2e test * chore: upgrade gpt api version * chore: fix e2e test * chore: fix e2e test * chore: fix direction * chore: fix direction * chore: split test * chore: split test * chore: modify input info * fix: scroll param in ci * fix: lint * fix: ai test * fix: ai test --------- Co-authored-by: yutao <yutao.tao@bytedance.com>	2025-01-24 15:02:50 +08:00
Zhou xiao	6c188d09e8	fix(e2e): optimize e2e error (#307) ... * fix(e2e): optimize e2e error * chore: ignore unless e2e	2025-01-22 13:51:40 +08:00
yuyutaotao	ed45cfab6c	fix(action): keyboard and div extracting (#304) ... * fix: clearInput in browser * fix: input issue on mac * fix: playwright input * fix: issue when collecting fixed item --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com> * fix: extract fixed style content * fix: extract fixed style content * fix: customize window size in yaml	2025-01-21 19:21:09 +08:00
Zhou xiao	56845b75ba	chore: fix planning typo (#269)	2025-01-13 14:52:15 +08:00
Zhou xiao	2b18ed55de	feat(ai-model): support vlm (#262) ... * feat(ai-model): support plan to target * chore: modify test * chore: modify test * chore: fix env config * chore: unify the action logic * chore: optimize type hint * chore: optimize type hint * chore: fix type hint * chore: fix build type error * chore: support open new tab * feat: support auto complete element * chore: add sleep event * chore: add ai cost time * chore: optimize prompt * chore: optimize report prompt * chore: optimize vlm name * chore: fix command * chore: optimize error handle and use check debugger list replace last tab id * chore: fix chrome debugger attach logic * chore: fix unit test	2025-01-13 14:32:17 +08:00
yuyutaotao	ae49685348	feat: add bridge mode for extension (#228)	2025-01-07 11:10:28 +08:00
Zhou xiao	691eb6ef0a	feat(ai-model): support Image positioning and integrate langchain (#230) ... * feat: add point img logic * feat: migrate prompt to langchain * chore: delete unless log * chore: optimize test case * chore: fix lint error * chore: delete httpAgent logic * chore: delete unless fn * chore: fix some comment * chore: fix ci error * chore: delete unless fn * chore: update prompt * chore: delete unless language	2025-01-02 21:23:30 +08:00
yuyutaotao	537a5c43d0	feat: add a real-time progress indicator for playground (#177)	2024-12-16 15:04:21 +08:00
yuyutaotao	082e347da9	feat: replanning before locating (#167)	2024-12-08 20:12:17 +08:00
yuyutaotao	9e1eef5cfd	feat: Build a chrome extension for playground (#140)	2024-11-05 11:49:21 +08:00
Zhou xiao	adb9b58879	feat(ai-model): add claude computer ablity (#136) ... * Add new changes * Add computer test results and update AI evaluation tests * chore: Update build outputs and configurations * feat(ai-model): support claude computer ability use position replace element id * feat: generate add and commit * feat: implement computer ability test for Claude * chore: fix build Lose * chore: Add and commit changes * chore: optimize ai position * chore: optimize ai position * Add AI evaluation results and update tests * chore: optimize ai test * chore: add and commit changes * chore: optimize ai test content * chore: fix test case * chore: fix e2e test	2024-10-31 18:18:31 +08:00
yuyutaotao	c288baa448	feat: make playground working in the browser (#135) ... --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2024-10-28 11:04:40 +08:00
yuyutaotao	f9dc0f698e	feat(ai-model): merge ai planning and insight call to accelerate the aiAction (#97) ... --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com> * feat(ai-model): optimize AI model for element inspection * feat(ai-model): optimize AI model and add quick answer functionality --------- Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com> * feat(ai-model): implement quick answer functionality for element inspection --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2024-10-12 12:09:25 +08:00
Zhou xiao	10757a8ba1	refacotr(ai-model): optimize model evalution method (#98)	2024-09-29 17:16:07 +08:00
Leyang	43bf165ddc	define appium export in package.json & encapsulated screenshot picture path generation (#95) ... * feat: define appium export in package.json * feat: encapsulated screenshot picture path generation	2024-09-23 10:57:19 +08:00
Zhou xiao	6b6f37a764	workflow(ci): fix ai e2e test (#94)	2024-09-12 11:03:42 +08:00
Zhou xiao	d481ea4201	feat(model): support azure open ai (#90) ... * feat(model): support open ai azure methods * chore: fix e2e test * chore: add OPENAI_USE_AZURE env config * docs: add openai azure env	2024-09-10 14:29:01 +08:00
yuyutaotao	9e29edc0c6	fix: type error in AI test (#91)	2024-09-10 11:21:44 +08:00
yuyutaotao	30dc7a3c22	chore(web): merge the Page implementation of Puppeteer and Playwright (#87)	2024-09-09 15:57:36 +08:00
Zhou xiao	eafa5bfa20	feat(cache): The cache is generalized to support puppeteers and mobile terminals (#85) ... * feat(cache): The cache is generalized to support Puppeteers and mobile terminals * chore: update cache test * chore: update cache test * chore: update cache test * docs: update cache doc * chore: update ai test command * chore: update ai test command * chore: update ai test command * chore: optimize cache logic * chore: update get dir path logic * chore: update get dir path logic	2024-09-06 17:19:35 +08:00