21 Commits

Author	SHA1	Message	Date
Zhou xiao	4c82eff526	chore: fix e2e test (#316) ... * chore: fix e2e test * chore: ignore todo test * chore: fix e2e test * chore: upgrade gpt api version * chore: fix e2e test * chore: fix e2e test * chore: fix direction * chore: fix direction * chore: split test * chore: split test * chore: modify input info * fix: scroll param in ci * fix: lint * fix: ai test * fix: ai test --------- Co-authored-by: yutao <yutao.tao@bytedance.com>	2025-01-24 15:02:50 +08:00
yuyutaotao	57f6786628	feat(extract-data): extract data from same-origin iframe (#258) ... * feat: extract data from same-origin iframe * fix: ci snapshot * fix: extracting timeout error * fix: ci timeout * fix: update assets * feat: set default size of yaml as 1920x1080 * chore: update default viewport size --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2025-01-22 20:52:11 +08:00
yuyutaotao	ed45cfab6c	fix(action): keyboard and div extracting (#304) ... * fix: clearInput in browser * fix: input issue on mac * fix: playwright input * fix: issue when collecting fixed item --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com> * fix: extract fixed style content * fix: extract fixed style content * fix: customize window size in yaml	2025-01-21 19:21:09 +08:00
yuyutaotao	8479bcb652	feat: bridge mode - phase 2 (#257) ... * feat: allow auto reconnect in bridge mode after disconnect * feat: show agent progress in extension * feat: allow using bridge mode in yaml * doc: add doc for bridge mode * doc: add doc for bridge mode * docs: update screenshot	2025-01-10 10:55:41 +08:00
yuyutaotao	4a82e9bda9	feat: let max_tokens configurable (#212) ... * feat: let max_tokens configurable * fix: update ci test case	2024-12-26 13:24:21 +08:00
yuyutaotao	523adab12f	feat: support the if-statement in planning prompt (#184)	2024-12-19 10:44:08 +08:00
yuyutaotao	537a5c43d0	feat: add a real-time progress indicator for playground (#177)	2024-12-16 15:04:21 +08:00
yuyutaotao	863e5a54d0	fix: sandbox issue of puppeteer in Ubuntu (#176) ... * fix: disable setuid sandbox in cli * fix: disable setuid sandbox in cli	2024-12-10 09:24:43 +08:00
yuyutaotao	082e347da9	feat: replanning before locating (#167)	2024-12-08 20:12:17 +08:00
yuyutaotao	e7a58b3b24	faet: support yaml style scripts (#165)	2024-11-25 16:05:01 +08:00
yuyutaotao	4282e7bf07	feat: lower the cost of page description (#159)	2024-11-20 16:00:34 +08:00
Zhou xiao	08d46becf1	feat(cache): optimize cache logic id and export overrideAIConfig (#148) ... * chore(cache): optimize cache logic id and export overrideAIConfig * chore: use cache logic	2024-11-07 21:06:01 +08:00
yuyutaotao	f8507efd50	chore: some minor bug fixes (#146) ... * feat: always use latest process.env as fallback --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2024-11-07 11:29:50 +08:00
Zhou xiao	1eb4c8de9f	workflow(ci): fix ci error (#142)	2024-11-04 17:14:14 +08:00
yuyutaotao	ee521e31e0	fix: fix the Player style when the locator is failed (#129) ... * fix: fix the Player style when the locator is failed * fix: add marker image into UIContext	2024-10-17 10:44:30 +08:00
Zhou xiao	3b24df1ec0	workflow(ci): fix ai test error (#113) ... * chore: update element inspector prompt and schema * test: update snapshots for planning-input tests	2024-10-12 16:01:07 +08:00
yuyutaotao	f9dc0f698e	feat(ai-model): merge ai planning and insight call to accelerate the aiAction (#97) ... --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com> * feat(ai-model): optimize AI model for element inspection * feat(ai-model): optimize AI model and add quick answer functionality --------- Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com> * feat(ai-model): implement quick answer functionality for element inspection --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2024-10-12 12:09:25 +08:00
Zhou xiao	10757a8ba1	refacotr(ai-model): optimize model evalution method (#98)	2024-09-29 17:16:07 +08:00
yuyutaotao	7d9792c651	fix(ci): fix build error for Cli, remove used package (#89)	2024-09-09 18:07:22 +08:00
yuyutaotao	30dc7a3c22	chore(web): merge the Page implementation of Puppeteer and Playwright (#87)	2024-09-09 15:57:36 +08:00
Zhou xiao	eafa5bfa20	feat(cache): The cache is generalized to support puppeteers and mobile terminals (#85) ... * feat(cache): The cache is generalized to support Puppeteers and mobile terminals * chore: update cache test * chore: update cache test * chore: update cache test * docs: update cache doc * chore: update ai test command * chore: update ai test command * chore: update ai test command * chore: optimize cache logic * chore: update get dir path logic * chore: update get dir path logic	2024-09-06 17:19:35 +08:00