18 Commits

Author	SHA1	Message	Date
Leyang	fb2580616c	fix cache bugs(scroll instant, text node info, cache hit condition) (#732) ... * fix(web-integration): cache hit when element.id exist and scroll element instantly * fix(web-integration): use parent xpath for text node * fix(web-integration): only scroll in to view when element is not completly visible * fix(shared): distinct text node * test(web-integration): getElementInfoByXpath * test(web-integration): rename desc * test(web-integration): fix * test(web-integration): snapshot attributes only * test(web-integration): fix test	2025-05-20 13:19:32 +08:00
yuyutaotao	8e1ba565d0	feat: optimize locator (#456) ... --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2025-03-17 19:19:54 +08:00
yuyutaotao	2a28472fa5	feat: use different color for annotations (#366)	2025-02-10 16:36:12 +08:00
yuyutaotao	9d5f2fbcac	feat(web-extract): extract web content as a tree (#337) ... * feat: extract web content as a tree * chore: update test data * chore: update test data * feat: update answer of evaluation * chore: update test cases * chore: remove focusing on cases * fix: ci * fix: put rect in html tree * fix: CI * fix: AI test * fix: lint * fix: CI * fix: static-page compatibility * fix: CI * fix: map by markerId * fix: llm planning prompt * chore: update hash length * chore: ignore writing dump file * fix: lint * fix: ci snapshot * chore: snapshot tree in web extractor * chore: export tree utils in core * chore: export tree utils in core * fix: CI * fix: update test case and evaluation * chore: remove unused file * refactor(extract): modify dependencies (#358) * refactor(extract): modify dependencies * chore: modify files config * chore: add indexId as key for map --------- Co-authored-by: Zhou Xiao <zhouxiao.shaw@bytedance.com>	2025-02-07 14:55:52 +08:00
yuyutaotao	57f6786628	feat(extract-data): extract data from same-origin iframe (#258) ... * feat: extract data from same-origin iframe * fix: ci snapshot * fix: extracting timeout error * fix: ci timeout * fix: update assets * feat: set default size of yaml as 1920x1080 * chore: update default viewport size --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2025-01-22 20:52:11 +08:00
yuyutaotao	3d95460f44	docs(ai-model): update docs for ui-tars (#305) ... * feat: update docs for ui-tars * doc: update * doc: update * doc: update * chore: update readme * fix: ci * docs: upgrade video * chore: modify huagging face icon --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2025-01-22 09:24:29 +08:00
yuyutaotao	05dad23bfd	chore: print yaml file in chrome extension (#205)	2024-12-25 20:23:12 +08:00
yuyutaotao	523adab12f	feat: support the if-statement in planning prompt (#184)	2024-12-19 10:44:08 +08:00
yuyutaotao	537a5c43d0	feat: add a real-time progress indicator for playground (#177)	2024-12-16 15:04:21 +08:00
yuyutaotao	082e347da9	feat: replanning before locating (#167)	2024-12-08 20:12:17 +08:00
yuyutaotao	198172dc4e	feat: optimize the speed of screenshot in browser (#144) ... * feat: optimize the speed of screenshot in browser * feat: remove unnecessary context call * fix: CI	2024-11-05 14:28:16 +08:00
yuyutaotao	c288baa448	feat: make playground working in the browser (#135) ... --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2024-10-28 11:04:40 +08:00
yuyutaotao	7d4f9847f5	feat: add a playground page to debug (#131) ... * fix: fix the Player style when the locator is failed * feat: add Playground UI --------- Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>	2024-10-21 16:30:07 +08:00
Zhou xiao	10757a8ba1	refacotr(ai-model): optimize model evalution method (#98)	2024-09-29 17:16:07 +08:00
Leyang	43bf165ddc	define appium export in package.json & encapsulated screenshot picture path generation (#95) ... * feat: define appium export in package.json * feat: encapsulated screenshot picture path generation	2024-09-23 10:57:19 +08:00
yuyutaotao	5bd49852b8	feat(web-extract): collect svg elements on page, trim attribute values to save token (#83)	2024-09-10 07:04:27 +08:00
Zhou xiao	eafa5bfa20	feat(cache): The cache is generalized to support puppeteers and mobile terminals (#85) ... * feat(cache): The cache is generalized to support Puppeteers and mobile terminals * chore: update cache test * chore: update cache test * chore: update cache test * docs: update cache doc * chore: update ai test command * chore: update ai test command * chore: update ai test command * chore: optimize cache logic * chore: update get dir path logic * chore: update get dir path logic	2024-09-06 17:19:35 +08:00
Leyang	cfa92b3980	feat(app): supports control of iOS and Android devices through appium (#82) ... Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com> Co-authored-by: linyibing <linyibing@bytedance.com>	2024-09-05 20:05:19 +08:00