* feat: enable search area for locate
* fix: update evaluation
* fix: build error
* fix: ci
* fix: locator
* feat: show searchArea in report
* chore: add yaml support for aiTap
* feat: update status tip
* fix: #473 (#484)
* chore: optimize unit test list
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* feat: extract web content as a tree
* chore: update test data
* chore: update test data
* feat: update answer of evaluation
* chore: update test cases
* chore: remove focusing on cases
* fix: ci
* fix: put rect in html tree
* fix: CI
* fix: AI test
* fix: lint
* fix: CI
* fix: static-page compatibility
* fix: CI
* fix: map by markerId
* fix: llm planning prompt
* chore: update hash length
* chore: ignore writing dump file
* fix: lint
* fix: ci snapshot
* chore: snapshot tree in web extractor
* chore: export tree utils in core
* chore: export tree utils in core
* fix: CI
* fix: update test case and evaluation
* chore: remove unused file
* refactor(extract): modify dependencies (#358)
* refactor(extract): modify dependencies
* chore: modify files config
* chore: add indexId as key for map
---------
Co-authored-by: Zhou Xiao <zhouxiao.shaw@bytedance.com>
* chore: fix e2e test
* chore: ignore todo test
* chore: fix e2e test
* chore: upgrade gpt api version
* chore: fix e2e test
* chore: fix e2e test
* chore: fix direction
* chore: fix direction
* chore: split test
* chore: split test
* chore: modify input info
* fix: scroll param in ci
* fix: lint
* fix: ai test
* fix: ai test
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
* feat(ai-model): support plan to target
* chore: modify test
* chore: modify test
* chore: fix env config
* chore: unify the action logic
* chore: optimize type hint
* chore: optimize type hint
* chore: fix type hint
* chore: fix build type error
* chore: support open new tab
* feat: support auto complete element
* chore: add sleep event
* chore: add ai cost time
* chore: optimize prompt
* chore: optimize report prompt
* chore: optimize vlm name
* chore: fix command
* chore: optimize error handle and use check debugger list replace last tab id
* chore: fix chrome debugger attach logic
* chore: fix unit test
* feat: allow auto reconnect in bridge mode after disconnect
* feat: show agent progress in extension
* feat: allow using bridge mode in yaml
* doc: add doc for bridge mode
* doc: add doc for bridge mode
* docs: update screenshot
* feat: invoke anthropic SDK
* chore: set response format for extract
* fix: do not throw if waitUntilNetworkIdle failed in aiAction
* fix: timeout config for Puppeteer
* chore: add instruction for connectivity test
* Add new changes
* Add computer test results and update AI evaluation tests
* chore: Update build outputs and configurations
* feat(ai-model): support claude computer ability use position replace element id
* feat: generate add and commit
* feat: implement computer ability test for Claude
* chore: fix build Lose
* chore: Add and commit changes
* chore: optimize ai position
* chore: optimize ai position
* Add AI evaluation results and update tests
* chore: optimize ai test
* chore: add and commit changes
* chore: optimize ai test content
* chore: fix test case
* chore: fix e2e test
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* feat(ai-model): optimize AI model for element inspection
* feat(ai-model): optimize AI model and add quick answer functionality
---------
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
* feat(ai-model): implement quick answer functionality for element inspection
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* feat(cache): The cache is generalized to support Puppeteers and mobile terminals
* chore: update cache test
* chore: update cache test
* chore: update cache test
* docs: update cache doc
* chore: update ai test command
* chore: update ai test command
* chore: update ai test command
* chore: optimize cache logic
* chore: update get dir path logic
* chore: update get dir path logic