- Optimize session creation to use timestamp naming by default without requiring modal input
- Improve UI layout to display titles and descriptions more effectively in both list and
detail views
- Apply code formatting improvements across the codebase for better readability
- Fix linting issues in scripts and component files
- Add @rsbuild/plugin-node-polyfill to support Node.js polyfills in the project
- Update event recording logic to include viewport dimensions and element positioning
- Improve screenshot handling by integrating new properties in RecordedEvent interface
- Enhance RecordTimeline component to display element positioning and dimensions
- Optimize event handling and UI updates for better user experience
- Clean up and refactor code for improved readability and maintainability
* feat(web-integration): add support for new agent method(aiBoolean, aiString, aiNumber, aiLocate)
* fix(core, web-integration): update data extraction logic and refine return types for agent methods
* feat(site): add detailed descriptions and examples
* fix(web-integration): remove unused properties from aiLocate return type and update UI titles
* fix(core): enhance agent methods for better extraction and querying
* fix(core): update test scripts and refine data extraction prompts
* fix(core): refine return type in ExecutionTaskApply and remove unused import in inspect
* fix(core): update data extraction logic and enhance type handling in Insight class
* fix(web-integration): update import path for puppeteerAgentForTarget in player test file
* fix(core): tests fix
* fix(core): fix tests
* fix(shared): enhance imageInfo tests by validating individual properties and updating snapshots
* fix(site): remove waitForNavigationTimeout from Playwright integration examples
* fix(site): update timeout configuration examples in FAQ for clarity
* test(web-integration): remove unused client-extractor test and related snapshots
* chore(core): fix query implementation
* fix(report): improve data handling in DetailSide component and enhance output display
* fix(core): refine data extraction prompts and improve error handling in PageTaskExecutor
* fix(core): update data extraction prompt for clarity and type validation
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
* refactor: android api
* refactor: enhance Android agent to accept options for device connection
* fix: type error
* fix: click after clearInput
* fix: click before clearInput
* feat: android playground
* feat: support npx package name
* feat: android playground joint
* fix: git ignore conflicts
* feat: ensure adb server is running before initializing adb client
* fix: deps consistency
* ci: add android playground
* feat: integrate shared constants and improve server configuration in android playground
* feat: android playground style
* feat: style opt
* feat: add @rsbuild/plugin-svgr dependency and improve URI handling in adb
* feat: remove unused water flow scripts and update comments to English
* feat: download report file
* feat: standalone android playground
* feat: use dynamic import
* feat: migrate CSS to LESS and remove unused styles in chrome extension and report
* feat: enhance Android playground with ScrcpyPlayer ref integration and device management improvements
* feat: optimize styles and layout in Android playground and visualizer components
* chore: add bin back
* chore: update build script to exclude documentation generation
* feat: add not ready message to PlaygroundResult for improved user guidance
* feat: add error handling for screenshot capture in Android page
* docs: update readme
* feat: add PNG validation for screenshot buffer in Android page
* feat: enhance UI components with improved styling and tooltips in ScrcpyPlayer and PromptInput
* docs: update uri parameter description in integrate-with-android documentation and improve uri handling in launch function
* style: update primary color to #2B83FF across multiple components and adjust margin in App.less
* refactor: replace userConfig with globalConfig for environment configuration management and update related functions
* feat: integrate server validation logic in App, AdbDevice, and ScrcpyPlayer components for improved connection handling
* style: enhance player component layout with overflow handling and margin adjustments
* style: refine player component layout with flex adjustments and improved spacing
* feat: add midscene model name display and improve layout in EnvConfig component
* feat: integrate ShinyText component for enhanced loading progress display in PlaygroundResult
* test: add test for isValidPNGImageBuffer
* style: remove background color from App.less and adjust AI config override behavior in env.ts
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
* feat: enable search area for locate
* fix: update evaluation
* fix: locator
* feat: show searchArea in report
* chore: add yaml support for aiTap
* feat: use adb instead appium
* feat: Adds debugging information and reconstructs input text capabilities
* feat: refactoring Android related functions and adding android modules
* feat: update the image scaling algorithm, adjust the Android page class to support device scaling, and remove test files that are no longer needed
* feat: adjust the Android page class to support device scaling, and remove test files that are no longer needed
* feat: use appium-adb instead of bare command
* fix: update entry for @midscene/android
* feat: optimize the screenshot processing logic, add a backup mechanism when screenshots fail, and update test cases to accommodate new features
* fix: rethrow error
* feat: add Android debug configuration options and update documentation
* chore: fix code style in #483 (#492)
* fix: remove try for error handle by outside
---------
Co-authored-by: yutao <yutao.tao@bytedance.com>
Co-authored-by: linyibing <linyibing@bytedance.com>
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
* feat: enable search area for locate
* fix: update evaluation
* fix: build error
* fix: ci
* fix: locator
* feat: show searchArea in report
* chore: add yaml support for aiTap
* feat: update status tip
* fix: #473 (#484)
* chore: optimize unit test list
---------
Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
* feat: extract web content as a tree
* chore: update test data
* chore: update test data
* feat: update answer of evaluation
* chore: update test cases
* chore: remove focusing on cases
* fix: ci
* fix: put rect in html tree
* fix: CI
* fix: AI test
* fix: lint
* fix: CI
* fix: static-page compatibility
* fix: CI
* fix: map by markerId
* fix: llm planning prompt
* chore: update hash length
* chore: ignore writing dump file
* fix: lint
* fix: ci snapshot
* chore: snapshot tree in web extractor
* chore: export tree utils in core
* chore: export tree utils in core
* fix: CI
* fix: update test case and evaluation
* chore: remove unused file
* refactor(extract): modify dependencies (#358)
* refactor(extract): modify dependencies
* chore: modify files config
* chore: add indexId as key for map
---------
Co-authored-by: Zhou Xiao <zhouxiao.shaw@bytedance.com>
