49 Commits

Author SHA1 Message Date
zhouxiao.shaw
4de7fd81f7 feat(record): improve session management and code quality
- Optimize session creation to use timestamp naming by default without requiring modal input
     - Improve UI layout to display titles and descriptions more effectively in both list and
     detail views
     - Apply code formatting improvements across the codebase for better readability
     - Fix linting issues in scripts and component files
2025-06-01 11:30:06 +08:00
zhouxiao.shaw
84fb598233 fix(core): align dependency versions across workspace
- Update React to ^19.1.0 and React DOM to >=19.1.0 in all packages
- Update @types/react to ^19.1.4 and @types/react-dom to ^19.1.3
- Update TypeScript to ^5.8.3 across all packages
- Update dayjs to use caret version ^1.11.11
- Align all rsbuild and rslib plugin versions
- Fix dependency version inconsistencies to pass CI checks
2025-05-28 12:31:58 +08:00
github-actions[bot]
049d9f6565 release: v0.17.1 2025-05-20 09:11:17 +00:00
github-actions[bot]
39ddc57df3 release: v0.17.0 2025-05-16 14:32:01 +00:00
Leyang
b9ff80a0db
implement repeat function for scrolling until actions (#713)
* feat(android): implement repeat function for scrolling until actions

* fix(shared): fix potential error in getAIConfig by ensuring trim is called correctly

* feat(android): update scrolling behavior with adjustable duration and added sleep

* feat(android): refine scrolling durations with new constants for fast and normal scroll
2025-05-14 18:28:10 +08:00
Leyang
388bbb6a34
fix(android): update yadb (#714) 2025-05-14 18:26:54 +08:00
github-actions[bot]
571ec07829 release: v0.16.10 2025-05-09 09:00:22 +00:00
github-actions[bot]
7f982f7cb7 release: v0.16.9 2025-05-09 03:44:51 +00:00
Leyang
57f1a7b7d2
feat(site): seo optimization (#693)
* feat(site): seo optimization

* feat(android, web-integration): update package descriptions and add keywords

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
2025-05-08 10:54:52 +08:00
HBLADEH
7762e5d04e
feat(android): fix custom adb path no effect (#688)
* feat(android): fix custom adb path no effect

* feat(android): fix custom adb, removed redundant `this.adb =` assignment
2025-05-06 17:29:13 +08:00
github-actions[bot]
c5a88931f0 release: v0.16.8 2025-04-30 14:31:14 +00:00
yuyutaotao
c1bc73c78b
feat(android): customize adb path (#684)
* feat(shared): add custom adb path
feat(android): add custom adb path

* feat(android): add docs for custom adb path

---------

Co-authored-by: HBLADEH <1012582116@qq.com>
2025-04-30 17:16:38 +08:00
github-actions[bot]
7ce8225369 release: v0.16.7 2025-04-29 08:36:53 +00:00
github-actions[bot]
aa2e767b79 release: v0.16.6 2025-04-29 05:54:48 +00:00
github-actions[bot]
9c5d22a57e release: v0.16.5 2025-04-29 05:17:39 +00:00
github-actions[bot]
061ff92c69 release: v0.16.4 2025-04-29 04:25:49 +00:00
github-actions[bot]
4f41e99ddc release: v0.16.3 2025-04-28 15:14:58 +00:00
github-actions[bot]
c4112adb51 release: v0.16.2 2025-04-28 06:22:02 +00:00
github-actions[bot]
33d2733c77 release: v0.16.1 2025-04-28 02:58:31 +00:00
github-actions[bot]
8acbb6a32f release: v0.16.0 2025-04-28 00:26:25 +00:00
Leyang
b2ac7e710d
fix(android): add mouse click and keyboard press for input handling (#645)
* fix(android): add mouse click and keyboard press for input handling in index.ts

* fix(android): add check for soft keyboard presence before mouse click in index.ts
2025-04-27 13:32:00 +08:00
github-actions[bot]
ee3821f7f9 release: v0.15.5 2025-04-26 07:42:06 +00:00
github-actions[bot]
767b3e3a8c release: v0.15.4 2025-04-25 09:18:44 +00:00
Leyang
ca644d8914
feat(core): allow custom midscene_run dir (#631)
* feat(core): support custom midscene_run dir

* feat(report): add search functionality to PlaywrightCaseSelector component

* refactor(shared): simplify base directory resolution and remove unused environment variable

* feat(shared): integrate shared environment variables across multiple packages

* refactor(shared): update base directory resolution to use dynamic midscene_run directory

* fix(puppeteer): increase screenshot timeout from 3s to 10s for improved reliability
2025-04-24 22:54:52 +08:00
github-actions[bot]
bd104a8afa release: v0.15.3 2025-04-24 08:04:27 +00:00
github-actions[bot]
ec3fd040d4 release: v0.15.2 2025-04-23 01:51:12 +00:00
Leyang
38c50a23c3
feat: support android device button (#567) 2025-04-22 23:55:42 +08:00
Leyang
46369c576e
feat(android): hide keyboard after type (#615) 2025-04-22 15:37:07 +08:00
github-actions[bot]
385f3eb639 release: v0.15.1 2025-04-21 12:13:32 +00:00
github-actions[bot]
0a3bc1e230 release: v0.15.0 2025-04-18 11:26:30 +00:00
Leyang
8fc7d74d0a
fix(core): race condition when initing env config (#590)
* fix(env): refactor globalConfig handling and update AI config access methods

* fix(page): add debug logging for adb command execution

* refactor(ai): initialize debug configuration and improve logging setup
2025-04-18 16:06:41 +08:00
Leyang
bcfcb3c4d0
fix: style of chrome (#586) 2025-04-18 11:33:20 +08:00
Leyang
b76211bd5d
feat: android playground (#542)
* refactor: android api

* refactor: enhance Android agent to accept options for device connection

* fix: type error

* fix: click after clearInput

* fix: click before clearInput

* feat: android playground

* feat: support npx package name

* feat: android playground joint

* fix: git ignore conflicts

* feat: ensure adb server is running before initializing adb client

* fix: deps consistency

* ci: add android playground

* feat: integrate shared constants and improve server configuration in android playground

* feat: android playground style

* feat: style opt

* feat: add @rsbuild/plugin-svgr dependency and improve URI handling in adb

* feat: remove unused water flow scripts and update comments to English

* feat: download report file

* feat: standalone android playground

* feat: use dynamic import

* feat: migrate CSS to LESS and remove unused styles in chrome extension and report

* feat: enhance Android playground with ScrcpyPlayer ref integration and device management improvements

* feat: optimize styles and layout in Android playground and visualizer components

* chore: add bin back

* chore: update build script to exclude documentation generation

* feat: add not ready message to PlaygroundResult for improved user guidance

* feat: add error handling for screenshot capture in Android page

* docs: update readme

* feat: add PNG validation for screenshot buffer in Android page

* feat: enhance UI components with improved styling and tooltips in ScrcpyPlayer and PromptInput

* docs: update uri parameter description in integrate-with-android documentation and improve uri handling in launch function

* style: update primary color to #2B83FF across multiple components and adjust margin in App.less

* refactor: replace userConfig with globalConfig for environment configuration management and update related functions

* feat: integrate server validation logic in App, AdbDevice, and ScrcpyPlayer components for improved connection handling

* style: enhance player component layout with overflow handling and margin adjustments

* style: refine player component layout with flex adjustments and improved spacing

* feat: add midscene model name display and improve layout in EnvConfig component

* feat: integrate ShinyText component for enhanced loading progress display in PlaygroundResult

* test: add test for isValidPNGImageBuffer

* style: remove background color from App.less and adjust AI config override behavior in env.ts

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
2025-04-17 17:44:11 +08:00
Leyang
570c2d7294
fix: rethrow error with android faq when adb error occured (#554) 2025-04-10 20:51:56 +08:00
github-actions[bot]
1bd873b360 release: v0.14.3 2025-04-10 09:10:39 +00:00
Leyang
fbaa314520
feat(android): implement custom method to retrieve screen size and simplify size handling (#544)
* feat(android): implement custom method to retrieve screen size and simplify size handling

* fix: use debugPage

* feat: print device info
2025-04-09 10:54:39 +08:00
Leyang
0bbe416151
fix(android): verify vl-model mode in AndroidAgent constructor (#547)
* fix(android): verify vl-model mode in AndroidAgent constructor

* fix: error message

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
2025-04-09 10:48:53 +08:00
github-actions[bot]
4d77207c0f release: v0.14.2 2025-04-09 02:30:47 +00:00
github-actions[bot]
92e4d7ed61 release: v0.14.1 2025-04-03 08:40:18 +00:00
yuyutaotao
767ffcd873
docs: blog for instant action and deep think (#527) 2025-04-03 14:26:30 +08:00
github-actions[bot]
00dc2f9f50 release: v0.14.0 2025-04-03 06:01:06 +00:00
Leyang
bc645c3d0c
refactor: android api (#521)
* refactor: android api

* refactor: update the Android agent and device connection logic

* refactor: enhance Android agent to accept options for device connection

* fix: type error

* feat: use first device when no deviceId pass

* fix: import from agent.ts

* fix: click after clearInput

* fix: click before clearInput
2025-04-03 10:28:40 +08:00
Zhou Xiao
814f99ca48
refactor(visualizer): optimize extension logic (#525) 2025-04-02 19:12:52 +08:00
yuyutaotao
cf4acf30d9
feat: print stats in debug (#515)
Co-authored-by: Zhou Xiao <zhouxiao.shaw@bytedance.com>
2025-04-01 17:20:37 +08:00
Leyang
882a2db9ee
fix: force screenshot when the app doesn't allow it (#518)
* fix: force screenshot when the app doesn't allow it

* fix: support start point in scroll method

* refactor: rename to ensureYadb
2025-04-01 17:05:47 +08:00
Zhou Xiao
6468bb0206
refactor(logger): use log file output instead of command line output in Node (#509)
* chore: add element detail info

* chore: add element detail info

* chore: add element detail info

* chore: optimize logger logic

* chore: optimize logger logic
2025-03-31 19:22:39 +08:00
Leyang
bf9b4e06e7
feat: migrate android code to @midscene/android (#505) 2025-03-26 18:59:50 +08:00
github-actions[bot]
00de5d6478 release: v0.13.1 2025-03-25 14:53:44 +00:00
Leyang
934a1e2b5d
use adb instead of appium (#483)
* feat: enable search area for locate

* fix: update evaluation

* fix: locator

* feat: show searchArea in report

* chore: add yaml support for aiTap

* feat: use adb instead appium

* feat: Adds debugging information and reconstructs input text capabilities

* feat: refactoring Android related functions and adding android modules

* feat: update the image scaling algorithm, adjust the Android page class to support device scaling, and remove test files that are no longer needed

* feat: adjust the Android page class to support device scaling, and remove test files that are no longer needed

* feat: use appium-adb instead of bare command

* fix: update entry for @midscene/android

* feat: optimize the screenshot processing logic, add a backup mechanism when screenshots fail, and update test cases to accommodate new features

* fix: rethrow error

* feat: add Android debug configuration options and update documentation

* chore: fix code style in #483 (#492)

* fix: remove try for error handle by outside

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
Co-authored-by: linyibing <linyibing@bytedance.com>
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
2025-03-25 22:45:05 +08:00