yujunjun/midscene
1
0
Fork 0
mirror of https://github.com/web-infra-dev/midscene.git synced 2025-07-13 12:01:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
726 Commits 31 Branches 106 Tags
Commit Graph

557 Commits

Author SHA1 Message Date
yuyutaotao
667fb59474
refactor(bridge): enhance error handling and connection logic in BridgeClient and BridgeServer (#653) 
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
 2025-04-27 16:27:42 +08:00
晓
a5fb21e74c
docs(mcp): optimize playwright example (#652) 
* docs(mcp): optimize playwright example

* docs(mcp): optimize playwright example
 2025-04-27 15:00:26 +08:00
Leyang
b2ac7e710d
fix(android): add mouse click and keyboard press for input handling (#645) 
* fix(android): add mouse click and keyboard press for input handling in index.ts

* fix(android): add check for soft keyboard presence before mouse click in index.ts
 2025-04-27 13:32:00 +08:00
yuyutaotao
e1f708740f
refactor(bridge): update connection handling and server close logic (#646) 
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
 2025-04-27 13:30:46 +08:00
github-actions[bot]
ee3821f7f9 release: v0.15.5 2025-04-26 07:42:06 +00:00
晓
e00f1467c3
feat(mcp): optimize mcp tools args and add resource mimeType (#648) 
* feat(mcp): optimize mcp tools args and add resource mimeType

* fix(mcp): resolve chrome devtools  reconnect error
 2025-04-26 15:07:01 +08:00
github-actions[bot]
767b3e3a8c release: v0.15.4 2025-04-25 09:18:44 +00:00
Leyang
f50a4011d7
fix(puppeter): check close status before close popup (#644) 
* fix(puppeter): check close status before close popup

* feat(web-integration): implement forceCloseTab function to handle popup management in Playwright and Puppeteer agents

* refactor(web-integration): rename forceCloseTab to forceClosePopup and update usage in Playwright and Puppeteer agents

* refactor(web-integration): replace console.warn with debug for closed popup and page messages in forceClosePopup function
 2025-04-25 16:42:53 +08:00
Leyang
9a9e3bde49
fix(web-integration): sanitize cacheId to replace illegal path characters (#643) 2025-04-25 15:19:09 +08:00
yuyutaotao
07614961c8
fix(visualizer): the style of error state in report (#641) 
* fix(visualizer): the style of error state in report

* fix(core): fix ci
 2025-04-25 12:00:48 +08:00
Leyang
974ebd34ed
fix(visualizer): scroll for result container (#640) 
* fix(visualizer): scroll for result container

* feat(visualizer): add font weight to title in player component

* feat(visualizer): initialize subtitle for the first task in animation script generation
 2025-04-25 11:46:42 +08:00
Leyang
ca644d8914
feat(core): allow custom midscene_run dir (#631) 
* feat(core): support custom midscene_run dir

* feat(report): add search functionality to PlaywrightCaseSelector component

* refactor(shared): simplify base directory resolution and remove unused environment variable

* feat(shared): integrate shared environment variables across multiple packages

* refactor(shared): update base directory resolution to use dynamic midscene_run directory

* fix(puppeteer): increase screenshot timeout from 3s to 10s for improved reliability
 2025-04-24 22:54:52 +08:00
Leyang
f85cd6cd1b
feat(playwright): enhance report filename generation with unique identifiers and support split mode (#629) 
* feat(playwright): enhance report filename generation with unique identifiers and support split mode

* fix(playwright): update reporter type from "single" to "merged" and adjust related configurations

* chore(playwright): improve filename sanitization in reporter

* feat(web-integration): add function to replace illegal path characters

* feat(web-integration): update path sanitization function to replace spaces and illegal characters
 2025-04-24 22:42:08 +08:00
yuyutaotao
ecefd8b0fa
fix(report): reduce context size in report file (#626) 
* fix(core): reduce context size in report file

* chore(core): fix lint

* chore(core): resolve conflict

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
 2025-04-24 18:28:45 +08:00
github-actions[bot]
bd104a8afa release: v0.15.3 2025-04-24 08:04:27 +00:00
晓
c0aea8f3fe
feat(mcp): add playwright-example and midscene api prompts (#630) 2025-04-24 14:41:19 +08:00
Leyang
03a597e022
feat(web-integration): enhance timeout configurations and logging for network idle and navigation (#624) 
* feat(web-integration): enhance timeout configurations and logging for network idle and navigation

* fix(web-integration): refine timeout warning messages and remove unnecessary test files

* feat(site): add network timeout customization details and additional parameters for Puppeteer

* fix(site): update default timeout values and enhance customization options for network idle in YAML

* fix(site): remove redundant timeout customization details in FAQ documentation

* fix(web-integration): enhance Playwright agent to support network idle functionality

* docs(playwright): update config docs

* docs(playwright): update config docs

* fix(web-integration): refactor network idle handling in Playwright agent

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
 2025-04-24 10:28:26 +08:00
yuyutaotao
9e5c9cc5ca
feat(core): adapt gpt 4.1 (#621) 
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
 2025-04-24 09:26:41 +08:00
晓
1d8ac2875d
refactor(mcp): use bridge mode replace puppeteer (#618) 
* refactor(mcp): use bridge mode replace puppeteer

* refactor(mcp): use bridge mode replace puppeteer

* chore: delete unless code

* chore: use getAIConfigInBoolean replace getAiConfig

* chore: upgrade lock file
 2025-04-23 19:44:01 +08:00
晓
ab51c5b40d
feat(mcp): add report to response (#625) 2025-04-23 19:03:35 +08:00
github-actions[bot]
ec3fd040d4 release: v0.15.2 2025-04-23 01:51:12 +00:00
Leyang
38c50a23c3
feat: support android device button (#567) 2025-04-22 23:55:42 +08:00
晓
5c6e3e3b66
fix(mcp): optimize mcp navigate to new page (#617) 
* fix(mcp): optimize navigate new page

* fix(mcp): add google as default page
 2025-04-22 20:57:23 +08:00
晓
d033c98387
feat(mcp): add puppeteer mode and refactor mcp register tools logic (#609) 2025-04-22 15:53:31 +08:00
Leyang
fdbdb7d426
style(chrome-extension): opt chrome logo icon (#614) 2025-04-22 15:39:17 +08:00
Leyang
46369c576e
feat(android): hide keyboard after type (#615) 2025-04-22 15:37:07 +08:00
yuyutaotao
07f2068e88
refactor(playwright): rename agent interface in playwright (#610) 
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
 2025-04-22 10:27:01 +08:00
yuyutaotao
e7f185d7b4
feat(core): adapt for gemini-2.5-pro (#605) 
* feat(core): introduce gemini as vl

* feat(core): introduce gemini

* docs(core): update gemini docs

* docs(core): docs for gemini

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>

* docs(core): update quick start for models

* chore(core): update docs
 2025-04-22 10:26:08 +08:00
Leyang
2589a9c4ca
docs(android): update android docs (#607) 
* docs: release android automation

* chore(docs): update doubao docs

* chore(docs): merge docs for doubao

* docs(android): update

* docs(site): add more android case

* docs(site): update slogan and authors

* docs(site): android yaml

* docs(core): instruction for override config

* docs(core): update readme

* Update README.md

* docs(core): update readme

* docs(core): update readme

* docs(core): update readme

* docs(core): update readme

* docs(core): update README and blog for Android automation support

* docs(core): update android playground doc

* docs(core): enhance Android integration documentation with setup instructions

* docs(core): update android playground doc

* docs(core): update Android integration documentation and add setup instructions

* docs(core): update bridge mode title

* docs(core): update yaml docs

* docs(site): chore update

* docs(site): update YAML documentation with setup instructions and clarify parameters

* docs(core): update instructions

* chore: update docs

* chore: update bridge mode docs

* docs(site): translate to zh

* docs(site): translate error

* docs(site): remove unnecessary code block in YAML automation documentation

* docs(core): update blog

* docs(core): update instructions

* docs(core): update instructions

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
Co-authored-by: yuyutaotao <167746126+yuyutaotao@users.noreply.github.com>
 2025-04-21 20:51:17 +08:00
github-actions[bot]
385f3eb639 release: v0.15.1 2025-04-21 12:13:32 +00:00
yuyutaotao
86bd961542
docs: update docs (#574) 
* docs: release android automation

* chore: update docs

* chore: update readme

* docs: append docs for doubao-1.5-ui-tars

---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>

* chore(docs): update doubao docs

* chore(docs): merge docs for doubao

* docs(android): update

* docs(llm): upgrade open source model

---------

Co-authored-by: 晓 <zhouxiao.shaw@bytedance.com>
 2025-04-21 14:18:55 +08:00
Leyang
e1b8fa45a5
fix(android): update styles and transitions in playground components (#596) 
* fix(android): update styles and transitions in playground components

* fix(android): optimize the style of the input box and the automatic scrolling function

* fix(android): remove max-width constraint from player component styles
 2025-04-21 14:10:12 +08:00
yuyutaotao
138864e6b1
fix(core): keep context in log file when locate fails (#597) 2025-04-21 13:56:30 +08:00
yuyutaotao
10efa40c8b
fix(cli): keep window after cli running (#598) 2025-04-21 13:54:58 +08:00
晓
daf308b1d0
fix(mcp): resolve mcp server log error (#599) 
* fix(mcp): resolve mcp server log error

* chore(shared): delete unless code

* chore(workflow): fix lint error
 2025-04-19 12:00:39 +08:00
github-actions[bot]
0a3bc1e230 release: v0.15.0 2025-04-18 11:26:30 +00:00
Leyang
2c66902677
fix(core): player title max width (#595) 2025-04-18 19:16:17 +08:00
Leyang
76eb4e1417
fix(report): ai tap in report (#594) 
* fix: ai tap in report

* chore(playwright): update lockfile

* fix(core): lint

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
 2025-04-18 18:42:47 +08:00
Leyang
758fa44d71
fix(yaml): handle null case for android configuration in parseYamlScript function (#593) 
* fix(yaml): handle null case for android configuration in parseYamlScript function

* fix(cli): fix yaml parser

---------

Co-authored-by: yutao <yutao.tao@bytedance.com>
 2025-04-18 17:38:31 +08:00
Leyang
06ce3c889b
android playground compatible with windows (#592) 
* fix(playground): simplify class property definitions and add root redirect for static file serving

* fix(scrcpy-player): update empty state rendering logic to handle server validity more accurately
 2025-04-18 17:03:00 +08:00
Leyang
8fc7d74d0a
fix(core): race condition when initing env config (#590) 
* fix(env): refactor globalConfig handling and update AI config access methods

* fix(page): add debug logging for adb command execution

* refactor(ai): initialize debug configuration and improve logging setup
 2025-04-18 16:06:41 +08:00
Leyang
cf621a564e
fix(visualizer): update type references and improve tooltip handling in components (#589) 2025-04-18 15:18:03 +08:00
yuyutaotao
a6ac78aee3
chore(core): update prompt for section locator (#588) 2025-04-18 13:35:58 +08:00
yuyutaotao
7e43a29d02
chore: update extension style (#585) 
---------

Co-authored-by: zhouxiao.shaw <zhouxiao.shaw@bytedance.com>
 2025-04-18 12:53:33 +08:00
Zhou Xiao
bc5b6e2121
ci(workflow): add commit msg check (#587) 
* ci(workflow): add commit check

* docs(workflow): add commit check to CONTRIBUTING

* chore(workflow): optimize lint error
 2025-04-18 12:50:52 +08:00
Leyang
bcfcb3c4d0
fix: style of chrome (#586) 2025-04-18 11:33:20 +08:00
Zhou Xiao
2cc12dad12
feat(mcp): provide midscene mcp server (#562) 2025-04-18 10:47:48 +08:00
Leyang
7596da2ab7
feat: support tap in prompt (#584) 2025-04-18 10:27:56 +08:00
yuyutaotao
ad457a33a8
feat(yaml): allow running javascript in yaml (#555) 
* feat: allow running javascript in yaml

* feat: change the output dir

* fix: CI

* docs: update docs about evaluate javascript

* chore: merge main

* chore: merge main
 2025-04-18 09:58:51 +08:00
Leyang
1d49e981d0
fix: compatible with node 20 (#581) 
* fix: compatible with node 20(https://github.com/yume-chan/async/pull/44)

* fix: compatible with node 18 due ipv6
 2025-04-17 22:56:02 +08:00