README.md
Headless Qt/PySide6 GUI testing with visual verification and user interactions.
An MCP server for headless Qt/PySide6 GUI testing that enables AI assistants to launch desktop applications via Xvfb and perform visual verification. It supports widget discovery, screenshot capture, and simulated user interactions like clicks, typing, and keyboard shortcuts.
Tools (4)
launch_appLaunch a Qt/PySide6 application via Xvfb.capture_screenshotCapture a screenshot of the current application state for visual verification.discover_widgetsList and identify available widgets within the running application.simulate_interactionPerform user interactions like clicks, typing, and keyboard shortcuts.Environment Variables
DISPLAYrequiredThe X11 display to use for Xvfb (e.g., :99).Configuration
claude_desktop_config.json
{
"mcpServers": {
"qt-pilot": {
"command": "npx",
"args": ["-y", "@neatobandit0/qt-pilot"],
"env": {
"DISPLAY": ":99"
}
}
}
}Try it
→Launch my PySide6 application located at ./app.py and take a screenshot of the main window.
→Find all the buttons and input fields in the currently running Qt application.
→Type 'Hello World' into the widget named 'username_input' and then click the 'Submit' button.
→Simulate pressing the Ctrl+S keyboard shortcut in the active application window.
→Capture a screenshot and tell me if the error message label is visible.