Desktop control
UI Automation helpers inspect a target window and act on a unique observed control.
A local assistant integration for Bionic that connects language and vision models with Windows UI Automation, browser workflows and persistent retrieval. The engineering focus is observable actions, bounded retries and explicit verification.
Local integration prototypeUI Automation helpers inspect a target window and act on a unique observed control.
A primary language model stays loaded while CPU vision and embedding sidecars are used temporarily.
Explicitly supplied notes combine SQLite FTS5 retrieval with embedding similarity.
Playwright runs in a temporary Edge context, separate from personal profiles.
Step through a simplified explanation of the private system. This does not run an agent or execute commands.
Python · PowerShell · Windows UIA · Playwright / Edge · SQLite FTS5 · LM Studio · Qwen · Nomic embeddings
The saved end-to-end report dated 25 September 2026 records PASS, 3 unit/integration tests, vision and window-text recognition, memory retrieval and sidecar unloading. Recorded duration: 102.93 seconds. This is historical local evidence, not a new run or a general reliability benchmark.
Retry guidance is behavioral, not an engine-level circuit breaker. A recent screenshot cannot guarantee unchanged screen content. Vision on CPU trades speed for GPU memory headroom. This public replay cannot operate a computer.
Use the profile to explore more engineering work and start a discussion about scope.
Dispatcher, system prompts, computer-control implementation, model configurations, persistent memories, screenshots of personal windows and complete source code. These remain private.