Skip to content

Jev directory

jev-use (Coco Research)

A voice-driven control layer for macOS: speak a goal and the Mac does it, watching the screen through the accessibility tree with everything running locally. Jev is the fallback, not the router — deterministic matching resolves commands in about 50 ms.
Stars
2
Language
Rust
License
APACHE-2.0
Reading time
3 min
Published by
Community
Author
coco-research
Last verified
Oct 2026

coco-research/jev-use

User repository on GitHub

View on GitHub

Voice-driven control layer for macOS. Jev is the fallback, not the router. Rust core, Tauri shell.

Forks
1
Last pushed
Updated Oct 2026

Repo stats from the GitHub API, cached Oct 2026.

Highlights

  • Pre-alpha with no release yet: no installer, notarised build or Homebrew tap, so today you clone it and build it.
  • Observation is at parity with its reference on four apps: Finder 12/12, Terminal 13/13, PI-Desktop 10/10 (Electron) and Notes 8/8, identical fingerprints.
  • The voice hook is done and in daily use: 0.24–0.33 s to paste a dictation and 6–15 ms to hand a command off.
  • The layer boundary is deliberate: jev-ax knows nothing about models and the decision layer nothing about the screen, so the port was proven without a model.
  • Execution and the CLI are not yet done (T6/T7); until then the walk runs through crates/jev-ax/examples/walk.rs and needs macOS 26 plus a Rust toolchain.

Quickstart

bash
cargo test --workspace                              # 77 tests
cargo run --example list_apps -p jev-ax             # the apps a walk can see
cargo run --example walk -p jev-ax -- --app Finder --json   # one observation, as JSON

Watch out

Copy reviewed against the repo README on 2026-10-15; it was truncated inside the 'How it works' section, so the Repo Standard material and later sections were not inspected. The parity and latency figures are the project's own published measurements, and the repo is labelled pre-alpha: watching works, acting does not yet.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

X: Voice-controlled computer use on a Mac

X: Speech to live slides

X: Jev for real-time speech

X: On-device audio, no LLM in the loop

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai