User repository on GitHub
Say it, and your Mac does it. A computer-use harness on Jev that reads the screen through Accessibility. Fast, no vision model
- Forks
- 19
- Last pushed
- Updated Sep 2026
Repo stats from the GitHub API, cached Oct 2026.
Jev directory
CommunityJev Tools & CLIs
Jev Use — savka777
Voice and typed computer use for macOS: Jev picks the next on-screen action from the Accessibility tree, macOS performs it, and each step is checked for its real effect. No screenshots are sent.
- Stars
- 124
- Language
- Swift
- License
- MIT
- Reading time
- 3 min
- Published by
- Community
- Author
- savka777
- Last verified
- Sep 2026
About this project
Voice and typed computer use for macOS. You say what you want. Jev picks the next on-screen action. macOS performs it. No screenshots: the app reads the screen through the Accessibility tree. Requires macOS 14.2+ and Xcode. No dependencies. In setup: save your TypeSafe API key (stored in the Keychain), then allow Accessibility, microphone and speech.
Quoted from the project's README. Read the full README.
Works forJev for Realtime control
Used inJev for Software & DevTools
Highlights
- Each step walks the front app's Accessibility tree in about 120 ms, then sends one jev-latest request with the goal, numbered targets, and last ten actions.
- A loop takes about 0.3-1.5 s per step and ends on DONE, BLOCKED, or WAIT; low-confidence and destructive picks stop and ask instead of acting.
- Reads the screen without screenshots, excludes secure text fields, and sends the command, app and window names, targets, labels, values, and recent actions.
- Requires macOS 14.2+ and Xcode with no dependencies; the API key is stored in the Keychain, and builds run through bash build.sh.
- Supports hold-to-talk with a configurable shortcut, an optional 'Hey Jev' wake phrase, a hands-free widget, and typed commands.
Quickstart
bash
bash build.sh
open "$HOME/Applications/Desktop Voice.app"
scripts/say.sh "Open Finder"Watch out
MIT-licensed and macOS-only. Needs macOS 14.2+, Xcode, a TypeSafe key, and Accessibility, microphone, and speech permissions; speech uses Apple Speech, which may process audio online.
Questions about this entry
Short answers drawn from the linked project or page.
No. It walks the front app's Accessibility tree, roughly 120 ms per step, and Jev picks an operation plus a numbered target from that. No screenshots are captured or sent. macOS performs the action and the loop re-reads the tree to report the real effect, at about 0.3-1.5 s per step.
Only what you said. Jev never generates free text; typed text is a span of your sentence, and code supplies the candidates. Anything beyond that would need a different tool. It also handles menus, keys, scrolling, window arranging, and can repeat a worked-out sequence across every window of an app.
Low-confidence and destructive picks stop and ask instead of acting. The loop terminates on DONE, BLOCKED, or WAIT rather than guessing, and the read/check step means a wrong pick is reported as a wrong effect instead of silently continuing.
A request to the TypeSafe system-one endpoint carrying your command, the app and window names, the on-screen targets with their labels and values, and recent actions. Secure text fields are excluded and no screenshots are included. Speech goes through Apple Speech, which may process audio online. Everything is logged locally under the local.jev-use subsystem.
It needs macOS 14.2 or newer and Xcode with no dependencies. Run bash build.sh, open "$HOME/Applications/Desktop Voice.app", then in setup save your TypeSafe API key to the Keychain and allow Accessibility, microphone, and speech.
Hold Control-Option-Space, speak, and release, or change that combination in Settings, where Escape cancels recording. You can also use the hands-free widget, where you speak and pause about 1.5 seconds to submit, enable the optional "Hey Jev" wake phrase, type in the widget, or run scripts/say.sh "Open Finder" from a shell.
It reads the front app's Accessibility tree in about 120 ms, sends one jev-latest request with the goal, numbered targets, and the last ten actions and their effects, performs the selected press, select, type, menu, key, scroll, open, or window action, then reads the screen again. It repeats until DONE, BLOCKED, or WAIT, at roughly 0.3 to 1.5 seconds per step.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Voice-controlled computer use on a Mac
X: A computer assistant that listens
X: Computer use without screenshots
X: Copy and paste, with a decision in between
Other listings of this project
Forks and copies of this project in the directory. This entry is the canonical one.
Claude Code, Codex, and pi plugin plus MCP server and npm library that hands steps needing no text output to Jev: one batched call answers typed questions about a state, and an opt-in PreToolUse gate can only deny or ask.
Jev Tools & CLIs#community#javascript#claude-code
Community
shitianfang/jev-useJavaScript
shitianfang/jev-useJavaScriptMore Jev resources like this
A macOS menu bar app that turns a typed click task into desktop actions: Jev picks from locally detected controls, TipTour executes and validates each action, and a separate Gemini mode handles voice.
Jev Tools & CLIs#community#swift#macos
Community
milind-soni/tiptour-macosSwift
milind-soni/tiptour-macosSwiftAgent! is a native Swift macOS agent that drives any app through the Accessibility API, codes and builds in Xcode, runs shell commands, and wires in 23 LLM providers plus on-device Apple Intelligence and a Jev guard.
Jev Tools & CLIs#community#catalog-import#logicrw
Community
agentiloop/agentSwift
agentiloop/agentSwiftVoice control for macOS from tostechbr that acts partway through your sentence: it asks Jev about every word and gets typed decisions back in about 200 ms, so Notes can open before you finish saying the command. It needs a Jev API key and Apple Silicon.
Jev Tools & CLIs#community#github#macos
Community
tostechbr/partwaySwift
tostechbr/partwaySwiftA macOS computer-use loop that OCRs the screen, asks Jev for the next action with typed Choices, and clicks, at about $0.0002 per decision without sending screenshots to a frontier model.
Jev Tools & CLIs#community#python#agents
Community
awlevin/typesafe-computer-usePython
awlevin/typesafe-computer-usePythonA CLI browser automation tool with optional Jev semantic mode: Surf observes, Jev selects the next action, Surf validates and acts, Jev checks the goal.
Jev Tools & CLIs#community#browser#cli
Community
nicobailon/surf-cliTypeScript
nicobailon/surf-cliTypeScriptRemote control for coding agents: give Claude Code, Codex, Cursor, OpenCode, Pi and others a task from your phone, and get a notification when the result is ready while your laptop stays closed. Self-hosting is a free MIT install; the hosted version has a free plan and paid plans from $19/mo.
Jev Tools & CLIs#community#catalog-import#logicrw
Community
bennykok/omg.devTypeScript
bennykok/omg.devTypeScriptFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.