User repository on GitHub
Open-Source fast local computer use
- Forks
- 106
- Last pushed
- Updated Oct 2026
Repo stats from the GitHub API, cached Oct 2026.Homepage
Jev directory
CommunityJev Tools & CLIs
TipTour
A macOS menu bar app that turns a typed click task into desktop actions: Jev picks from locally detected controls, TipTour executes and validates each action, and a separate Gemini mode handles voice.
- Stars
- 681
- Language
- Swift
- Reading time
- 3 min
- Published by
- Community
- Author
- milind-soni
- Last verified
- Sep 2026
About this project
A macOS menu bar companion with two modes, powered by your own API keys. JEV is selected by default. On first launch, choose JEV or Gemini, save that mode’s API key, then grant its permissions. JEV does not require microphone access. You can switch later in Settings → Models, which shows only the selected mode’s key field. Keys stay in macOS Keychain. There are no shared keys, hosted key proxies, or keys loaded from other projects.
Quoted from the project's README. Read the full README.
Works forJev for Classification
Used inJev for Software & DevTools
Highlights
- JEV mode chooses among locally detected screen labels and locations for single, double, or right clicks without sending screenshots.
- The loop stops when Jev chooses none, reports completion, hits an execution failure, or reaches its 12-action limit.
- A separate Gemini realtime mode handles voice, typing, shortcuts, scrolling, and text edits, and requires microphone access.
- Keys stay in the macOS Keychain, and the app has no shared keys or hosted key proxies.
- JEV is the default mode, supports only click actions, and does not require microphone access.
Watch out
GitHub reports a non-standard license (NOASSERTION) while the README states MIT. Requires macOS 14.2+, Xcode, Accessibility permission, and Screen Recording for local detection; Jev cannot see images or write replacement text and acts without a confidence cutoff.
Questions about this entry
Short answers drawn from the linked project or page.
Clicks only: single, double and right. It chooses among locally detected screen labels and locations, cannot see images, and cannot generate replacement text. Typing, shortcuts, scrolling, app and URL opening, and highlighted text edits belong to the separate Gemini realtime mode, which is the one that needs microphone access.
Not in JEV mode. JEV receives your typed task, locally detected labels and locations, and recent action history, while screenshots stay local. Gemini is the mode that gets microphone audio and, when enabled, screenshots. Screen Recording permission is needed for screenshots and local detection and does not mean the app records video; there is no recording or image pipeline at all.
Not much, and the README admits it: JEV acts on its top-ranked target with no confidence cutoff, and it requires the auto-click setting rather than point-only. The loop ends when JEV chooses none or reports completion, on an execution pause or failure, or at its 12-action limit, and Escape or Stop cancels.
You need Xcode. It requires macOS 14.2 or newer and a current Xcode with Swift support: open the xcodeproj, pick the TipTour scheme, set your signing team, and run it. The repository's workflow prohibits terminal xcodebuild so the installed app keeps its macOS permissions; scripts/test-jev.sh runs isolated decision tests without installing or launching.
Gemini realtime on Ctrl+Option lets you talk about your screen and ask for one desktop action per turn, pressing again to stop. JEV text on Ctrl+K lets you type a click-based task, and JEV chooses from locally detected controls before TipTour executes and validates each action. JEV is selected by default.
Gemini supports clicking, typing, shortcuts, app and URL opening, scrolling, highlighted text edits, and creating an Apple Notes note from supplied content. JEV supports single, double and right clicks and reads screen labels and locations from local detection, but it cannot see images or generate replacement text, so use Gemini for writing or keyboard actions.
Accessibility permission is needed to inspect and control apps. Screen Recording or Screen Content permission enables screenshots and local screen detection, though TipTour does not record video. Microphone access is only needed for Gemini voice, and JEV does not require it.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Voice-controlled computer use on a Mac
X: A computer assistant that listens
X: Computer use without screenshots
X: Copy and paste, with a decision in between
More Jev resources like this
Voice and typed computer use for macOS: Jev picks the next on-screen action from the Accessibility tree, macOS performs it, and each step is checked for its real effect. No screenshots are sent.
Jev Tools & CLIs#community#swift#macos
Community
savka777/jev-useSwift
savka777/jev-useSwiftA free, local-first macOS file organizer that sorts Downloads, Desktop and chosen folders with deterministic rules, review-before-move, crash recovery and undo. Optional AI, including a direct TypeSafe Jev decision adapter for closed-set classification, can suggest destinations but never touches the filesystem.
Jev Tools & CLIs#community#github#macos
Community
jerrysun-ofive/mochiSwift
jerrysun-ofive/mochiSwiftAgent! is a native Swift macOS agent that drives any app through the Accessibility API, codes and builds in Xcode, runs shell commands, and wires in 23 LLM providers plus on-device Apple Intelligence and a Jev guard.
Jev Tools & CLIs#community#catalog-import#logicrw
Community
agentiloop/agentSwift
agentiloop/agentSwiftA hands-free macOS voice assistant: whisper.cpp transcribes locally in about 100 ms, then one roughly 250 ms Jev request selects a typed action plus arguments, and code executes it against the Mac.
Jev Tools & CLIs#community#python#voice
Community
kevinbadi/jev-voicePython
kevinbadi/jev-voicePythonVoice control for macOS from tostechbr that acts partway through your sentence: it asks Jev about every word and gets typed decisions back in about 200 ms, so Notes can open before you finish saying the command. It needs a Jev API key and Apple Silicon.
Jev Tools & CLIs#community#github#macos
Community
tostechbr/partwaySwift
tostechbr/partwaySwiftA Mac menu-bar app that routes every coding agent you run in herdr from one ask bar, phone remote or edge rail: requests go to Jev via jev-fabric as typed questions over self-built candidates — which session, which folder, side question or continuation — and come back as keys and probabilities in about a second.
Jev Tools & CLIs#community#github#swift
Community
monotykamary/reflexSwift
monotykamary/reflexSwiftFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.