Computer use built on Jev
A computer-use loop built on Jev: OCR the screen, attach bounding rects to text areas, then ask Jev which item moves the goal forward and click that item.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- The screen is OCR'd, bounding rects are attached to text areas, and the chunks go to Jev as context alongside the goal.
- Jev names the single most relevant item in that list, and the click is issued at the item's OCR bounding rect.
- For steps with no on-screen target, such as opening a browser or typing a URL, control defers to a small model.
- Stated per-step cost is $0.003 at about 1.5 seconds, against roughly $0.50 and 5.5 seconds for Opus 5.
Watch out
This is a build log thread, not an evaluation. The cost and latency figures are per step as quoted in the post, with no step count, no task suite, no success rate and no token accounting; the repository the thread links carries its own tagline of about $0.0002 a step, a different number from the post, and neither figure states what a step includes. The headline multiples are a comparison against Opus 5 on this one loop, not general model benchmarks, and the author's own framing is Jev as an aid for LLMs rather than a replacement. OCR was chosen for operating-system coverage, and the post concedes that not all apps or operating systems expose accessibility trees while arguing those trees would be faster and more performant in most cases. Not every step is a Jev decision: when no element is clickable the loop hands control to small language models, so a cost per completed task would mix both. An open question in the thread, whether a browser DOM processor would work instead of OCR, is not answered in the captured text, and no prompt, question set or code appears there. Copy reviewed against the linked page on 2026-10-04.
Questions about this entry
More Jev resources like this
From the Jev guides
Original write-ups on what this entry is for.
From the Jev community
Posts from builders shipping with Jev right now.