Playground
CommunityJev Benchmarks & Evaluations
Convex Evaluation Visualizer
The web visualizer for Convex Evals hosted on Netlify: browse experiments, models and recent runs, with Coding and Decision sections. The page is client-rendered, so the captured HTML shows only the shell and a loading state.
- Format
- Playground
- Reading time
- 2 min
- Published by
- Community
- Last verified
- Oct 2026
Used inJev for Software & DevTools
- Platforms
- Browser
Highlights
- Presented as the Convex Evaluation Visualizer for browsing experiments, models and recent runs.
- Navigation names Convex Evals with Experiments, Coding and Decision sections plus a Convex Evaluation Results heading.
- Results load at runtime: the Recent Runs, Experiments and Models panels showed 'Loading recent runs...' in the capture.
- The supplemental fetch extracted no human strings beyond the title.
Watch out
Page text fetched 2026-10-17; the site is client-rendered, so only the title, section labels and the loading state could be verified and a second fetch recovered no further strings. No experiment values, model names, scores or any explicit Jev references could be confirmed from the digest.
Questions about this entry
Short answers drawn from the linked project or page.
The web interface for Convex Evals at convex-evals.netlify.app. Its shell text describes browsing experiments, models and recent runs, with top-level sections for Experiments, Coding and Decision under the Convex Evals label.
The captured navigation names Convex Evals, Experiments, Coding and Decision, and a Convex Evaluation Results heading, with panels for Recent Runs, Experiments and Models. What each section contains could not be read because the results load client-side.
Not from the digest: the capture stops at the loading state, with the Recent Runs area showing 'Loading recent runs...'. A supplemental fetch also returned no human strings, so no score, ranking or model detail could be verified here.
The captured text never mentions Jev, so this entry cannot claim how any decision board is wired. A Decision section exists in the navigation, but what it measures and which models it evaluates were not recoverable from the client-rendered page.
The page does not name an author or organization in the captured text, and the digest offers no affiliation statement, so that could not be verified. It is hosted at convex-evals.netlify.app and is cataloged here with the community tag.
Almost everything beyond the shell: experiments, model lists, run history, scores and charts are fetched at runtime. Both fetches recovered only the title, navigation labels and the loading state, so those details remain unverified.
Visit https://convex-evals.netlify.app in a browser. The captured page shows no sign-in, key or setup requirement, but the digest gives no usage instructions, so any account or configuration needs could not be confirmed.
More Jev resources like this
System One Mosaic Benchmark: a Python evaluator and Next.js viewer comparing Jev and open decision models across 137 English Choice, Noul and Score benchmarks from 106 dataset subsets, with recorded evaluation conditions and a public Hugging Face leaderboard.
Jev Benchmarks & Evaluations#community#benchmark#leaderboard
Community
hotchpotch/S1MBPython
hotchpotch/S1MBPythonA minimal coding agent that filters every tool result through Jev before the main model reads it, plus the A/B harness that measured pass@1 and cost. The final TB4 follow-up closed the experiment without an end-to-end win.
Jev Benchmarks & Evaluations#community#catalog-import#madewithjev
Community
astro-han/jev-harnessPython
astro-han/jev-harnessPythonA benchmarking studio and real-time simulator that pits Jev (remote TypeSafe System One), a local Laya model and the optimal blackjack Basic Strategy against each other on identical deterministic shoes. It scores every deviation turn by turn and runs headless batches of up to 100,000 rounds.
Jev Benchmarks & Evaluations#community#github#blackjack
Community
mrbanana55/decision_blackjackPython
mrbanana55/decision_blackjackPythonA calibration write-up and scripts for Jev comment and code rules on a Unity project, with ordering.py to compare rule versions on real blocks.
Jev Benchmarks & Evaluations#community#evaluation#code-review
An educational lab for DeepEval plus Jev: replay 17 recorded Jev evaluations of fictional support cases, inspect raw requests and responses, adjust release gates and drift playback, or run fresh evaluations with your own key.
Jev Benchmarks & Evaluations#community#catalog-import#logicrw
Community
shyamsridhar123/judgejevPython
shyamsridhar123/judgejevPythonThe benchmark behind JevAgentHarness's paper on decision models that share control with LLMs: next-tool decisions scored at isolated, open-loop and closed-loop levels, with 3,939 common-state questions and 153,621 answers from 39 models. The L1 question texts are third-party data and are not redistributed. CC BY 4.0.
Jev Benchmarks & EvaluationsDocs#community#evaluation#agents
Community
From the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.