What does the paper call silent hallucination?

Under out-of-vocabulary weights, model confidence fails inversely on open-set evaluation, assigning higher confidence to unseen than to seen classes with AUROC 0.38; the paper names this failure silent hallucination.

How well does letter binding work within its vocabulary?

It reaches 97.71% overall accuracy on UCM, which the paper describes as highly effective within the training vocabulary.

How variable is out-of-vocabulary accuracy across datasets?

Zero-adaptation accuracy across four cross-dataset directions fluctuates between 7.35% and 96.40%.

How does RSAJEV classify an image?

It keeps the slot representation and replaces the letter readout with retrieval-based prototype matching: K reference images per class are cached as prototypes, and classification becomes nearest-neighbor retrieval refined by a shrinkage-Mahalanobis geometric correction.

What accuracy does the RSAJEV readout reach?

89.43% on the UCM cross-dataset gate with 16 references per class and zero gradient updates, and 96.90% on AID.

How does RSAJEV handle open-set abstention scoring?

Its ID-ness scores reach 0.91–0.99 AUROC on open-set evaluation over two datasets, exceeding symbolic confidence's 0.38–0.96 across all four open-set settings and restoring a calibratable abstention channel.

What is the cost of adding or removing a class later?

The paper says classes can be added or removed at zero extra inference cost through offline rescoring of the cached prototype matrix.

CommunityJev Practices & Patterns

RSAJEV: Training-Free Abstaining Prototype Memory for Eliminating Silent Hallucination in JEV-Based Remote Sensing Classification (arXiv 2610.15742)

Documents a failure mode in letter-bound remote sensing classification: 97.71% OA on UCM in vocabulary but 7.35%–96.40% cross-dataset accuracy and inverted confidence (AUROC 0.38). RSAJEV replaces the letter readout with training-free prototype retrieval, reaching 89.43% on the UCM cross-dataset gate.

See highlights

Open arxiv.org

Format: Article
Published by: Community
Last verified: Oct 2026

Tagscommunity research arxiv vision calibration

Works forJev for Classification Jev for Decision gating

Used inJev for Data & Analytics Jev for Software & DevTools

Highlights

Letter binding reaches 97.71% overall accuracy on UCM within its training vocabulary.
Cross-dataset accuracy across four directions fluctuates between 7.35% and 96.40%.
Under out-of-vocabulary weights, confidence inverts on open-set evaluation (AUROC 0.38), which the paper calls silent hallucination.
RSAJEV caches K reference images per class as prototypes and retrieves nearest neighbors refined by a shrinkage-Mahalanobis correction.
Reaches 89.43% on the UCM cross-dataset gate with 16 references per class and 96.90% on AID, with no gradient updates.

Watch out

arXiv preprint submitted October 11, 2026 (cs.CV) by Man Chen and seven co-authors. All numbers come from the paper's own remote sensing experiments; the abstract names no code release, and the prototype cache costs K reference images per class at setup.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

Hacker News: A one-token logprob wrapper that also classifies webcam frames.

allanrbo151 pointsA single function Jev-like wrapper for LLMs, including vision modelsRead the thread on Hacker News

Related terms

Glossary definitions related to this entry.

More Jev resources like this

HydroJEV: A one-second, training-free screen for cyber-attack and fault attribution in water distribution networks (arXiv 2610.02048)

A pre-registered evaluation of Jev as a one-second, training-free screen for SCADA alarm triage in water distribution networks. On a four-class EPANET C-Town benchmark it matched a hand-written rule tree, and a gated cascade spared an LLM reviewer 35-38% of windows.