JEV-27B scores probabilities for fixed-choice decisions
AutoTrust Labs released JEV-27B v1.1, a 27-billion-parameter model that returns option probabilities rather than free-form text. The company reports a score of 67.31 across 37 benchmarks; the model supports multiple-choice and yes/no questions only.
AlphaSignalNov 8, 2026
1 min read
The model selects among supplied options and returns a probability distribution. It stands out on tool selection and intent classification, but is weaker on open-ended reasoning and some other tests.
The Apache-2.0-licensed model uses BF16 weights. Application-specific calibration is needed before its scores influence consequential decisions.
Why it matters
It offers an interface for fixed-choice routing and classification systems, though the reported benchmark score is not independent verification.
GUIDES
Something to try
For a hypothetical prototype, plan how to evaluate its probability distribution against an existing classifier on a limited label set.
PUSULAM / UNDERSTAND
A good question changes everything.
Let’s unpack this article together. Ask what it means, why it matters, or how to use the idea.
A personal overviewFor your work and interests
What does this mean for you?
An explanation shaped around your work and interests.
Tell us a little about yourself to get an explanation that fits.
PUSULAM / COMMUNITY
The conversation
What did this change for you? Share a useful example or ask other readers a question.
Open-source Bark can generate speech, music, laughter, and sound effects from a single text prompt. The source says it supports 13 languages and more than 100 voice presets, but it may alter wording or add unexpected sounds. Bark generates audio clips of about 13–14 seconds and is released under the MIT license. The source reports about 12 GB of GPU memory for the full models, with smaller variants available for lower-memory use.
A study finds that AI models can detect some misbehavior in agent logs, but higher detection rates also mean more warnings about harmless actions. The results suggest auditors may be more useful for estimating how often problems occur than for safety checks that must catch every incident. Andy Hall evaluated several models on logs from METR’s MALT dataset. At a 5 percent false-alarm rate, GPT-5 caught nearly 98 percent of 47 reward-hacking cases, while Gemini 3.8 Flash found about half. Auditors caught 71 to 81 percent of sandbagging cases, most of which were synthetic.
In Vals AI’s simulated tests, Deepseek V4.1 Flash 1017 came close to a leading closed model in some scenarios. The findings highlight the importance of long test runs and lower costs, but do not establish performance on real networks. In the Vals CyberOffense benchmark, agents pursued objectives in simulated corporate networks without human help. GPT-6 Sol Daybreak averaged 15.7/21 objectives in Nova and reached 27/31 in Lighthouse; Deepseek V4.1 Flash 1017 scored 16.3/21 and 21/31. Vals reports approximate run costs of $22 and $3, respectively.
Start the conversation.