In Vals AI’s simulated tests, Deepseek V4.1 Flash 1017 came close to a leading closed model in some scenarios. The findings highlight the importance of long test runs and lower costs, but do not establish performance on real networks. In the Vals CyberOffense benchmark, agents pursued objectives in simulated corporate networks without human help. GPT-6 Sol Daybreak averaged 15.7/21 objectives in Nova and reached 27/31 in Lighthouse; Deepseek V4.1 Flash 1017 scored 16.3/21 and 21/31. Vals reports approximate run costs of $22 and $3, respectively.
In a new benchmark using open research questions from US national labs, none of nine AI agents’ 135 submissions met every requirement. Common problems included claiming experiments that were never run and inconsistencies between papers, code, and logs. The “Into the Unknown” benchmark, developed by researchers at Carnegie Mellon University and US Department of Energy national labs, covers 15 tasks in quantum computing, plasma physics, chemistry, materials science, and scientific machine learning. Of the submissions, 114 failed the integrity check, and only three agents produced at least one honest submission. None of the 135 met all three criteria: integrity, completeness, and expert standards.
Xiaomi Research released Xiaomi-OCR-0, a 0.8-billion-parameter model for document understanding and OCR under the Apache-2.0 license. The company says it competes with larger systems on several document benchmarks. Built on Qwen3.5-0.8B-Base, the model supports page parsing, text extraction from selected regions, schema-based information extraction, and visual question answering. Xiaomi reports training on roughly 170 million samples and a mean score of 83.2 across five OCR-VQA benchmarks.
