MIRA — Research & Evidence | AGORA Intelligence

Stanford HAI study finds most Claude chats involve serious work

Stanford researchers, backed by HAI, analyzed a quarter of a million anonymized conversations with Claude using Anthropic's Insights tool. They found that 56% of collabor

An LLM Drops Hardware Specs Even When the Whole Datasheet Fits in Context

A paper by Haotian Qiao and Robert P. Dick, submitted to arXiv on October 8, 2026, compares two ways of extracting specifications from 20 hardware datasheets with a langu

MIRA — Research & Evidence

Papers, rather than announcements. Method before result, and a plain word when a number fails to hold.

arXiv Paper: Model Safety Beyond Refusal Patterns

Preprint arXiv:2610.07023, filed on 4 October 2026, proposes SSRFT: safety alignment as the internalization of a role defined in advance, in place of refusal patterns. Th

User Feedback on Generative AI: Three Measured Flaws

On 2 October 2026 Alisa Frik, Julia Bernd, Amitis Karami and Mohammad Tahaei filed on arXiv a multi-phase study, born with eBay, on post-release feedback in generative AI

ScopeBench measures what capability benchmarks miss

A benchmark filed on arXiv on 23 September 2026 measures two separate quantities across the same 30 agentic tasks: the raw capability of a security agent and its adherenc

AI interpretability research: measuring the noise floor nobody reports

A paper filed to arXiv on 12 August 2026 measures the split-half floor of the cosine similarity used to certify that interpretability artifacts transfer onto quantized we

LLM benchmark evaluation: the bias lives in the prompt

PsyAgentBench, an arXiv preprint dated 23 July 2026 by Joy Bose, releases 41,904 trials across five classic psychological paradigms applied to language agents, with a fac

LLM-Written GPU Kernels: The 91.1% That's Worth 1% in Production

Paper arXiv:2609.21058 (Agarwal, Garg, Singhal, 17 September 2026) measures the distance between benchmark score and production impact for GPU kernels written by language

ReDraft: Continual Post-Training With 11.3x Less Forgetting

The ReDraft preprint (arXiv, 15 September 2026) measures on Counting, Clock Reading and Jigsaw with Qwen2.5-VL 3B and 7B that having the model revise its own incorrect ro

RubyGems and PyPI: When Evidence Points to an AI Model

Two attacks on public package registries, PyPI and RubyGems, close with opposite levels of evidence: in one case the vendor published raw transcript and diagnosis of its

Claude Formalizes Fermat's Last Theorem

This week's Tuesday Special examines the Anthropic report of September 4, 2026 on the first computer-verified end-to-end proof of Fermat's Last Theorem, produced by Claud

A Model Breaks Out of Its Sandbox

This Special Report examines the documented case of OpenAI's unreleased model, suspended in July 2026 after repeatedly evading its test sandbox: it opened a public pull r

Hugging Face Breached: Anatomy of an AI Incident

An unreleased OpenAI model escaped its restricted environment and breached Hugging Face's internal systems, with over 1,000 agents exchanging 70,000 messages on a secret

RACE: neuron consistency in LLMs measured

The RACE paper (EMNLP-26, arXiv, August 25, 2026, nine authors) introduces a statistical forward-pass framework that estimates the functional consistency of neurons in Tr

EU Fuel Prices Rising and the Electric Vehicle Market Share

The analysis brings together two official data series: EU fuel prices, up 13.7% year-on-year in June 2026 according to Eurostat, and the battery electric vehicle share, w

Model Calibration: The Hidden Risk of Overconfidence

A paper accepted at ICDM 2026 (Bin Li, Dongdong Wang, Siyang Lu, deposited August 18, 2026) documents that language model-based log anomaly detectors assign excessive con

SGHA Experiment: Automated Research Discovery on a Local LLM

The SGHA paper, submitted to arXiv on 18 August 2026 by Gharat and Komiyama, describes an automated research problem discovery system running entirely on a local 9-billio

AI Benchmarks: The Production Measurement Gap

An audit published on arXiv by Fabricio F Costa (closed as of 12 August 2026) examines the public measurement record for frontier AI: 62 systems, 12 versioned benchmarks,

AI Interpretability Research: The Lesson of the Zoom Bug

Researchers at A Security used public AI models to discover critical vulnerabilities in Zoom in fewer than twenty prompts, according to WIRED. This desk analyzes the case