SUPER INTELLIGENCE BREAK

INTELLIGENCE LIBRARY

The Signal.

A focused stream of intelligence from the sources you trust.

Topics / tags
Reset
820 resultsSorted by latest
3 days ago

SANE: Automated Scorer-Specific Metamorphic Testing for LLM Judges

arXiv:2610.28886v1 Announce Type: new Abstract: LLM judges increasingly mediate benchmark evaluation, model selection, data curation, and training. Their decisions are useful only when each judge responds reliably to changes affecting its scoring criterion. Existing…

3 days ago

GLUScope: A Tool for Analyzing GLU Neurons in Transformer Language Models

arXiv:2602.23826v2 Announce Type: replace Abstract: We present **GLUScope**, an open-source resource for analyzing neurons in Transformer-based language models (LMs), intended for interpretability researchers. We focus on the now-standard *GLU-based activation functions* such as SwiGLU,…

3 days ago

KIRA: A Full-Stack Reading Screening System with Dual-Pathway Analysis for Children

arXiv:2610.28840v1 Announce Type: new Abstract: Early-grade reading screening is critical for identifying children at risk of reading difficulty. Existing AI-based screeners are often limited in the scope of their analyses and evaluation metrics, or…

3 days ago

VX-One: Typed, Calibrated Decision Heads for Real-Time Perimeter Triage – An empirical study of unknown-attack honesty, cascade gray zones, and calibration under drift

arXiv:2610.30090v1 Announce Type: cross Abstract: Perimeter triage faces a latency/semantics trade-off: signature engines are fast and format-safe but blind to unseen attacks, while generative models are semantic but slow and produce unparseable output. In…

3 days ago

How to Use Parallel Data for Multilingual Pretraining

arXiv:2610.28838v1 Announce Type: new Abstract: High-quality human-translated parallel corpora can improve cross-lingual transfer, but are typically too small for large-scale pretraining. Machine-translated web corpora help overcome this limitation, making parallel data available at pretraining…

3 days ago

SPARE: Sparsity Allocation via Routing Entropy for Efficient MoEs

arXiv:2610.29662v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) architectures scale model capacity efficiently, yet their substantial memory footprint poses a major barrier to deployment. Expert pruning reduces this footprint, but most methods focus on which…

3 days ago

SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models

arXiv:2610.28767v1 Announce Type: new Abstract: Current evaluation of LLMs on benchmarks typically aggregates performance over individual examples into a single scalar score. This approach is overly coarse and ignores the diverse scope of skills…

3 days ago

Scaling Therapy Supervision: Assessing Psychotherapy Fidelity Using Large Language Models

arXiv:2610.28772v1 Announce Type: new Abstract: Psychotherapy fidelity assessment measures how faithfully a therapist adheres to a treatment protocol, a critical determinant of positive patient outcomes. However, fidelity assessment is bottlenecked by manual expert review,…

3 days ago

Is Anyone Enforcing the Cartel? What Reinforcement Learning Teaches LLM Agents in Markets

arXiv:2610.28787v1 Announce Type: new Abstract: Evaluations of large language model (LLM) agents report that pricing agents collude at others' expense. Yet collusion is defined by enforcement: a cartel, in which competitors share monopoly profits,…

3 days ago

LIFT: Scoped Constraints for Evaluating and Training Instruction Following

arXiv:2610.28819v1 Announce Type: new Abstract: Common instruction following (IF) benchmarks, such as IFEval, evaluate the ability of language models (LMs) to follow simple constraints that can easily be verified programmatically. These same constraints, in…

3 days ago

Where Do Legal Factors Live in LLMs?

arXiv:2610.28799v1 Announce Type: new Abstract: In case-based legal reasoning, legal professionals identify legally significant fact patterns in a new dispute and compare them with those of decided cases. In AI & Law, HYPO dimensions…

3 days ago

The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction

arXiv:2510.06198v4 Announce Type: replace Abstract: Despite the remarkable reasoning capabilities of large language models, they still struggle with one-shot relation extraction without predefined relation labels. We identify two pitfalls: models are often misled by…