State AI Rules Loom as Benchmarks Face a Reckoning
Monday, June 22, 2026 · 5 min
Senate AI moratorium rejection leaves companies facing a patchwork of targeted state rules, while an arXiv survey of 283 LLM benchmarks flags contamination, bias, and weak process evaluation as core measurement risks.
Listen
Show notes
Senate AI moratorium rejection leaves companies facing a patchwork of targeted state rules, while an arXiv survey of 283 LLM benchmarks flags contamination, bias, and weak process evaluation as core measurement risks.
In this episode
- A Survey on Large Language Model Benchmarks — arXiv
# A Survey on Large Language Model Benchmarks ###### Abstract In recent years, with the rapid development of the depth and breadth of large language models’ capabilities, various corresponding evaluation benchmarks have been emerging in increasing numbers. As a quantitative assessment tool for model performance, benchmarks are not only a core means to measure model capabilities but also a key…
- Step Back — Now that the Senate has rejected the proposed AI regulatory moratorium, are AI companies really headed for a state-by-state rulebook — and which kinds of state laws would actually bite first?
Background sources
- 'Big, beautiful bill' passes Senate without AI-law moratorium — Nbcnews
- US Senate abandons proposed state AI law moratorium as compromise falls through | IAPP — Caitlin Andrews
- Some States Are Forging Ahead With AI Regulations — Marc Levy
- The Federal AI Moratorium is DOA; What’s Next for State AI Regulation? | 07 | 2025 | Publications | Insights & Publications | Debevoise & Plimpton LLP — Debevoise & Plimpton LLP
- State AI Laws – Where Are They Now? // Cooley // Global Law Firm — Cooley
- Trump tried to block state AI regulations, but some states are forging ahead - The Boston Globe — Bostonglobe