SWE-Bench Pro Raises the Bar as Coding Agents Harden
Monday, August 10, 2026 · 7 min
SWE-Bench Pro sets a tougher public yardstick for coding agents, while Claude Code makes auto mode default, GitHub Copilot adds context-preserving releases, and fresh CI flaws in Claude Code and Gemini CLI underline that the harness is now the attack surface.
Listen
Show notes
SWE-Bench Pro sets a tougher public yardstick for coding agents, while Claude Code makes auto mode default, GitHub Copilot adds context-preserving releases, and fresh CI flaws in Claude Code and Gemini CLI underline that the harness is now the attack surface.
In this episode
- SWE-Bench Pro (Public Dataset) - Scale Labs — Scale Labs
[](/) # SWE-Bench Pro (Public Dataset) Evaluating challenging long-horizon software engineering tasks in public open source repositories [GitHub Dataset](https://github.com/scaleapi/SWE-bench_Pro-os) SWE-Bench Pro is a benchmark designed to provide a rigorous and realistic evaluation of AI agents for software engineering. It was developed to…
- Running auto mode in production | Claude by Anthropic — Claude by Anthropic
Running auto mode in production | Claude by Anthropic Explore here # Running auto mode in production How the teams at Nuro, Gusto, and Garner Health use auto mode to balance speed and safety at production scale. Category Product Date August 7, 2026 Reading time 5 min Share Copy link https://claude.com/blog/auto-mode-in-production Author(s) Molly Vorwerck Auto mode is now the…
- GitHub Copilot weekly releases — August 3 - GitHub Changelog — GitHub Changelog
# GitHub Copilot weekly releases — August 3 - GitHub Changelog Published: 2026-08-07T16:16:02-07:00 Source: github.blog (github.blog) Language: en ## Story GitHub Copilot weekly releases — August 3 - GitHub Changelog Skip to content Skip to sidebar [GitHub homepage](https://github.com/)/ [Blog](https://github.blog/) - [Changelog](https://github.blog/changelog/) -…
- Claude Code and Gemini CLI Flaws Let a GitHub Issue Reach CI Workflow Secrets - InfoSec Today — InfoSec Today
Claude Code and Gemini CLI Flaws Let a GitHub Issue Reach CI Workflow Secrets - InfoSec Today Artificial Intelligence / Vulnerability A GitHub issue opened by an account with no repository privileges was enough to execute code on the CI runners behind Anthropic’s and Google’s own coding-agent repositories. On OpenAI’s, it was enough to hijack the next agent run. Novee Security ran the…