Make claude.ai three times faster in a two-week agent sprint
Reporting Anthropic's September 23 engineering post, this analysis describes the AI running a two-week performance sprint from a Slack channel: 150-plus threads, benchmarks built for each bottleneck, and more than 3,000 merged changes with no customer-facing incident. Time to a typeable page at the 75th percentile fell from 3.1 seconds to 0.55, with a human approving every pull request.
How it works
- Put the AI in a Slack channel with standing instructions
- Analyze usage data via the Datadog MCP server
- Pick the four highest-impact user journeys
- Build a lab benchmark per bottleneck
- Open risk-sized pull requests behind feature flags
- Watch deploys and field data
- Ratchet each benchmark down in CI
Why it’s worth knowing
The agent ran its own maker's product-speed program: 3,000 merged changes driven from a chat channel.
Where it’s from
Summarized from a public post on fourweekmba.com. See the original ↗