Amanda Brooke Perino

@amandabperino · Twitter ·

These benchmark results have really driven it home for me how engineering teams have suddenly had (in the space of the past 12/18 months) a massive new line item in their budget. The cost diff between our top 2 models is insane. Great, insightful work again from @evilmartians!

Ruby on Rails

@rails · Twitter ·

Agents on Rails: Stage 2 is live. We wanted to find out: can you hand a model a real feature ticket and trust what comes back? The jump from atomic tasks to feature requests has interesting results… @OpenAI GPT-6 Astra is new to the leaderboard, and it came out on top: 35% of

Agents on Rails Stage 2 leaderboard showing the results of asking models to ship features in a Rails app. GPT-Astra is in the number one spot as of September 9 2026.