Fact Check: Does GPT-5.5 underperform Claude Opus 4.7 on the SWE-Bench Pro coding benchmark?
“GPT 5.5 underperforms Opus 4.7 on SWE-Bench Pro. Couldn't find any reported SWE-Bench scores at all and an internal benchmark is reported instead. That footnote is trying really hard to bury the lede. GPT 5.5 isn't SOTA for coding.”
Evidence from official release notes and independent technical analysis confirms that Claude Opus 4.7 outperforms GPT-5.5 on the SWE-Bench Pro benchmark, a key metric for real-world software engineering. While OpenAI's announcement highlights a state-of-the-art (SOTA) score on a different benchmark (`Terminal-Bench 2.0`), its reported score for SWE-Bench Pro is lower than the...