HealthBench Hard

OpenAI logoGPT-6.1 Sol on HealthBench Hard

rank 4 of 21 · updated November 2, 2026via Addendum to GPT-6 Astra System Card: GPT-6.1 Sol

On the 21-model HealthBench Hard board, GPT-6.1 Sol holds rank 4 with a score of 0.362. HealthBench Hard tests models on the 1,000 health conversations the frontier found hardest, with each response judged against its conversation's physician-written rubric and scored between 0 and 1.

Score and API facts

rank4 of 21
score0.362
sourceAddendum to GPT-6 Astra System Card: GPT-6.1 Sol (Section 5.1, Table 7, HealthBench Hard length-adjusted, GPT-6.1 Sol column), vendor-reported
configurationOpenAI; length-adjusted; 36.2 (33.4, 1646) (adjusted, raw, mean response characters); addendum Table 7 refers to the GPT-6 Astra card for method
labOpenAI
context window1.05M tokens
API price per 1M tokens$2.00 in / $10.00 out
licenseproprietary
released2026-09-29

Where it sits

Muse Spark tops the board at 0.428, which puts GPT-6.1 Sol 0.066 off the lead. One place up is GPT-6 Astra at 0.366. One place down is GPT-5 at 0.347. Rows on this board are compiled from published documents, so a gap between two models is exact only when both numbers came from the same document under the same settings; the sources page shows which document each row came from.

What does GPT-6.1 Sol score on HealthBench Hard?

As of November 2, 2026, GPT-6.1 Sol scores 0.362 on HealthBench Hard, 4 of 21 models on the board. The number is read from the Addendum to GPT-6 Astra System Card: GPT-6.1 Sol (Section 5.1, Table 7, HealthBench Hard length-adjusted, GPT-6.1 Sol column), vendor-reported.

What does GPT-6.1 Sol cost per million tokens?

OpenAI lists GPT-6.1 Sol at $2.00 per million input tokens and $10.00 per million output tokens.

Head to head

The pairings that earned a full page are linked below; the rest of the differences live in the score-difference matrix.

How numbers are read from their documents is on the methodology page, the document for this row is on the sources page, and how the subset was selected is on the benchmark page. The full ranking is on the leaderboard.