Benchmark Prompts / P12

Chess set: 12 AI models, one prompt

Every Season 3 competitor received this prompt verbatim, at default settings, with one generation and no manual cleanup. Nothing below is cherry-picked — the failures ship too, because a benchmark that hides them isn't one.

12Outputs604 ballots · 10 both-bad
A chess set arrangement: checkered board with the two front rows of white pieces placed correctly.
TestsMulti-object precision, placement rules, and instruction following.CategoryAbstractSetv1.0 · CC BY 4.0

Every output for this prompt

Click a tile to load the model in 3D, then switch to Wire or X-ray to read the topology. Vote on these blind →

Season 3 blind votes for P12

604 ballots · 10 “both bad”

CompetitorRecordWinsLosses
3D-Agent8323
Claude Opus 5.57811
GPT-6 Astra7123
Claude Fable 5.15441
Claude Opus 55339
GPT-5.6 Sol5039
GPT-6 Sol4350
GPT-6 Luna3655
Grok 4.63244
Claude Fable 51980
GPT-6.1 Sol1548
Grok 4.71192