Leaderboard / Model

Grok

by xAI · assistant · Free tier, paid plans via X Premium

xAI's assistant, usable for Blender through bpy scripting or any MCP-capable client.

Arena Status

Season 1 — Calibration

Competitors

1

Benchmark Outputs

10

of 12 prompts

Ballot Appearances

141

CompetitorStatusRatingW–L–T
Grok 4.6Provisional1799 ±7199315

Every competitor starts Season 1 at the Glicko-2 default of 1500 ±350 and stays unranked until it clears the calibration floors. Ratings move only on real head-to-head votes — no seeded or editorial vote data is ever shown as community results, and every ballot is published. Read the methodology.

What is Grok?

Grok is xAI's assistant. It has no first-party Blender integration, so for 3D work it plays the same two roles as other general assistants: writing Blender Python (bpy) scripts you run in the Scripting workspace, or driving a live scene through an MCP-capable client connected to the open-source blender-mcp server.

It ships a capable command-line tool, which makes it straightforward to script against — useful if Blender is one step in a larger automated pipeline rather than something you sit in front of.

In Season 1 it entered the benchmark writing one-shot bpy scripts under the same rules as the other entrants. Ten of its twelve entries produced geometry; the two failures are published rather than retried.

Strengths

  • +Strong at long, self-contained procedural code — its benchmark scripts ran to hundreds of lines
  • +A first-class CLI with a real headless mode, easy to automate
  • +Adjustable reasoning effort, so you can trade time for quality per task

Limitations

  • Not a mesh generator — geometry comes from code, so organic subjects are the weak spot
  • No official Blender connector; integration is via community MCP tooling or copy-pasted scripts
  • Fewer Blender-specific tutorials and forum answers target it than Claude or GPT, so there is less prior art when something breaks
  • In our run it reached for a shader node removed in Blender 5.1 — worth pinning your Blender version in the prompt

How to use Grok with Blender

Either paste generated bpy scripts into Blender's Scripting workspace, or point an MCP-capable client running Grok at the blender-mcp server for live scene access.

Best for: Procedural and parametric modelling driven from a script or a pipeline, especially where you want to automate Blender from the command line.

Season 1 Benchmark Outputs

Grok's unedited results on the benchmark prompt set. Each competitor generated its entries independently — no shared code or outputs.

P02: “A desk lamp with an articulated two-joint arm and a round metal shade, in a bent working pose.

Grok 4.6Characters

P03: “A low-poly stylized knight character in idle pose, with helmet, shield on back, T-pose acceptable.

Grok 4.6Characters

P04: “A cute cartoon mushroom creature with big eyes and stubby legs, standing.

Grok 4.6Architecture

P05: “A small medieval stone watchtower with a wooden door, arrow slits, and a conical roof.

Grok 4.6Architecture

P06: “A modern single-story house with flat roof, large windows, and an attached carport.

Grok 4.6Vehicles

P07: “A low-poly pickup truck with visible wheels, cabin, and cargo bed, game-asset style.

Grok 4.6Vehicles

P08: “A small sailing boat with hull, single mast, boom, and simplified sail.

Grok 4.6Nature

P10: “A low-poly island scene: small rocky island with two palm trees and a sandy beach.

Grok 4.6Abstract

P11: “A spiral staircase with twelve steps winding around a central column, with a handrail.

Grok 4.6Abstract

P12: “A chess set arrangement: checkered board with the two front rows of white pieces placed correctly.

Related