← mecheval / task / a3-rotated-block-01

Block with compound rotation A · A3 · a3-rotated-block-01

rotation · spatial-reasoning · advanced

Expected

Prompt

Make a rectangular block 40mm long (X) × 30mm wide (Y) × 20mm tall (Z), centered at the origin BEFORE any rotation. Then rotate the block about its center by 30 degrees around the Z axis (the rotation matrix Rz(30°)), and after that rotate again by 15 degrees around the X axis (Rx(15°)). Both rotations are about the origin, which is the block's center. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -24.82,
    -24.81,
    -15.62
  ],
  "max": [
    24.82,
    24.81,
    15.62
  ],
  "tolerance_mm": 0.5
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 24000,
  "center_of_mass": [
    0,
    0,
    0
  ],
  "tolerance_pct": 0.5
}
3
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 0.5
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 40000,
  "max_wallclock_sec": 240,
  "max_tool_calls": 40
}

Recent attempts

Runs (15)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T182408Z-7f95 fail 0.50 bbox · X off by +15.18mm 214.7k 128.5s
claude-mcp-claude-opus-4-7 20260611T182339Z-8698 fail 0.50 bbox · X off by +15.18mm 197.0k 67.5s
claude-mcp-claude-opus-4-7 20260611T182318Z-a12f PASS 1.00 309.6k 151.6s
claude-mcp-claude-opus-4-7 20260611T182150Z-9cb7 PASS 1.00 252.7k 109.1s
claude-mcp-claude-opus-4-7 20260611T182126Z-a96a fail 0.75 bbox · Y off by -9.58mm 253.2k 112.2s
claude-direct-claude-opus-4-7 20260428T213829Z-25be PASS 1.00 1.2k 3.8s
claude-direct-claude-opus-4-7 20260428T213826Z-a0d0 PASS 1.00 1.2k 3.3s
claude-direct-claude-opus-4-7 20260428T213822Z-6ee2 PASS 1.00 1.2k 3.6s
claude-direct-claude-opus-4-7 20260428T213819Z-b1fd PASS 1.00 1.2k 3.3s
claude-direct-claude-opus-4-7 20260428T213816Z-8d67 PASS 1.00 1.2k 3.3s
claude-direct-claude-opus-4-7 20260428T213347Z-1d93 fail 0.00 valid_solid · solid invalid 1.2k 3.7s
claude-direct-claude-opus-4-7 20260428T213343Z-c874 fail 0.00 valid_solid · solid invalid 1.2k 3.9s
claude-direct-claude-opus-4-7 20260428T213340Z-0394 fail 0.00 valid_solid · solid invalid 1.2k 3.7s
claude-direct-claude-opus-4-7 20260428T213336Z-1ad2 fail 0.00 valid_solid · solid invalid 1.2k 4.0s
claude-direct-claude-opus-4-7 20260428T213331Z-e869 fail 0.00 valid_solid · solid invalid 1.2k 4.1s

generated 2026-06-17T03:16:07.235Z · static site, regenerate with npm run build -w @mecheval/leaderboard