← mecheval / task / a2-bolt-circle-block-01

Block with 8-hole bolt circle A · A2 · a2-bolt-circle-block-01

block · bolt-circle · multi-hole · trigonometry

Expected

Prompt

Make a square block 60mm × 60mm × 10mm. Center it in X and Y, with the bottom face on the XY plane (z = 0 to z = 10). Drill eight through-holes of diameter 5mm, axes parallel to Z, on a bolt circle of radius 20mm centered on the Z axis. Holes are evenly spaced every 45 degrees, with the first hole on the +X axis. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -30,
    -30,
    0
  ],
  "max": [
    30,
    30,
    10
  ],
  "tolerance_mm": 0.1
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 34429.2,
  "tolerance_pct": 0.5
}
3
hole_count
{
  "type": "hole_count",
  "diameter_mm": 5,
  "expected": 8,
  "diameter_tolerance_mm": 0.05
}
4
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 5,
  "positions": [
    [
      20,
      0,
      0
    ],
    [
      14.14,
      14.14,
      0
    ],
    [
      0,
      20,
      0
    ],
    [
      -14.14,
      14.14,
      0
    ],
    [
      -20,
      0,
      0
    ],
    [
      -14.14,
      -14.14,
      0
    ],
    [
      0,
      -20,
      0
    ],
    [
      14.14,
      -14.14,
      0
    ]
  ],
  "tolerance_mm": 0.2
}
5
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 1
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 40000,
  "max_wallclock_sec": 240,
  "max_tool_calls": 40
}

Recent attempts

Runs (35)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T172450Z-f253 PASS 1.00 376.3k 71.2s
claude-mcp-claude-opus-4-7 20260611T172431Z-0377 PASS 1.00 229.2k 44.9s
claude-mcp-claude-opus-4-7 20260611T172412Z-e241 PASS 1.00 263.9k 45.9s
claude-mcp-claude-opus-4-7 20260611T172337Z-9747 PASS 1.00 269.8k 53.7s
claude-mcp-claude-opus-4-7 20260611T172301Z-f5ca PASS 1.00 589.9k 108.1s
openai-direct-gpt-5 20260428T215119Z-5019 PASS 1.00 3.7k 34.0s
openai-direct-gpt-5 20260428T215042Z-8791 PASS 1.00 3.4k 36.3s
openai-direct-gpt-5 20260428T215005Z-47f1 PASS 1.00 3.8k 36.6s
openai-direct-gpt-5 20260428T214930Z-b470 PASS 1.00 3.4k 35.0s
openai-direct-gpt-5 20260428T214907Z-b22d PASS 1.00 2.9k 22.2s
openai-direct-gpt-5-mini 20260428T214848Z-5917 PASS 1.00 3.8k 27.7s
openai-direct-gpt-5-mini 20260428T214822Z-6efd PASS 1.00 3.4k 25.1s
openai-direct-gpt-5-mini 20260428T214753Z-1307 PASS 1.00 3.6k 29.1s
openai-direct-gpt-5-mini 20260428T214716Z-8d5a PASS 1.00 3.5k 35.9s
openai-direct-gpt-5-mini 20260428T214641Z-e4de PASS 1.00 4.3k 35.2s
openai-direct-gpt-4o-mini 20260428T213527Z-4a13 fail 0.00 valid_solid · solid invalid 1.5k 14.1s
openai-direct-gpt-4o-mini 20260428T213514Z-c235 fail 0.00 valid_solid · solid invalid 1.5k 12.3s
openai-direct-gpt-4o-mini 20260428T213455Z-a3cf fail 0.00 valid_solid · solid invalid 1.6k 19.7s
openai-direct-gpt-4o-mini 20260428T213437Z-685e fail 0.00 valid_solid · solid invalid 1.5k 18.0s
openai-direct-gpt-4o-mini 20260428T213425Z-540c fail 0.00 valid_solid · solid invalid 1.5k 11.5s
claude-direct-claude-sonnet-4-6 20260428T212114Z-52c1 PASS 1.00 2.1k 10.7s
claude-direct-claude-sonnet-4-6 20260428T212103Z-0977 PASS 1.00 2.1k 10.9s
claude-direct-claude-sonnet-4-6 20260428T212051Z-79c9 PASS 1.00 2.1k 10.7s
claude-direct-claude-sonnet-4-6 20260428T212040Z-6e1e PASS 1.00 2.1k 11.3s
claude-direct-claude-sonnet-4-6 20260428T212028Z-fd46 PASS 1.00 2.1k 10.6s
claude-direct-claude-opus-4-7 20260428T211933Z-0826 PASS 1.00 2.5k 12.0s
claude-direct-claude-opus-4-7 20260428T211923Z-2c85 PASS 1.00 2.1k 10.1s
claude-direct-claude-opus-4-7 20260428T211910Z-f2d1 PASS 1.00 2.5k 12.3s
claude-direct-claude-opus-4-7 20260428T211859Z-1964 PASS 1.00 2.1k 9.9s
claude-direct-claude-opus-4-7 20260428T211846Z-b5f4 PASS 1.00 2.5k 12.7s
claude-direct-claude-haiku-4-5-20251001 20260428T211811Z-6071 fail 0.00 valid_solid · solid invalid 2.7k 8.2s
claude-direct-claude-haiku-4-5-20251001 20260428T211802Z-f4dd fail 0.00 valid_solid · solid invalid 2.9k 9.0s
claude-direct-claude-haiku-4-5-20251001 20260428T211755Z-5f6e PASS 1.00 2.1k 6.5s
claude-direct-claude-haiku-4-5-20251001 20260428T211747Z-2a7e fail 0.00 valid_solid · solid invalid 2.9k 8.7s
claude-direct-claude-haiku-4-5-20251001 20260428T211739Z-2f67 fail 0.00 valid_solid · solid invalid 2.4k 7.1s

generated 2026-06-17T03:16:07.200Z · static site, regenerate with npm run build -w @mecheval/leaderboard