← mecheval / task / a3-octagonal-flange-01

Octagonal flange with 8 bolt holes A · A3 · a3-octagonal-flange-01

polygon · octagon · bolt-circle · advanced

Expected

Prompt

Make an octagonal prism flange. The outer cross-section is a regular octagon with flat-to-flat distance 40mm (apothem 20mm), oriented so two flats are parallel to the X axis (the top and bottom of the octagon). Height 8mm along Z, base on the XY plane (z = 0 to z = 8). Drill eight through-holes of diameter 5mm, axes parallel to Z, on a bolt circle of radius 15mm centered on the Z axis. The first bolt hole is on the +X axis, and the rest are evenly spaced every 45 degrees. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -21.65,
    -20,
    0
  ],
  "max": [
    21.65,
    20,
    8
  ],
  "tolerance_mm": 0.3
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 9347.81,
  "tolerance_pct": 1.5
}
3
hole_count
{
  "type": "hole_count",
  "diameter_mm": 5,
  "expected": 8,
  "diameter_tolerance_mm": 0.05
}
4
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 5,
  "positions": [
    [
      15,
      0,
      0
    ],
    [
      10.61,
      10.61,
      0
    ],
    [
      0,
      15,
      0
    ],
    [
      -10.61,
      10.61,
      0
    ],
    [
      -15,
      0,
      0
    ],
    [
      -10.61,
      -10.61,
      0
    ],
    [
      0,
      -15,
      0
    ],
    [
      10.61,
      -10.61,
      0
    ]
  ],
  "tolerance_mm": 0.2
}
5
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 1.5
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 40000,
  "max_wallclock_sec": 240,
  "max_tool_calls": 40
}

Recent attempts

Runs (37)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T181717Z-1694 fail 0.33 bbox · X off by -1.65mm 636.8k 160.0s
claude-mcp-claude-opus-4-7 20260611T181701Z-651f fail 0.83 bbox · X off by -1.65mm 439.2k 182.1s
claude-mcp-claude-opus-4-7 20260611T181601Z-5692 fail 0.33 bbox · X off by -1.65mm 661.5k 139.0s
claude-mcp-claude-opus-4-7 20260611T181534Z-03af fail 0.83 bbox · X off by -1.65mm 323.4k 87.3s
claude-mcp-claude-opus-4-7 20260611T181521Z-d7a0 fail 0.83 bbox · X off by -1.65mm 322.6k 116.0s
openai-direct-gpt-5-mini 20260429T001046Z-de66 fail 0.67 bbox · X off by -1.65mm 4.5k 87.8s
openai-direct-gpt-5 20260429T000824Z-cd7a fail 0.83 bbox · X off by -1.65mm 7.9k 89.9s
openai-direct-gpt-5-mini 20260429T000804Z-28c7 fail 0.00 valid_solid · no valid solid produced 8.2k 162.1s
openai-direct-gpt-5 20260429T000700Z-d34b fail 0.83 bbox · X off by -1.65mm 8.4k 83.4s
openai-direct-gpt-5-mini 20260429T000616Z-ba90 fail 0.00 valid_solid · solid invalid 6.0k 108.0s
openai-direct-gpt-5 20260429T000521Z-8c3c fail 0.83 bbox · X off by -1.65mm 7.7k 98.6s
openai-direct-gpt-5-mini 20260429T000445Z-9852 fail 0.67 bbox · X off by -1.65mm 5.6k 90.6s
openai-direct-gpt-5 20260429T000421Z-8e49 fail 0.83 bbox · X off by -1.65mm 6.1k 59.7s
openai-direct-gpt-5-mini 20260429T000254Z-2be7 fail 0.83 bbox · X off by -1.65mm 6.3k 109.9s
openai-direct-gpt-5-mini 20260428T233213Z-12bc fail 0.83 bbox · X off by -1.65mm 6.6k 65.6s
openai-direct-gpt-5-mini 20260428T233052Z-2da0 fail 0.00 valid_solid · no valid solid produced 8.2k 80.7s
openai-direct-gpt-5 20260428T232829Z-af1f fail 0.83 bbox · X off by -1.65mm 7.5k 162.3s
openai-direct-gpt-5-mini 20260428T232730Z-a3bf fail 0.83 bbox · X off by -1.65mm 7.3k 95.1s
claude-direct-claude-sonnet-4-6 20260428T232655Z-070a fail 0.83 bbox · X off by -1.65mm 2.3k 19.9s
openai-direct-gpt-4o-mini 20260428T232636Z-c549 fail 0.00 valid_solid · solid invalid 1.7k 17.4s
claude-direct-claude-sonnet-4-6 20260428T232629Z-c8fe fail 0.83 bbox · X off by -1.65mm 2.8k 25.9s
claude-direct-claude-haiku-4-5-20251001 20260428T232608Z-6d86 fail 0.00 valid_solid · solid invalid 3.6k 11.2s
openai-direct-gpt-4o-mini 20260428T232606Z-bd4a fail 0.00 valid_solid · solid invalid 1.5k 14.1s
claude-direct-claude-sonnet-4-6 20260428T232601Z-f5d4 fail 0.83 bbox · X off by -1.65mm 3.0k 27.3s
claude-direct-claude-haiku-4-5-20251001 20260428T232556Z-2a4d fail 0.00 valid_solid · solid invalid 3.9k 12.1s
openai-direct-gpt-5-mini 20260428T232553Z-a6bb fail 0.83 bbox · X off by -1.65mm 7.1k 96.3s
claude-direct-claude-haiku-4-5-20251001 20260428T232544Z-fa66 fail 0.00 valid_solid · solid invalid 3.9k 11.7s
openai-direct-gpt-5 20260428T232536Z-6b27 fail 0.83 bbox · X off by -1.65mm 6.5k 73.0s
claude-direct-claude-haiku-4-5-20251001 20260428T232532Z-b434 fail 0.00 valid_solid · solid invalid 3.8k 11.5s
claude-direct-claude-sonnet-4-6 20260428T232531Z-0614 fail 0.83 bbox · X off by -1.65mm 3.0k 29.6s
claude-direct-claude-haiku-4-5-20251001 20260428T232520Z-be62 fail 0.00 valid_solid · solid invalid 3.9k 12.3s
claude-direct-claude-sonnet-4-6 20260428T232508Z-11c7 fail 0.67 bbox · Y off by +1.65mm 2.6k 22.1s
claude-direct-claude-opus-4-7 20260428T231950Z-197e fail 0.83 bbox · X off by -1.65mm 2.3k 11.2s
claude-direct-claude-opus-4-7 20260428T231926Z-6a9d fail 0.67 bbox · X off by -1.65mm 4.2k 23.9s
claude-direct-claude-opus-4-7 20260428T231915Z-f8c3 fail 0.67 bbox · Y off by +1.65mm 2.2k 10.2s
claude-direct-claude-opus-4-7 20260428T231851Z-fef7 fail 0.67 bbox · X off by -1.65mm 4.1k 23.3s
claude-direct-claude-opus-4-7 20260428T231836Z-5683 fail 0.67 bbox · X off by +8.35mm 2.8k 14.3s

generated 2026-06-17T03:16:07.228Z · static site, regenerate with npm run build -w @mecheval/leaderboard