← mecheval / task / a2-square-flange-01

Square flange with corner and center holes A · A2 · a2-square-flange-01

plate · multi-hole · boolean · mixed-diameter

Expected

Prompt

Make a square plate 80mm × 80mm × 6mm (X × Y × Z). Center it in X and Y, with the bottom face on the XY plane (z = 0 to z = 6). Drill one central through-hole of diameter 12mm on the Z axis, and four corner through-holes of diameter 6mm with axes parallel to Z, centered 10mm in from each corner of the top face. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -40,
    -40,
    0
  ],
  "max": [
    40,
    40,
    6
  ],
  "tolerance_mm": 0.1
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 37042.83,
  "tolerance_pct": 0.5
}
3
hole_count
{
  "type": "hole_count",
  "diameter_mm": 12,
  "expected": 1,
  "diameter_tolerance_mm": 0.1
}
4
hole_count
{
  "type": "hole_count",
  "diameter_mm": 6,
  "expected": 4,
  "diameter_tolerance_mm": 0.05
}
5
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 12,
  "positions": [
    [
      0,
      0,
      0
    ]
  ],
  "tolerance_mm": 0.15
}
6
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 6,
  "positions": [
    [
      30,
      30,
      0
    ],
    [
      -30,
      30,
      0
    ],
    [
      -30,
      -30,
      0
    ],
    [
      30,
      -30,
      0
    ]
  ],
  "tolerance_mm": 0.15
}
7
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 1
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 30000,
  "max_wallclock_sec": 180,
  "max_tool_calls": 30
}

Recent attempts

Runs (35)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T220542Z-d0ba fail 0.50 bbox · Z off by +2.00mm 620.1k 153.9s
claude-mcp-claude-opus-4-7 20260611T175349Z-f2e9 fail 0.50 bbox · X off by +40.00mm 632.5k 166.8s
claude-mcp-claude-opus-4-7 20260611T175155Z-dc65 fail 0.50 bbox · Z off by +2.00mm 578.1k 203.9s
claude-mcp-claude-opus-4-7 20260611T175129Z-8d50 PASS 1.00 438.5k 139.6s
claude-mcp-claude-opus-4-7 20260611T174836Z-5235 PASS 1.00 517.5k 199.6s
openai-direct-gpt-5 20260428T213914Z-8819 PASS 1.00 2.7k 23.4s
openai-direct-gpt-5-mini 20260428T213913Z-4be8 PASS 1.00 2.7k 19.6s
openai-direct-gpt-5 20260428T213850Z-3ed8 PASS 1.00 2.9k 24.3s
openai-direct-gpt-5-mini 20260428T213849Z-b80b PASS 1.00 2.8k 23.1s
openai-direct-gpt-5-mini 20260428T213827Z-7089 PASS 1.00 3.0k 21.8s
openai-direct-gpt-5 20260428T213822Z-29af PASS 1.00 2.8k 27.6s
openai-direct-gpt-5-mini 20260428T213805Z-cbe9 PASS 1.00 2.8k 22.3s
openai-direct-gpt-5 20260428T213747Z-1a7a PASS 1.00 3.2k 34.8s
openai-direct-gpt-5-mini 20260428T213743Z-a9f5 PASS 1.00 3.1k 21.0s
openai-direct-gpt-5 20260428T213707Z-47a7 PASS 1.00 3.7k 39.1s
openai-direct-gpt-4o-mini 20260428T212940Z-28cf fail 0.00 valid_solid · solid invalid 1.5k 12.3s
openai-direct-gpt-4o-mini 20260428T212927Z-f70f fail 0.00 valid_solid · solid invalid 1.4k 13.6s
openai-direct-gpt-4o-mini 20260428T212915Z-56db fail 0.00 valid_solid · solid invalid 1.3k 11.6s
openai-direct-gpt-4o-mini 20260428T212902Z-d8d8 fail 0.50 bbox · X off by +40.00mm 1.5k 12.7s
openai-direct-gpt-4o-mini 20260428T212853Z-8601 fail 0.00 valid_solid · solid invalid 1.1k 9.0s
claude-direct-claude-sonnet-4-6 20260428T211727Z-dd7e PASS 1.00 1.6k 7.7s
claude-direct-claude-sonnet-4-6 20260428T211718Z-cd1e PASS 1.00 1.5k 8.7s
claude-direct-claude-sonnet-4-6 20260428T211711Z-410e PASS 1.00 1.6k 7.7s
claude-direct-claude-sonnet-4-6 20260428T211702Z-e752 PASS 1.00 1.6k 7.8s
claude-direct-claude-sonnet-4-6 20260428T211655Z-aeb6 PASS 1.00 1.5k 7.3s
claude-direct-claude-opus-4-7 20260428T211550Z-c19b PASS 1.00 1.9k 8.8s
claude-direct-claude-haiku-4-5-20251001 20260428T211542Z-409b fail 0.00 valid_solid · solid invalid 2.0k 5.4s
claude-direct-claude-opus-4-7 20260428T211540Z-d573 PASS 1.00 1.9k 9.3s
claude-direct-claude-haiku-4-5-20251001 20260428T211536Z-65d9 fail 0.00 valid_solid · solid invalid 2.0k 6.0s
claude-direct-claude-opus-4-7 20260428T211531Z-3486 PASS 1.00 1.9k 9.2s
claude-direct-claude-haiku-4-5-20251001 20260428T211529Z-66fb fail 0.00 valid_solid · solid invalid 2.1k 6.7s
claude-direct-claude-haiku-4-5-20251001 20260428T211523Z-8173 PASS 1.00 2.0k 6.0s
claude-direct-claude-opus-4-7 20260428T211521Z-d396 PASS 1.00 1.9k 9.2s
claude-direct-claude-haiku-4-5-20251001 20260428T211517Z-20c8 fail 0.00 valid_solid · solid invalid 2.1k 6.3s
claude-direct-claude-opus-4-7 20260428T211512Z-c9b0 PASS 1.00 1.9k 9.0s

generated 2026-06-17T03:16:07.217Z · static site, regenerate with npm run build -w @mecheval/leaderboard