← mecheval / task / a4-counterbore-plate-01

Plate with four counterbore holes A · A4 · a4-counterbore-plate-01

plate · counterbore · multi-diameter-hole · boolean · advanced

Expected

Prompt

Make a single solid: a flat plate 60mm × 60mm × 12mm, centered in X and Y with the bottom face on the XY plane (z = 0 to z = 12). Drill four counterbore holes at corners (20, 20), (-20, 20), (-20, -20), (20, -20). Each counterbore consists of two coaxial Z-aligned through-features: a clearance through-hole of diameter 4mm running the full thickness (z = 0 to z = 12), and a coaxial recess of diameter 8mm machined 4mm deep from the top face (so the larger diameter spans z = 8 to z = 12). Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -30,
    -30,
    0
  ],
  "max": [
    30,
    30,
    12
  ],
  "tolerance_mm": 0.1
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 41993.63,
  "tolerance_pct": 1
}
3
hole_count
{
  "type": "hole_count",
  "diameter_mm": 4,
  "expected": 4,
  "diameter_tolerance_mm": 0.05
}
4
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 4,
  "positions": [
    [
      20,
      20,
      0
    ],
    [
      -20,
      20,
      0
    ],
    [
      -20,
      -20,
      0
    ],
    [
      20,
      -20,
      0
    ]
  ],
  "tolerance_mm": 0.15
}
5
hole_count
{
  "type": "hole_count",
  "diameter_mm": 8,
  "expected": 4,
  "diameter_tolerance_mm": 0.05
}
6
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 8,
  "positions": [
    [
      20,
      20,
      0
    ],
    [
      -20,
      20,
      0
    ],
    [
      -20,
      -20,
      0
    ],
    [
      20,
      -20,
      0
    ]
  ],
  "tolerance_mm": 0.15
}
7
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 1
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 40000,
  "max_wallclock_sec": 240,
  "max_tool_calls": 40
}

Recent attempts

Runs (20)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T221600Z-7469 fail 0.63 mass_props · volume off by 616.8% 611.2k 281.2s
claude-mcp-claude-opus-4-7 20260611T221542Z-9d60 fail 0.25 bbox · X off by +30.00mm 636.0k 288.8s
claude-mcp-claude-opus-4-7 20260611T221444Z-17e1 fail 0.25 bbox · Z off by +2.00mm 667.3k 119.0s
claude-mcp-claude-opus-4-7 20260611T221409Z-7124 fail 0.63 mass_props · volume off by 308.9% 658.1k 111.0s
claude-mcp-claude-opus-4-7 20260611T221349Z-e0d8 fail 0.25 bbox · Z off by +0.20mm 645.4k 113.1s
claude-direct-claude-sonnet-4-6 20260429T120214Z-f57e PASS 1.00 2.2k 15.7s
claude-direct-claude-opus-4-7 20260429T120212Z-f6e6 PASS 1.00 2.5k 13.0s
claude-direct-claude-haiku-4-5-20251001 20260429T120202Z-79cb fail 0.00 valid_solid · solid invalid 3.0k 8.6s
claude-direct-claude-sonnet-4-6 20260429T120200Z-8e34 PASS 1.00 2.1k 12.9s
claude-direct-claude-opus-4-7 20260429T120159Z-74ce PASS 1.00 2.5k 13.3s
claude-direct-claude-haiku-4-5-20251001 20260429T120154Z-9ddf fail 0.00 valid_solid · solid invalid 2.8k 7.9s
claude-direct-claude-sonnet-4-6 20260429T120149Z-6f3f PASS 1.00 2.2k 10.9s
claude-direct-claude-opus-4-7 20260429T120146Z-866a PASS 1.00 2.5k 12.3s
claude-direct-claude-haiku-4-5-20251001 20260429T120145Z-9eb9 fail 0.00 valid_solid · solid invalid 3.1k 8.7s
claude-direct-claude-sonnet-4-6 20260429T120138Z-b7b4 PASS 1.00 2.1k 10.6s
claude-direct-claude-haiku-4-5-20251001 20260429T120135Z-f79c fail 0.00 valid_solid · solid invalid 2.8k 9.9s
claude-direct-claude-opus-4-7 20260429T120133Z-dcba PASS 1.00 2.5k 12.7s
claude-direct-claude-haiku-4-5-20251001 20260429T120127Z-a8a5 fail 0.00 valid_solid · solid invalid 2.8k 7.8s
claude-direct-claude-sonnet-4-6 20260429T120123Z-17a3 PASS 1.00 2.2k 13.8s
claude-direct-claude-opus-4-7 20260429T120120Z-2865 PASS 1.00 2.5k 12.1s

generated 2026-06-17T03:16:07.244Z · static site, regenerate with npm run build -w @mecheval/leaderboard