← mecheval / task / a2-l-bracket-01

L-bracket with mounting holes A · A2 · a2-l-bracket-01

bracket · boolean · holes · asymmetric

Expected

Prompt

Make an L-shaped mounting bracket. The base lies in the XY plane, occupying x in [0, 50], y in [0, 30], z in [0, 4] (50mm long, 30mm wide, 4mm thick). A vertical wall stands on the +X edge: x in [46, 50], y in [0, 30], z in [4, 30] (4mm thick, 30mm wide, rising to z = 30). Two through-holes of diameter 5mm pierce the base parallel to Z, centered at (10, 15) and (35, 15) on the top face. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    0,
    0,
    0
  ],
  "max": [
    50,
    30,
    30
  ],
  "tolerance_mm": 0.1
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 8962.92,
  "tolerance_pct": 0.5
}
3
hole_count
{
  "type": "hole_count",
  "diameter_mm": 5,
  "expected": 2,
  "diameter_tolerance_mm": 0.05
}
4
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 5,
  "positions": [
    [
      10,
      15,
      0
    ],
    [
      35,
      15,
      0
    ]
  ],
  "tolerance_mm": 0.1
}
5
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 0.1
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 60000,
  "max_wallclock_sec": 300,
  "max_tool_calls": 50
}

Recent attempts

Runs (35)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T220542Z-fdb0 fail 0.17 bbox · X off by -2.50mm 588.0k 129.9s
claude-mcp-claude-opus-4-7 20260611T174501Z-edb6 fail 0.50 mass_props · volume off by 1.8% 637.3k 128.8s
claude-mcp-claude-opus-4-7 20260611T174414Z-c49d PASS 1.00 413.2k 75.5s
claude-mcp-claude-opus-4-7 20260611T174344Z-af8c PASS 1.00 448.1k 77.5s
claude-mcp-claude-opus-4-7 20260611T174304Z-a978 PASS 1.00 318.1k 70.3s
openai-direct-gpt-5-mini 20260428T213635Z-f681 PASS 1.00 2.7k 20.5s
openai-direct-gpt-5-mini 20260428T213615Z-46d8 PASS 1.00 2.3k 19.8s
openai-direct-gpt-5-mini 20260428T213558Z-f74c PASS 1.00 2.1k 17.2s
openai-direct-gpt-5-mini 20260428T213532Z-c667 PASS 1.00 2.6k 25.6s
openai-direct-gpt-5 20260428T213531Z-aeed PASS 1.00 3.0k 35.2s
openai-direct-gpt-5-mini 20260428T213509Z-c90f PASS 1.00 2.5k 22.6s
openai-direct-gpt-5 20260428T213454Z-af3b PASS 1.00 3.5k 37.5s
openai-direct-gpt-5 20260428T213431Z-051d PASS 1.00 2.4k 22.4s
openai-direct-gpt-5 20260428T213335Z-b513 PASS 1.00 2.6k 24.3s
openai-direct-gpt-4o-mini 20260428T212824Z-cd39 fail 0.00 valid_solid · solid invalid 1.2k 9.2s
openai-direct-gpt-4o-mini 20260428T212817Z-8ed1 fail 0.00 valid_solid · solid invalid 1.2k 7.8s
openai-direct-gpt-4o-mini 20260428T212806Z-e5ff fail 0.00 valid_solid · solid invalid 1.1k 10.3s
openai-direct-gpt-4o-mini 20260428T212757Z-4ef2 fail 0.00 valid_solid · solid invalid 1.2k 9.6s
openai-direct-gpt-4o-mini 20260428T212747Z-b3e1 fail 0.00 valid_solid · solid invalid 1.2k 9.8s
claude-direct-claude-sonnet-4-6 20260428T211632Z-ea20 PASS 1.00 1.3k 6.6s
claude-direct-claude-sonnet-4-6 20260428T211626Z-3786 PASS 1.00 1.3k 6.6s
claude-direct-claude-sonnet-4-6 20260428T211619Z-8797 PASS 1.00 1.3k 6.6s
claude-direct-claude-sonnet-4-6 20260428T211612Z-ebb5 PASS 1.00 1.3k 6.3s
claude-direct-claude-sonnet-4-6 20260428T211606Z-0b99 PASS 1.00 1.3k 6.7s
claude-direct-claude-haiku-4-5-20251001 20260428T211502Z-db06 fail 0.00 valid_solid · solid invalid 1.6k 4.4s
claude-direct-claude-haiku-4-5-20251001 20260428T211459Z-730f fail 0.00 valid_solid · solid invalid 1.4k 3.4s
claude-direct-claude-haiku-4-5-20251001 20260428T211455Z-466b fail 0.00 valid_solid · solid invalid 1.5k 4.1s
claude-direct-claude-haiku-4-5-20251001 20260428T211451Z-de15 fail 0.00 valid_solid · solid invalid 1.4k 3.7s
claude-direct-claude-haiku-4-5-20251001 20260428T211447Z-f157 fail 0.00 valid_solid · solid invalid 1.5k 3.8s
claude-direct-claude-opus-4-7 20260428T153537Z-3a65 PASS 1.00 1.5k 5.9s
claude-direct-claude-opus-4-7 20260428T153525Z-a46b PASS 1.00 1.6k 6.8s
claude-direct-claude-opus-4-7 20260428T153513Z-ac6b PASS 1.00 1.6k 6.7s
claude-mcp-claude-opus-4-7 20260428T145833Z-d1a8 fail 0.17 bbox · X off by -2.50mm 973.8k 138.2s
claude-direct-claude-opus-4-7 20260428T142504Z-02a4 PASS 1.00 1.6k 7.2s
claude-direct-claude-opus-4-7 20260428T141643Z-2876 PASS 1.00 1.6k 6.8s

generated 2026-06-17T03:16:07.213Z · static site, regenerate with npm run build -w @mecheval/leaderboard