← mecheval / task / a2-channel-bracket-01

U-channel bracket A · A2 · a2-channel-bracket-01

bracket · channel · union · multi-feature

Expected

Prompt

Make a U-shaped channel bracket built from three rectangular plates fused into a single solid. Bottom plate: x in [0, 30], y in [0, 40], z in [0, 4]. Left wall standing on top of the bottom: x in [0, 4], y in [0, 40], z in [4, 30]. Right wall standing on top of the bottom: x in [26, 30], y in [0, 40], z in [4, 30]. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    0,
    0,
    0
  ],
  "max": [
    30,
    40,
    30
  ],
  "tolerance_mm": 0.05
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 13120,
  "tolerance_pct": 0.1
}
3
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 0.1
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 30000,
  "max_wallclock_sec": 180,
  "max_tool_calls": 30
}

Recent attempts

Runs (35)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T172638Z-94c5 PASS 1.00 585.2k 90.4s
claude-mcp-claude-opus-4-7 20260611T172626Z-b8b4 fail 0.75 mass_props · volume off by 68.3% 589.6k 109.4s
claude-mcp-claude-opus-4-7 20260611T172601Z-ecd4 fail 0.75 mass_props · volume off by 231.7% 148.2k 25.3s
claude-mcp-claude-opus-4-7 20260611T172516Z-3c7e PASS 1.00 408.4k 81.8s
claude-mcp-claude-opus-4-7 20260611T172458Z-5d5f PASS 1.00 606.8k 114.0s
openai-direct-gpt-5 20260428T215246Z-3bcd PASS 1.00 1.7k 13.3s
openai-direct-gpt-5 20260428T215234Z-067b PASS 1.00 1.7k 11.0s
openai-direct-gpt-5 20260428T215216Z-5389 PASS 1.00 1.9k 18.9s
openai-direct-gpt-5 20260428T215205Z-9537 PASS 1.00 1.6k 10.4s
openai-direct-gpt-5 20260428T215153Z-9dde PASS 1.00 1.6k 11.8s
openai-direct-gpt-5-mini 20260428T214957Z-77ce PASS 1.00 1.7k 12.0s
openai-direct-gpt-5-mini 20260428T214946Z-670c PASS 1.00 1.7k 10.8s
openai-direct-gpt-5-mini 20260428T214935Z-661e PASS 1.00 1.7k 10.7s
openai-direct-gpt-5-mini 20260428T214926Z-8e1b PASS 1.00 1.7k 9.1s
openai-direct-gpt-5-mini 20260428T214916Z-e045 PASS 1.00 1.7k 10.2s
openai-direct-gpt-4o-mini 20260428T213611Z-f773 fail 0.00 valid_solid · solid invalid 1.1k 11.1s
openai-direct-gpt-4o-mini 20260428T213604Z-e779 fail 0.00 valid_solid · solid invalid 1.1k 6.9s
openai-direct-gpt-4o-mini 20260428T213558Z-2f31 fail 0.00 valid_solid · solid invalid 1.0k 5.9s
openai-direct-gpt-4o-mini 20260428T213549Z-94b0 fail 0.00 valid_solid · solid invalid 1.1k 9.0s
openai-direct-gpt-4o-mini 20260428T213541Z-5bba fail 0.00 valid_solid · solid invalid 1.1k 8.4s
claude-direct-claude-sonnet-4-6 20260428T212146Z-13c6 PASS 1.00 1.1k 4.8s
claude-direct-claude-sonnet-4-6 20260428T212140Z-1b0c PASS 1.00 1.1k 5.2s
claude-direct-claude-sonnet-4-6 20260428T212135Z-3f9d PASS 1.00 1.1k 5.2s
claude-direct-claude-sonnet-4-6 20260428T212130Z-0a6d PASS 1.00 1.1k 5.3s
claude-direct-claude-sonnet-4-6 20260428T212125Z-da0f PASS 1.00 1.1k 4.5s
claude-direct-claude-opus-4-7 20260428T212006Z-d872 PASS 1.00 1.4k 4.9s
claude-direct-claude-opus-4-7 20260428T212001Z-8a2e PASS 1.00 1.4k 4.8s
claude-direct-claude-opus-4-7 20260428T211956Z-80cb PASS 1.00 1.4k 4.8s
claude-direct-claude-opus-4-7 20260428T211951Z-ec4f PASS 1.00 1.3k 4.8s
claude-direct-claude-opus-4-7 20260428T211946Z-9f4a PASS 1.00 1.4k 5.0s
claude-direct-claude-haiku-4-5-20251001 20260428T211832Z-86c4 fail 0.00 valid_solid · solid invalid 1.3k 2.9s
claude-direct-claude-haiku-4-5-20251001 20260428T211829Z-08f1 fail 0.00 valid_solid · solid invalid 1.3k 3.2s
claude-direct-claude-haiku-4-5-20251001 20260428T211826Z-469f fail 0.00 valid_solid · solid invalid 1.3k 3.0s
claude-direct-claude-haiku-4-5-20251001 20260428T211823Z-fb15 fail 0.00 valid_solid · solid invalid 1.3k 3.2s
claude-direct-claude-haiku-4-5-20251001 20260428T211820Z-cc19 fail 0.00 valid_solid · solid invalid 1.3k 3.1s

generated 2026-06-17T03:16:07.204Z · static site, regenerate with npm run build -w @mecheval/leaderboard