← mecheval / task / a2-mounting-rail-01

Mounting rail with three through-holes A · A2 · a2-mounting-rail-01

rail · multi-hole · boolean

Expected

Prompt

Make a long rectangular mounting rail 100mm long (X) × 20mm wide (Y) × 8mm thick (Z). Center it in X and Y, with the bottom face on the XY plane (z = 0 to z = 8). Drill three through-holes of diameter 6mm, axes parallel to Z, evenly spaced along the centerline (y = 0) at x = -40, x = 0, and x = 40. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -50,
    -10,
    0
  ],
  "max": [
    50,
    10,
    8
  ],
  "tolerance_mm": 0.1
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 15321.42,
  "tolerance_pct": 0.5
}
3
hole_count
{
  "type": "hole_count",
  "diameter_mm": 6,
  "expected": 3,
  "diameter_tolerance_mm": 0.05
}
4
hole_positions
{
  "type": "hole_positions",
  "diameter_mm": 6,
  "positions": [
    [
      -40,
      0,
      0
    ],
    [
      0,
      0,
      0
    ],
    [
      40,
      0,
      0
    ]
  ],
  "tolerance_mm": 0.15
}
5
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 0.5
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 30000,
  "max_wallclock_sec": 180,
  "max_tool_calls": 30
}

Recent attempts

Runs (35)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T174742Z-1b14 fail 0.83 mass_props · volume off by 120.6% 560.3k 227.1s
claude-mcp-claude-opus-4-7 20260611T174712Z-c23c PASS 1.00 348.8k 83.5s
claude-mcp-claude-opus-4-7 20260611T174710Z-648a fail 0.33 bbox · X off by -47.00mm 581.8k 236.3s
claude-mcp-claude-opus-4-7 20260611T174549Z-9e47 fail 0.33 bbox · X off by +50.00mm 610.0k 112.9s
claude-mcp-claude-opus-4-7 20260611T174530Z-8b41 PASS 1.00 498.0k 102.3s
openai-direct-gpt-5 20260428T214847Z-4ccb PASS 1.00 2.6k 20.2s
openai-direct-gpt-5 20260428T214826Z-c220 PASS 1.00 2.4k 20.1s
openai-direct-gpt-5 20260428T214804Z-6baa PASS 1.00 2.5k 22.8s
openai-direct-gpt-5 20260428T214741Z-0fad PASS 1.00 2.8k 22.1s
openai-direct-gpt-5 20260428T214716Z-dcbb PASS 1.00 3.0k 25.4s
openai-direct-gpt-5-mini 20260428T214626Z-2d24 PASS 1.00 2.3k 14.7s
openai-direct-gpt-5-mini 20260428T214607Z-010f PASS 1.00 2.6k 18.8s
openai-direct-gpt-5-mini 20260428T214549Z-a7e7 PASS 1.00 2.4k 17.9s
openai-direct-gpt-5-mini 20260428T214529Z-d6a9 PASS 1.00 2.2k 20.1s
openai-direct-gpt-5-mini 20260428T214500Z-6e7a PASS 1.00 2.2k 28.3s
openai-direct-gpt-4o-mini 20260428T213416Z-475d fail 0.00 valid_solid · solid invalid 1.2k 9.1s
openai-direct-gpt-4o-mini 20260428T213406Z-444c fail 0.00 valid_solid · solid invalid 1.3k 10.0s
openai-direct-gpt-4o-mini 20260428T213355Z-a142 fail 0.00 valid_solid · solid invalid 1.1k 10.6s
openai-direct-gpt-4o-mini 20260428T213345Z-baa6 fail 0.00 valid_solid · solid invalid 1.3k 9.8s
openai-direct-gpt-4o-mini 20260428T213338Z-8aac fail 0.00 valid_solid · solid invalid 1.1k 6.8s
claude-direct-claude-sonnet-4-6 20260428T212022Z-b484 PASS 1.00 1.3k 5.9s
claude-direct-claude-sonnet-4-6 20260428T212016Z-85ef PASS 1.00 1.3k 6.0s
claude-direct-claude-sonnet-4-6 20260428T212011Z-62cf PASS 1.00 1.3k 5.6s
claude-direct-claude-sonnet-4-6 20260428T212005Z-2fbe PASS 1.00 1.3k 5.7s
claude-direct-claude-sonnet-4-6 20260428T211959Z-a5cd PASS 1.00 1.3k 5.8s
claude-direct-claude-opus-4-7 20260428T211839Z-9560 PASS 1.00 1.6k 6.8s
claude-direct-claude-opus-4-7 20260428T211833Z-911f PASS 1.00 1.6k 6.3s
claude-direct-claude-opus-4-7 20260428T211826Z-e39c PASS 1.00 1.6k 6.9s
claude-direct-claude-opus-4-7 20260428T211819Z-6087 PASS 1.00 1.6k 6.9s
claude-direct-claude-opus-4-7 20260428T211811Z-b71f PASS 1.00 1.6k 7.3s
claude-direct-claude-haiku-4-5-20251001 20260428T211735Z-1456 fail 0.00 valid_solid · solid invalid 1.5k 4.1s
claude-direct-claude-haiku-4-5-20251001 20260428T211731Z-8300 PASS 1.00 1.5k 4.2s
claude-direct-claude-haiku-4-5-20251001 20260428T211727Z-4ff8 fail 0.00 valid_solid · solid invalid 1.6k 4.0s
claude-direct-claude-haiku-4-5-20251001 20260428T211723Z-70d1 fail 0.00 valid_solid · solid invalid 1.6k 3.8s
claude-direct-claude-haiku-4-5-20251001 20260428T211719Z-92bd fail 0.00 valid_solid · solid invalid 1.6k 4.3s

generated 2026-06-17T03:16:07.214Z · static site, regenerate with npm run build -w @mecheval/leaderboard