← mecheval / task / a4-x-frame-01

Cross frame from two perpendicular bars A · A4 · a4-x-frame-01

frame · cross · union · boolean · advanced

Expected

Prompt

Make a cross-shaped frame in the XY plane by fusing two rectangular bars at right angles. Bar A is 100mm long along X, 20mm wide along Y, and 10mm tall along Z, centered in X and Y with its bottom face on the XY plane (so it spans x in [-50, 50], y in [-10, 10], z in [0, 10]). Bar B is 20mm wide along X, 100mm long along Y, and 10mm tall along Z, centered in X and Y with its bottom face on the XY plane (so it spans x in [-10, 10], y in [-50, 50], z in [0, 10]). Union the two bars into a single plus-sign-shaped solid; the central 20mm × 20mm × 10mm overlap is counted only once. Output a single solid.

Checks

0
valid_solid
{
  "type": "valid_solid"
}
1
bbox
{
  "type": "bbox",
  "min": [
    -50,
    -50,
    0
  ],
  "max": [
    50,
    50,
    10
  ],
  "tolerance_mm": 0.05
}
2
mass_props
{
  "type": "mass_props",
  "volume_mm3": 36000,
  "center_of_mass": [
    0,
    0,
    5
  ],
  "tolerance_pct": 0.5
}
3
step_roundtrip
{
  "type": "step_roundtrip",
  "tolerance_pct": 0.5
}

Anti-cheese

{
  "max_solid_count": 1
}

Limits

{
  "max_tokens": 40000,
  "max_wallclock_sec": 240,
  "max_tool_calls": 40
}

Recent attempts

Runs (21)

modelrun statusscorefirst failtokenswall
claude-mcp-claude-opus-4-7 20260611T223630Z-73f7 PASS 1.00 267.1k 57.1s
claude-mcp-claude-opus-4-7 20260611T223601Z-8bfa PASS 1.00 283.2k 47.9s
claude-mcp-claude-opus-4-7 20260611T223549Z-641d PASS 1.00 241.6k 40.4s
claude-mcp-claude-opus-4-7 20260611T223535Z-7f28 PASS 1.00 574.1k 91.0s
claude-mcp-claude-opus-4-7 20260611T223507Z-fc6f PASS 1.00 246.8k 42.5s
claude-direct-claude-opus-4-7 20260429T120529Z-c230 PASS 1.00 1.4k 4.4s
claude-direct-claude-sonnet-4-6 20260429T120529Z-56ba PASS 1.00 1.2k 3.7s
claude-direct-claude-opus-4-7 20260429T120524Z-c5b7 PASS 1.00 1.4k 4.4s
claude-direct-claude-sonnet-4-6 20260429T120523Z-3f5c PASS 1.00 1.2k 6.5s
claude-direct-claude-sonnet-4-6 20260429T120519Z-e5b7 PASS 1.00 1.2k 3.9s
claude-direct-claude-opus-4-7 20260429T120519Z-8621 PASS 1.00 1.4k 4.6s
claude-direct-claude-sonnet-4-6 20260429T120515Z-9923 PASS 1.00 1.2k 4.0s
claude-direct-claude-opus-4-7 20260429T120514Z-fbd7 PASS 1.00 1.4k 5.2s
claude-direct-claude-sonnet-4-6 20260429T120511Z-8649 PASS 1.00 1.1k 3.4s
claude-direct-claude-opus-4-7 20260429T120509Z-b120 PASS 1.00 1.4k 4.8s
claude-direct-claude-haiku-4-5-20251001 20260429T120400Z-7f59 fail 0.00 valid_solid · solid invalid 1.2k 2.2s
claude-direct-claude-haiku-4-5-20251001 20260429T120358Z-8075 fail 0.00 valid_solid · solid invalid 1.3k 2.3s
claude-direct-claude-haiku-4-5-20251001 20260429T120355Z-9322 PASS 1.00 1.2k 2.3s
claude-direct-claude-haiku-4-5-20251001 20260429T120350Z-7599 fail 0.00 valid_solid · solid invalid 1.2k 4.9s
claude-direct-claude-haiku-4-5-20251001 20260429T120348Z-5e51 fail 0.00 valid_solid · solid invalid 1.3k 2.4s
claude-direct-claude-haiku-4-5-20251001 20260429T120057Z-41aa fail 0.00 valid_solid · solid invalid 1.2k 3.3s

generated 2026-06-17T03:16:07.257Z · static site, regenerate with npm run build -w @mecheval/leaderboard