← mecheval / run / a4-rectangular-tube-01 / claude-direct-claude-haiku-4-5-20251001 / 20260429T120220Z-293c

run 20260429T120220Z-293c

a4-rectangular-tube-01 · claude-direct-claude-haiku-4-5-20251001

Summary

statusfail
score0.00 (0/4)
submissionself-run
modelclaude-direct-claude-haiku-4-5-20251001 (anthropic)
started2026-04-29T12:02:20.404Z
ended2026-04-29T12:02:22.759Z
tokens736 in · 463 out · 1,199 total
wallclock2.3s
tool calls1
task hash26b7bf3bb00bfe80…
vcad hash13924792106b39cd…

Prompt

Make a hollow square tube. The outer cross-section is a 40mm × 40mm square; the inner cavity is a 28mm × 28mm square, concentric with the outer. The cavity passes all the way through. The tube is 80mm long along Z, with the bottom face on the XY plane (so it spans x in [-20, 20], y in [-20, 20], z in [0, 80] for the outer envelope). The inner cavity spans x in [-14, 14], y in [-14, 14], z in [0, 80]. Wall thickness is 6mm uniformly. Output a single solid.

Checks

0
valid_solid
fail
solid invalid
params + details
params: {
  "type": "valid_solid"
}

details: {
  "error": "parse: Invalid JSON vcad file: invalid value: expected key to be a number in quotes at line 4 column 5",
  "reason": "fatal evaluation error"
}
1
bbox
fail
? off by 0.00mm
params + details
params: {
  "type": "bbox",
  "min": [
    -20,
    -20,
    0
  ],
  "max": [
    20,
    20,
    80
  ],
  "tolerance_mm": 0.05
}

details: {
  "reason": "no valid solid to measure"
}
2
mass_props
fail
mass props off
params + details
params: {
  "type": "mass_props",
  "volume_mm3": 65280,
  "center_of_mass": [
    0,
    0,
    40
  ],
  "tolerance_pct": 0.5
}

details: {
  "reason": "no valid solid to measure"
}
3
step_roundtrip
fail
STEP roundtrip failed
params + details
params: {
  "type": "step_roundtrip",
  "tolerance_pct": 0.5
}

details: {
  "reason": "no valid solid to round-trip"
}

Tool calls

0
anthropic.messages.create
ok
2341ms
args
{
  "model": "claude-haiku-4-5-20251001",
  "max_tokens": 8000,
  "system_chars": 1674,
  "user_chars": 524
}

What the model built

no render available — vcad-render did not produce geometry for this attempt

.vcad source

{
  "version": "0.1",
  "nodes": {
    "outer_cube": {
      "id": "outer_cube",
      "name": "Outer cube",
      "op": {
        "type": "Cube",
        "size": {"x": 40, "y": 40, "z": 80}
      }
    },
    "outer_translated": {
      "id": "outer_translated",
      "name": "Outer cube centered in XY",
      "op": {
        "type": "Translate",
        "child": "outer_cube",
        "offset": {"x": -20, "y": -20, "z": 0}
      }
    },
    "inner_cube": {
      "id": "inner_cube",
      "name": "Inner cavity cube",
      "op": {
        "type": "Cube",
        "size": {"x": 28, "y": 28, "z": 80}
      }
    },
    "inner_translated": {
      "id": "inner_translated",
      "name": "Inner cavity cube centered in XY",
      "op": {
        "type": "Translate",
        "child": "inner_cube",
        "offset": {"x": -14, "y": -14, "z": 0}
      }
    },
    "hollow_tube": {
      "id": "hollow_tube",
      "name": "Hollow rectangular tube",
      "op": {
        "type": "Difference",
        "left": "outer_translated",
        "right": "inner_translated"
      }
    }
  },
  "materials": {},
  "part_materials": {},
  "roots": [
    {
      "root": "hollow_tube",
      "material": "default"
    }
  ]
}

generated 2026-06-19T01:47:56.090Z · static site, regenerate with npm run build -w @mecheval/leaderboard