← mecheval / run / a4-rectangular-tube-01 / claude-direct-claude-haiku-4-5-20251001 / 20260429T120218Z-f865

run 20260429T120218Z-f865

a4-rectangular-tube-01 · claude-direct-claude-haiku-4-5-20251001

Summary

statusfail
score0.00 (0/4)
submissionself-run
modelclaude-direct-claude-haiku-4-5-20251001 (anthropic)
started2026-04-29T12:02:18.177Z
ended2026-04-29T12:02:20.300Z
tokens736 in · 455 out · 1,191 total
wallclock2.1s
tool calls1
task hash26b7bf3bb00bfe80…
vcad hash8168fc3261721349…

Prompt

Make a hollow square tube. The outer cross-section is a 40mm × 40mm square; the inner cavity is a 28mm × 28mm square, concentric with the outer. The cavity passes all the way through. The tube is 80mm long along Z, with the bottom face on the XY plane (so it spans x in [-20, 20], y in [-20, 20], z in [0, 80] for the outer envelope). The inner cavity spans x in [-14, 14], y in [-14, 14], z in [0, 80]. Wall thickness is 6mm uniformly. Output a single solid.

Checks

0
valid_solid
fail
solid invalid
params + details
params: {
  "type": "valid_solid"
}

details: {
  "error": "parse: Invalid JSON vcad file: invalid value: expected key to be a number in quotes at line 4 column 5",
  "reason": "fatal evaluation error"
}
1
bbox
fail
? off by 0.00mm
params + details
params: {
  "type": "bbox",
  "min": [
    -20,
    -20,
    0
  ],
  "max": [
    20,
    20,
    80
  ],
  "tolerance_mm": 0.05
}

details: {
  "reason": "no valid solid to measure"
}
2
mass_props
fail
mass props off
params + details
params: {
  "type": "mass_props",
  "volume_mm3": 65280,
  "center_of_mass": [
    0,
    0,
    40
  ],
  "tolerance_pct": 0.5
}

details: {
  "reason": "no valid solid to measure"
}
3
step_roundtrip
fail
STEP roundtrip failed
params + details
params: {
  "type": "step_roundtrip",
  "tolerance_pct": 0.5
}

details: {
  "reason": "no valid solid to round-trip"
}

Tool calls

0
anthropic.messages.create
ok
2114ms
args
{
  "model": "claude-haiku-4-5-20251001",
  "max_tokens": 8000,
  "system_chars": 1674,
  "user_chars": 524
}

What the model built

no render available — vcad-render did not produce geometry for this attempt

.vcad source

{
  "version": "0.1",
  "nodes": {
    "outer_cube": {
      "id": "outer_cube",
      "name": "Outer cube",
      "op": {
        "type": "Cube",
        "size": {"x": 40, "y": 40, "z": 80}
      }
    },
    "outer_centered": {
      "id": "outer_centered",
      "name": "Outer cube centered",
      "op": {
        "type": "Translate",
        "child": "outer_cube",
        "offset": {"x": -20, "y": -20, "z": 0}
      }
    },
    "inner_cube": {
      "id": "inner_cube",
      "name": "Inner cube",
      "op": {
        "type": "Cube",
        "size": {"x": 28, "y": 28, "z": 80}
      }
    },
    "inner_centered": {
      "id": "inner_centered",
      "name": "Inner cube centered",
      "op": {
        "type": "Translate",
        "child": "inner_cube",
        "offset": {"x": -14, "y": -14, "z": 0}
      }
    },
    "hollow_tube": {
      "id": "hollow_tube",
      "name": "Hollow square tube",
      "op": {
        "type": "Difference",
        "left": "outer_centered",
        "right": "inner_centered"
      }
    }
  },
  "materials": {},
  "part_materials": {},
  "roots": [
    {
      "root": "hollow_tube",
      "material": "default"
    }
  ]
}

generated 2026-06-19T01:47:56.089Z · static site, regenerate with npm run build -w @mecheval/leaderboard