← mecheval / run / a4-rectangular-tube-01 / claude-direct-claude-haiku-4-5-20251001 / 20260429T120222Z-798b

run 20260429T120222Z-798b

a4-rectangular-tube-01 · claude-direct-claude-haiku-4-5-20251001

Summary

statusfail
score0.00 (0/4)
submissionself-run
modelclaude-direct-claude-haiku-4-5-20251001 (anthropic)
started2026-04-29T12:02:22.856Z
ended2026-04-29T12:02:24.949Z
tokens736 in · 433 out · 1,169 total
wallclock2.1s
tool calls1
task hash26b7bf3bb00bfe80…
vcad hash2245d4be24a21d7e…

Prompt

Make a hollow square tube. The outer cross-section is a 40mm × 40mm square; the inner cavity is a 28mm × 28mm square, concentric with the outer. The cavity passes all the way through. The tube is 80mm long along Z, with the bottom face on the XY plane (so it spans x in [-20, 20], y in [-20, 20], z in [0, 80] for the outer envelope). The inner cavity spans x in [-14, 14], y in [-14, 14], z in [0, 80]. Wall thickness is 6mm uniformly. Output a single solid.

Checks

0
valid_solid
fail
solid invalid
params + details
params: {
  "type": "valid_solid"
}

details: {
  "error": "parse: Invalid JSON vcad file: invalid value: expected key to be a number in quotes at line 4 column 5",
  "reason": "fatal evaluation error"
}
1
bbox
fail
? off by 0.00mm
params + details
params: {
  "type": "bbox",
  "min": [
    -20,
    -20,
    0
  ],
  "max": [
    20,
    20,
    80
  ],
  "tolerance_mm": 0.05
}

details: {
  "reason": "no valid solid to measure"
}
2
mass_props
fail
mass props off
params + details
params: {
  "type": "mass_props",
  "volume_mm3": 65280,
  "center_of_mass": [
    0,
    0,
    40
  ],
  "tolerance_pct": 0.5
}

details: {
  "reason": "no valid solid to measure"
}
3
step_roundtrip
fail
STEP roundtrip failed
params + details
params: {
  "type": "step_roundtrip",
  "tolerance_pct": 0.5
}

details: {
  "reason": "no valid solid to round-trip"
}

Tool calls

0
anthropic.messages.create
ok
2084ms
args
{
  "model": "claude-haiku-4-5-20251001",
  "max_tokens": 8000,
  "system_chars": 1674,
  "user_chars": 524
}

What the model built

no render available — vcad-render did not produce geometry for this attempt

.vcad source

{
  "version": "0.1",
  "nodes": {
    "outer_cube": {
      "id": 0,
      "name": "outer_cube",
      "op": {
        "type": "Cube",
        "size": {"x": 40, "y": 40, "z": 80}
      }
    },
    "outer_centered": {
      "id": 1,
      "name": "outer_centered",
      "op": {
        "type": "Translate",
        "child": 0,
        "offset": {"x": -20, "y": -20, "z": 0}
      }
    },
    "inner_cube": {
      "id": 2,
      "name": "inner_cube",
      "op": {
        "type": "Cube",
        "size": {"x": 28, "y": 28, "z": 80}
      }
    },
    "inner_centered": {
      "id": 3,
      "name": "inner_centered",
      "op": {
        "type": "Translate",
        "child": 2,
        "offset": {"x": -14, "y": -14, "z": 0}
      }
    },
    "hollow_tube": {
      "id": 4,
      "name": "hollow_tube",
      "op": {
        "type": "Difference",
        "left": 1,
        "right": 3
      }
    }
  },
  "materials": {},
  "part_materials": {},
  "roots": [
    {
      "root": 4,
      "material": "default"
    }
  ]
}

generated 2026-06-19T01:47:56.091Z · static site, regenerate with npm run build -w @mecheval/leaderboard