← mecheval / run / a5-double-d-shaft-01 / claude-mcp-claude-opus-4-7 / 20260611T224017Z-9039

run 20260611T224017Z-9039

a5-double-d-shaft-01 · claude-mcp-claude-opus-4-7

Summary

statusfail
score0.50 (2/4)
submissionself-run
modelclaude-mcp-claude-opus-4-7 (anthropic)
started2026-06-11T22:40:17.181Z
ended2026-06-11T22:42:12.366Z
tokens562,371 in · 5,801 out · 568,172 total
wallclock115.2s
tool calls32
task hashfe39d8a3436856ee…
vcad hash3df6312b95384720…

Prompt

Make a double-D profile shaft as a single solid. Start with a cylinder of diameter 40mm (radius 20mm) and height 60mm, with its base on the XY plane (z = 0 to z = 60), centered on the Z axis. Mill a flat on each side by subtracting a rectangular block from the left and from the right. The left flat is at x = -14: subtract all material at x < -14 (i.e. remove the cylindrical segment from x = -20 to x = -14, running the full height z = 0 to z = 60 and the full cylinder width in Y). The right flat is at x = +14: subtract all material at x > 14. The result is a shaft with flat-to-flat width 28mm and circular arc sections of radius 20mm on the front and back (+Y and -Y sides). Output a single solid.

Checks

0
valid_solid
pass
params + details 
params: {
  "type": "valid_solid"
}

details: {
  "root_count": 2,
  "solids_produced": 2
}
1
bbox
fail
Y off by +30.00mm
params + details 
params: {
  "type": "bbox",
  "min": [
    -14,
    -20,
    0
  ],
  "max": [
    14,
    20,
    60
  ],
  "tolerance_mm": 0.15
}

details: {
  "actual_max": [
    20,
    50,
    62
  ],
  "actual_min": [
    -20,
    -20,
    0
  ],
  "deviation_max": [
    6,
    30,
    2
  ],
  "deviation_min": [
    -6,
    0,
    0
  ],
  "max_abs_deviation_mm": 30,
  "tolerance_mm": 0.15
}
2
mass_props
fail
volume off by 78.7%
params + details 
params: {
  "type": "mass_props",
  "volume_mm3": 61214.28,
  "center_of_mass": [
    0,
    0,
    30
  ],
  "tolerance_pct": 1
}

details: {
  "center_of_mass": {
    "actual": [
      1.714708930832681,
      7.7941315037849135,
      30.311765260151358
    ],
    "bbox_diagonal_mm": 101.70545708072896,
    "deviation": [
      1.714708930832681,
      7.7941315037849135,
      0.31176526015135764
    ],
    "max_abs_deviation_mm": 7.7941315037849135,
    "pass": false,
    "spec": [
      0,
      0,
      30
    ],
    "tolerance_mm": 1.0170545708072896
  },
  "volume": {
    "actual_mm3": 109377.16403502005,
    "deviation_pct": 78.67916446133165,
    "pass": false,
    "spec_mm3": 61214.28,
    "tolerance_pct": 1
  }
}
3
step_roundtrip
pass
params + details 
params: {
  "type": "step_roundtrip",
  "tolerance_pct": 1
}

details: {
  "per_solid": [
    {
      "bbox": {
        "max_abs_deviation_mm": 0,
        "original_max": [
          20,
          20,
          60
        ],
        "original_min": [
          -20,
          -20,
          0
        ],
        "pass": true,
        "roundtripped_max": [
          20,
          20,
          60
        ],
        "roundtripped_min": [
          -20,
          -20,
          0
        ],
        "tolerance_mm": 0.8246211251235321
      },
      "index": 0,
      "pass": true,
      "volume": {
        "deviation_pct": 0.4815275502573938,
        "original_mm3": 75277.16403502005,
        "pass": true,
        "roundtripped_mm3": 74914.68375113897
      }
    },
    {
      "bbox": {
        "max_abs_deviation_mm": 0,
        "original_max": [
          11,
          50,
          62
        ],
        "original_min": [
          0,
          0,
          0
        ],
        "pass": true,
        "roundtripped_max": [
          11,
          50,
          62
        ],
        "roundtripped_min": [
          0,
          0,
          0
        ],
        "tolerance_mm": 0.8040522371090078
      },
      "index": 1,
      "pass": true,
      "volume": {
        "deviation_pct": 0,
        "original_mm3": 34100,
        "pass": true,
        "roundtripped_mm3": 34100
      }
    }
  ],
  "tolerance_pct": 1
}

Tool calls

0
open_document
ok
2ms
args
{}
1
create
err
6ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "difference",
  "name": "Double-D Shaft",
  "params": {
    "children": [
      {
        "type": "translate",
        "params": {
          "x": 0,
          "y": 0,
          "z": 0,
          "child": {
            "type": "cylinder",
            "params": {
              "radius": 20,
              "height": 60
            }
          }
        }
      },
      {
        "type": "translate",
        "params": {
          "x": -25,
          "y": -25,
          "z": -1,
          "child": {
            "type": "cube",
            "params": {
              "x": 11,
              "y": 50,
              "z": 62
            }
          }
        }
      },
      {
        "type": "translate",
        "params": {
          "x": 14,
          "y": -25,
          "z": -1,
          "child": {
            "type": "cube",
            "params": {
              "x": 11,
              "y": 50,
              "z": 62
            }
          }
        }
      }
    ]
  }
}
2
create_cad_loon
ok
15ms
args
{
  "source": "[let shaft [cylinder 20 60]\n  [let left-block [translate -25 -25 -1 [cube 11 50 62]]\n    [let right-block [translate 14 -25 -1 [cube 11 50 62]]\n      [difference right-block [difference left-block shaft]]]]]"
}
3
create
err
4ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cylinder",
  "name": "shaft_blank",
  "params": {
    "radius": 20,
    "height": 60
  }
}
4
create
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cylinder",
  "name": "shaft_blank",
  "params": {
    "radius": 20,
    "height": 60,
    "segments": 64
  }
}
5
create
err
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cube",
  "name": "left_cut_raw",
  "parent_part_id": "1",
  "params": {
    "x": 11,
    "y": 50,
    "z": 62
  }
}
6
read
ok
4ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "1"
}
7
delete
ok
5ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "1"
}
8
create
ok
4ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cube",
  "params": {
    "size": {
      "x": 10,
      "y": 10,
      "z": 10
    }
  }
}
9
delete
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "1"
}
10
create
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cylinder",
  "name": "shaft",
  "params": {
    "radius": 20,
    "height": 60,
    "segments": 64
  }
}
11
create
err
5ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "difference",
  "name": "left_flat",
  "parent_part_id": "1",
  "params": {
    "tool": {
      "type": "Translate",
      "x": -25,
      "y": -25,
      "z": -1,
      "child": {
        "type": "Cube",
        "size": {
          "x": 11,
          "y": 50,
          "z": 62
        }
      }
    }
  }
}
12
create
err
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "difference",
  "name": "left_flat",
  "parent_part_id": "1",
  "params": {
    "right": {
      "type": "Translate",
      "x": -25,
      "y": -25,
      "z": -1,
      "child": {
        "type": "Cube",
        "size": {
          "x": 11,
          "y": 50,
          "z": 62
        }
      }
    }
  }
}
13
delete
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "1"
}
14
create_cad_loon
ok
7ms
args
{
  "source": "[difference \n  [translate 14 -25 -1 [cube 11 50 62]]\n  [difference \n    [translate -25 -25 -1 [cube 11 50 62]]\n    [cylinder 20 60]]]"
}
15
create
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cylinder",
  "name": "shaft_blank",
  "params": {
    "radius": 20,
    "height": 60,
    "segments": 64
  }
}
16
create
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cube",
  "name": "left_block_raw",
  "parent_part_id": "1",
  "params": {
    "size": {
      "x": 11,
      "y": 50,
      "z": 62
    }
  }
}
17
read
ok
3ms
args
{
  "document_id": "doc_1781217617354_1"
}
18
delete
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "1"
}
19
delete
ok
2ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "2"
}
20
create
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cylinder",
  "name": "shaft_blank",
  "params": {
    "radius": 20,
    "height": 60,
    "segments": 64
  }
}
21
create
err
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "difference",
  "name": "cut_left",
  "parent_part_id": "1",
  "params": {
    "tool": {
      "type": "translate",
      "params": {
        "x": -25,
        "y": -25,
        "z": -1,
        "child": {
          "type": "cube",
          "params": {
            "size": {
              "x": 11,
              "y": 50,
              "z": 62
            }
          }
        }
      }
    }
  }
}
22
create
err
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "difference",
  "name": "cut_left",
  "parent_part_id": "1",
  "params": {
    "left": 1,
    "right": {
      "type": "translate",
      "params": {
        "x": -25,
        "y": -25,
        "z": -1,
        "child": {
          "type": "cube",
          "params": {
            "size": {
              "x": 11,
              "y": 50,
              "z": 62
            }
          }
        }
      }
    }
  }
}
23
create
ok
1ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cube",
  "name": "left_block",
  "parent_part_id": "1",
  "params": {
    "size": {
      "x": 11,
      "y": 50,
      "z": 62
    }
  }
}
24
read
ok
2ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "1"
}
25
read
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "2"
}
26
delete
ok
2ms
args
{
  "document_id": "doc_1781217617354_1",
  "part_id": "2"
}
27
create
err
4ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "translate",
  "name": "tr_left",
  "parent_part_id": "1",
  "params": {
    "x": 0,
    "y": 0,
    "z": 0
  }
}
28
create
ok
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "cube",
  "name": "left_block_raw",
  "params": {
    "size": {
      "x": 11,
      "y": 50,
      "z": 62
    }
  }
}
29
create
err
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "translate",
  "name": "left_block",
  "parent_part_id": "2",
  "params": {
    "x": -25,
    "y": -25,
    "z": -1
  }
}
30
create
err
3ms
args
{
  "document_id": "doc_1781217617354_1",
  "type": "translate",
  "name": "left_block",
  "parent_part_id": "2",
  "params": {
    "x": -25,
    "y": -25,
    "z": -1,
    "child": 2
  }
}
31
get_document
ok
1ms
args
{
  "document_id": "doc_1781217617354_1"
}

What the model built

isometric render via vcad-render · the model's actual .vcad output, faceted at 28 segments per cylinder · download 20260611T224017Z-9039.vcad

.vcad source

{
  "version": "0.1",
  "nodes": {
    "1": {
      "id": 1,
      "name": "shaft_blank",
      "op": {
        "type": "Cylinder",
        "radius": 20,
        "height": 60,
        "segments": 64
      }
    },
    "2": {
      "id": 2,
      "name": "left_block_raw",
      "op": {
        "type": "Cube",
        "size": {
          "x": 11,
          "y": 50,
          "z": 62
        }
      }
    }
  },
  "materials": {},
  "part_materials": {},
  "roots": [
    {
      "root": 1,
      "material": "default"
    },
    {
      "root": 2,
      "material": "default"
    }
  ]
}
mecheval · an evaluation suite by Municipal Robotics
sibling project: vcad. · github

generated 2026-06-19T01:47:56.204Z · static site, regenerate with npm run build -w @mecheval/leaderboard