← mecheval / model / claude-direct-claude-opus-4-7

claude-direct-claude-opus-4-7

216 run blobs across 37 tasks

All runs

taskrun statusscorefirst failtokenswall
a4-rounded-bar-01 20260429T120654Z-e23a PASS 1.00 — 1.5k 5.0s
a4-rounded-bar-01 20260429T120648Z-5e06 PASS 1.00 — 1.5k 6.0s
a4-rounded-bar-01 20260429T120643Z-5d96 PASS 1.00 — 1.5k 5.1s
a4-rounded-bar-01 20260429T120638Z-ddc6 PASS 1.00 — 1.5k 5.0s
a4-rounded-bar-01 20260429T120632Z-b1dd PASS 1.00 — 1.5k 5.1s
a4-bolt-circle-flange-with-bore-01 20260429T120621Z-8698 PASS 1.00 — 2.1k 9.9s
a4-bolt-circle-flange-with-bore-01 20260429T120608Z-6050 PASS 1.00 — 2.3k 11.2s
a4-bolt-circle-flange-with-bore-01 20260429T120556Z-3633 PASS 1.00 — 2.3k 10.3s
a4-bolt-circle-flange-with-bore-01 20260429T120546Z-2cc1 PASS 1.00 — 2.1k 9.4s
a4-bolt-circle-flange-with-bore-01 20260429T120533Z-dc14 PASS 1.00 — 2.4k 10.9s
a4-x-frame-01 20260429T120529Z-c230 PASS 1.00 — 1.4k 4.4s
a4-x-frame-01 20260429T120524Z-c5b7 PASS 1.00 — 1.4k 4.4s
a4-x-frame-01 20260429T120519Z-8621 PASS 1.00 — 1.4k 4.6s
a4-x-frame-01 20260429T120514Z-fbd7 PASS 1.00 — 1.4k 5.2s
a4-x-frame-01 20260429T120509Z-b120 PASS 1.00 — 1.4k 4.8s
a4-stepped-pyramid-with-holes-01 20260429T120459Z-ee4c PASS 1.00 — 2.2k 9.8s
a4-stepped-pyramid-with-holes-01 20260429T120450Z-ff11 PASS 1.00 — 2.1k 8.8s
a4-stepped-pyramid-with-holes-01 20260429T120440Z-2613 fail 0.83 step_roundtrip · STEP drift on 1/1 solid 2.2k 9.4s
a4-stepped-pyramid-with-holes-01 20260429T120430Z-af74 PASS 1.00 — 2.2k 10.6s
a4-stepped-pyramid-with-holes-01 20260429T120420Z-7572 fail 0.83 step_roundtrip · STEP drift on 1/1 solid 2.2k 9.8s
a4-slotted-bracket-01 20260429T120412Z-c796 fail 0.83 mass_props · volume off by 1.9% 1.7k 7.1s
a4-slotted-bracket-01 20260429T120404Z-a94e fail 0.83 mass_props · volume off by 1.9% 1.7k 7.9s
a4-slotted-bracket-01 20260429T120357Z-ce24 fail 0.83 mass_props · volume off by 1.9% 1.7k 7.1s
a4-slotted-bracket-01 20260429T120350Z-d857 fail 0.83 mass_props · volume off by 1.9% 1.7k 7.2s
a4-slotted-bracket-01 20260429T120342Z-79e2 fail 0.83 mass_props · volume off by 1.9% 1.7k 7.4s
a4-flanged-shaft-01 20260429T120332Z-87b8 PASS 1.00 — 2.0k 8.8s
a4-flanged-shaft-01 20260429T120320Z-9e8b PASS 1.00 — 2.1k 11.5s
a4-flanged-shaft-01 20260429T120309Z-545f PASS 1.00 — 2.1k 9.5s
a4-flanged-shaft-01 20260429T120259Z-93fe PASS 1.00 — 1.9k 9.1s
a4-flanged-shaft-01 20260429T120248Z-8807 PASS 1.00 — 2.0k 9.9s
a4-rectangular-tube-01 20260429T120244Z-b822 PASS 1.00 — 1.3k 4.5s
a4-rectangular-tube-01 20260429T120239Z-2d8e PASS 1.00 — 1.3k 4.7s
a4-rectangular-tube-01 20260429T120235Z-edd2 PASS 1.00 — 1.3k 4.0s
a4-rectangular-tube-01 20260429T120230Z-4c47 PASS 1.00 — 1.3k 4.3s
a4-rectangular-tube-01 20260429T120226Z-6a3e PASS 1.00 — 1.3k 4.4s
a4-counterbore-plate-01 20260429T120212Z-f6e6 PASS 1.00 — 2.5k 13.0s
a4-counterbore-plate-01 20260429T120159Z-74ce PASS 1.00 — 2.5k 13.3s
a4-counterbore-plate-01 20260429T120146Z-866a PASS 1.00 — 2.5k 12.3s
a4-counterbore-plate-01 20260429T120133Z-dcba PASS 1.00 — 2.5k 12.7s
a4-counterbore-plate-01 20260429T120120Z-2865 PASS 1.00 — 2.5k 12.1s
a3-spherical-dome-block-01 20260428T235643Z-fe76 PASS 1.00 — 1.6k 6.0s
a3-spherical-dome-block-01 20260428T232209Z-3ad6 PASS 1.00 — 1.6k 5.3s
a3-spherical-dome-block-01 20260428T232204Z-8c54 PASS 1.00 — 1.6k 5.0s
a3-spherical-dome-block-01 20260428T232158Z-d717 PASS 1.00 — 1.6k 5.2s
a3-spherical-dome-block-01 20260428T232152Z-2718 PASS 1.00 — 1.6k 6.0s
a3-spherical-dome-block-01 20260428T232147Z-0174 PASS 1.00 — 1.6k 5.0s
a3-three-tangent-cylinders-01 20260428T232142Z-f7fb PASS 1.00 — 1.5k 5.5s
a3-three-tangent-cylinders-01 20260428T232135Z-96db PASS 1.00 — 1.6k 6.9s
a3-three-tangent-cylinders-01 20260428T232129Z-a884 PASS 1.00 — 1.5k 5.7s
a3-three-tangent-cylinders-01 20260428T232119Z-5f8e PASS 1.00 — 1.8k 9.7s
a3-three-tangent-cylinders-01 20260428T232113Z-93a1 PASS 1.00 — 1.6k 5.6s
a3-hex-bolt-pattern-01 20260428T232104Z-76c0 PASS 1.00 — 2.0k 8.9s
a3-hex-bolt-pattern-01 20260428T232054Z-978b PASS 1.00 — 2.1k 9.5s
a3-hex-bolt-pattern-01 20260428T232045Z-c7d0 PASS 1.00 — 2.0k 8.7s
a3-hex-bolt-pattern-01 20260428T232034Z-a9c2 PASS 1.00 — 2.4k 11.2s
a3-hex-bolt-pattern-01 20260428T232024Z-e18f PASS 1.00 — 2.0k 9.8s
a3-cross-shaft-01 20260428T232020Z-9c1f fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.3k 3.8s
a3-cross-shaft-01 20260428T232016Z-cdfb fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.3k 4.1s
a3-cross-shaft-01 20260428T232011Z-6c4b fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.4k 4.1s
a3-cross-shaft-01 20260428T232006Z-dd44 fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.4k 4.7s
a3-cross-shaft-01 20260428T232002Z-8cb9 fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.4k 4.5s
a3-octagonal-flange-01 20260428T231950Z-197e fail 0.83 bbox · X off by -1.65mm 2.3k 11.2s
a3-octagonal-flange-01 20260428T231926Z-6a9d fail 0.67 bbox · X off by -1.65mm 4.2k 23.9s
a3-octagonal-flange-01 20260428T231915Z-f8c3 fail 0.67 bbox · Y off by +1.65mm 2.2k 10.2s
a3-octagonal-flange-01 20260428T231851Z-fef7 fail 0.67 bbox · X off by -1.65mm 4.1k 23.3s
a3-octagonal-flange-01 20260428T231836Z-5683 fail 0.67 bbox · X off by +8.35mm 2.8k 14.3s
a3-tangent-cylinders-01 20260428T213854Z-da01 PASS 1.00 — 1.3k 3.9s
a3-tangent-cylinders-01 20260428T213850Z-7039 PASS 1.00 — 1.2k 3.4s
a3-tangent-cylinders-01 20260428T213844Z-7dbd PASS 1.00 — 1.3k 5.8s
a3-tangent-cylinders-01 20260428T213840Z-a9e2 PASS 1.00 — 1.3k 4.1s
a3-tangent-cylinders-01 20260428T213833Z-cba8 PASS 1.00 — 1.2k 6.6s
a3-rotated-block-01 20260428T213829Z-25be PASS 1.00 — 1.2k 3.8s
a3-rotated-block-01 20260428T213826Z-a0d0 PASS 1.00 — 1.2k 3.3s
a3-rotated-block-01 20260428T213822Z-6ee2 PASS 1.00 — 1.2k 3.6s
a3-rotated-block-01 20260428T213819Z-b1fd PASS 1.00 — 1.2k 3.3s
a3-rotated-block-01 20260428T213816Z-8d67 PASS 1.00 — 1.2k 3.3s
a3-pentagonal-prism-01 20260428T213748Z-fa85 PASS 1.00 — 3.7k 27.5s
a3-pentagonal-prism-01 20260428T213725Z-a341 PASS 1.00 — 3.0k 22.8s
a3-pentagonal-prism-01 20260428T213701Z-88a6 PASS 1.00 — 3.1k 23.9s
a3-pentagonal-prism-01 20260428T213634Z-0517 PASS 1.00 — 3.2k 26.6s
a3-pentagonal-prism-01 20260428T213613Z-6877 PASS 1.00 — 2.9k 21.4s
a3-hex-nut-01 20260428T213607Z-58f2 fail 0.33 bbox · X off by +5.97mm 1.4k 5.6s
a3-hex-nut-01 20260428T213556Z-9daf PASS 1.00 — 1.9k 11.2s
a3-hex-nut-01 20260428T213552Z-1d97 fail 0.67 bbox · Y off by +1.46mm 1.2k 3.5s
a3-hex-nut-01 20260428T213548Z-e2e0 fail 0.67 bbox · Y off by +1.46mm 1.3k 4.2s
a3-hex-nut-01 20260428T213544Z-4764 fail 0.67 bbox · Y off by +1.46mm 1.3k 4.3s
a3-tangent-cylinders-01 20260428T213406Z-6dc9 PASS 1.00 — 1.2k 3.9s
a3-tangent-cylinders-01 20260428T213403Z-98ee PASS 1.00 — 1.2k 3.5s
a3-tangent-cylinders-01 20260428T213359Z-f60d PASS 1.00 — 1.2k 3.8s
a3-tangent-cylinders-01 20260428T213355Z-c70f PASS 1.00 — 1.3k 3.9s
a3-tangent-cylinders-01 20260428T213351Z-42cf PASS 1.00 — 1.2k 3.7s
a3-rotated-block-01 20260428T213347Z-1d93 fail 0.00 valid_solid · solid invalid 1.2k 3.7s
a3-rotated-block-01 20260428T213343Z-c874 fail 0.00 valid_solid · solid invalid 1.2k 3.9s
a3-rotated-block-01 20260428T213340Z-0394 fail 0.00 valid_solid · solid invalid 1.2k 3.7s
a3-rotated-block-01 20260428T213336Z-1ad2 fail 0.00 valid_solid · solid invalid 1.2k 4.0s
a3-rotated-block-01 20260428T213331Z-e869 fail 0.00 valid_solid · solid invalid 1.2k 4.1s
a3-pentagonal-prism-01 20260428T213327Z-164e fail 0.00 valid_solid · solid invalid 1.3k 4.2s
a3-pentagonal-prism-01 20260428T213323Z-5f49 fail 0.00 valid_solid · solid invalid 1.3k 4.5s
a3-pentagonal-prism-01 20260428T213318Z-ecee fail 0.00 valid_solid · solid invalid 1.3k 4.6s
a3-pentagonal-prism-01 20260428T213312Z-ebb9 fail 0.00 valid_solid · solid invalid 1.3k 5.7s
a3-pentagonal-prism-01 20260428T213307Z-65fd fail 0.00 valid_solid · solid invalid 1.3k 4.6s
a3-hex-nut-01 20260428T213254Z-0c6a fail 0.00 valid_solid · solid invalid 2.6k 13.8s
a3-hex-nut-01 20260428T213249Z-d031 fail 0.00 valid_solid · solid invalid 1.3k 4.4s
a3-hex-nut-01 20260428T213242Z-28df fail 0.00 valid_solid · solid invalid 1.7k 7.3s
a3-hex-nut-01 20260428T213238Z-88b8 fail 0.00 valid_solid · solid invalid 1.2k 3.9s
a3-hex-nut-01 20260428T213231Z-7d62 fail 0.00 valid_solid · solid invalid 1.2k 6.7s
a2-stepped-pyramid-01 20260428T212114Z-ee56 PASS 1.00 — 1.5k 5.2s
a2-stepped-pyramid-01 20260428T212108Z-de73 PASS 1.00 — 1.5k 6.1s
a2-stepped-pyramid-01 20260428T212103Z-9c86 PASS 1.00 — 1.5k 4.9s
a2-stepped-pyramid-01 20260428T212057Z-c52b PASS 1.00 — 1.5k 5.4s
a2-stepped-pyramid-01 20260428T212052Z-9d54 PASS 1.00 — 1.5k 5.0s
a2-cube-with-pocket-01 20260428T212048Z-8693 PASS 1.00 — 1.3k 4.1s
a2-cube-with-pocket-01 20260428T212044Z-7e1e PASS 1.00 — 1.3k 4.0s
a2-cube-with-pocket-01 20260428T212040Z-21d0 PASS 1.00 — 1.3k 4.3s
a2-cube-with-pocket-01 20260428T212036Z-9151 PASS 1.00 — 1.3k 4.0s
a2-cube-with-pocket-01 20260428T212032Z-a580 PASS 1.00 — 1.3k 4.1s
a2-stepped-block-01 20260428T212027Z-c240 PASS 1.00 — 1.2k 4.2s
a2-stepped-block-01 20260428T212023Z-5717 PASS 1.00 — 1.3k 4.2s
a2-stepped-block-01 20260428T212019Z-9a3f PASS 1.00 — 1.3k 4.0s
a2-stepped-block-01 20260428T212015Z-22d6 PASS 1.00 — 1.3k 4.1s
a2-stepped-block-01 20260428T212011Z-aa4a PASS 1.00 — 1.3k 4.1s
a2-channel-bracket-01 20260428T212006Z-d872 PASS 1.00 — 1.4k 4.9s
a2-channel-bracket-01 20260428T212001Z-8a2e PASS 1.00 — 1.4k 4.8s
a2-channel-bracket-01 20260428T211956Z-80cb PASS 1.00 — 1.4k 4.8s
a2-channel-bracket-01 20260428T211951Z-ec4f PASS 1.00 — 1.3k 4.8s
a2-channel-bracket-01 20260428T211946Z-9f4a PASS 1.00 — 1.4k 5.0s
a2-bolt-circle-block-01 20260428T211933Z-0826 PASS 1.00 — 2.5k 12.0s
a2-bolt-circle-block-01 20260428T211923Z-2c85 PASS 1.00 — 2.1k 10.1s
a2-bolt-circle-block-01 20260428T211910Z-f2d1 PASS 1.00 — 2.5k 12.3s
a2-bolt-circle-block-01 20260428T211859Z-1964 PASS 1.00 — 2.1k 9.9s
a2-bolt-circle-block-01 20260428T211846Z-b5f4 PASS 1.00 — 2.5k 12.7s
a2-mounting-rail-01 20260428T211839Z-9560 PASS 1.00 — 1.6k 6.8s
a2-mounting-rail-01 20260428T211833Z-911f PASS 1.00 — 1.6k 6.3s
a2-mounting-rail-01 20260428T211826Z-e39c PASS 1.00 — 1.6k 6.9s
a2-mounting-rail-01 20260428T211819Z-6087 PASS 1.00 — 1.6k 6.9s
a2-mounting-rail-01 20260428T211811Z-b71f PASS 1.00 — 1.6k 7.3s
a2-finned-block-01 20260428T211805Z-fcea PASS 1.00 — 1.6k 6.4s
a2-finned-block-01 20260428T211759Z-53fd PASS 1.00 — 1.6k 6.1s
a2-finned-block-01 20260428T211752Z-6dc9 PASS 1.00 — 1.6k 6.7s
a2-finned-block-01 20260428T211746Z-f1ff PASS 1.00 — 1.6k 6.5s
a2-finned-block-01 20260428T211739Z-eb9f PASS 1.00 — 1.6k 6.9s
a2-cubemark-01 20260428T211727Z-f52c PASS 1.00 — 2.2k 10.7s
a2-cubemark-01 20260428T211716Z-c35c PASS 1.00 — 2.2k 10.3s
a2-cubemark-01 20260428T211703Z-ef2e PASS 1.00 — 2.2k 13.2s
a2-cubemark-01 20260428T211651Z-1859 PASS 1.00 — 2.2k 10.6s
a2-cubemark-01 20260428T211640Z-eead PASS 1.00 — 2.2k 10.6s
a2-tee-bracket-01 20260428T211629Z-4e33 PASS 1.00 — 1.8k 10.6s
a2-tee-bracket-01 20260428T211622Z-dc64 PASS 1.00 — 1.8k 7.5s
a2-tee-bracket-01 20260428T211614Z-41c2 PASS 1.00 — 1.8k 7.9s
a2-tee-bracket-01 20260428T211606Z-a454 PASS 1.00 — 1.8k 7.5s
a2-tee-bracket-01 20260428T211559Z-7896 PASS 1.00 — 1.8k 7.5s
a2-square-flange-01 20260428T211550Z-c19b PASS 1.00 — 1.9k 8.8s
a2-square-flange-01 20260428T211540Z-d573 PASS 1.00 — 1.9k 9.3s
a2-square-flange-01 20260428T211531Z-3486 PASS 1.00 — 1.9k 9.2s
a2-square-flange-01 20260428T211521Z-d396 PASS 1.00 — 1.9k 9.2s
a2-square-flange-01 20260428T211512Z-c9b0 PASS 1.00 — 1.9k 9.0s
a2-washer-01 20260428T211508Z-5200 PASS 1.00 — 1.1k 3.8s
a2-washer-01 20260428T211504Z-cd98 PASS 1.00 — 1.1k 3.9s
a2-washer-01 20260428T211500Z-9162 PASS 1.00 — 1.1k 3.6s
a2-washer-01 20260428T211456Z-5566 PASS 1.00 — 1.1k 3.9s
a2-washer-01 20260428T211452Z-9ac3 PASS 1.00 — 1.1k 4.2s
a1-pipe-01 20260428T211447Z-9eed PASS 1.00 — 1.1k 4.2s
a1-pipe-01 20260428T211444Z-9246 PASS 1.00 — 1.1k 3.0s
a1-pipe-01 20260428T211440Z-3216 PASS 1.00 — 1.1k 4.0s
a1-pipe-01 20260428T211437Z-121a PASS 1.00 — 1.1k 3.1s
a1-pipe-01 20260428T211433Z-3d3a PASS 1.00 — 1.1k 3.2s
a1-block-01 20260428T211431Z-2327 PASS 1.00 — 1.0k 2.6s
a1-block-01 20260428T211428Z-d17f PASS 1.00 — 1.0k 2.9s
a1-block-01 20260428T211425Z-aab8 PASS 1.00 — 1.0k 2.7s
a1-block-01 20260428T211422Z-bce9 PASS 1.00 — 1.0k 2.7s
a1-block-01 20260428T211419Z-a9c4 PASS 1.00 — 1.0k 2.8s
a1-cone-01 20260428T211416Z-7451 PASS 1.00 — 957 3.0s
a1-cone-01 20260428T211414Z-4720 PASS 1.00 — 957 2.3s
a1-cone-01 20260428T211412Z-d178 PASS 1.00 — 957 2.2s
a1-cone-01 20260428T211406Z-48f2 PASS 1.00 — 957 6.1s
a1-cone-01 20260428T211403Z-1030 PASS 1.00 — 957 2.5s
a1-sphere-01 20260428T211401Z-07af PASS 1.00 — 910 2.1s
a1-sphere-01 20260428T211358Z-6de9 PASS 1.00 — 911 2.7s
a1-sphere-01 20260428T211356Z-302b PASS 1.00 — 910 2.3s
a1-sphere-01 20260428T211353Z-56c7 PASS 1.00 — 910 2.1s
a1-sphere-01 20260428T211351Z-bb1a PASS 1.00 — 912 2.8s
a2-flanged-cap-01 20260428T205703Z-1893 PASS 1.00 — 2.3k 10.5s
a2-flanged-cap-01 20260428T205652Z-d6f3 PASS 1.00 — 2.0k 9.7s
a2-flanged-cap-01 20260428T205641Z-8767 PASS 1.00 — 2.2k 10.4s
a2-flanged-cap-01 20260428T205630Z-575d PASS 1.00 — 2.0k 9.8s
a2-flanged-cap-01 20260428T205618Z-c81e PASS 1.00 — 2.2k 10.7s
a1-plate-01 20260428T205602Z-0bf4 PASS 1.00 — 1.7k 7.6s
a1-plate-01 20260428T205554Z-7b1f PASS 1.00 — 1.7k 7.6s
a1-plate-01 20260428T205547Z-4faa PASS 1.00 — 1.5k 6.7s
a1-plate-01 20260428T205541Z-8ebc PASS 1.00 — 1.5k 6.3s
a1-plate-01 20260428T205518Z-42a4 PASS 1.00 — 1.7k 7.4s
a1-plate-01 20260428T153537Z-bc66 fail 0.83 bbox · Z off by -5.00mm 1.5k 6.3s
a1-cube-01 20260428T153537Z-bb2f PASS 1.00 — 965 2.6s
a2-flanged-cap-01 20260428T153537Z-97a4 PASS 1.00 — 2.3k 11.5s
a2-l-bracket-01 20260428T153537Z-3a65 PASS 1.00 — 1.5k 5.9s
a1-stepped-shaft-01 20260428T153537Z-33d7 PASS 1.00 — 1.2k 3.4s
a2-l-bracket-01 20260428T153525Z-a46b PASS 1.00 — 1.6k 6.8s
a1-stepped-shaft-01 20260428T153525Z-8710 PASS 1.00 — 1.1k 5.0s
a2-flanged-cap-01 20260428T153525Z-72cb PASS 1.00 — 2.2k 11.7s
a1-plate-01 20260428T153525Z-5f47 fail 0.83 bbox · Z off by -5.00mm 1.5k 6.8s
a1-cube-01 20260428T153525Z-1416 PASS 1.00 — 959 3.1s
a1-plate-01 20260428T153513Z-cbe8 fail 0.83 bbox · Z off by -5.00mm 1.7k 7.8s
a2-l-bracket-01 20260428T153513Z-ac6b PASS 1.00 — 1.6k 6.7s
a1-stepped-shaft-01 20260428T153513Z-ab32 PASS 1.00 — 1.2k 3.4s
a1-cube-01 20260428T153513Z-a078 PASS 1.00 — 961 2.7s
a2-flanged-cap-01 20260428T153513Z-1961 PASS 1.00 — 2.3k 11.4s
a2-flanged-cap-01 20260428T142511Z-8f59 PASS 1.00 — 2.1k 10.4s
a2-l-bracket-01 20260428T142504Z-02a4 PASS 1.00 — 1.6k 7.2s
a1-stepped-shaft-01 20260428T142500Z-3bc3 PASS 1.00 — 1.2k 3.6s
a1-plate-01 20260428T142452Z-c85b fail 0.83 bbox · Z off by -5.00mm 1.5k 7.9s
a1-cube-01 20260428T142449Z-9da6 PASS 1.00 — 959 2.4s
a2-flanged-cap-01 20260428T141650Z-bd80 PASS 1.00 — 2.0k 15.8s
a2-l-bracket-01 20260428T141643Z-2876 PASS 1.00 — 1.6k 6.8s
a1-stepped-shaft-01 20260428T141639Z-92f3 PASS 1.00 — 1.2k 3.9s
a1-plate-01 20260428T141632Z-d7d2 fail 0.83 bbox · Z off by -5.00mm 1.5k 6.8s
a1-cube-01 20260428T141611Z-6a7b PASS 1.00 — 962 2.9s
mecheval · an evaluation suite by Municipal Robotics
sibling project: vcad. · github

generated 2026-06-17T03:16:07.287Z · static site, regenerate with npm run build -w @mecheval/leaderboard