← mecheval / model / claude-direct-claude-sonnet-4-6

claude-direct-claude-sonnet-4-6

193 run blobs across 34 tasks

All runs

taskrun statusscorefirst failtokenswall
a4-rounded-bar-01 20260429T120654Z-501a PASS 1.00 — 1.3k 6.3s
a4-rounded-bar-01 20260429T120648Z-bc3c PASS 1.00 — 1.2k 5.5s
a4-rounded-bar-01 20260429T120642Z-2ed6 PASS 1.00 — 1.3k 6.3s
a4-rounded-bar-01 20260429T120636Z-f7ea PASS 1.00 — 1.2k 5.5s
a4-rounded-bar-01 20260429T120630Z-bb6b PASS 1.00 — 1.2k 5.3s
a4-bolt-circle-flange-with-bore-01 20260429T120619Z-c713 PASS 1.00 — 2.0k 10.4s
a4-bolt-circle-flange-with-bore-01 20260429T120608Z-f571 PASS 1.00 — 2.0k 10.0s
a4-bolt-circle-flange-with-bore-01 20260429T120556Z-e111 PASS 1.00 — 2.0k 9.8s
a4-bolt-circle-flange-with-bore-01 20260429T120545Z-1679 PASS 1.00 — 2.0k 10.0s
a4-bolt-circle-flange-with-bore-01 20260429T120533Z-283b PASS 1.00 — 2.0k 10.6s
a4-x-frame-01 20260429T120529Z-56ba PASS 1.00 — 1.2k 3.7s
a4-x-frame-01 20260429T120523Z-3f5c PASS 1.00 — 1.2k 6.5s
a4-x-frame-01 20260429T120519Z-e5b7 PASS 1.00 — 1.2k 3.9s
a4-x-frame-01 20260429T120515Z-9923 PASS 1.00 — 1.2k 4.0s
a4-x-frame-01 20260429T120511Z-8649 PASS 1.00 — 1.1k 3.4s
a4-stepped-pyramid-with-holes-01 20260429T120501Z-977a fail 0.83 step_roundtrip · STEP drift on 1/1 solid 1.8k 9.5s
a4-stepped-pyramid-with-holes-01 20260429T120449Z-2893 PASS 1.00 — 1.9k 12.4s
a4-stepped-pyramid-with-holes-01 20260429T120438Z-e0b6 fail 0.83 step_roundtrip · STEP drift on 1/1 solid 1.9k 10.9s
a4-stepped-pyramid-with-holes-01 20260429T120426Z-bbdc PASS 1.00 — 1.9k 11.5s
a4-stepped-pyramid-with-holes-01 20260429T120415Z-10c6 PASS 1.00 — 1.9k 10.8s
a4-slotted-bracket-01 20260429T120408Z-4945 fail 0.83 mass_props · volume off by 1.9% 1.4k 6.9s
a4-slotted-bracket-01 20260429T120359Z-4cd3 fail 0.83 mass_props · volume off by 1.9% 1.5k 8.2s
a4-slotted-bracket-01 20260429T120352Z-90c7 fail 0.83 mass_props · volume off by 1.9% 1.4k 7.0s
a4-slotted-bracket-01 20260429T120346Z-971e fail 0.83 mass_props · volume off by 1.9% 1.5k 6.6s
a4-slotted-bracket-01 20260429T120338Z-100e fail 0.83 mass_props · volume off by 1.9% 1.4k 7.2s
a4-flanged-shaft-01 20260429T120329Z-5b41 PASS 1.00 — 1.8k 8.2s
a4-flanged-shaft-01 20260429T120319Z-7140 PASS 1.00 — 1.8k 8.3s
a4-flanged-shaft-01 20260429T120310Z-a67c PASS 1.00 — 1.8k 8.8s
a4-flanged-shaft-01 20260429T120300Z-8c32 PASS 1.00 — 1.8k 8.3s
a4-flanged-shaft-01 20260429T120251Z-953e PASS 1.00 — 1.8k 8.3s
a4-rectangular-tube-01 20260429T120247Z-ee3c PASS 1.00 — 1.1k 4.1s
a4-rectangular-tube-01 20260429T120242Z-5cd0 PASS 1.00 — 1.1k 4.8s
a4-rectangular-tube-01 20260429T120238Z-8c75 PASS 1.00 — 1.1k 4.1s
a4-rectangular-tube-01 20260429T120234Z-105e PASS 1.00 — 1.1k 4.0s
a4-rectangular-tube-01 20260429T120230Z-b581 PASS 1.00 — 1.0k 3.8s
a4-counterbore-plate-01 20260429T120214Z-f57e PASS 1.00 — 2.2k 15.7s
a4-counterbore-plate-01 20260429T120200Z-8e34 PASS 1.00 — 2.1k 12.9s
a4-counterbore-plate-01 20260429T120149Z-6f3f PASS 1.00 — 2.2k 10.9s
a4-counterbore-plate-01 20260429T120138Z-b7b4 PASS 1.00 — 2.1k 10.6s
a4-counterbore-plate-01 20260429T120123Z-17a3 PASS 1.00 — 2.2k 13.8s
a3-spherical-dome-block-01 20260428T233012Z-031f PASS 1.00 — 1.3k 6.3s
a3-spherical-dome-block-01 20260428T233006Z-025f PASS 1.00 — 1.3k 5.7s
a3-spherical-dome-block-01 20260428T233001Z-255f PASS 1.00 — 1.3k 5.5s
a3-spherical-dome-block-01 20260428T232955Z-e280 PASS 1.00 — 1.3k 5.8s
a3-spherical-dome-block-01 20260428T232949Z-ed11 PASS 1.00 — 1.3k 5.4s
a3-three-tangent-cylinders-01 20260428T232940Z-78b6 PASS 1.00 — 1.5k 9.1s
a3-three-tangent-cylinders-01 20260428T232926Z-6694 PASS 1.00 — 1.7k 14.4s
a3-three-tangent-cylinders-01 20260428T232913Z-3016 PASS 1.00 — 1.7k 12.1s
a3-three-tangent-cylinders-01 20260428T232859Z-18fb PASS 1.00 — 1.7k 14.3s
a3-three-tangent-cylinders-01 20260428T232847Z-adb5 PASS 1.00 — 1.6k 11.6s
a3-hex-bolt-pattern-01 20260428T232835Z-f690 PASS 1.00 — 1.9k 12.5s
a3-hex-bolt-pattern-01 20260428T232822Z-847a PASS 1.00 — 2.0k 12.0s
a3-hex-bolt-pattern-01 20260428T232805Z-682c PASS 1.00 — 2.3k 16.9s
a3-hex-bolt-pattern-01 20260428T232753Z-ae80 PASS 1.00 — 1.9k 11.9s
a3-hex-bolt-pattern-01 20260428T232740Z-173c PASS 1.00 — 2.0k 12.1s
a3-cross-shaft-01 20260428T232735Z-192c fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 4.8s
a3-cross-shaft-01 20260428T232730Z-f8fb fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 5.1s
a3-cross-shaft-01 20260428T232725Z-94fc fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 5.3s
a3-cross-shaft-01 20260428T232720Z-9d98 fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 4.7s
a3-cross-shaft-01 20260428T232715Z-bef3 fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 4.4s
a3-octagonal-flange-01 20260428T232655Z-070a fail 0.83 bbox · X off by -1.65mm 2.3k 19.9s
a3-octagonal-flange-01 20260428T232629Z-c8fe fail 0.83 bbox · X off by -1.65mm 2.8k 25.9s
a3-octagonal-flange-01 20260428T232601Z-f5d4 fail 0.83 bbox · X off by -1.65mm 3.0k 27.3s
a3-octagonal-flange-01 20260428T232531Z-0614 fail 0.83 bbox · X off by -1.65mm 3.0k 29.6s
a3-octagonal-flange-01 20260428T232508Z-11c7 fail 0.67 bbox · Y off by +1.65mm 2.6k 22.1s
c-reacher-01 20260428T212339Z-6878 fail 0.00 valid_solid · solid invalid 1.7k 8.8s
c-reacher-01 20260428T212331Z-bc4c fail 0.20 body_valid · check not implemented 1.6k 7.8s
c-reacher-01 20260428T212321Z-c84a fail 0.00 valid_solid · solid invalid 1.8k 10.4s
c-reacher-01 20260428T212313Z-fbcc fail 0.00 valid_solid · solid invalid 1.6k 7.8s
c-reacher-01 20260428T212305Z-5ea1 fail 0.20 body_valid · check not implemented 1.6k 8.2s
a2-stepped-pyramid-01 20260428T212259Z-f435 PASS 1.00 — 1.2k 5.8s
a2-stepped-pyramid-01 20260428T212253Z-d937 PASS 1.00 — 1.2k 5.4s
a2-stepped-pyramid-01 20260428T212248Z-1c49 PASS 1.00 — 1.2k 5.6s
a2-stepped-pyramid-01 20260428T212242Z-965b PASS 1.00 — 1.2k 5.3s
a2-stepped-pyramid-01 20260428T212236Z-7d66 PASS 1.00 — 1.2k 5.9s
a2-cube-with-pocket-01 20260428T212232Z-1b2f PASS 1.00 — 1.0k 4.3s
a2-cube-with-pocket-01 20260428T212228Z-a4ae PASS 1.00 — 1.0k 4.1s
a2-cube-with-pocket-01 20260428T212222Z-3c88 PASS 1.00 — 1.0k 6.2s
a2-cube-with-pocket-01 20260428T212217Z-4289 PASS 1.00 — 1.0k 4.4s
a2-cube-with-pocket-01 20260428T212213Z-c1dc PASS 1.00 — 1.0k 4.4s
a2-stepped-block-01 20260428T212208Z-d16a PASS 1.00 — 1.1k 4.5s
a2-stepped-block-01 20260428T212203Z-f259 PASS 1.00 — 1.1k 4.8s
a2-stepped-block-01 20260428T212159Z-73e0 PASS 1.00 — 1.0k 4.0s
a2-stepped-block-01 20260428T212154Z-84fc PASS 1.00 — 1.1k 4.5s
a2-stepped-block-01 20260428T212150Z-da5a PASS 1.00 — 1.1k 4.0s
a2-channel-bracket-01 20260428T212146Z-13c6 PASS 1.00 — 1.1k 4.8s
a2-channel-bracket-01 20260428T212140Z-1b0c PASS 1.00 — 1.1k 5.2s
a2-channel-bracket-01 20260428T212135Z-3f9d PASS 1.00 — 1.1k 5.2s
a2-channel-bracket-01 20260428T212130Z-0a6d PASS 1.00 — 1.1k 5.3s
a2-channel-bracket-01 20260428T212125Z-da0f PASS 1.00 — 1.1k 4.5s
a2-bolt-circle-block-01 20260428T212114Z-52c1 PASS 1.00 — 2.1k 10.7s
a2-bolt-circle-block-01 20260428T212103Z-0977 PASS 1.00 — 2.1k 10.9s
a2-bolt-circle-block-01 20260428T212051Z-79c9 PASS 1.00 — 2.1k 10.7s
a2-bolt-circle-block-01 20260428T212040Z-6e1e PASS 1.00 — 2.1k 11.3s
a2-bolt-circle-block-01 20260428T212028Z-fd46 PASS 1.00 — 2.1k 10.6s
a2-mounting-rail-01 20260428T212022Z-b484 PASS 1.00 — 1.3k 5.9s
a2-mounting-rail-01 20260428T212016Z-85ef PASS 1.00 — 1.3k 6.0s
a2-mounting-rail-01 20260428T212011Z-62cf PASS 1.00 — 1.3k 5.6s
a2-mounting-rail-01 20260428T212005Z-2fbe PASS 1.00 — 1.3k 5.7s
a2-mounting-rail-01 20260428T211959Z-a5cd PASS 1.00 — 1.3k 5.8s
a2-finned-block-01 20260428T211951Z-8708 PASS 1.00 — 1.4k 7.6s
a2-finned-block-01 20260428T211944Z-cde7 PASS 1.00 — 1.4k 7.0s
a2-finned-block-01 20260428T211937Z-020d PASS 1.00 — 1.3k 6.7s
a2-finned-block-01 20260428T211929Z-ceee PASS 1.00 — 1.4k 8.0s
a2-finned-block-01 20260428T211923Z-b6c8 PASS 1.00 — 1.4k 6.5s
a2-cubemark-01 20260428T211907Z-e608 PASS 1.00 — 2.3k 14.7s
a2-cubemark-01 20260428T211855Z-d0d0 PASS 1.00 — 2.3k 11.8s
a2-cubemark-01 20260428T211840Z-7b3f PASS 1.00 — 2.3k 15.0s
a2-cubemark-01 20260428T211824Z-7dbc PASS 1.00 — 2.3k 15.1s
a2-cubemark-01 20260428T211812Z-99ee PASS 1.00 — 1.8k 11.7s
a2-tee-bracket-01 20260428T211804Z-5880 PASS 1.00 — 1.5k 7.6s
a2-tee-bracket-01 20260428T211757Z-a961 PASS 1.00 — 1.5k 6.7s
a2-tee-bracket-01 20260428T211750Z-48e0 PASS 1.00 — 1.5k 7.7s
a2-tee-bracket-01 20260428T211742Z-ccf2 PASS 1.00 — 1.5k 7.1s
a2-tee-bracket-01 20260428T211735Z-7a42 PASS 1.00 — 1.5k 6.8s
a2-square-flange-01 20260428T211727Z-dd7e PASS 1.00 — 1.6k 7.7s
a2-square-flange-01 20260428T211718Z-cd1e PASS 1.00 — 1.5k 8.7s
a2-square-flange-01 20260428T211711Z-410e PASS 1.00 — 1.6k 7.7s
a2-square-flange-01 20260428T211702Z-e752 PASS 1.00 — 1.6k 7.8s
a2-square-flange-01 20260428T211655Z-aeb6 PASS 1.00 — 1.5k 7.3s
a2-washer-01 20260428T211652Z-7128 PASS 1.00 — 850 3.0s
a2-washer-01 20260428T211649Z-6c49 PASS 1.00 — 850 2.8s
a2-washer-01 20260428T211646Z-7a64 PASS 1.00 — 855 3.0s
a2-washer-01 20260428T211642Z-5fb9 PASS 1.00 — 850 3.3s
a2-washer-01 20260428T211639Z-4b2d PASS 1.00 — 839 3.1s
a2-l-bracket-01 20260428T211632Z-ea20 PASS 1.00 — 1.3k 6.6s
a2-l-bracket-01 20260428T211626Z-3786 PASS 1.00 — 1.3k 6.6s
a2-l-bracket-01 20260428T211619Z-8797 PASS 1.00 — 1.3k 6.6s
a2-l-bracket-01 20260428T211612Z-ebb5 PASS 1.00 — 1.3k 6.3s
a2-l-bracket-01 20260428T211606Z-0b99 PASS 1.00 — 1.3k 6.7s
a2-flanged-cap-01 20260428T211552Z-3159 PASS 1.00 — 1.9k 12.4s
a2-flanged-cap-01 20260428T211539Z-8234 PASS 1.00 — 1.9k 12.7s
a2-flanged-cap-01 20260428T211525Z-e541 PASS 1.00 — 1.9k 12.7s
a2-flanged-cap-01 20260428T211511Z-8102 PASS 1.00 — 1.9k 12.5s
a2-flanged-cap-01 20260428T211501Z-28a8 PASS 1.00 — 1.9k 9.9s
a1-pipe-01 20260428T211458Z-1ea1 PASS 1.00 — 846 3.0s
a1-pipe-01 20260428T211454Z-4af9 PASS 1.00 — 846 3.3s
a1-pipe-01 20260428T211451Z-8c54 PASS 1.00 — 846 3.0s
a1-pipe-01 20260428T211448Z-a580 PASS 1.00 — 852 3.3s
a1-pipe-01 20260428T211444Z-d58c PASS 1.00 — 846 3.0s
a1-block-01 20260428T211441Z-96ed PASS 1.00 — 843 3.3s
a1-block-01 20260428T211438Z-1c23 PASS 1.00 — 825 3.2s
a1-block-01 20260428T211435Z-ec47 PASS 1.00 — 825 3.0s
a1-block-01 20260428T211432Z-ec8a PASS 1.00 — 825 3.1s
a1-block-01 20260428T211428Z-e0a2 PASS 1.00 — 825 3.4s
a1-cone-01 20260428T211425Z-e812 PASS 1.00 — 778 3.1s
a1-cone-01 20260428T211422Z-f63c PASS 1.00 — 778 2.8s
a1-cone-01 20260428T211419Z-cd42 PASS 1.00 — 778 2.8s
a1-cone-01 20260428T211417Z-b852 PASS 1.00 — 778 2.5s
a1-cone-01 20260428T211414Z-b076 PASS 1.00 — 778 2.7s
a1-sphere-01 20260428T211411Z-d412 PASS 1.00 — 736 2.5s
a1-sphere-01 20260428T211409Z-4abd PASS 1.00 — 714 2.4s
a1-sphere-01 20260428T211406Z-4358 PASS 1.00 — 715 2.4s
a1-sphere-01 20260428T211404Z-7d05 PASS 1.00 — 715 2.3s
a1-sphere-01 20260428T211402Z-4882 PASS 1.00 — 736 2.4s
a1-stepped-shaft-01 20260428T211358Z-0d14 PASS 1.00 — 920 3.3s
a1-stepped-shaft-01 20260428T211354Z-a26a PASS 1.00 — 927 3.9s
a1-stepped-shaft-01 20260428T211351Z-b805 PASS 1.00 — 926 3.4s
a1-stepped-shaft-01 20260428T211347Z-263f PASS 1.00 — 927 4.0s
a1-stepped-shaft-01 20260428T211343Z-7be8 PASS 1.00 — 925 3.9s
a1-plate-01 20260428T211336Z-2fde PASS 1.00 — 1.4k 6.8s
a1-plate-01 20260428T211327Z-d58e PASS 1.00 — 1.4k 9.0s
a1-plate-01 20260428T211318Z-a254 PASS 1.00 — 1.4k 8.2s
a1-plate-01 20260428T211308Z-1872 PASS 1.00 — 1.6k 9.6s
a1-plate-01 20260428T211300Z-5218 PASS 1.00 — 1.4k 8.3s
a1-cube-01 20260428T211257Z-2be0 PASS 1.00 — 770 2.5s
a1-cube-01 20260428T211255Z-bc54 PASS 1.00 — 760 2.8s
a1-cube-01 20260428T211251Z-7829 PASS 1.00 — 784 3.2s
a1-cube-01 20260428T211248Z-fe4e PASS 1.00 — 752 3.2s
a1-cube-01 20260428T211245Z-3630 PASS 1.00 — 784 3.1s
a1-cone-01 20260428T211226Z-c5a9 PASS 1.00 — 778 2.3s
a1-cone-01 20260428T211224Z-f777 PASS 1.00 — 778 2.5s
a1-sphere-01 20260428T211221Z-3d63 PASS 1.00 — 726 2.3s
a1-sphere-01 20260428T211219Z-60d5 PASS 1.00 — 726 2.3s
a1-sphere-01 20260428T211217Z-4141 PASS 1.00 — 715 2.3s
a1-sphere-01 20260428T211214Z-c11b PASS 1.00 — 714 2.3s
a1-sphere-01 20260428T211212Z-7e5a PASS 1.00 — 715 2.2s
a1-stepped-shaft-01 20260428T211208Z-baab PASS 1.00 — 937 3.8s
a1-stepped-shaft-01 20260428T211205Z-7b19 PASS 1.00 — 926 3.7s
a1-stepped-shaft-01 20260428T211201Z-c8dc PASS 1.00 — 927 3.7s
a1-stepped-shaft-01 20260428T211157Z-078c PASS 1.00 — 927 3.8s
a1-stepped-shaft-01 20260428T211153Z-cd47 PASS 1.00 — 926 3.9s
a1-plate-01 20260428T211144Z-9859 PASS 1.00 — 1.4k 8.7s
a1-plate-01 20260428T211135Z-65a1 PASS 1.00 — 1.4k 8.6s
a1-plate-01 20260428T211127Z-faa5 PASS 1.00 — 1.4k 8.2s
a1-plate-01 20260428T211119Z-a793 PASS 1.00 — 1.4k 7.0s
a1-plate-01 20260428T211112Z-1249 PASS 1.00 — 1.5k 7.8s
a1-cube-01 20260428T211109Z-cb72 PASS 1.00 — 755 2.8s
a1-cube-01 20260428T211106Z-6ace PASS 1.00 — 784 3.0s
a1-cube-01 20260428T211102Z-ff92 PASS 1.00 — 784 3.1s
a1-cube-01 20260428T211059Z-80e8 PASS 1.00 — 770 2.8s
a1-cube-01 20260428T211056Z-8f7f PASS 1.00 — 770 3.0s
a1-cube-01 20260428T211009Z-297e PASS 1.00 — 770 2.6s
mecheval · an evaluation suite by Municipal Robotics
sibling project: vcad. · github

generated 2026-06-17T03:16:07.288Z · static site, regenerate with npm run build -w @mecheval/leaderboard