← mecheval / model / claude-direct-claude-haiku-4-5-20251001

claude-direct-claude-haiku-4-5-20251001

173 run blobs across 34 tasks

All runs

taskrun statusscorefirst failtokenswall
a4-rounded-bar-01 20260429T120449Z-ad3a fail 0.00 valid_solid · solid invalid 1.4k 3.3s
a4-rounded-bar-01 20260429T120446Z-159b fail 0.00 valid_solid · solid invalid 1.5k 3.5s
a4-rounded-bar-01 20260429T120443Z-0071 fail 0.00 valid_solid · solid invalid 1.4k 3.1s
a4-rounded-bar-01 20260429T120439Z-2b28 fail 0.00 valid_solid · solid invalid 1.4k 3.5s
a4-rounded-bar-01 20260429T120436Z-c74f fail 0.00 valid_solid · solid invalid 1.4k 3.2s
a4-bolt-circle-flange-with-bore-01 20260429T120429Z-4eb8 fail 0.00 valid_solid · solid invalid 2.4k 6.9s
a4-bolt-circle-flange-with-bore-01 20260429T120421Z-d6a2 fail 0.00 valid_solid · solid invalid 2.6k 7.2s
a4-bolt-circle-flange-with-bore-01 20260429T120415Z-c1ce fail 0.00 valid_solid · solid invalid 2.2k 6.3s
a4-bolt-circle-flange-with-bore-01 20260429T120409Z-c889 fail 0.00 valid_solid · solid invalid 2.2k 5.7s
a4-bolt-circle-flange-with-bore-01 20260429T120403Z-84d3 fail 0.00 valid_solid · solid invalid 2.3k 6.5s
a4-x-frame-01 20260429T120400Z-7f59 fail 0.00 valid_solid · solid invalid 1.2k 2.2s
a4-x-frame-01 20260429T120358Z-8075 fail 0.00 valid_solid · solid invalid 1.3k 2.3s
a4-x-frame-01 20260429T120355Z-9322 PASS 1.00 1.2k 2.3s
a4-x-frame-01 20260429T120350Z-7599 fail 0.00 valid_solid · solid invalid 1.2k 4.9s
a4-x-frame-01 20260429T120348Z-5e51 fail 0.00 valid_solid · solid invalid 1.3k 2.4s
a4-stepped-pyramid-with-holes-01 20260429T120342Z-dbf3 fail 0.00 valid_solid · solid invalid 2.3k 6.2s
a4-stepped-pyramid-with-holes-01 20260429T120336Z-2fa3 fail 0.00 valid_solid · solid invalid 2.2k 5.9s
a4-stepped-pyramid-with-holes-01 20260429T120329Z-c74b fail 0.00 valid_solid · solid invalid 2.2k 6.1s
a4-stepped-pyramid-with-holes-01 20260429T120323Z-21da fail 0.00 valid_solid · solid invalid 2.4k 6.5s
a4-stepped-pyramid-with-holes-01 20260429T120316Z-5316 fail 0.00 valid_solid · solid invalid 2.5k 6.6s
a4-slotted-bracket-01 20260429T120312Z-f9fe fail 0.00 valid_solid · solid invalid 1.8k 4.2s
a4-slotted-bracket-01 20260429T120307Z-c947 fail 0.00 valid_solid · solid invalid 1.8k 4.6s
a4-slotted-bracket-01 20260429T120303Z-8b44 fail 0.00 valid_solid · solid invalid 1.7k 4.1s
a4-slotted-bracket-01 20260429T120258Z-8f99 fail 0.00 valid_solid · solid invalid 1.7k 4.5s
a4-slotted-bracket-01 20260429T120254Z-b488 fail 0.00 valid_solid · solid invalid 1.7k 4.2s
a4-flanged-shaft-01 20260429T120248Z-3de0 fail 0.00 valid_solid · solid invalid 2.2k 5.9s
a4-flanged-shaft-01 20260429T120242Z-6a44 fail 0.00 valid_solid · solid invalid 2.2k 5.7s
a4-flanged-shaft-01 20260429T120236Z-7bd7 fail 0.00 valid_solid · solid invalid 2.2k 5.9s
a4-flanged-shaft-01 20260429T120230Z-3962 fail 0.00 valid_solid · solid invalid 2.2k 5.9s
a4-flanged-shaft-01 20260429T120225Z-fa65 fail 0.00 valid_solid · solid invalid 2.0k 5.3s
a4-rectangular-tube-01 20260429T120222Z-798b fail 0.00 valid_solid · solid invalid 1.2k 2.1s
a4-rectangular-tube-01 20260429T120220Z-293c fail 0.00 valid_solid · solid invalid 1.2k 2.3s
a4-rectangular-tube-01 20260429T120218Z-f865 fail 0.00 valid_solid · solid invalid 1.2k 2.1s
a4-rectangular-tube-01 20260429T120215Z-70b8 fail 0.00 valid_solid · solid invalid 1.2k 2.6s
a4-rectangular-tube-01 20260429T120211Z-4533 fail 0.00 valid_solid · solid invalid 1.2k 3.9s
a4-counterbore-plate-01 20260429T120202Z-79cb fail 0.00 valid_solid · solid invalid 3.0k 8.6s
a4-counterbore-plate-01 20260429T120154Z-9ddf fail 0.00 valid_solid · solid invalid 2.8k 7.9s
a4-counterbore-plate-01 20260429T120145Z-9eb9 fail 0.00 valid_solid · solid invalid 3.1k 8.7s
a4-counterbore-plate-01 20260429T120135Z-f79c fail 0.00 valid_solid · solid invalid 2.8k 9.9s
a4-counterbore-plate-01 20260429T120127Z-a8a5 fail 0.00 valid_solid · solid invalid 2.8k 7.8s
a4-x-frame-01 20260429T120057Z-41aa fail 0.00 valid_solid · solid invalid 1.2k 3.3s
a3-spherical-dome-block-01 20260428T232743Z-60e9 fail 0.00 valid_solid · solid invalid 1.4k 2.8s
a3-spherical-dome-block-01 20260428T232740Z-e0ea PASS 1.00 1.4k 3.5s
a3-spherical-dome-block-01 20260428T232736Z-dfc1 fail 0.00 valid_solid · solid invalid 1.5k 3.7s
a3-spherical-dome-block-01 20260428T232733Z-a61e fail 0.00 valid_solid · solid invalid 1.4k 3.1s
a3-spherical-dome-block-01 20260428T232729Z-53aa fail 0.00 valid_solid · solid invalid 1.5k 3.8s
a3-three-tangent-cylinders-01 20260428T232726Z-9751 fail 0.00 valid_solid · solid invalid 1.5k 3.4s
a3-three-tangent-cylinders-01 20260428T232722Z-ad5a fail 0.00 valid_solid · solid invalid 1.5k 3.4s
a3-three-tangent-cylinders-01 20260428T232719Z-3fda fail 0.00 valid_solid · solid invalid 1.5k 3.3s
a3-three-tangent-cylinders-01 20260428T232715Z-e24e fail 0.00 valid_solid · solid invalid 1.5k 3.2s
a3-three-tangent-cylinders-01 20260428T232712Z-3ff6 fail 0.00 valid_solid · solid invalid 1.5k 3.1s
a3-hex-bolt-pattern-01 20260428T232704Z-87ae fail 0.00 valid_solid · solid invalid 2.7k 8.1s
a3-hex-bolt-pattern-01 20260428T232657Z-eae4 fail 0.00 valid_solid · solid invalid 2.6k 7.4s
a3-hex-bolt-pattern-01 20260428T232649Z-bc9e fail 0.00 valid_solid · solid invalid 2.5k 7.2s
a3-hex-bolt-pattern-01 20260428T232642Z-4b59 fail 0.00 valid_solid · solid invalid 2.5k 6.9s
a3-hex-bolt-pattern-01 20260428T232635Z-3a5b fail 0.00 valid_solid · solid invalid 2.5k 7.0s
a3-cross-shaft-01 20260428T232633Z-bdde fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 2.1s
a3-cross-shaft-01 20260428T232630Z-726a fail 0.00 valid_solid · solid invalid 1.3k 2.6s
a3-cross-shaft-01 20260428T232628Z-7d7c fail 0.75 step_roundtrip · STEP drift on 1/1 solid 1.2k 2.6s
a3-cross-shaft-01 20260428T232625Z-881a fail 0.00 valid_solid · solid invalid 1.2k 2.6s
a3-cross-shaft-01 20260428T232619Z-68b0 fail 0.00 valid_solid · solid invalid 1.3k 5.6s
a3-octagonal-flange-01 20260428T232608Z-6d86 fail 0.00 valid_solid · solid invalid 3.6k 11.2s
a3-octagonal-flange-01 20260428T232556Z-2a4d fail 0.00 valid_solid · solid invalid 3.9k 12.1s
a3-octagonal-flange-01 20260428T232544Z-fa66 fail 0.00 valid_solid · solid invalid 3.9k 11.7s
a3-octagonal-flange-01 20260428T232532Z-b434 fail 0.00 valid_solid · solid invalid 3.8k 11.5s
a3-octagonal-flange-01 20260428T232520Z-be62 fail 0.00 valid_solid · solid invalid 3.9k 12.3s
c-reacher-01 20260428T211947Z-d1e0 fail 0.00 valid_solid · solid invalid 2.2k 7.8s
c-reacher-01 20260428T211940Z-e5dc fail 0.00 valid_solid · solid invalid 2.3k 7.0s
c-reacher-01 20260428T211933Z-2a19 fail 0.00 valid_solid · solid invalid 2.2k 6.8s
c-reacher-01 20260428T211925Z-e26d fail 0.00 valid_solid · solid invalid 2.5k 7.7s
c-reacher-01 20260428T211918Z-c7ec fail 0.00 valid_solid · solid invalid 2.3k 7.5s
a2-stepped-pyramid-01 20260428T211914Z-ddb7 PASS 1.00 1.4k 3.5s
a2-stepped-pyramid-01 20260428T211911Z-6be9 PASS 1.00 1.4k 2.8s
a2-stepped-pyramid-01 20260428T211908Z-090c fail 0.00 valid_solid · solid invalid 1.4k 3.1s
a2-stepped-pyramid-01 20260428T211905Z-2cc9 fail 0.00 valid_solid · solid invalid 1.5k 3.1s
a2-stepped-pyramid-01 20260428T211902Z-1171 fail 0.00 valid_solid · solid invalid 1.4k 3.2s
a2-cube-with-pocket-01 20260428T211859Z-1d2a fail 0.00 valid_solid · solid invalid 1.2k 2.5s
a2-cube-with-pocket-01 20260428T211857Z-29c0 fail 0.00 valid_solid · solid invalid 1.1k 2.3s
a2-cube-with-pocket-01 20260428T211854Z-89dc fail 0.00 valid_solid · solid invalid 1.1k 2.5s
a2-cube-with-pocket-01 20260428T211852Z-9fb2 fail 0.00 valid_solid · solid invalid 1.1k 2.4s
a2-cube-with-pocket-01 20260428T211849Z-a438 fail 0.00 valid_solid · solid invalid 1.1k 2.7s
a2-stepped-block-01 20260428T211846Z-a13c PASS 1.00 1.1k 2.5s
a2-stepped-block-01 20260428T211843Z-e7bf fail 0.00 valid_solid · solid invalid 1.2k 2.8s
a2-stepped-block-01 20260428T211841Z-e0bd fail 0.00 valid_solid · solid invalid 1.1k 2.8s
a2-stepped-block-01 20260428T211838Z-0d90 fail 0.00 valid_solid · solid invalid 1.1k 2.3s
a2-stepped-block-01 20260428T211835Z-6f1a fail 0.00 valid_solid · solid invalid 1.1k 2.7s
a2-channel-bracket-01 20260428T211832Z-86c4 fail 0.00 valid_solid · solid invalid 1.3k 2.9s
a2-channel-bracket-01 20260428T211829Z-08f1 fail 0.00 valid_solid · solid invalid 1.3k 3.2s
a2-channel-bracket-01 20260428T211826Z-469f fail 0.00 valid_solid · solid invalid 1.3k 3.0s
a2-channel-bracket-01 20260428T211823Z-fb15 fail 0.00 valid_solid · solid invalid 1.3k 3.2s
a2-channel-bracket-01 20260428T211820Z-cc19 fail 0.00 valid_solid · solid invalid 1.3k 3.1s
a2-bolt-circle-block-01 20260428T211811Z-6071 fail 0.00 valid_solid · solid invalid 2.7k 8.2s
a2-bolt-circle-block-01 20260428T211802Z-f4dd fail 0.00 valid_solid · solid invalid 2.9k 9.0s
a2-bolt-circle-block-01 20260428T211755Z-5f6e PASS 1.00 2.1k 6.5s
a2-bolt-circle-block-01 20260428T211747Z-2a7e fail 0.00 valid_solid · solid invalid 2.9k 8.7s
a2-bolt-circle-block-01 20260428T211739Z-2f67 fail 0.00 valid_solid · solid invalid 2.4k 7.1s
a2-mounting-rail-01 20260428T211735Z-1456 fail 0.00 valid_solid · solid invalid 1.5k 4.1s
a2-mounting-rail-01 20260428T211731Z-8300 PASS 1.00 1.5k 4.2s
a2-mounting-rail-01 20260428T211727Z-4ff8 fail 0.00 valid_solid · solid invalid 1.6k 4.0s
a2-mounting-rail-01 20260428T211723Z-70d1 fail 0.00 valid_solid · solid invalid 1.6k 3.8s
a2-mounting-rail-01 20260428T211719Z-92bd fail 0.00 valid_solid · solid invalid 1.6k 4.3s
a2-finned-block-01 20260428T211714Z-91a3 fail 0.00 valid_solid · solid invalid 1.6k 4.4s
a2-finned-block-01 20260428T211710Z-2568 fail 0.00 valid_solid · solid invalid 1.7k 4.4s
a2-finned-block-01 20260428T211705Z-ed63 fail 0.00 valid_solid · solid invalid 1.7k 4.3s
a2-finned-block-01 20260428T211701Z-9bf2 fail 0.00 valid_solid · solid invalid 1.7k 4.3s
a2-finned-block-01 20260428T211656Z-a2ef fail 0.00 valid_solid · solid invalid 1.7k 4.5s
a2-cubemark-01 20260428T211648Z-67bc fail 0.00 valid_solid · solid invalid 2.9k 8.3s
a2-cubemark-01 20260428T211640Z-fc7f fail 0.00 valid_solid · solid invalid 2.9k 8.2s
a2-cubemark-01 20260428T211631Z-6228 fail 0.00 valid_solid · solid invalid 2.9k 8.3s
a2-cubemark-01 20260428T211622Z-e7b6 fail 0.00 valid_solid · solid invalid 3.2k 9.2s
a2-cubemark-01 20260428T211612Z-39b2 fail 0.00 valid_solid · solid invalid 2.9k 9.4s
a2-tee-bracket-01 20260428T211608Z-85b9 fail 0.00 valid_solid · solid invalid 1.7k 4.7s
a2-tee-bracket-01 20260428T211603Z-cdc3 PASS 1.00 1.6k 4.1s
a2-tee-bracket-01 20260428T211558Z-423d fail 0.00 valid_solid · solid invalid 1.8k 5.4s
a2-tee-bracket-01 20260428T211553Z-979f fail 0.00 valid_solid · solid invalid 1.8k 4.8s
a2-tee-bracket-01 20260428T211548Z-4307 fail 0.00 valid_solid · solid invalid 1.9k 5.5s
a2-square-flange-01 20260428T211542Z-409b fail 0.00 valid_solid · solid invalid 2.0k 5.4s
a2-square-flange-01 20260428T211536Z-65d9 fail 0.00 valid_solid · solid invalid 2.0k 6.0s
a2-square-flange-01 20260428T211529Z-66fb fail 0.00 valid_solid · solid invalid 2.1k 6.7s
a2-square-flange-01 20260428T211523Z-8173 PASS 1.00 2.0k 6.0s
a2-square-flange-01 20260428T211517Z-20c8 fail 0.00 valid_solid · solid invalid 2.1k 6.3s
a2-washer-01 20260428T211514Z-b30c fail 0.00 valid_solid · solid invalid 932 2.2s
a2-washer-01 20260428T211512Z-2e83 PASS 1.00 914 1.9s
a2-washer-01 20260428T211511Z-beae fail 0.00 valid_solid · solid invalid 876 1.7s
a2-washer-01 20260428T211509Z-7ed5 PASS 1.00 914 1.7s
a2-washer-01 20260428T211507Z-b913 fail 0.00 valid_solid · solid invalid 919 1.8s
a2-l-bracket-01 20260428T211502Z-db06 fail 0.00 valid_solid · solid invalid 1.6k 4.4s
a2-l-bracket-01 20260428T211459Z-730f fail 0.00 valid_solid · solid invalid 1.4k 3.4s
a2-l-bracket-01 20260428T211455Z-466b fail 0.00 valid_solid · solid invalid 1.5k 4.1s
a2-l-bracket-01 20260428T211451Z-de15 fail 0.00 valid_solid · solid invalid 1.4k 3.7s
a2-l-bracket-01 20260428T211447Z-f157 fail 0.00 valid_solid · solid invalid 1.5k 3.8s
a2-flanged-cap-01 20260428T211441Z-1051 fail 0.00 valid_solid · solid invalid 2.2k 6.4s
a2-flanged-cap-01 20260428T211434Z-23f7 fail 0.00 valid_solid · solid invalid 2.2k 6.7s
a2-flanged-cap-01 20260428T211426Z-7999 fail 0.00 valid_solid · solid invalid 2.6k 7.8s
a2-flanged-cap-01 20260428T211419Z-e48d fail 0.00 valid_solid · solid invalid 2.4k 7.2s
a2-flanged-cap-01 20260428T211413Z-217b fail 0.00 valid_solid · solid invalid 2.1k 6.2s
a1-pipe-01 20260428T211411Z-1951 fail 0.00 valid_solid · solid invalid 914 2.0s
a1-pipe-01 20260428T211409Z-0d37 PASS 1.00 910 1.7s
a1-pipe-01 20260428T211407Z-5313 fail 0.00 valid_solid · solid invalid 927 1.6s
a1-pipe-01 20260428T211405Z-7853 PASS 1.00 910 1.7s
a1-pipe-01 20260428T211403Z-21af fail 0.00 valid_solid · solid invalid 914 1.8s
a1-block-01 20260428T211401Z-92c7 fail 0.00 valid_solid · solid invalid 883 1.9s
a1-block-01 20260428T211400Z-e330 fail 0.00 valid_solid · solid invalid 842 1.5s
a1-block-01 20260428T211358Z-a58a fail 0.00 valid_solid · solid invalid 882 1.7s
a1-block-01 20260428T211357Z-5bfe PASS 1.00 874 1.4s
a1-block-01 20260428T211355Z-14b8 PASS 1.00 846 1.7s
a1-cone-01 20260428T211354Z-e94b fail 0.00 valid_solid · solid invalid 788 1.1s
a1-cone-01 20260428T211353Z-2dba fail 0.00 valid_solid · solid invalid 786 1.1s
a1-cone-01 20260428T211351Z-d584 fail 0.00 valid_solid · solid invalid 785 1.1s
a1-cone-01 20260428T211350Z-6a6d fail 0.00 valid_solid · solid invalid 788 1.4s
a1-cone-01 20260428T211349Z-cca9 fail 0.00 valid_solid · solid invalid 789 1.2s
a1-sphere-01 20260428T211347Z-dc35 fail 0.00 valid_solid · solid invalid 735 1.6s
a1-sphere-01 20260428T211346Z-3258 fail 0.00 valid_solid · solid invalid 734 1.3s
a1-sphere-01 20260428T211345Z-9e55 fail 0.00 valid_solid · solid invalid 735 1.0s
a1-sphere-01 20260428T211344Z-91f2 fail 0.00 valid_solid · solid invalid 734 1.0s
a1-sphere-01 20260428T211342Z-2ffc fail 0.00 valid_solid · solid invalid 735 1.2s
a1-stepped-shaft-01 20260428T211340Z-356d fail 0.00 valid_solid · solid invalid 1.0k 2.5s
a1-stepped-shaft-01 20260428T211337Z-0510 fail 0.00 valid_solid · solid invalid 1.1k 2.4s
a1-stepped-shaft-01 20260428T211335Z-3895 fail 0.00 valid_solid · solid invalid 1.1k 2.5s
a1-stepped-shaft-01 20260428T211332Z-40dc fail 0.50 bbox · X off by -20.00mm 1.1k 2.6s
a1-stepped-shaft-01 20260428T211330Z-227a PASS 1.00 1.0k 2.1s
a1-plate-01 20260428T211325Z-541a PASS 1.00 1.7k 4.4s
a1-plate-01 20260428T211320Z-af9a fail 0.00 valid_solid · solid invalid 1.9k 5.0s
a1-plate-01 20260428T211316Z-88dd fail 0.00 valid_solid · solid invalid 1.7k 4.6s
a1-plate-01 20260428T211311Z-23f3 fail 0.00 valid_solid · solid invalid 1.8k 4.8s
a1-plate-01 20260428T211305Z-8c29 fail 0.00 valid_solid · solid invalid 1.9k 5.9s
a1-cube-01 20260428T211303Z-76e0 fail 0.00 valid_solid · solid invalid 809 1.9s
a1-cube-01 20260428T211301Z-71e1 PASS 1.00 831 1.5s
a1-cube-01 20260428T211259Z-5ec8 fail 0.00 valid_solid · solid invalid 813 2.1s
a1-cube-01 20260428T211257Z-1d70 PASS 1.00 781 1.5s
a1-cube-01 20260428T211256Z-f60d PASS 1.00 801 1.4s
a1-cube-01 20260428T211113Z-5054 fail 0.00 valid_solid · solid invalid 809 2.0s
a1-cube-01 20260428T211020Z-0ebf PASS 1.00 829 1.6s

generated 2026-06-17T03:16:07.285Z · static site, regenerate with npm run build -w @mecheval/leaderboard