← mecheval / model / openai-direct-gpt-5

openai-direct-gpt-5

125 run blobs across 25 tasks

All runs

taskrun statusscorefirst failtokenswall
a3-spherical-dome-block-01 20260429T002029Z-1d3a PASS 1.00 — 3.0k 24.3s
a3-spherical-dome-block-01 20260429T002000Z-8a02 PASS 1.00 — 2.8k 29.2s
a3-spherical-dome-block-01 20260429T001925Z-fed8 PASS 1.00 — 3.1k 34.5s
a3-spherical-dome-block-01 20260429T001857Z-aa27 PASS 1.00 — 2.5k 28.9s
a3-spherical-dome-block-01 20260429T001823Z-17c7 PASS 1.00 — 2.4k 33.2s
a3-three-tangent-cylinders-01 20260429T001740Z-af24 PASS 1.00 — 3.2k 42.9s
a3-three-tangent-cylinders-01 20260429T001659Z-c1ad PASS 1.00 — 3.3k 41.3s
a3-three-tangent-cylinders-01 20260429T001623Z-ebcb PASS 1.00 — 2.7k 36.1s
a3-three-tangent-cylinders-01 20260429T001551Z-e739 PASS 1.00 — 3.0k 31.5s
a3-three-tangent-cylinders-01 20260429T001512Z-f326 PASS 1.00 — 3.8k 38.8s
a3-hex-bolt-pattern-01 20260429T001438Z-79ad PASS 1.00 — 3.4k 34.0s
a3-hex-bolt-pattern-01 20260429T001350Z-9cec PASS 1.00 — 4.0k 47.7s
a3-hex-bolt-pattern-01 20260429T001319Z-6fbc PASS 1.00 — 3.2k 30.6s
a3-hex-bolt-pattern-01 20260429T001246Z-a793 PASS 1.00 — 3.7k 32.1s
a3-hex-bolt-pattern-01 20260429T001217Z-55e6 PASS 1.00 — 3.4k 29.4s
a3-cross-shaft-01 20260429T001154Z-944e fail 0.75 step_roundtrip · STEP drift on 1/1 solid 2.5k 22.7s
a3-cross-shaft-01 20260429T001130Z-432d fail 0.75 step_roundtrip · STEP drift on 1/1 solid 2.7k 23.8s
a3-cross-shaft-01 20260429T001050Z-cfb7 fail 0.75 step_roundtrip · STEP drift on 1/1 solid 2.4k 39.8s
a3-cross-shaft-01 20260429T001021Z-7fcd fail 0.75 step_roundtrip · STEP drift on 1/1 solid 3.0k 29.1s
a3-cross-shaft-01 20260429T000954Z-abff fail 0.75 step_roundtrip · STEP drift on 1/1 solid 2.5k 26.5s
a3-octagonal-flange-01 20260429T000824Z-cd7a fail 0.83 bbox · X off by -1.65mm 7.9k 89.9s
a3-octagonal-flange-01 20260429T000700Z-d34b fail 0.83 bbox · X off by -1.65mm 8.4k 83.4s
a3-octagonal-flange-01 20260429T000521Z-8c3c fail 0.83 bbox · X off by -1.65mm 7.7k 98.6s
a3-octagonal-flange-01 20260429T000421Z-8e49 fail 0.83 bbox · X off by -1.65mm 6.1k 59.7s
a3-octagonal-flange-01 20260428T232829Z-af1f fail 0.83 bbox · X off by -1.65mm 7.5k 162.3s
a3-octagonal-flange-01 20260428T232536Z-6b27 fail 0.83 bbox · X off by -1.65mm 6.5k 73.0s
a2-stepped-pyramid-01 20260428T215635Z-684e PASS 1.00 — 2.5k 24.6s
a2-stepped-pyramid-01 20260428T215622Z-33aa PASS 1.00 — 2.1k 13.2s
a2-stepped-pyramid-01 20260428T215607Z-378e PASS 1.00 — 2.0k 15.0s
a2-stepped-pyramid-01 20260428T215553Z-40b2 PASS 1.00 — 1.9k 13.7s
a2-stepped-pyramid-01 20260428T215533Z-b05e PASS 1.00 — 2.0k 20.6s
a2-cube-with-pocket-01 20260428T215518Z-2456 PASS 1.00 — 1.9k 14.3s
a2-cube-with-pocket-01 20260428T215509Z-5125 PASS 1.00 — 1.4k 9.7s
a2-cube-with-pocket-01 20260428T215445Z-1870 PASS 1.00 — 2.7k 23.8s
a2-cube-with-pocket-01 20260428T215415Z-1e51 PASS 1.00 — 3.0k 29.7s
a2-cube-with-pocket-01 20260428T215401Z-0bb6 PASS 1.00 — 1.6k 13.6s
a2-stepped-block-01 20260428T215353Z-9f7c PASS 1.00 — 1.4k 8.7s
a2-stepped-block-01 20260428T215341Z-d935 PASS 1.00 — 1.7k 12.0s
a2-stepped-block-01 20260428T215331Z-f073 PASS 1.00 — 1.5k 9.6s
a2-stepped-block-01 20260428T215312Z-6765 PASS 1.00 — 2.3k 18.6s
a2-stepped-block-01 20260428T215259Z-4dd1 PASS 1.00 — 1.9k 13.3s
a2-channel-bracket-01 20260428T215246Z-3bcd PASS 1.00 — 1.7k 13.3s
a2-channel-bracket-01 20260428T215234Z-067b PASS 1.00 — 1.7k 11.0s
a2-channel-bracket-01 20260428T215216Z-5389 PASS 1.00 — 1.9k 18.9s
a2-channel-bracket-01 20260428T215205Z-9537 PASS 1.00 — 1.6k 10.4s
a2-channel-bracket-01 20260428T215153Z-9dde PASS 1.00 — 1.6k 11.8s
a2-bolt-circle-block-01 20260428T215119Z-5019 PASS 1.00 — 3.7k 34.0s
a2-bolt-circle-block-01 20260428T215042Z-8791 PASS 1.00 — 3.4k 36.3s
a2-bolt-circle-block-01 20260428T215005Z-47f1 PASS 1.00 — 3.8k 36.6s
a2-bolt-circle-block-01 20260428T214930Z-b470 PASS 1.00 — 3.4k 35.0s
a2-bolt-circle-block-01 20260428T214907Z-b22d PASS 1.00 — 2.9k 22.2s
a2-mounting-rail-01 20260428T214847Z-4ccb PASS 1.00 — 2.6k 20.2s
a2-mounting-rail-01 20260428T214826Z-c220 PASS 1.00 — 2.4k 20.1s
a2-mounting-rail-01 20260428T214804Z-6baa PASS 1.00 — 2.5k 22.8s
a2-mounting-rail-01 20260428T214741Z-0fad PASS 1.00 — 2.8k 22.1s
a2-mounting-rail-01 20260428T214716Z-dcbb PASS 1.00 — 3.0k 25.4s
a2-finned-block-01 20260428T214657Z-a74e PASS 1.00 — 2.4k 18.5s
a2-finned-block-01 20260428T214628Z-9335 PASS 1.00 — 2.6k 28.8s
a2-finned-block-01 20260428T214604Z-d9c6 PASS 1.00 — 2.5k 24.5s
a2-finned-block-01 20260428T214539Z-7c48 PASS 1.00 — 2.5k 25.1s
a2-finned-block-01 20260428T214512Z-f8e2 PASS 1.00 — 2.6k 26.2s
a2-cubemark-01 20260428T214430Z-afc3 PASS 1.00 — 3.8k 41.4s
a2-cubemark-01 20260428T214358Z-fc7c PASS 1.00 — 3.1k 32.0s
a2-cubemark-01 20260428T214319Z-a276 PASS 1.00 — 3.9k 38.6s
a2-cubemark-01 20260428T214232Z-1570 PASS 1.00 — 3.6k 45.8s
a2-cubemark-01 20260428T214152Z-7556 PASS 1.00 — 3.4k 39.8s
a2-tee-bracket-01 20260428T214120Z-bb37 PASS 1.00 — 3.3k 32.2s
a2-tee-bracket-01 20260428T214048Z-b43d PASS 1.00 — 3.4k 31.7s
a2-tee-bracket-01 20260428T214026Z-8b99 PASS 1.00 — 2.7k 22.2s
a2-tee-bracket-01 20260428T214000Z-7eaf PASS 1.00 — 2.9k 25.1s
a2-tee-bracket-01 20260428T213938Z-df0c PASS 1.00 — 2.7k 22.5s
a2-square-flange-01 20260428T213914Z-8819 PASS 1.00 — 2.7k 23.4s
a2-square-flange-01 20260428T213850Z-3ed8 PASS 1.00 — 2.9k 24.3s
a2-square-flange-01 20260428T213822Z-29af PASS 1.00 — 2.8k 27.6s
a2-square-flange-01 20260428T213747Z-1a7a PASS 1.00 — 3.2k 34.8s
a2-square-flange-01 20260428T213707Z-47a7 PASS 1.00 — 3.7k 39.1s
a2-washer-01 20260428T213657Z-d642 PASS 1.00 — 1.3k 10.5s
a2-washer-01 20260428T213646Z-1dc0 PASS 1.00 — 1.2k 10.8s
a2-washer-01 20260428T213637Z-77ca PASS 1.00 — 1.2k 8.4s
a2-washer-01 20260428T213628Z-6b9f PASS 1.00 — 1.2k 9.1s
a2-washer-01 20260428T213607Z-d91a PASS 1.00 — 1.6k 21.3s
a2-l-bracket-01 20260428T213531Z-aeed PASS 1.00 — 3.0k 35.2s
a2-l-bracket-01 20260428T213454Z-af3b PASS 1.00 — 3.5k 37.5s
a2-l-bracket-01 20260428T213431Z-051d PASS 1.00 — 2.4k 22.4s
a2-l-bracket-01 20260428T213335Z-b513 PASS 1.00 — 2.6k 24.3s
a2-flanged-cap-01 20260428T213300Z-9f7d fail 0.86 mass_props · volume off by 0.6% 3.1k 34.3s
a2-flanged-cap-01 20260428T213221Z-f46b fail 0.86 mass_props · volume off by 0.6% 3.8k 38.6s
a2-flanged-cap-01 20260428T213134Z-83dc fail 0.86 mass_props · volume off by 0.6% 3.8k 46.9s
a2-flanged-cap-01 20260428T213101Z-4f70 fail 0.86 mass_props · volume off by 0.6% 2.9k 32.8s
a2-flanged-cap-01 20260428T213024Z-27e5 fail 0.86 mass_props · volume off by 0.6% 3.0k 36.2s
a1-pipe-01 20260428T213012Z-a95c PASS 1.00 — 1.3k 12.1s
a1-pipe-01 20260428T212943Z-e9ff PASS 1.00 — 1.2k 28.3s
a1-pipe-01 20260428T212934Z-de22 PASS 1.00 — 1.2k 9.2s
a1-pipe-01 20260428T212921Z-d353 PASS 1.00 — 1.3k 13.2s
a1-pipe-01 20260428T212913Z-8e1c PASS 1.00 — 1.0k 7.7s
a1-block-01 20260428T212905Z-533a PASS 1.00 — 1.1k 8.1s
a1-block-01 20260428T212859Z-ca68 PASS 1.00 — 1.0k 5.9s
a1-block-01 20260428T212851Z-a6e5 PASS 1.00 — 1.1k 7.8s
a1-block-01 20260428T212835Z-e20b PASS 1.00 — 1.6k 15.6s
a1-cone-01 20260428T212816Z-31d2 PASS 1.00 — 1.3k 11.0s
a1-cone-01 20260428T212810Z-2cca PASS 1.00 — 1.0k 6.0s
a1-cone-01 20260428T212758Z-ea4e PASS 1.00 — 1.2k 12.2s
a1-cone-01 20260428T212751Z-62c4 PASS 1.00 — 1.0k 7.2s
a1-cone-01 20260428T212746Z-027a PASS 1.00 — 895 4.9s
a1-sphere-01 20260428T212739Z-046a PASS 1.00 — 853 6.2s
a1-sphere-01 20260428T212734Z-a064 PASS 1.00 — 920 5.3s
a1-sphere-01 20260428T212728Z-03bb PASS 1.00 — 908 6.1s
a1-sphere-01 20260428T212723Z-4f50 PASS 1.00 — 856 5.1s
a1-sphere-01 20260428T212717Z-650a PASS 1.00 — 901 5.2s
a1-stepped-shaft-01 20260428T212708Z-c37e PASS 1.00 — 1.4k 8.8s
a1-stepped-shaft-01 20260428T212657Z-ddcf PASS 1.00 — 1.4k 11.5s
a1-stepped-shaft-01 20260428T212646Z-5538 PASS 1.00 — 1.4k 10.9s
a1-stepped-shaft-01 20260428T212636Z-5690 PASS 1.00 — 1.4k 10.4s
a1-stepped-shaft-01 20260428T212626Z-2d9a PASS 1.00 — 1.3k 9.3s
a1-plate-01 20260428T212602Z-c2bf PASS 1.00 — 2.5k 24.1s
a1-plate-01 20260428T212535Z-9b56 PASS 1.00 — 2.7k 26.3s
a1-plate-01 20260428T212512Z-a59e PASS 1.00 — 2.6k 23.2s
a1-plate-01 20260428T212447Z-dc71 PASS 1.00 — 2.9k 25.1s
a1-plate-01 20260428T212421Z-91d7 PASS 1.00 — 2.8k 25.3s
a1-cube-01 20260428T212413Z-54a2 PASS 1.00 — 1.2k 8.5s
a1-cube-01 20260428T212405Z-f6c0 PASS 1.00 — 908 7.4s
a1-cube-01 20260428T212355Z-2b83 PASS 1.00 — 1.1k 10.4s
a1-cube-01 20260428T212348Z-2201 PASS 1.00 — 1.2k 6.9s
a1-cube-01 20260428T212331Z-5b81 PASS 1.00 — 1.4k 17.0s
a1-cube-01 20260428T212203Z-cd3a PASS 1.00 — 1.2k 10.0s
mecheval · an evaluation suite by Municipal Robotics
sibling project: vcad. · github

generated 2026-06-17T03:16:07.292Z · static site, regenerate with npm run build -w @mecheval/leaderboard