codex-gpt-5.4 [medium]

reasoning: mediumprovenance: communityCodex GPT-5.4harness: codex_cli

Blind track

2.45/4

Overall

Families scored

Seeds

Infra errors

±0.48

Std error

Per-task family scores

Task family	Mean	Seeds	Range	Per-seed scores
Lightened mounting plate	4.00	2	4.00–4.00	4.00, 4.00
Two-part fastened enclosure	1.00	2	1.00–1.00	1.00, 1.00
Sheet-metal L-bracket (flat pattern)	4.00	2	4.00–4.00	4.00, 4.00
Laser-cut tab-slot panel	4.00	2	4.00–4.00	4.00, 4.00
Two-body enclosure (no fasteners)	1.00	2	1.00–1.00	1.00, 1.00
Fastened two-body enclosure (no BOM)	1.00	2	1.00–1.00	1.00, 1.00
DFM-tight enclosure (no BOM)	1.00	2	1.00–1.00	1.00, 1.00
Sheet-metal L-bracket (tight tolerances)	4.00	2	4.00–4.00	4.00, 4.00
Laser-cut tab-slot panel (tight tolerances)	1.00	2	0.00–2.00	0.00, 2.00
Laser-cut tab-slot panel (native vector)	0.00	2	0.00–0.00	0.00, 0.00
Laser-cut bridge and web panel (native vector)	untested
Kerf-aware multi-part laser nest (native vector)	untested
Reverse-engineered bracket	4.00	2	4.00–4.00	4.00, 4.00
PCB layout coupon (KiCad DFM)	untested
Injection-molded drafted tray	untested
Sand-cast drafted boss with riser	untested
NEMA stepper motor face mount plate	untested
Lofted hollow glass/ceramic vessel	untested
Subsystem interface failure modes	untested
Forensic root-cause classification	untested
Tolerance stack-up and GD&T	untested
Packaging/enclosure reliability compliance	untested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)	untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)	untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)	untested
Beam bending DFM	untested
Bearing selection DFM	untested
Bolted joint DFM	untested
Column buckling DFM	untested
Compression spring DFM	untested
Fatigue life DFM	untested
Flat plate DFM	untested
Geartrain efficiency DFM	untested
Heat sink DFM	untested
Hydraulic rod DFM	untested
Injection molding DFM	untested
O-ring groove DFM	untested
Pipe wall DFM	untested
Press-fit interference DFM	untested
Shaft keyway DFM	untested
Sheet-metal bend DFM	untested
Snap-fit DFM	untested
Spur gear DFM	untested
Thermal expansion mismatch DFM	untested
Thread engagement	untested
Thread engagement DFM	untested
Torsion shaft DFM	untested
V-belt drive DFM	untested
Weld joint DFM	untested

Failure-level histogram

L0 (failed L1)3

L1 structural8

L2 geometric1

L3 physical constraints0

L4 dfm10

infra error0

Efficiency & cost

Metric	Value	Source
Agent calls	1.00	runtime.agent_call_count
Wall time (s)	50.05	runtime.wall_time_s
Cost (USD)	not available	opaque / not reported
Total tokens	not available	opaque / not reported

Perception track

2.51/4

Overall

Families scored

Seeds

Infra errors

±0.42

Std error

Per-task family scores

Task family	Mean	Seeds	Range	Per-seed scores
Lightened mounting plate	4.00	3	4.00–4.00	4.00, 4.00, 4.00
Two-part fastened enclosure	1.00	3	1.00–1.00	1.00, 1.00, 1.00
Sheet-metal L-bracket (flat pattern)	4.00	3	4.00–4.00	4.00, 4.00, 4.00
Laser-cut tab-slot panel	4.00	3	4.00–4.00	4.00, 4.00, 4.00
Two-body enclosure (no fasteners)	2.00	3	1.00–4.00	1.00, 1.00, 4.00
Fastened two-body enclosure (no BOM)	1.00	3	1.00–1.00	1.00, 1.00, 1.00
DFM-tight enclosure (no BOM)	1.00	3	1.00–1.00	1.00, 1.00, 1.00
Sheet-metal L-bracket (tight tolerances)	3.00	3	3.00–3.00	3.00, 3.00, 3.00
Laser-cut tab-slot panel (tight tolerances)	2.00	3	2.00–2.00	2.00, 2.00, 2.00
Laser-cut tab-slot panel (native vector)	0.00	3	0.00–0.00	0.00, 0.00, 0.00
Laser-cut bridge and web panel (native vector)	untested
Kerf-aware multi-part laser nest (native vector)	untested
Reverse-engineered bracket	4.00	3	4.00–4.00	4.00, 4.00, 4.00
PCB layout coupon (KiCad DFM)	untested
Injection-molded drafted tray	untested
Sand-cast drafted boss with riser	untested
NEMA stepper motor face mount plate	untested
Lofted hollow glass/ceramic vessel	untested
Subsystem interface failure modes	untested
Forensic root-cause classification	untested
Tolerance stack-up and GD&T	untested
Packaging/enclosure reliability compliance	untested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)	untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)	untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)	untested
Beam bending DFM	untested
Bearing selection DFM	untested
Bolted joint DFM	untested
Column buckling DFM	untested
Compression spring DFM	untested
Fatigue life DFM	untested
Flat plate DFM	untested
Geartrain efficiency DFM	untested
Heat sink DFM	untested
Hydraulic rod DFM	untested
Injection molding DFM	untested
O-ring groove DFM	untested
Pipe wall DFM	untested
Press-fit interference DFM	untested
Shaft keyway DFM	untested
Sheet-metal bend DFM	untested
Snap-fit DFM	untested
Spur gear DFM	untested
Thermal expansion mismatch DFM	untested
Thread engagement	untested
Thread engagement DFM	untested
Torsion shaft DFM	untested
V-belt drive DFM	untested
Weld joint DFM	untested

Failure-level histogram

L0 (failed L1)3

L1 structural11

L2 geometric3

L3 physical constraints3

L4 dfm13

infra error0

Efficiency & cost

Metric	Value	Source
Agent calls	2.36	runtime.agent_call_count
Wall time (s)	108.67	runtime.wall_time_s
Cost (USD)	0.09 (est.)	api_equivalent_estimate
Total tokens	40847.79 (est.)	local_log_tokens

Perception summary

Observations	45
Compiled	37
Render artifacts	132
Section artifacts	222
Warnings	12
Mean iterations	2.36

Badge endpoint JSON · Back to leaderboard