claude-code-sonnet-5

provenance: communitySonnet 5harness: claude_cli

Blind track

2.93/4

Overall

Families scored

Seeds

Infra errors

±0.43

Std error

Per-task family scores

Task family	Mean	Seeds	Range	Per-seed scores
Lightened mounting plate	4.00	1	4.00–4.00	4.00
Two-part fastened enclosure	1.00	1	1.00–1.00	1.00
Sheet-metal L-bracket (flat pattern)	n/a	0	—	infra (1)
Laser-cut tab-slot panel	4.00	1	4.00–4.00	4.00
Two-body enclosure (no fasteners)	1.00	1	1.00–1.00	1.00
Fastened two-body enclosure (no BOM)	untested
DFM-tight enclosure (no BOM)	1.00	1	1.00–1.00	1.00
Sheet-metal L-bracket (tight tolerances)	4.00	1	4.00–4.00	4.00
Laser-cut tab-slot panel (tight tolerances)	untested
Laser-cut tab-slot panel (native vector)	untested
Laser-cut bridge and web panel (native vector)	untested
Kerf-aware multi-part laser nest (native vector)	untested
Reverse-engineered bracket	4.00	1	4.00–4.00	4.00
PCB layout coupon (KiCad DFM)	0.00	1	0.00–0.00	0.00
Injection-molded drafted tray	4.00	1	4.00–4.00	4.00
Sand-cast drafted boss with riser	4.00	1	4.00–4.00	4.00
NEMA stepper motor face mount plate	4.00	1	4.00–4.00	4.00
Lofted hollow glass/ceramic vessel	n/a	0	—	infra (1)
Subsystem interface failure modes	untested
Forensic root-cause classification	untested
Tolerance stack-up and GD&T	untested
Packaging/enclosure reliability compliance	untested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)	untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)	untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)	untested
Beam bending DFM	untested
Bearing selection DFM	untested
Bolted joint DFM	untested
Column buckling DFM	untested
Compression spring DFM	untested
Fatigue life DFM	untested
Flat plate DFM	untested
Geartrain efficiency DFM	untested
Heat sink DFM	untested
Hydraulic rod DFM	untested
Injection molding DFM	untested
O-ring groove DFM	untested
Pipe wall DFM	untested
Press-fit interference DFM	untested
Shaft keyway DFM	untested
Sheet-metal bend DFM	untested
Snap-fit DFM	untested
Spur gear DFM	untested
Thermal expansion mismatch DFM	untested
Thread engagement	untested
Thread engagement DFM	untested
Torsion shaft DFM	untested
V-belt drive DFM	untested
Weld joint DFM	untested

Failure-level histogram

L0 (failed L1)1

L1 structural3

L2 geometric0

L3 physical constraints0

L4 dfm7

infra error2

Efficiency & cost

Metric	Value	Source
Agent calls	1.00	runtime.agent_call_count
Wall time (s)	164.16	runtime.wall_time_s
Cost (USD)	0.26 (est.)	api_equivalent_estimate
Total tokens	54616.36	measured_tokens

Perception track

2.38/4

Overall

Families scored

Seeds

Infra errors

±0.41

Std error

Per-task family scores

Task family	Mean	Seeds	Range	Per-seed scores
Lightened mounting plate	4.00	1	4.00–4.00	4.00
Two-part fastened enclosure	1.00	1	1.00–1.00	1.00
Sheet-metal L-bracket (flat pattern)	4.00	1	4.00–4.00	4.00
Laser-cut tab-slot panel	4.00	1	4.00–4.00	4.00
Two-body enclosure (no fasteners)	1.00	1	1.00–1.00	1.00
Fastened two-body enclosure (no BOM)	untested
DFM-tight enclosure (no BOM)	1.00	1	1.00–1.00	1.00
Sheet-metal L-bracket (tight tolerances)	4.00	1	4.00–4.00	4.00
Laser-cut tab-slot panel (tight tolerances)	untested
Laser-cut tab-slot panel (native vector)	untested
Laser-cut bridge and web panel (native vector)	untested
Kerf-aware multi-part laser nest (native vector)	untested
Reverse-engineered bracket	2.00	1	2.00–2.00	2.00
PCB layout coupon (KiCad DFM)	0.00	1	0.00–0.00	0.00
Injection-molded drafted tray	n/a	0	—	infra (1)
Sand-cast drafted boss with riser	1.00	1	1.00–1.00	1.00
NEMA stepper motor face mount plate	4.00	1	4.00–4.00	4.00
Lofted hollow glass/ceramic vessel	3.00	1	3.00–3.00	3.00
Subsystem interface failure modes	untested
Forensic root-cause classification	untested
Tolerance stack-up and GD&T	untested
Packaging/enclosure reliability compliance	untested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)	untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)	untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)	untested
Beam bending DFM	untested
Bearing selection DFM	untested
Bolted joint DFM	untested
Column buckling DFM	untested
Compression spring DFM	untested
Fatigue life DFM	untested
Flat plate DFM	untested
Geartrain efficiency DFM	untested
Heat sink DFM	untested
Hydraulic rod DFM	untested
Injection molding DFM	untested
O-ring groove DFM	untested
Pipe wall DFM	untested
Press-fit interference DFM	untested
Shaft keyway DFM	untested
Sheet-metal bend DFM	untested
Snap-fit DFM	untested
Spur gear DFM	untested
Thermal expansion mismatch DFM	untested
Thread engagement	untested
Thread engagement DFM	untested
Torsion shaft DFM	untested
V-belt drive DFM	untested
Weld joint DFM	untested

Failure-level histogram

L0 (failed L1)1

L1 structural4

L2 geometric1

L3 physical constraints1

L4 dfm5

infra error1

Efficiency & cost

Metric	Value	Source
Agent calls	2.00	runtime.agent_call_count
Wall time (s)	239.25	runtime.wall_time_s
Cost (USD)	0.40 (est.)	api_equivalent_estimate
Total tokens	105631.00	measured_tokens

Perception summary

Observations	12
Compiled	11
Render artifacts	33
Section artifacts	66
Warnings	4
Mean iterations	2.00

Badge endpoint JSON · Back to leaderboard