claude-code-sonnet-5.5

provenance: communitySonnet 5.5harness: claude_cli

Blind track

4.00/4

Overall

Families scored

Seeds

Infra errors

±0.00

Std error

Per-task family scores

Task family	Mean	Seeds	Range	Per-seed scores
Lightened mounting plate	4.00	3	4.00–4.00	4.00, 4.00, 4.00
Two-part fastened enclosure	untested
Sheet-metal L-bracket (flat pattern)	untested
Laser-cut tab-slot panel	untested
Two-body enclosure (no fasteners)	untested
Fastened two-body enclosure (no BOM)	untested
DFM-tight enclosure (no BOM)	untested
Sheet-metal L-bracket (tight tolerances)	untested
Laser-cut tab-slot panel (tight tolerances)	untested
Laser-cut tab-slot panel (native vector)	untested
Laser-cut bridge and web panel (native vector)	untested
Kerf-aware multi-part laser nest (native vector)	untested
Reverse-engineered bracket	untested
PCB layout coupon (KiCad DFM)	untested
Injection-molded drafted tray	untested
Sand-cast drafted boss with riser	untested
NEMA stepper motor face mount plate	untested
Lofted hollow glass/ceramic vessel	untested
Subsystem interface failure modes	untested
Forensic root-cause classification	untested
Tolerance stack-up and GD&T	untested
Packaging/enclosure reliability compliance	untested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)	untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)	untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)	untested
Beam bending DFM	untested
Bearing selection DFM	untested
Bolted joint DFM	untested
Column buckling DFM	untested
Compression spring DFM	untested
Fatigue life DFM	untested
Flat plate DFM	untested
Geartrain efficiency DFM	untested
Heat sink DFM	untested
Hydraulic rod DFM	untested
Injection molding DFM	untested
O-ring groove DFM	untested
Pipe wall DFM	untested
Press-fit interference DFM	untested
Shaft keyway DFM	untested
Sheet-metal bend DFM	untested
Snap-fit DFM	untested
Spur gear DFM	untested
Thermal expansion mismatch DFM	untested
Thread engagement	untested
Thread engagement DFM	untested
Torsion shaft DFM	untested
V-belt drive DFM	untested
Weld joint DFM	untested

Failure-level histogram

L0 (failed L1)0

L1 structural0

L2 geometric0

L3 physical constraints0

L4 dfm3

infra error0

Efficiency & cost

Metric	Value	Source
Agent calls	1.00	runtime.agent_call_count
Wall time (s)	15.91	runtime.wall_time_s
Cost (USD)	0.02 (est.)	api_equivalent_estimate
Total tokens	4075.00	measured_tokens

Perception track

4.00/4

Overall

Families scored

Seeds

Infra errors

±0.00

Std error

Per-task family scores

Task family	Mean	Seeds	Range	Per-seed scores
Lightened mounting plate	4.00	3	4.00–4.00	4.00, 4.00, 4.00
Two-part fastened enclosure	untested
Sheet-metal L-bracket (flat pattern)	untested
Laser-cut tab-slot panel	untested
Two-body enclosure (no fasteners)	untested
Fastened two-body enclosure (no BOM)	untested
DFM-tight enclosure (no BOM)	untested
Sheet-metal L-bracket (tight tolerances)	untested
Laser-cut tab-slot panel (tight tolerances)	untested
Laser-cut tab-slot panel (native vector)	untested
Laser-cut bridge and web panel (native vector)	untested
Kerf-aware multi-part laser nest (native vector)	untested
Reverse-engineered bracket	untested
PCB layout coupon (KiCad DFM)	untested
Injection-molded drafted tray	untested
Sand-cast drafted boss with riser	untested
NEMA stepper motor face mount plate	untested
Lofted hollow glass/ceramic vessel	untested
Subsystem interface failure modes	untested
Forensic root-cause classification	untested
Tolerance stack-up and GD&T	untested
Packaging/enclosure reliability compliance	untested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)	untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)	untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)	untested
Beam bending DFM	untested
Bearing selection DFM	untested
Bolted joint DFM	untested
Column buckling DFM	untested
Compression spring DFM	untested
Fatigue life DFM	untested
Flat plate DFM	untested
Geartrain efficiency DFM	untested
Heat sink DFM	untested
Hydraulic rod DFM	untested
Injection molding DFM	untested
O-ring groove DFM	untested
Pipe wall DFM	untested
Press-fit interference DFM	untested
Shaft keyway DFM	untested
Sheet-metal bend DFM	untested
Snap-fit DFM	untested
Spur gear DFM	untested
Thermal expansion mismatch DFM	untested
Thread engagement	untested
Thread engagement DFM	untested
Torsion shaft DFM	untested
V-belt drive DFM	untested
Weld joint DFM	untested

Failure-level histogram

L0 (failed L1)0

L1 structural0

L2 geometric0

L3 physical constraints0

L4 dfm3

infra error0

Efficiency & cost

Metric	Value	Source
Agent calls	2.00	runtime.agent_call_count
Wall time (s)	26.41	runtime.wall_time_s
Cost (USD)	0.04 (est.)	api_equivalent_estimate
Total tokens	8899.33	measured_tokens

Perception summary

Observations	3
Compiled	3
Render artifacts	0
Section artifacts	9
Warnings	18
Mean iterations	2.00

Badge endpoint JSON · Back to leaderboard