← MakerBench leaderboard

deepseek-v4-flash [default_or_unset]

reasoning: default_or_unsetprovenance: communitydeepseek-v4-flashharness: openrouter_api

Blind track

1.90/4
Overall
11
Families scored
33
Seeds
0
Infra errors
±0.28
Std error

Per-task family scores

Task familyMeanSeedsRangePer-seed scores
Lightened mounting plate3.3332.00–4.002.00, 4.00, 4.00
Two-part fastened enclosure1.0031.00–1.001.00, 1.00, 1.00
Sheet-metal L-bracket (flat pattern)3.3333.00–4.003.00, 4.00, 3.00
Laser-cut tab-slot panel2.6732.00–4.002.00, 4.00, 2.00
Two-body enclosure (no fasteners)1.0031.00–1.001.00, 1.00, 1.00
Fastened two-body enclosure (no BOM)1.0031.00–1.001.00, 1.00, 1.00
DFM-tight enclosure (no BOM)1.0031.00–1.001.00, 1.00, 1.00
Sheet-metal L-bracket (tight tolerances)2.6731.00–4.001.00, 3.00, 4.00
Laser-cut tab-slot panel (tight tolerances)2.3332.00–3.003.00, 2.00, 2.00
Laser-cut tab-slot panel (native vector)0.0030.00–0.000.00, 0.00, 0.00
Laser-cut bridge and web panel (native vector)untested
Kerf-aware multi-part laser nest (native vector)untested
Reverse-engineered bracket2.0031.00–4.004.00, 1.00, 1.00
PCB layout coupon (KiCad DFM)untested
Injection-molded drafted trayuntested
Sand-cast drafted boss with riseruntested
NEMA stepper motor face mount plateuntested
Lofted hollow glass/ceramic vesseluntested
Subsystem interface failure modesuntested
Forensic root-cause classificationuntested
Tolerance stack-up and GD&Tuntested
Packaging/enclosure reliability complianceuntested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)untested
Beam bending DFMuntested
Bearing selection DFMuntested
Bolted joint DFMuntested
Column buckling DFMuntested
Compression spring DFMuntested
Fatigue life DFMuntested
Flat plate DFMuntested
Geartrain efficiency DFMuntested
Heat sink DFMuntested
Hydraulic rod DFMuntested
Injection molding DFMuntested
O-ring groove DFMuntested
Pipe wall DFMuntested
Press-fit interference DFMuntested
Shaft keyway DFMuntested
Sheet-metal bend DFMuntested
Snap-fit DFMuntested
Spur gear DFMuntested
Thermal expansion mismatch DFMuntested
Thread engagementuntested
Thread engagement DFMuntested
Torsion shaft DFMuntested
V-belt drive DFMuntested
Weld joint DFMuntested

Failure-level histogram

L0 (failed L1)3
L1 structural15
L2 geometric5
L3 physical constraints4
L4 dfm6
infra error0

Efficiency & cost

MetricValueSource
Agent calls1.00runtime.agent_call_count
Wall time (s)92.92runtime.wall_time_s
Cost (USD)0.00actual_cost
Total tokens8468.06measured_tokens

Perception track

2.23/4
Overall
11
Families scored
33
Seeds
0
Infra errors
±0.44
Std error

Per-task family scores

Task familyMeanSeedsRangePer-seed scores
Lightened mounting plate4.0034.00–4.004.00, 4.00, 4.00
Two-part fastened enclosure1.0031.00–1.001.00, 1.00, 1.00
Sheet-metal L-bracket (flat pattern)4.0034.00–4.004.00, 4.00, 4.00
Laser-cut tab-slot panel2.0032.00–2.002.00, 2.00, 2.00
Two-body enclosure (no fasteners)1.3331.00–2.002.00, 1.00, 1.00
Fastened two-body enclosure (no BOM)1.0031.00–1.001.00, 1.00, 1.00
DFM-tight enclosure (no BOM)1.0031.00–1.001.00, 1.00, 1.00
Sheet-metal L-bracket (tight tolerances)2.6731.00–4.004.00, 3.00, 1.00
Laser-cut tab-slot panel (tight tolerances)2.0032.00–2.002.00, 2.00, 2.00
Laser-cut tab-slot panel (native vector)0.0030.00–0.000.00, 0.00, 0.00
Laser-cut bridge and web panel (native vector)untested
Kerf-aware multi-part laser nest (native vector)untested
Reverse-engineered bracket4.0034.00–4.004.00, 4.00, 4.00
PCB layout coupon (KiCad DFM)untested
Injection-molded drafted trayuntested
Sand-cast drafted boss with riseruntested
NEMA stepper motor face mount plateuntested
Lofted hollow glass/ceramic vesseluntested
Subsystem interface failure modesuntested
Forensic root-cause classificationuntested
Tolerance stack-up and GD&Tuntested
Packaging/enclosure reliability complianceuntested
PCBA BOM cost-optimization (target COGS, alt-vendor selection)untested
PCBA-to-enclosure mechanical interference (Z-height, keepout, connector cutout)untested
PRD → system block diagram + BOM starter + STEP bounding box (PCBA kickoff)untested
Beam bending DFMuntested
Bearing selection DFMuntested
Bolted joint DFMuntested
Column buckling DFMuntested
Compression spring DFMuntested
Fatigue life DFMuntested
Flat plate DFMuntested
Geartrain efficiency DFMuntested
Heat sink DFMuntested
Hydraulic rod DFMuntested
Injection molding DFMuntested
O-ring groove DFMuntested
Pipe wall DFMuntested
Press-fit interference DFMuntested
Shaft keyway DFMuntested
Sheet-metal bend DFMuntested
Snap-fit DFMuntested
Spur gear DFMuntested
Thermal expansion mismatch DFMuntested
Thread engagementuntested
Thread engagement DFMuntested
Torsion shaft DFMuntested
V-belt drive DFMuntested
Weld joint DFMuntested

Failure-level histogram

L0 (failed L1)3
L1 structural12
L2 geometric7
L3 physical constraints1
L4 dfm10
infra error0

Efficiency & cost

MetricValueSource
Agent calls2.45runtime.agent_call_count
Wall time (s)193.19runtime.wall_time_s
Cost (USD)0.00actual_cost
Total tokens16318.21measured_tokens

Perception summary

Observations48
Compiled41
Render artifacts138
Section artifacts246
Warnings13
Mean iterations2.45