BlueCollarBench

Trades/Automotive & Diesel

Automotive & DieselTask AU-039journeymanCatchUS

Tech gets a Corolla with P0420, reads the code, sells the customer a new converter, installs it, clears the code, and the light comes back in 400 miles.

Prompt as given to every model

Tech gets a Corolla with P0420, reads the code, sells the customer a new converter, installs it, clears the code, and the light comes back in 400 miles. He wants to warranty the converter. What did he miss?

Model answers

Pick up to two to compare side by side. Score chips fill in as the judge grades.

Laguna S 2.1Score —

What he missed:

  1. Root cause analysis. P0420 (catalyst efficiency below threshold) has many causes beyond a failed converter: - Engine misfires (check for P0300–P030X codes) - Oxygen sensor faults (upstream O2 sensor lazy/failing) - Exhaust leaks (false lean readings trigger P0420) - Engine running rich/lean (fuel trim issues, MAF, vacuum leaks) - Oil burning (contaminates converter)
  1. Pre-installation testing. Should have: - Monitored upstream/downstream O2 sensor waveforms (upstream should switch; downstream should be relatively flat) - Checked for exhaust leaks before the converter - Verified no active misfire codes - Inspected for oil/coolant contamination
  1. Warranty implications. If the converter fails again so quickly, it's likely due to an underlying engine issue. Installing a new converter without fixing the root cause voids most manufacturer warranties.

Code reference: SAE J2012 and EPA regulations require addressing engine performance issues before replacing emissions components.

Bottom line: Diagnose the system, not just the code. A converter replacement without verifying engine health and exhaust integrity is incomplete diagnosis.

383 tokens · 10.7s

Judge rubric · pending

Not graded yet. Grading starts when the exam run completes.

Nemotron 3 Ultra 550BScore —

He missed the diagnosis. P0420 means "Catalyst System Efficiency Below Threshold (Bank 1)." It does not mean "replace the catalytic converter."

What he likely skipped (per SAE J2534 / OEM diagnostics):

  1. Exhaust Leaks: Check upstream of the converter (manifold, flange gaskets, flex pipe). An upstream leak pulls in O₂, fooling the downstream O₂ sensor into mimicking a bad cat.
  2. O₂ Sensor Health: Graph Bank 1 Sensor 1 (upstream) and Sensor 2 (downstream) on a scanner. Upstream should switch rapidly (0.1V–0.9V). Downstream should be steady (~0.45–0.6V) at hot idle/cruise. If downstream mirrors upstream switching, the cat is dead. If downstream is lazy/flat but* upstream is also lazy, the upstream sensor is the cause.
  3. Fuel Trim: Check Long Term Fuel Trim (LTFT). If > +10% (lean) or < -10% (rich), fix the vacuum leak / injector / MAF issue first. A rich condition kills cats; a lean condition prevents light-off.
  4. Misfire History: Check Mode $06 for misfire counts. Unburned fuel from a misfire destroys the catalyst. P0300-P0304 may not set a hard code yet.
  5. PCM Software: Many 2000s–2010s Toyotas (TSB EG007-03, etc.) require a PCM reflash to relax the catalyst monitor threshold after hardware repair. Without it, a perfectly good new cat sets P0420.

Warranty Reality: Catalyst warranties (Federal 8yr/80k, CA 7yr/70k) cover defects, not contamination from unresolved root causes. The supplier will deny the claim if the root cause (leak, sensor, trim, misfire, software) isn't documented as fixed.

Fix: Diagnose the system, not the code. Verify repairs with Mode $06 catalyst monitor results before clearing.

610 tokens · 13.3s

Judge rubric · pending

Not graded yet. Grading starts when the exam run completes.