BlueCollarBench

Trades/Roofing

RoofingTask RO-030journeymanCatchUS

Job in progress: a 12x30 addition roof at 2.5:12 tying into the main 6:12 house roof.

Prompt as given to every model

Job in progress: a 12x30 addition roof at 2.5:12 tying into the main 6:12 house roof. Crew laid one layer of synthetic underlayment over the whole thing and is starting to shingle the low section the same as the main roof, 5-5/8 exposure, 4 nails, standard valley detail at the transition. What's about to go wrong?

Model answers

Pick up to two to compare side by side. Score chips fill in as the judge grades.

Nemotron 3 Ultra 550BScore —

Three critical failures in progress:

  1. Slope Violation (IRC R905.2.2 / Manufacturer Specs): Asphalt shingles require minimum 4:12 slope for standard application. At 2.5:12, you are installing below code minimum. Standard 4-nail, 5-5/8" exposure will leak via capillary action and wind-driven rain. Fix: Strip shingles. Install self-adhering modified bitumen (SBS/APP) or TPO/PVC membrane on the 2.5:12 section. If owner insists on shingles, you need double-coverage (2" exposure), 6 nails, and sealed tabs* per "low slope" manufacturer exceptions (rarely approved < 3:12).
  1. Transition/Valley Detail Failure: A "standard valley" (open or closed-cut) cannot bridge a 6:12 to 2.5:12 transition. The slope break creates a dead valley (water traps against the wall/steep roof). Standard flashing will pond water and leak at the corner. Fix: Requires a custom soldered metal transition pan* (copper/steel) extending 12"+ up the steep roof and wrapping the low-slope eave/rake, integrated with the membrane roof system. Shingles cannot turn this corner.
  1. Underlayment Mismatch: Synthetic underlayment is not a roof covering. It provides zero waterproofing at 2.5:12. It will fail at fasteners and laps within months.

Stop work. Order low-slope membrane and transition metal. Continuing with shingles guarantees a leak callback and voids manufacturer warranty.

534 tokens · 8.5s

Judge rubric · pending

Not graded yet. Grading starts when the exam run completes.

Nemotron 3 Super 120BScore —

You’re setting up for premature failure — specifically, leaks at the transition and potential ice damming — due to incompatible roof slopes and improper underlayment/shingle application.

Key Issues:

  1. Slope Mismatch & Water Flow Dynamics - Main roof: 6:12 (steep, sheds water quickly). - Addition: 2.5:12 (very low slope — barely above minimum for asphalt shingles). - Water from the steep main roof will dump rapidly onto the low-slope addition, overwhelming its drainage capacity. At 2.5:12, water moves slowly, increasing exposure time and risk of wind-driven rain infiltration.
  1. Underlayment Inadequacy - One layer of synthetic underlayment is not sufficient for a 2.5:12 roof. - IRC R905.1.1 & Manufacturer Requirements: For slopes 2:12 to 4:12, two layers of underlayment are required (or a self-adhering ice/water shield) unless the shingle manufacturer explicitly allows otherwise for single layer at ≥3:12. - At 2.5:12, single layer violates code and warranty. Synthetic underlayment alone won’t stop water backup from ice dams or wind-driven rain.
  1. Shingle Exposure & Nailing - 5-5/8" exposure is standard for 3-tab or architectural shingles on ≥4:12 roofs. - On 2.5:12, manufacturers often require reduced exposure (e.g., 5") and/or 6 nails per shingle to resist uplift and water infiltration. - Using standard exposure and 4 nails increases risk of shingle lifting, tearing, and water ingress under hydraulic load from the main roof.
  1. Valley Detail - Standard open or closed-cut valley may not handle the concentrated, high-volume flow from the 6:12 roof into the low-slope valley. - Without ice and water shield extending at least 36" up the low-slope roof from the valley centerline (per IRC R905.1.2 and shingle specs), leaks are likely at the transition.

What’s Going to Happen:

  • Leaks within 1–2 years, especially after wind-driven rain or snow melt.
  • Ice dams likely in cold climates due to poor drainage and heat loss at the transition.
  • Shingle blow-offs or tearing at the low-slope edge.
  • Warranty voided by manufacturer (most require 2:12–4:12 special application).

What Should Be Done:

  • Remove shingles from the low-slope section.
  • Apply self-adhering ice and water shield over the entire 2.5:12 roof (or at least 36" past the valley and up walls).
  • Use manufacturer-approved low-slope application: reduced exposure (5"), 6 nails
842 tokens · 4.6s

Judge rubric · pending

Not graded yet. Grading starts when the exam run completes.