BlueCollarBench

Trades/Roofing

RoofingTask RO-039journeymanCatchUS

Shingle reroof around a 4-foot-wide brick chimney on a 6:12.

Prompt as given to every model

Shingle reroof around a 4-foot-wide brick chimney on a 6:12. The crew installed step flashing and an apron, bent a single piece of metal up 6 inches against the back of the chimney under the shingles, and surface-mounted counterflashing with masonry screws and a bead of caulk along the top where it meets the brick. No cricket. Pass or fail?

Model answers

Pick up to two to compare side by side. Score chips fill in as the judge grades.

Nemotron 3 Ultra 550BScore —

Fail. Multiple code violations (IRC R903.2, R905.2.8.3, R903.3).

  1. No Cricket/Saddle (Major): A 48"-wide chimney on a 6:12 slope requires a cricket (IRC R903.2.1 / IBC 1503.2.1). The "single piece bent up 6 inches" is a flat headwall flashing, not a cricket. Water/snow will pond behind the chimney, guaranteeing leaks.
  2. Counterflashing Method (Major): Surface-mounting counterflashing with screws and caulk is not code-compliant (IRC R903.3). Counterflashing must be embedded in a mortar joint (reglet) min. 1" deep and sealed with mortar/sealant. Screws penetrate the water plane; caulk fails under UV/thermal cycling.
  3. Headwall Flashing Height (Minor): 6" up the chimney is minimal. IRC R905.2.8.3 requires flashing to extend up the wall at least the height of the shingle exposure (typically 5–6") plus the counterflashing overlap. With surface-mounted counter, the overlap is unreliable.
  4. Apron Flashing: Ensure the apron (bottom) extends 4" min. over the shingle course below and 4" min. up the chimney face (R905.2.8.3).

Fix: Frame/install a cricket (saddle) covered with ice & water shield and metal flashing. Grind reglets into mortar joints for step, head, and counterflashing. Embed counterflashing 1"+, seal with polyurethane. Re-point mortar.

537 tokens · 17.1s

Judge rubric · pending

Not graded yet. Grading starts when the exam run completes.

Nemotron 3 Super 120BScore —

Fail.

This installation does not meet code or best practices for a 4-foot-wide brick chimney on a 6:12 roof.

Key deficiencies:

  1. No cricket (saddle) – Required by IRC R903.2.1 and IBC 1507.2.8 for chimneys wider than 30 inches on slopes ≥ 6:12. A 48" chimney on a 6:12 roof must have a cricket to divert water around the uphill side. Without it, water ponds behind the chimney, leading to leaks, rot, and premature failure.
  1. Inadequate step flashing integration – While step flashing was installed, the description suggests it may not be properly woven with shingles (each step flashing piece should overlap the shingle below and be covered by the shingle above). Surface-mounted counterflashing alone is insufficient without proper step flashing underneath.
  1. Counterflashing method – Surface-mounted counterflashing with masonry screws and caulk is acceptable only if it’s a secondary barrier over properly installed base flashing (step flashing + apron). However, caulk alone at the top is not a reliable long-term seal; it should be a reglet or mortar joint for durability. Caulk degrades and cracks.
  1. Apron flashing – The bent metal up 6" under shingles sounds like an apron, but it must extend at least 4" up the chimney and 6" onto the roof deck (IRC R903.2.1), and be sealed under shingles. If it’s only bent and not sealed properly, it’s inadequate.

Verdict: Fail. Required fix: Install a cricket (saddle) on the uphill side, ensure step flashing is properly woven with shingles, extend apron flashing correctly, and replace surface-mounted caulked counterflashing with a reglet or mortar-set counterflashing. This is a leak-prone detail — correct it before shingling is complete. Consult a licensed roofer if unsure — this is a critical water management detail.

602 tokens · 5.0s

Judge rubric · pending

Not graded yet. Grading starts when the exam run completes.