Comparison mistakes: how the wrong equipment gets chosen

What to take away

Mistake one: mixing test bases

Efficiency metrics change over time and vary by equipment type. SEER2 and HSPF2 are the current federal metrics for central air conditioners and heat pumps, and AHRI 210/240 is the test standard behind them. They replaced SEER and HSPF, so an old SEER figure and a new SEER2 figure describe the same machine under different procedures.

Heat pump water heaters have the same problem: UEF replaced EF, so a tank rated under the old metric is not comparable to one rated under the new one.

Capacity ratings quoted at different outdoor conditions are not comparable either. Heating capacity is published at 47 F and at 17 F, and cold-climate models add a 5 F rating. Design temperature is the outdoor temperature local code uses for heating load. When comparing electric home upgrades, verify efficiency ratings use the same test standard.

The fix is mechanical. Record the metric name, the test standard and the outdoor temperature next to every number. Refuse to compare rows where any of those differ. If a seller cannot say which procedure produced a figure, treat the figure as unusable.

Mistake two: reading a label as a ranking

Certification marks tell you a product cleared a bar. They do not rank products above that bar or say the bar fits your house.

Standards come from a structured process. EIA's account of how a consensus process provides an alternative route to developing efficiency standards shows the levels are negotiated policy outcomes, not natural constants.

Certification adoption shifts over time as bars move and markets respond. EIA's older reporting that ENERGY STAR homes accounted for roughly a quarter of new construction in 2011 reminds us these programs track a moving share of a moving market. For a current figure, use EPA's annual unit shipment and market share reports instead.

A label's meaning depends on when it was earned.

Mistake three: borrowing someone else's climate

A review from a mild coastal city tells you very little about performance at your design temperature. This is the most common failure in online research, because reviews rarely state climate zone, house vintage or what was replaced. Local installers can explain how regional rules affect heat pump placement and performance.

Mistake four: buying the feature list

Households commonly select on features that turn out to be irrelevant within a month. Connectivity, app dashboards and modes with marketing names all sell equipment and rarely affect satisfaction a year later. Sizing, installation quality and local service availability do.

A useful discipline: write down the three things that will determine whether you are happy with this purchase in year five, before looking at any product page. Almost nobody writes down an app.

Rebuilding the comparison properly

Use one table, one set of units, one test basis, and fill it completely for every candidate. Leave a cell blank rather than guessing, and treat a blank as a question for the seller. The full method is in our guide to comparing product categories, and the broader error patterns sit in the mistakes that cost time.

The same house, two cold-climate heat pumps, one basis:

Rows from different standards belong in different tables. A heat pump water heater is compared with another heat pump water heater on UEF under the DOE test procedure.

The two guide addresses above carry a 2027 label from when those guides were written. It is not a standard effective date. The test methods in force are SEER2 and HSPF2 under AHRI 210/240, and UEF for water heaters.

Common questions