Methodology
Luxury Lemon Lawyers Research Methodology
Our research philosophy prioritizes rigorous categorization over casual comparison. We aim to understand what the data actually says, rather than twisting it into a score.
Source Hierarchy
Our primary underlying source for public-data research is the National Highway Traffic Safety Administration (NHTSA) Office of Defects Investigation. We examine four distinct data categories:
- Consumer complaints: Reports submitted by vehicle owners and other reporters. These are self-reported observations, not agency findings.
- Safety recalls: Formal campaigns addressing defined safety defects or regulatory noncompliance.
- Defect investigations: Agency examinations determining whether a safety-related defect may exist.
- Manufacturer communications: Technical service bulletins, diagnostic instructions, and other service-related documentation submitted to NHTSA.
For a practical source-by-source explanation, read how to distinguish NHTSA complaints, recalls, investigations, and manufacturer communications when organizing a vehicle’s records.
Unit of Analysis — Complaints
The conceptual unit in our complaint analysis is one unique NHTSA ODI complaint report.
One single complaint can contain multiple NHTSA component tags (e.g., a single report tagging both "Electrical" and "Brakes"). Therefore, our complaint count and component-mention count are different measurements. Component percentages measure the composition of component mentions, which means percentages can add to more than 100% when interpreted against the raw number of complaints.
Model-Year Control
The pilot uses ONLY MY2024 vehicles. Comparing different model years can introduce large exposure differences because older vehicles have had more time to accumulate reports, mileage, and ownership changes. By restricting our analysis to a single recent model year, we minimize those exposure disparities.
Model-Family Control
The five pilot families were selected because their public-data model mapping was sufficiently clean for an initial study. Additional Mercedes-Benz, Porsche, and Audi models were intentionally withheld from the first report because model aliases and derivative naming require further record-level normalization.
This conservative narrowing is a strength of the methodology. We would rather omit a vehicle from a comparison than publish a number we cannot map confidently.
Audi Data-Quality Example
During our research, records displayed under a generic MY2024 Audi Q8 model label included Q8 e-tron reports. Because the combustion Q8 and the battery-electric Q8 e-tron are separate vehicle families for this research, those records required record-level normalization before use. We completed that separate review using vPIC powertrain fields and narrative checks, while preserving the original five-vehicle pilot as its fixed August 27, 2026 snapshot.
Read the completed Audi Q8 model-normalization study →
Mercedes & Porsche Exclusion
Similarly, Mercedes-Benz and Porsche frequently have model families represented through multiple NHTSA derivative names. Those families will be added only after all applicable aliases are rigorously reconciled and deduplicated. We do not provide incomplete totals.
No Reliability Score
Luxury Lemon Lawyers does NOT currently calculate a proprietary reliability score, "lemon score," or vehicle ranking.
Reasons include:
- Complaint volume is not normalized to sales/production in this pilot.
- Complaints are self-reported and not verified findings.
- One issue can receive multiple component tags.
- Recalls and complaints are fundamentally different evidence types.
- Reporting behavior differs.
- Model-name normalization can artificially inflate or deflate counts.
Future Normalization
Future research expansions may incorporate manufacturer-reported production or exposure information when a sufficiently comparable denominator can be matched to the complaint data.
Important limitations
NHTSA consumer complaints are reports submitted by vehicle owners and other reporters. They are not findings by NHTSA that a defect exists. Complaint volume can be influenced by vehicle population, time on the road, reporting behavior, recall publicity, and other factors. Recall campaigns identify defined safety defects or regulatory noncompliance affecting specified vehicle populations, not every vehicle sharing a model name. An investigation does not by itself establish a defect. Manufacturer communications are service and technical communications, not defect counts. This analysis therefore should not be interpreted as a vehicle reliability ranking, defect rate, or prediction that an individual vehicle qualifies under California lemon law.