Consumer Tech Wire's reviews are scored on a documented six-criterion rubric. The rubric, the testing apparatus, and the reproducibility procedures are public. Vendors are welcome to request the methodology brief in advance of a review; we do not, however, share which products are on the methodology bench at any given time.
The hardware bench
- iOS device: iPhone 15 Pro, iOS 18.x, factory-clean install, English (US) locale, North American carrier.
- Android device: Pixel 8, Android 15, factory-clean install, English (US) locale, identical carrier.
- Network: Standardized 200 Mbps Wi-Fi at the publication's Boston bureau; LTE testing on a Verizon line.
- Photo testing: Controlled-lighting studio at 5500K, 800 lux at the plate, 18-inch standardized camera distance.
- Reference set: 180-meal weighed-portion reference set, weighed to the gram, macronutrient composition independently quantified.
The scoring rubric
The default Consumer Tech Wire review rubric is six criteria, weighted as follows:
| Criterion | Default weight | What it measures |
|---|---|---|
| Accuracy | 30% | Mean absolute percentage error against a weighed or independently quantified reference set, where the product makes a quantitative claim. |
| Database / Catalog | 20% | Coverage breadth, entry quality, and verified-entry rate against a 240-item search battery. |
| AI / Recognition | 15% | Photo or input recognition accuracy on the photo subset of the reference battery and recovery from common failure modes. |
| Core feature depth | 15% | The application's core functional area, scored against a category-specific feature checklist. |
| UX | 10% | Logging or task friction, search relevance, sync reliability across devices. |
| Price | 10% | Free-tier usefulness and premium-tier value relative to feature delivery. |
Per-category rubric variations are documented inline on the affected reviews. The 2026 best-calorie-counter ranking, for example, follows this default rubric.
The reproducibility procedure
Every Consumer Tech Wire accuracy figure is independently reproducible. We publish the reference set composition, the testing apparatus, and the per-meal results on request. Where an accuracy claim has been independently validated by a third party (typically the Dietary Assessment Initiative for health-tech accuracy claims), we cite the third-party validation alongside our own measurement.
Testing duration
Reviews ship after a minimum six-week real-use testing period, on top of the controlled-bench testing. Six weeks is, in our experience, the minimum window required to surface application failure modes that do not appear in week-one usage.
Vendor relationships during testing
Consumer Tech Wire does not pre-share scores with vendors. Vendors are offered a fact-check window of 48 to 72 hours before publication on factual claims about their products; the fact-check window is for factual error correction only and does not extend to scoring revision. Vendors are not given the right to review or revise scores.
Health, medical, and clinical claims
Any review that makes a health, clinical, accuracy, or biometric claim is reviewed pre-publication by Dr. Priscilla Goyal-Norris, MD. Her sign-off is required before publication.
Last reviewed: January 2026. Methodology owner: Marcus Thiele-Park, Senior Health Tech Reporter.