Merchant validation evidence
Generated: May 26, 2026. This proof pass used synthetic small, medium, and large Shopify-style catalogs. It did not write to Shopify or the StoreFix production database.
589
Total fixture products scanned across small, medium, and large catalogs.
66-67%
Quality-score range with intentionally incomplete catalog records.
12-25%
Deeper-rule rate for duplicate descriptions, missing images, and missing catalog context.
6-7%
Manual-only field rate, keeping review-only warnings targeted.
Noise summary
| Catalog | Products | Score | Issues | Any-issue review rate | Deeper-rule rate | Manual-only field rate | Status |
|---|---|---|---|---|---|---|---|
| small-17 | 17 | 66% | 40 | 94% | 12% | 7% | usable |
| medium-72 | 72 | 67% | 168 | 92% | 25% | 6% | usable |
| large-500 | 500 | 67% | 1168 | 92% | 25% | 6% | usable |
Issue-family counts
| Catalog | Thin descriptions | Duplicate descriptions | Missing search title | Missing search description | Missing images | Missing alt text | Missing catalog context |
|---|---|---|---|---|---|---|---|
| small-17 | 5 | 0 | 12 | 14 | 1 | 7 | 1 |
| medium-72 | 18 | 6 | 54 | 54 | 6 | 24 | 6 |
| large-500 | 126 | 41 | 375 | 376 | 42 | 167 | 41 |
Revenue-validation readout
- The deeper rules add useful merchant evidence without dominating the workflow.
- Duplicate descriptions, missing images, and missing catalog context should remain review-only until a merchant confirms the issue is real.
- Writable fields stay scoped to merchant-approved product description, search listing title, search listing description, and image alt text updates.
- The next merchant-facing test should watch for false positives on intentional bundles, gift cards, and service products that may repeat descriptions or omit images on purpose.
Next safe task:
Use these results to tune the in-app filter labels and support copy so merchants see high-volume missing search result fields separately from review-only warnings.
Local source artifact: storefix-ai/test-results/catalog-fixtures/merchant-validation-2026-05-26.md.