Summary
Web crawl→markdown pilot (8/8 Moss docs pages) produced usable text but repeated documentation chrome in every page and site-generic titles, not page-specific. Bad for indexing quality without normalize step.
Evidence
Expected
Boilerplate stripping + canonical title extraction before index; metrics for chrome ratio.
Priority
P2 product quality for web KB (P1 if selling web ingest now).
Summary
Web crawl→markdown pilot (8/8 Moss docs pages) produced usable text but repeated documentation chrome in every page and site-generic titles, not page-specific. Bad for indexing quality without normalize step.
Evidence
Expected
Boilerplate stripping + canonical title extraction before index; metrics for chrome ratio.
Priority
P2 product quality for web KB (P1 if selling web ingest now).