Add complete Apps source coverage to data catalog

[mattfaltyn]

Summary

• Add 92 authoritative dataset guides in focused smoke/markets, housing/roads, and European hazard/warning batches. Extend Natural Earth for TitanSkies' pinned ocean and populated-place layers.
• Reconcile the six Apps source maps with 101 distinct exact-match guides. Expand TravelCanary's 45 country rows into 83 named warning systems with per-system guide links or specific exclusion reasons. Keep Bitview related to, rather than identical with, StackingSats' historical parquet.
• Add the source coverage audit, generated notebooks, typed source decisions, and browser/unit checks for routes, mapping, and national warning systems.

Local validation

• node --import tsx scripts/validate-datasets.ts --offline — 252 guides passed.
• Targeted live URL checks — all 92 new guides passed (some official pages use documented, expiring bot-protection exceptions).
• Python starters — all 92 new guides exercised against their official sources or the pinned public artifact; FCC's starter used the downloaded public ZIP.
• node --import tsx scripts/generate-notebooks.ts --check — 108 notebooks current.
• npm run lint, npm test (543 tests), npm run test:coverage (100% core), npm run build, and npm run test:e2e (99 passed, 13 configured skips) — passed.

Full live catalog validation still fails on existing BTS, EUR-Lex, Kalshi, NCES, and Polymarket URLs; provider validation still fails on existing EPSS, Kalshi, Overpass, and Polymarket contracts. These live jobs are already failing on the current main workflow run. No new-guide URL errors were found in the targeted check.

After merge and deployment, smoke-check /apps, the six detail routes, the new dataset routes and Apps guide links, outbound actions, and the sitemap.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
foundation_data	Ready	Preview	Sep 28, 2026 10:47pm UTC