de:wasserversorger-enrich

Run complete. Final report:

Enriched 45 more German water suppliers (23+22 shards, both verified clean against the roster with zero overlaps/malformed records), adding 45 new enrichment records and 67 municipality links with no contact made and no captchas touched. Merged into master files (enrichment.jsonl 1394→1439, roster-links.jsonl 17908→17975); population coverage holds steady at 99.99% (24 municipalities / 11,023 people still residual, unchanged as expected for an enrich-only pass). Flagged for human follow-up: a likely non-supplier on the roster (Stadtwerke Heilbad Heiligenstadt — real operator may be EW Wasser GmbH), a May-2026 billing handover to RangauWerke GmbH in Oberasbach, and a new (non-trap) HTTP 500 on stadtwerke.freilassing.de — plus several pre-existing open items carried forward in the journal.

Picked up cleanly where the 20:30 run left off (enrichment.jsonl 1394, roster.jsonl 3375, roster-links.jsonl 17908 — matched the prior entry's reported finish exactly).

Batch build: build_enrich_batch_excl.mjs 45 enrich-20260903-0030 — 2006 pending (excluding 6 standing duplicate-mint pairs), 0 pending_domain (queue still empty). Split 23/22, dispatched to 2 synchronous general-purpose Agent subagents (run_in_background: false, both launched in one message), each explicitly told not to nest further sub-agents (per the 15:30 run's near-miss) — neither did. Both wrote to their own enrichment.part-shard{A,B}-… / roster-links.part-shard{A,B}-… files as instructed.

Verified before merge: 0 malformed JSON across all 4 shard files, both shards' company_id sets matched their dispatched batch files exactly (no drift/drops), 0 overlap between shard A and B, 0 overlap with the existing 1394-line enrichment.jsonl.

• Shard A (23): 20/23 full 5-core contact, 21/23 email, 18/23 emergency_phone_number, 13/23 analysis_url, 6/23 multi_zone, 87 fetches / 30 searches, 34 municipality links (22/23 companies — the 23rd is a flagged non-supplier, see below).
• Shard B (22): 22/22 full 5-core contact, 20/22 emergency_phone_number, 22/22 analysis_url or named third-party fallback, 6/22 multi_zone, 112 fetches (+ curl workarounds) / 11 searches, 33 new municipality links (6 companies' links skipped as already-complete from prior passes, verified via grep -F first).
• Combined: 45/45 researched, no contact made, no captchas touched, 67 new municipality links.

Merge: enrichment.jsonl 1394 → 1439 lines / 1434 distinct company_id (+45 clean). roster-links.jsonl 17908 → 17975 (+67, exact match). map_roster.mjs ran clean (usual crop of no_ags_for_this_name unmatched Ortsteil/Verbandsgemeinde-composite names, nothing new). consolidate_roster.mjs: 177 shards / 3617 rows, still 3375 distinct companies; roster-links.csv 15410 distinct after dedup. coverage.mjs: population 99.99% → 99.99% (unchanged, expected for an enrich-only pass), 24 residual municipalities / 11,023 people, unchanged.

Findings, recorded in enrichment notes, not propagated to roster.jsonl (append-only; needs a future re-key pass):

• Likely non-supplier: wv-de-3751 (Stadtwerke Heilbad Heiligenstadt GmbH) has zero Trinkwasser content anywhere on its own site (the roster's /wasser URL 404s); a distinct company, EW Wasser GmbH (HRB 402446, Amtsgericht Jena — different HRB/address from Stadtwerke Heiligenstadt's HRB 403131), appears via third-party registry to be the real regional operator and is not on this roster. Needs human confirmation before any re-key.
• Oberasbach (wv-de-3763): billing/commercial water management moved to RangauWerke GmbH (Oberasbach/Zirndorf joint venture) in May 2026 per the city's own news, postdating this row's prior checked_at (2026-08-26) — freshness gap, not an error at the time.
• New host issue (not a known trap): stadtwerke.freilassing.de returned HTTP 500 on every content subpage tried, both WebFetch and curl — looks like a genuine server fault; flag for retry rather than adding to the permanent trap list.
• Confirmed-again known traps, no new workaround needed: avacon-wasser.de/purena.de Cloudflare 403 (routed to third_party_fallback instead), schwalmtalwerke.de needs an ordinary desktop UA (not a WAF, just UA sniffing).
• No python3/pdftotext in this environment for either shard — both used node + curl for PDF href extraction and left PDF body content unread where WebFetch's markdown conversion dropped the hrefs (JS/CMS download widgets); confidence held at medium where that mattered rather than guessing PDF contents.

Still stale (6+ consecutive runs now): export_csv.mjs still reads the dead legacy companies.jsonl/links.jsonl pair, not roster.jsonl/roster-links.jsonl — skipped again in favor of the live map_roster.mjs → consolidate_roster.mjs → coverage.mjs pipeline, as every recent run has done. Worth a maintainer actually fixing this rather than each run re-discovering it.

For next run: continue with build_enrich_batch_excl.mjs 45. 0 pending_domain. Open human follow-ups (compounding across runs, none touched this pass): (1) wv-de-20661 Gauting → Würmtal-Zweckverband re-key; (2) wv-de-20662/wv-de-3587 Gilching duplicate; (3) wv-de-3751 Heilbad Heiligenstadt likely non-supplier / EW Wasser GmbH may be the real operator (new this run); (4) export_csv.mjs pointed at dead source files; (5) wv-de-16016 Ainring and wv-de-3724 Prenzlau self_only roster flags contradicted by their own sites; (6) wv-de-3763 Oberasbach RangauWerke freshness gap (new this run); (7) stadtwerke.freilassing.de HTTP 500 — retry, don't trap yet.