Built surname matching and review CSV workflow
- Day: 2026-06-04
- Time: 11:35 to 11:45
- Project: Dev
- Workspace: WP 2: Operational
- Status: Completed
- Priority: MEDIUM
- Assignee: Matías Nehuen Iglesias
- Tags: Python, Pandas, Record-Linkage, Csv, Data-Cleaning, Normalization
Description
Session Goal
Develop a robust Python workflow to match contact sheets against a canonical roster using exact surname-based logic, while preserving original sheet order and producing reviewable outputs for manual adjudication.
Key Activities
- Drafted a pandas-based script to cross normalized contact sheets against a canonical roster by surname.
- Adjusted the matching logic from separate name columns to a single canonical
Apellido Nombrefield. - Added text normalization and phrase matching with word boundaries to reduce false positives.
- Designed output splits for
review,too-many, andno-matchcases so ambiguous records can be manually resolved. - Specified processing rules to preserve original row/sheet order and prevent rare duplicates from reappearing across sheets.
- Proposed a downstream decision CSV format to support manual validation and later reconciliation.
Achievements
- Defined a clearer entity-resolution approach centered on surname containment and normalized text matching.
- Established a repeatable review workflow that surfaces ambiguous matches instead of forcing automatic assignment.
- Clarified operational requirements for traceability: order preservation, duplicate avoidance, and console-visible review blocks.
Pending Tasks
- Run the script against the real CSV inputs and validate match quality.
- Review the generated
review,too-many, andno-matchfiles to tune normalization and matching thresholds. - Confirm the final decision CSV schema for manual adjudication and downstream ingestion.
Evidence
- source_file=2026-06-04.sessions.jsonl, line_number=3, event_count=0, session_id=86b59157c0b2f6e2008e5e4a542baec72ebe5b83009fbbcfd6a5f40aef16d4aa
- event_ids: []