Skip to content

Milestone 2 — Import REF CSV data into PostgreSQL #1

Description

@sonht

Milestone 2 scope:

Import all 14 data/csv_reference/REF_*.csv files into PostgreSQL.

Requirements:

  • Create one staging table per CSV file.
  • Store all CSV columns as TEXT.
  • Preserve PL1, PL3, CPT, ICD-9-CM, price codes, STT, IDs, order fields as TEXT.
  • Do not infer numbers or dates.
  • Create import_audit.
  • Implement:
    • POST /admin/import-csv
    • GET /admin/import-status
  • Add frontend buttons:
    • Import CSV into PostgreSQL
    • Check import status
  • Add pytest tests for text-safe import.

Acceptance:

  • All 14 files import successfully.
  • Row counts match /admin/healthcheck.
  • import_audit reports success.
  • "7.10", "03.01", "00123" remain unchanged as text.
  • No matching engine.
  • No AI API.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions