Skip to content

Build a community-curated adversarial test corpus across all 9 patterns #8

Description

@linus10x

ADR-0007 and ARCHITECTURE.md both name the adversarial test corpus as 'the single most-needed contribution.' A community-built corpus of adversarial inputs that exercises every veto reason code across all 9 patterns hardens v0.2 into v0.3.

How to contribute (per CONTRIBUTING.md):

  1. Pick one veto reason code (e.g., FHA-VOUCHER, PROV-HASH-MISMATCH, RESIDENCY-CROSS-JURISDICTION-UNTAGGED)
  2. Construct an adversarial input that exercises an edge case
  3. Add it to tests/adversarial_corpus/<reason_code>.py
  4. PR with the new test passing

Acceptance for issue close:

  • At least 3 adversarial cases per reason code (≈45 cases total)
  • All cases live in tests/adversarial_corpus/
  • CI runs the corpus as a separate test selection (pytest tests/adversarial_corpus/)

Priority: P1. Composite 19/27. Community contribution magnet.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestgood first issueGood for newcomershelp wantedExtra attention is neededv0.2.xPatches in the v0.2 cycle

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions