Skip to content

spec 009 P7: ablation matrix (--ablate) #13

@zenprocess

Description

@zenprocess

Phase P7 — the publishable counter-intuitive.

pawbench --ablate <component> disables one pipeline component at a time and reports DQS delta. In scope:

  • response gate
  • AC re-verification (single-run only)
  • DQS rewrite queue
  • doctor pre-checks
  • mid-trajectory pruning

pawbench --ablate response_gate,ac_verify,rewrite_queue,doctor,trajectory_pruning produces a 5-row delta table.

Policy: any component with negative delta on ≥ 2 consecutive weekly runs is filed as a removal candidate (issue auto-opened). Surprising negatives are published — that is the entire point of this phase.

Why: Fabian's "quality-focused instructions decreased performance" is the most counter-intuitive result in his write-up. We've added 5 quality gates over 6 months and never measured each in isolation. Either this validates the pipeline or kills dead weight.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions