Skip to content

Add relative score scoreboard to benchmark report#21

Open
decofe wants to merge 2 commits into
mainfrom
troy/relative-score-scoreboard
Open

Add relative score scoreboard to benchmark report#21
decofe wants to merge 2 commits into
mainfrom
troy/relative-score-scoreboard

Conversation

@decofe

@decofe decofe commented Jun 18, 2026

Copy link
Copy Markdown
Member

Summary

  • add a prominent higher-is-better fuzzer scoreboard for relscore and relcov
  • support optional --relative-scores-csv input with approach/fuzzer, relscore/relscores, and relcov/covered_edges columns
  • explain relscore as a coverage-value ordering score where rarer, consistently hit edges count more
  • explain relcov as directional coverage overlap, with normalized fallback coverage used only when the report input lacks full pairwise relcov

Tests

  • uv run --with-requirements analysis/requirements.txt python -m unittest analysis.tests.test_benchmark_report

Prompted by: @0xalpharush

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants