Add CI benchmark suite: latency + recall regression tracking - #446

Open

Sravan1011 wants to merge 24 commits into

usemoss:mainfrom

Sravan1011:feat/ci-benchmark-suite

Commits on Jun 26, 2026

feat(moss-cli): add shell completions
Sravan1011
committed
be9d9f6
Potential fix for pull request finding

Sravan1011
and
Copilot
authored
8e4937b

Commits on Jun 28, 2026

Merge branch 'usemoss:main' into main
Sravan1011
authored
d0b74b0

Commits on Jul 3, 2026

Merge branch 'usemoss:main' into main
Sravan1011
authored
e3f3133

Commits on Jul 9, 2026

Merge branch 'usemoss:main' into main
Sravan1011
authored
7f6ffc8

Commits on Jul 12, 2026

Merge branch 'usemoss:main' into main
Sravan1011
authored
f72b6d5

Commits on Jul 14, 2026

Merge branch 'usemoss:main' into main
Sravan1011
authored
81b15dd

Commits on Jul 15, 2026

Merge branch 'usemoss:main' into main
Sravan1011
authored
be0503c
Merge branch 'usemoss:main' into main
Sravan1011
authored
e021aec

Commits on Jul 20, 2026

Add CI benchmark suite for latency and recall regression tracking (#435)

Sravan1011
and
claude
committed
f4732a1
Address review feedback: harden generator, workflow, and docs

Sravan1011
and
claude
committed
ded57ea

Commits on Jul 22, 2026

Potential fix for pull request finding

Sravan1011
and
Copilot
authored
196d2f8
Fix broken indent from suggested change; address Copilot findings

Sravan1011
and
claude
committed
26ff7d4
Fix ruff F541: remove f-prefix from placeholder-free strings

Sravan1011
and
claude
committed
16313b1

Commits on Jul 28, 2026

fix: fail trusted CI on missing secrets; signature-derived benchmark index

Sravan1011
and
claude
committed
ffd185b
fix: fail on missing required inputs; serialize runs; validate baseline compatibility

Sravan1011
and
claude
committed
7df6fd3
ci: retry pip install on transient PyPI download failures

Sravan1011
and
claude
committed
16b0343
fix: guard --recreate against deleting non-benchmark indexes; fail on zero latency baseline

Sravan1011
and
claude
committed
1814b15
ci: retrigger after transient PyPI download failure in python-sdk-test (3.14)
Sravan1011
committed
85618ba
fix: explicit unarmed marker for the placeholder latency baseline

Sravan1011
and
claude
committed
3e6ac46
fix: regression guards fail in trusted CI when measurement data is missing

Sravan1011
and
claude
committed
062eebc
fix: guard recall@10 alongside recall@5 in the regression check

Sravan1011
and
claude
committed
bf8f116

Commits on Jul 29, 2026

Address review: exercise index build path per change; write artifact in sessionfinish

Sravan1011
and
claude
committed
ad59ba0
Address review: hash installed files not versions; fix loop/import ordering

Sravan1011
and
claude
committed
942ac8a