Skip to content

[GA-M4][engineering] Generate GA evidence index from ga-eval artifacts #49

Description

@Xunzhuo

Updated from the GA issue triage. This issue is intended to be directly assignable.

Goal

Aggregate GA result artifacts into a single release evidence index.

Deliverables

  • index.json with result ids, sources, verdicts, artifact dirs, and reproduction commands.
  • Markdown summary grouped by milestone/source/priority.
  • Links to Terminal-Bench, SR replay, SWE/internal, and final acceptance evidence.

Acceptance Criteria

  • Index generation fails on missing or invalid result records.
  • The markdown summary can be used by release notes.
  • Every linked artifact path exists or is explicitly marked external/unavailable.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:evaluation-harnessBenchmark tasks, adapters, artifacts, and reproducible result recordsarea:release-opsMilestones, release gates, final acceptance, docs, and issue closurekind:engineeringProduct/runtime implementation, docs wiring, and operational workpriority:p1-gaRequired for GA, but not blocking the first closed evidence slice

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions