Skip to content

Conversation

@yangw-dev
Copy link
Contributor

@yangw-dev yangw-dev commented Oct 30, 2025

Overview

Add Dashboard for compiler inductor non-aggreated data

Demo:

you can access the new dashboard in list benchmark pages:
https://torchci-git-compilerdashboard-fbopensource.vercel.app/benchmark/benchmark_list

Or directly:
https://torchci-git-compilerdashboard-fbopensource.vercel.app/benchmark/v3/dashboard/compiler_inductor

New features For Comparison Table : Compare Status

in the comparison table, add another comparison policy that user define the statusComparison policy. By default, the UI assume all metric values are numeric, user need to add custom logics to display status properly

status

export type BenchmarkStatusComparisonPolicy = {
  /** "good" (indicate desired value) */
  goodValues?: string[];
  goodValuePatterns?: string[];

  /** "bad" (indicated failure) */
  badValues?: string[];
  badValuePatterns?: string[];
};

Example use default, this will use default goodValuePatterns ['pass'],and default badValuePatterns: ['fail']

comparisonPolicy: {
    accuracy: {
        target: "accuracy",
         type: "status",
    }
}

user can also override it with their specific goodValues and badValues list or patterns.

Next step

  • Sync the link in regression page to dashboard detail page
  • A log component to provide logging info
  • Add CSV download for comparison table

@vercel
Copy link

vercel bot commented Oct 30, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Updated (UTC)
torchci Ready Ready Preview Oct 30, 2025 6:03pm

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 30, 2025
@yangw-dev yangw-dev requested a review from huydhn October 30, 2025 17:44
@yangw-dev yangw-dev changed the title Compiler dashboard Compiler dashboard feature Oct 30, 2025
@yangw-dev yangw-dev marked this pull request as ready for review October 30, 2025 18:04
@yangw-dev yangw-dev merged commit 2d313ab into main Oct 31, 2025
5 checks passed
@yangw-dev yangw-dev deleted the compilerDashboard branch October 31, 2025 01:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants