Skip to content

docs(compat-matrix): prep the page for the 9 column e2e matrix #855

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mateo-berri wants to merge 2 commits into
base: main
Choose a base branch
from
+13 −7
Open

docs(compat-matrix): prep the page for the 9 column e2e matrix #855

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
68839d0
docs(compat-matrix): prep the page for the 9 column e2e matrix
mateo-berri Aug 11, 2026
49095bb
chore: remove semi
mateo-berri Aug 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 7 additions & 5 deletions docs/claude_code_compatibility.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,17 +9,19 @@ import ClaudeCodeCompatibilityTable from '@site/src/components/ClaudeCodeCompati

This table is regenerated daily by an automated populator that runs the
[Claude Code CLI](https://docs.anthropic.com/en/docs/claude-code) against
the latest stable LiteLLM proxy across each supported provider, with
Haiku 4.5, Sonnet 4.6, and Opus 4.7 in parallel. A cell goes green only
if all three model tiers pass.
the latest stable LiteLLM proxy across each supported provider. The
Claude provider columns run Haiku 4.5, Sonnet 4.5, and Opus 4.7 in
parallel. The GPT provider columns (OpenAI, Azure OpenAI, Bedrock
Mantle) run GPT-5.6 Sol, Terra, and Luna. A cell goes green only if all
three model tiers of its column family pass.

<ClaudeCodeCompatibilityTable />

## Legend

| Glyph | Meaning |
| --- | --- |
| ✅ | All three model tiers pass for this `(feature, provider)` cell. |
| ✅ | All three model tiers of the column's family pass for this `(feature, provider)` cell. |
| ❌ | At least one model tier failed. Hover for the upstream error. |
| — | No test ran for this combination. |
| n/a | Not applicable (e.g. provider doesn't expose this feature). Hover for the reason. |
Expand Down Expand Up @@ -49,5 +51,5 @@ the entry will be removed.
The matrix JSON lives at
[`src/data/compatibility-matrix.json`](https://github.com/BerriAI/litellm-docs/blob/main/src/data/compatibility-matrix.json).
The populator is in
[`tests/claude_code/cron_vm/`](https://github.com/BerriAI/litellm/tree/main/tests/claude_code/cron_vm)
[`tests/e2e/claude_code/cron_vm/`](https://github.com/BerriAI/litellm/tree/litellm_internal_staging/tests/e2e/claude_code/cron_vm)
on the main repo.
8 changes: 6 additions & 2 deletions src/components/ClaudeCodeCompatibilityTable/index.tsx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,8 @@ import styles from "./styles.module.css";
* Claude Code compatibility matrix table.
*
* Renders the JSON published daily by the populator
* (`tests/claude_code/cron_vm/run_daily.sh` in BerriAI/litellm) into a
* features-by-providers grid. Each cell shows pass / fail / not_tested /
* (`tests/e2e/claude_code/cron_vm/run_daily.sh` in BerriAI/litellm) into
* a features-by-providers grid. Each cell shows pass / fail / not_tested /
* not_applicable; failure cells expose the upstream error on hover.
*
* The JSON is bundled at build time (no fetch), so the docs page works
Expand Down Expand Up @@ -44,6 +44,10 @@ const PROVIDER_LABELS: Record<string, string> = {
bedrock_converse: "Bedrock (Converse)",
vertex_ai: "Vertex AI",
azure: "Azure (Foundry)",
openai: "OpenAI",
azure_openai: "Azure OpenAI",
bedrock_mantle: "Bedrock (Mantle)",
vertex_ai_gpt: "Vertex AI (GPT)",
};

const STATUS_GLYPH: Record<CellStatus, string> = {
Expand Down