Skip to content

docs(proxy): add a page listing what needs Redis - #857

Merged
mateo-berri merged 5 commits into
mainfrom
litellm_redis_requirements_doc
Aug 13, 2026
Merged

docs(proxy): add a page listing what needs Redis#857
mateo-berri merged 5 commits into
mainfrom
litellm_redis_requirements_doc

Conversation

@devin-ai-integration

@devin-ai-integration devin-ai-integration Bot commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Summary

New page at /docs/proxy/redis_requirements listing every feature we know stops working, or silently works per worker, when the proxy runs without Redis: rate limits and budgets counted per worker, usage and latency based routing, cooldowns, response and semantic caching, key/team cache invalidation, DB-stored config propagation, the Redis spend transaction buffer, the pod lock that elects a single runner for scheduled jobs, shared health checks, request prioritization, CLI SSO, MCP outbound OAuth tokens, and background response polling.

The page says up front that multi-pod without Redis is beta and the list is not exhaustive: it is the best known functionality, other features may also misbehave, and the GA approach for multi-pod is to run Redis. The setup instructions live in #864 and both the "Configure Redis" section and the note about REDIS_* env vars link there rather than duplicating them.

It exists because the Admin UI now shows a default-on banner when no Redis is configured (BerriAI/litellm#36495) and that banner links here. LITELLM_DISABLE_NO_REDIS_WARNING is documented in the env var table alongside the page, and the Redis section of Production Best Practices now points at it.

Link to Devin session: https://app.devin.ai/sessions/c91185109405404bbb87c4967a1346b0
Requested by: @mateo-berri


Note

Cursor Bugbot is generating a summary for commit 8711533. Configure here.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@mateo-berri mateo-berri self-assigned this Aug 11, 2026
@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment, CI, and merge conflict monitoring

@vercel

vercel Bot commented Aug 11, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
litellm Ready Ready Preview Aug 12, 2026 5:14am

Request Review

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@mateo-berri

Copy link
Copy Markdown
Collaborator

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit ca8b402. Configure here.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@mateo-berri

Copy link
Copy Markdown
Collaborator

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 8711533. Configure here.

@mateo-berri
mateo-berri merged commit 9b361bc into main Aug 13, 2026
3 checks passed
@mateo-berri
mateo-berri deleted the litellm_redis_requirements_doc branch August 13, 2026 02:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant