Skip to content

docs(proxy): add a Redis setup guide - #864

Open
devin-ai-integration[bot] wants to merge 5 commits into
mainfrom
litellm_redis_setup_doc
Open

docs(proxy): add a Redis setup guide#864
devin-ai-integration[bot] wants to merge 5 commits into
mainfrom
litellm_redis_setup_doc

Conversation

@devin-ai-integration

@devin-ai-integration devin-ai-integration Bot commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Summary

There was no page telling an operator how to actually stand Redis up and wire the proxy to it. The Redis story was spread across prod.md (two config snippets) and caching.md (cluster, sentinel, TLS, TTL, all framed as response caching), so the "how do I set this up for multiple pods" question had no home. This adds docs/proxy/redis_setup.md under Setup & Deployment, right after Production Best Practices.

It covers provisioning (managed options, the Bitnami helm chart, docker run redis:7 for local checks, sizing and allkeys-lru), then the config, making explicit that REDIS_* env vars alone do nothing until the config points at Redis, and why you want both router_settings and the cache block: the former backs cooldowns and usage/latency routing, the latter backs the coordination Redis behind rate limits, budgets, cache invalidation, the pod lock and scheduled jobs. general_settings.coordination_redis is documented for the case where you want coordination without a response cache, or on a separate Redis. It closes with verification (show_no_redis_warning from /health/readiness/details, the Admin UI banner disappearing, redis-cli --scan) and the operational follow-ups (transaction buffer, simple-shuffle, the litellm_redis_* metrics, max_connections).

Deeper topologies stay in caching.md and this links there rather than duplicating them.

Companion to #857, which lists what breaks without Redis and will link here; the banner added in BerriAI/litellm#36495 points at that page.

Link to Devin session: https://app.devin.ai/sessions/c91185109405404bbb87c4967a1346b0
Requested by: @mateo-berri


Note

Cursor Bugbot is generating a summary for commit 44e25f8. Configure here.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@mateo-berri mateo-berri self-assigned this Aug 11, 2026
@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment, CI, and merge conflict monitoring

@vercel

vercel Bot commented Aug 11, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
litellm Ready Ready Preview Aug 13, 2026 3:09am

Request Review

mateo-berri and others added 2 commits August 12, 2026 01:09
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@mateo-berri

Copy link
Copy Markdown
Collaborator

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 44e25f8. Configure here.

@mateo-berri
mateo-berri enabled auto-merge (squash) August 13, 2026 02:55
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant