Summary
The project has moved to OpenRouter API as the production default due to superior performance. The local LLM setup (Ollama/GPU) should be documented as a community-maintained alternative rather than the primary deployment path.
Current State
- Many docs emphasize local GPU/Ollama deployment as the main path
- Code for local LLM support still exists and works
- Production uses OpenRouter API exclusively
Proposed Changes
Rationale
- OpenRouter provides faster, more reliable results
- No GPU hardware requirements for users
- Local LLM code remains available for those who need offline/air-gapped deployment
- Reduces maintenance burden on core team while preserving optionality
Labels
type: documentation
priority: low
Summary
The project has moved to OpenRouter API as the production default due to superior performance. The local LLM setup (Ollama/GPU) should be documented as a community-maintained alternative rather than the primary deployment path.
Current State
Proposed Changes
docs/community/local-llm.mdsectionRationale
Labels
type: documentationpriority: low