Skip to content

Update LightRAG setup: Kimi 2.5 entity extraction & Cerebras+Qwen3 options#1

Open
OnlyTerp wants to merge 1 commit into
mainfrom
devin/1776314159-lightrag-kimi-cerebras-update
Open

Update LightRAG setup: Kimi 2.5 entity extraction & Cerebras+Qwen3 options#1
OnlyTerp wants to merge 1 commit into
mainfrom
devin/1776314159-lightrag-kimi-cerebras-update

Conversation

@OnlyTerp
Copy link
Copy Markdown
Owner

@OnlyTerp OnlyTerp commented Apr 16, 2026

Summary

Replaces the single generic .env example in the LightRAG setup section with three clearly labeled configuration options:

  • Option A — Kimi 2.5 + Fireworks (recommended for quality)
  • Option B — Cerebras + Qwen 3 (recommended for speed)
  • Option C — Free local Ollama setup

Also adds LLM_BINDING_HOST for custom API endpoints, an "API keys" quick-reference with signup links, the entity extraction model comparison table (was missing from part3-lightrag-setup.md), and stronger recommendation copy. Updated both README.md and part3-lightrag-setup.md to stay in sync.

Updates since last revision

  • Rebased on main to resolve merge conflicts with the security-hardening commit (placeholder API keys now use <your-xxx-api-key> format throughout)
  • Preserved the chmod 600 security tip from main in README.md

Review & Testing Checklist for Human

  • Verify LLM_BINDING_HOST is a real LightRAG env var. This was not present in the original examples. If LightRAG uses a different name (e.g. LLM_BINDING_BASE_URL, LLM_BASE_URL), the Kimi and Cerebras examples will silently fail to connect. This is the highest-risk item.
  • Verify API endpoint URLshttps://api.moonshot.cn/v1 (Kimi) and https://api.cerebras.ai/v1 (Cerebras) should be confirmed against current provider docs.
  • Verify model name stringskimi-2.5, qwen-3-32b, qwen3:32b (Ollama variant) — confirm these match what each provider actually expects.
  • Spot-check that both files are consistent — the entity extraction table, .env options, and recommendation text should be identical between README.md (Part 3 inline section) and part3-lightrag-setup.md. Note: part3-lightrag-setup.md is currently missing the chmod 600 security tip that README.md has — minor inconsistency.

Notes

  • The README.md already had partial Kimi 2.5 references and the model comparison table; the main changes there are restructuring the .env into labeled options, adding LLM_BINDING_HOST, and adding the API key links.
  • part3-lightrag-setup.md had larger changes — it was still referencing gpt-4.1-mini as the default and lacked the model comparison table entirely.
  • The troubleshooting "Slow ingestion" section in part3-lightrag-setup.md was also updated to recommend Cerebras + Qwen 3 / Kimi 2.5 instead of the old GPT-4.1-mini / Claude Haiku suggestion.
  • No code changes — documentation only.

Link to Devin session: https://app.devin.ai/sessions/be57baa807b64c75b7f3cfe3596230d8
Requested by: @OnlyTerp


Open with Devin

@devin-ai-integration
Copy link
Copy Markdown
Contributor

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

…lti-option .env

- Replace single .env example with three clear options:
  Option A: Kimi 2.5 + Fireworks (recommended)
  Option B: Cerebras + Qwen 3 (fastest ingestion)
  Option C: Free local Ollama setup
- Add LLM_BINDING_HOST config for Kimi and Cerebras endpoints
- Add API key signup links for Moonshot, Cerebras, and Fireworks
- Update prerequisites to recommend Kimi 2.5 and Cerebras+Qwen3
- Add entity extraction model comparison table to part3-lightrag-setup.md
- Strengthen recommendation text with specific use-case guidance
- Update troubleshooting slow ingestion to reference new models
- Keep both README.md and part3-lightrag-setup.md in sync

Co-Authored-By: Rob <onerobby@gmail.com>
@devin-ai-integration devin-ai-integration Bot force-pushed the devin/1776314159-lightrag-kimi-cerebras-update branch from 35e9a9f to e0244cb Compare April 16, 2026 19:46
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 potential issue.

View 2 additional findings in Devin Review.

Open in Devin Review

Comment thread part3-lightrag-setup.md
Comment on lines +115 to +118
> **Where to get API keys:**
> - **Kimi / Moonshot:** [platform.moonshot.cn](https://platform.moonshot.cn) — sign up, create an API key
> - **Cerebras:** [cloud.cerebras.ai](https://cloud.cerebras.ai) — free tier available, very generous limits
> - **Fireworks:** [fireworks.ai](https://fireworks.ai) — sign up for an API key
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Security tip for chmod 600 on .env file dropped from part3-lightrag-setup.md

The old part3-lightrag-setup.md (line 87) included an important security tip: > **Security tip:** Set restrictive permissions on this file: \chmod 600 ~/.hermes/lightrag/.env`. This was removed during the rewrite but was kept in README.md:674. Since the .env` file contains API keys, users reading only the standalone part3 guide will miss this security guidance, potentially leaving their API keys world-readable.

Suggested change
> **Where to get API keys:**
> - **Kimi / Moonshot:** [platform.moonshot.cn](https://platform.moonshot.cn) — sign up, create an API key
> - **Cerebras:** [cloud.cerebras.ai](https://cloud.cerebras.ai) — free tier available, very generous limits
> - **Fireworks:** [fireworks.ai](https://fireworks.ai) — sign up for an API key
> **Security tip:** Set restrictive permissions on this file: `chmod 600 ~/.hermes/lightrag/.env`
> **Where to get API keys:**
> - **Kimi / Moonshot:** [platform.moonshot.cn](https://platform.moonshot.cn) — sign up, create an API key
> - **Cerebras:** [cloud.cerebras.ai](https://cloud.cerebras.ai) — free tier available, very generous limits
> - **Fireworks:** [fireworks.ai](https://fireworks.ai) — sign up for an API key
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant