Skip to content

Add llm-swarm-router — local LAN mesh router for oMLX/Ollama/vLLM#12

Open
matthewdcage wants to merge 1 commit into
av:mainfrom
matthewdcage:add-llm-swarm-router
Open

Add llm-swarm-router — local LAN mesh router for oMLX/Ollama/vLLM#12
matthewdcage wants to merge 1 commit into
av:mainfrom
matthewdcage:add-llm-swarm-router

Conversation

@matthewdcage

Copy link
Copy Markdown

Summary

Adds llm-swarm-router (netllm) to API & Proxies — a self-hosted mesh router for local LLM backends, not a cloud provider aggregator.

Fit

  • OSS, self-hostable, container-friendly (matches list criteria)
  • Discovers oMLX, Ollama, LM Studio, vLLM on localhost + LAN peers via mDNS
  • Single OpenAI-compatible + Anthropic Messages API on :11400 for coding agents (Cursor, Claude Code, Codex)
  • Complements LiteLLM (cloud aggregation) with local LAN mesh positioning

Links

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant