Skip to content

docs: update KServe integration routing - #798

Merged
artberger merged 2 commits into
agentgateway:mainfrom
danehans:update-kserve-integration
Jul 27, 2026
Merged

docs: update KServe integration routing#798
artberger merged 2 commits into
agentgateway:mainfrom
danehans:update-kserve-integration

Conversation

@danehans

Copy link
Copy Markdown
Collaborator

Summary

  • use KServe LLMInferenceService custom routing for AgentgatewayBackend
  • remove the redundant second HTTPRoute workaround
  • update generated route references, gateway service names, and cleanup steps

Validation

  • tested on kind with KServe v0.19.0
  • upgraded the same cluster to KServe v0.20.0-rc0 and retested
  • verified LLM telemetry, response transformations, and token rate limiting
  • ran hugo --gc --minify

Related to kserve/kserve#5729.

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
@danehans
danehans marked this pull request as ready for review July 27, 2026 23:16
@artberger
artberger merged commit 15f924a into agentgateway:main Jul 27, 2026
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants