Please select the area the issue is related to
Gateway, Platform API, AI Workspace
Please select the aspect the issue is related to
Aspect/API (API backends, definitions, contracts, interfaces, OpenAPI), Aspect/UI (Frontend layouts, components, styling), Aspect/UX (User experience, flows, usability, clarity), Aspect/AI (AI/LLM integration, MCP, AI readiness)
Suggested Feature
Problem
The gateway supports routing one LLM proxy to multiple providers, with per-provider transformer policies converting between wire formats. None of this is reachable from AI Workspace.
Two gaps today:
- A proxy connects to exactly one provider.
additionalProviders cannot be expressed in the UI.
- The inbound interface is silently inherited. A proxy's request format is copied from its primary provider at creation and never presented as a choice, so "expose an OpenAI-compatible endpoint in front of a Mistral provider" is not expressible.
The underlying capability already exists end to end in the gateway (additionalProviders, llm-header-router, five openai-to-* transformer policies) and is partially wired through Platform API.
Proposed solution
Introduce inbound interface as an explicit proxy setting, and allow attaching multiple providers to a proxy.
Core model
The inbound interface is the request format client applications send. It defaults to the primary provider's template and is identified by a template handle (openai, anthropic, gemini, mistralai, …). Its only job is resolving which transformer each attached provider needs:
| Condition |
Result |
| provider template == interface |
No transformer needed |
| provider template != interface |
Requires policy {interface}-to-{template}-transformer |
| that policy is absent |
Provider can be attached but proxy cannot be deployed without required transformer |
This one rule covers both gaps. Multi-provider fan-out is many providers reconciled to one interface; "OpenAI interface on a Mistral proxy" is one provider whose template differs from the interface.
Related Issues
No response
Steps to Verify
Please select the area the issue is related to
Gateway, Platform API, AI Workspace
Please select the aspect the issue is related to
Aspect/API (API backends, definitions, contracts, interfaces, OpenAPI), Aspect/UI (Frontend layouts, components, styling), Aspect/UX (User experience, flows, usability, clarity), Aspect/AI (AI/LLM integration, MCP, AI readiness)
Suggested Feature
Problem
The gateway supports routing one LLM proxy to multiple providers, with per-provider transformer policies converting between wire formats. None of this is reachable from AI Workspace.
Two gaps today:
additionalProviderscannot be expressed in the UI.The underlying capability already exists end to end in the gateway (
additionalProviders,llm-header-router, fiveopenai-to-*transformer policies) and is partially wired through Platform API.Proposed solution
Introduce inbound interface as an explicit proxy setting, and allow attaching multiple providers to a proxy.
Core model
The inbound interface is the request format client applications send. It defaults to the primary provider's template and is identified by a template handle (
openai,anthropic,gemini,mistralai, …). Its only job is resolving which transformer each attached provider needs:{interface}-to-{template}-transformerThis one rule covers both gaps. Multi-provider fan-out is many providers reconciled to one interface; "OpenAI interface on a Mistral proxy" is one provider whose template differs from the interface.
Related Issues
No response
Steps to Verify