Skip to content

stream:true not enabled in model server #2099

Description

@ritaneves

stream:true is not enabled in model server

some benchmarks are implemented bypassing model server because of this: e.g. Pinchbench, and this may be a blocker for model server usage for future benchmarks

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status
Dev WIP

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions