We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 542af1b commit 5033d06Copy full SHA for 5033d06
CHANGELOG.md
@@ -11,6 +11,8 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
11
12
### New features
13
14
+* Adds vLLM support via a new `ChatVLLM` class. (#24)
15
+
16
### Bug fixes
17
18
* `ChatOllama` no longer fails when a `OPENAI_API_KEY` environment variable is not set.
chatlas/_vllm.py
@@ -103,8 +103,8 @@ def __init__(
103
self,
104
base_url: str,
105
model: str,
106
- seed: int | None,
107
- api_key: str | None,
+ seed: Optional[int],
+ api_key: Optional[str],
108
kwargs: Optional["ChatClientArgs"],
109
):
110
self.base_url = base_url
0 commit comments