feat: add Dashscope (Qwen) LLM client support #687
Conversation
|
Seems the dashscope platform updated to sfm(bailian). Use the naming for client might not be a good idea. |
@kid1412621 In their official SDKs, they still call themselves as |
| * @property promptTokensDetails Breakdown of tokens used in the prompt. | ||
| */ | ||
| @Serializable | ||
| public class DashscopeUsage( |
There was a problem hiding this comment.
Is the usage of DashScope different from OpenAI?
I think they’re the same, so you could reuse OpenAIUsage
There was a problem hiding this comment.
I had found a slight different after testing locally.
/**
* @property audioTokens Audio input tokens generated by the model.
* @property cachedTokens Cached tokens present in the prompt.
*/
@Serializable
public class PromptTokensDetails(
public val audioTokens: Int? = null,
public val cachedTokens: Int,
)In older versions of Koog, the audioTokens property of PromptTokensDetails does not have a default value and will cause SerializationException for missing field with Dashscope endpoints.
In commit 6b2283a1fb733e95ccc28453f3c09cf30588dad1, this property was changed nullable and having a null default value. So I agree with your idea.
| * @property maxTokens The maximum number of tokens to generate. | ||
| * @property toolChoice Controls which (if any) tool is called by the model. | ||
| */ | ||
| public data class DashscopeParams( |
There was a problem hiding this comment.
DashscopeParams should inherit from LLMParams. But if it doesn’t extend LLMParams, then it’s better not to use it at all
| /** | ||
| * Dashscope LLM models enumeration. | ||
| */ | ||
| public object DashscopeModels : LLModelDefinitions { |
There was a problem hiding this comment.
In the documentation I see many more models – https://modelstudio.console.alibabacloud.com/?tab=doc#/doc/?type=model&url=2840914
Could you please add the latest Qwen3 models and remove the old turbo?
Motivation and Context
Alibaba cloud serves Qwen models and they have a different API format. This PR adds support to use models on Alibaba dashscope platform.
Resolves #529.
Breaking Changes
No breaking change.
Type of the changes
New feature (non-breaking change which adds functionality)
Checklist
developas the base branchAdditional steps for pull requests adding a new feature