LM-Studio Provider

[khill-fbmc]

I am starting to explore this, and was wondering if there was a way to adapt

https://github.com/lmstudio-ai/lmstudio-js

as a provider for your library?

[subeshb1]

Hey @khill-fbmc,

Yes! This can be added as a provider for Agenite. I'm a bit busy now, but when I have time, I can add a provider for it. PRs are welcome too

[khill-fbmc]

I was looking around to see where I might start.

I'm not opposed to figuring it out if I could get a little guidance what interfaces I'd need to implement.

I suppose I could investigate how the ollama provider works... 🤔

[subeshb1]

@khill-fbmc
That’s a great approach! The Ollama provider is a good reference since it follows the same structure you'd need to integrate lmstudio-js.

This is the interface you need to implement https://github.com/subeshb1/agenite/blob/main/packages/llm/src/types.ts#L149

There are two main function

• stream - Streaming mode
• generate - Non streaming mode

If you can make it compatible by using the lmstudio-js SDK then it should be good to go

Feel free to ask any questions along the way! Would love to see what you come up with. 🚀

[subeshb1]

Hey @khill-fbmc , checking if you made any progress on this?

No pressure though, just wanted to check if I could help you clear any confusions

[khill-fbmc]

I am ADHD so this was really important to me... for the hour I hyper-focused and wanted it... but then flitted away to other things 😄

So no, I'm not actively work on this, sorry

[subeshb1]

No worries @khill-fbmc! I'm planning to work on refactoring providers this weekend. I'll let you know if I get time to tackle this