Model selection currently can only be done through the UI and possibly is limited to preset models (or possibly just those that are already local):
- Possibly add a JSON configuration for selecting models
- Allow for selecting different models either off of HuggingFace or ollama to download in the background
- Model downloading should possibly occur when session is created rather than upon first get request
Model selection currently can only be done through the UI and possibly is limited to preset models (or possibly just those that are already local):