-
Notifications
You must be signed in to change notification settings - Fork 42
Open
Labels
bugSomething isn't workingSomething isn't working
Description
System Info
The latest install instruction from README are giving me an outdated Llama Stack server: 0.2.9, while latest is 0.2.19
🐛 Describe the bug
The instructions from README are install the operator:
kubectl apply -f https://raw.githubusercontent.com/llamastack/llama-stack-k8s-operator/main/release/operator.yaml
and apply:
apiVersion: llamastack.io/v1alpha1
kind: LlamaStackDistribution
metadata:
name: llamastackdistribution-sample
spec:
replicas: 1
server:
distribution:
name: ollama
containerSpec:
env:
- name: INFERENCE_MODEL
value: llama3.2:1b
- name: OLLAMA_URL
value: http://ollama-server-service.ollama-dist.svc.cluster.local:11434
name: llama-stack
resources: {}
storage:
mountPath: /home/lls/.lls
size: 20GiThis gives me a server of 0.2.9:
k get llamastackdistributions.llamastack.io
NAME PHASE OPERATOR VERSION SERVER VERSION AVAILABLE AGE
llamastackdistribution-sample Ready latest 0.2.9 1 19m
Looking at the actual Pod from the Deployment of the LLSD, I am seeing:
image: docker.io/llamastack/distribution-ollama:latest
imageID: docker.io/llamastack/distribution-ollama@sha256:dd9575ca199e02bdb5ebae7d04d3f87be3243905e7845b92830d128826ceee10
And looking at the image itself: https://hub.docker.com/r/llamastack/distribution-ollama I see the image is a bit old.
Error logs
image: docker.io/llamastack/distribution-ollama:latest
imageID: docker.io/llamastack/distribution-ollama@sha256:dd9575ca199e02bdb5ebae7d04d3f87be3243905e7845b92830d128826ceee10
Expected behavior
A more recent version of LlamaStack, for Ollama
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working