Skip to content

Outdated version of Llama stack server on latest operat st #149

@matzew

Description

@matzew

System Info

The latest install instruction from README are giving me an outdated Llama Stack server: 0.2.9, while latest is 0.2.19

🐛 Describe the bug

The instructions from README are install the operator:

kubectl apply -f https://raw.githubusercontent.com/llamastack/llama-stack-k8s-operator/main/release/operator.yaml

and apply:

apiVersion: llamastack.io/v1alpha1
kind: LlamaStackDistribution
metadata:
  name: llamastackdistribution-sample
spec:
  replicas: 1
  server:
    distribution:
      name: ollama
    containerSpec:
      env:
      - name: INFERENCE_MODEL
        value: llama3.2:1b
      - name: OLLAMA_URL
        value: http://ollama-server-service.ollama-dist.svc.cluster.local:11434
      name: llama-stack
      resources: {}
    storage:
      mountPath: /home/lls/.lls
      size: 20Gi

This gives me a server of 0.2.9:

k get llamastackdistributions.llamastack.io 
NAME                            PHASE   OPERATOR VERSION   SERVER VERSION   AVAILABLE   AGE
llamastackdistribution-sample   Ready   latest             0.2.9            1           19m

Looking at the actual Pod from the Deployment of the LLSD, I am seeing:

    image: docker.io/llamastack/distribution-ollama:latest
    imageID: docker.io/llamastack/distribution-ollama@sha256:dd9575ca199e02bdb5ebae7d04d3f87be3243905e7845b92830d128826ceee10

And looking at the image itself: https://hub.docker.com/r/llamastack/distribution-ollama I see the image is a bit old.

Error logs

    image: docker.io/llamastack/distribution-ollama:latest
    imageID: docker.io/llamastack/distribution-ollama@sha256:dd9575ca199e02bdb5ebae7d04d3f87be3243905e7845b92830d128826ceee10

Expected behavior

A more recent version of LlamaStack, for Ollama

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions