Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Makefile 1.9k 200

2. project-codeflare/codeflare project-codeflare/codeflare Public

   Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.

   Jupyter Notebook 234 37

3. llm-d/llm-d-inference-scheduler llm-d/llm-d-inference-scheduler Public

   Inference scheduler for llm-d

   Go 99 82

4. llm-d/llm-d-benchmark llm-d/llm-d-benchmark Public

   llm-d benchmark scripts and tooling

   Jupyter Notebook 30 33

5. foundation-model-stack/multi-nic-cni foundation-model-stack/multi-nic-cni Public

   Go 40 8