Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 20 additions & 2 deletions .github/workflows/docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ on:
pull_request:
branches:
- main
- f/sglang-support
paths:
- Dockerfile
- .github/workflows/docker.yml
Expand All @@ -22,8 +23,7 @@ jobs:
push_to_registry:
name: Push Docker image to Docker Hub
runs-on:
- self-hosted
- docker
- ubuntu-latest
steps:
- name: Checkout repository
uses: actions/[email protected]
Expand All @@ -34,6 +34,24 @@ jobs:
VERSION=$(grep -A 1 'name = "vllm"' uv.lock | grep version | cut -d '"' -f 2)
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Maximize build space
run: |
echo "Disk space before cleanup:"
df -h
# Remove unnecessary pre-installed software
sudo rm -rf /usr/share/dotnet
sudo rm -rf /usr/local/lib/android
sudo rm -rf /opt/ghc
sudo rm -rf /opt/hostedtoolcache/CodeQL
sudo rm -rf /usr/local/share/boost
sudo rm -rf "$AGENT_TOOLSDIRECTORY"
# Clean apt cache
sudo apt-get clean
# Remove docker images
docker rmi $(docker image ls -aq) >/dev/null 2>&1 || true
echo "Disk space after cleanup:"
df -h

- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3

Expand Down
4 changes: 3 additions & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,9 @@ WORKDIR /vec-inf
COPY . /vec-inf

# Install project dependencies with build requirements
RUN uv pip install --system -e .[dev] --prerelease=allow
# Use --no-cache to prevent uv from storing both downloaded and extracted packages
RUN uv pip install --system -e .[dev] --prerelease=allow --no-cache && \
rm -rf /root/.cache/uv /tmp/*

# Install a single, system NCCL (from NVIDIA CUDA repo in base image)
RUN apt-get update && apt-get install -y --allow-change-held-packages\
Expand Down