Scripts and resources for running AI workloads on AMD Instinct MI60 GPUs.
Full documentation is available at cruver.ai/gpu-ai/
- Hardware Setup & Cooling - BIOS settings, fan control, 3D-printed shrouds
- vLLM Inference - Tensor parallelism, AWQ quantization, 70B models
- ComfyUI Setup - Stable Diffusion with ROCm
- Configuration Management - Dynamic switching between workloads
- Metrics & Monitoring - Prometheus, Grafana, temperature alerts
- Single GPU: Thingiverse
- Dual GPU: Thingiverse
Fan control scripts for temperature management:
ml-fan-control.py- Data-driven fan controller with learned utilization→PWM curvemi60-fan.sh- Simple bash fallbackinstall-ml-fan-control.sh- Systemd service installationbenchmark_ollama.sh- Token generation benchmarking
Photos of fan housing setups.
Docker-based workflow for training LoRA adapters.
| Spec | Value |
|---|---|
| Memory | 32GB HBM2 per GPU |
| Architecture | gfx906 (Vega 20) |
| TDP | 300W |
| Interface | PCIe Gen3 |
MIT License