Skip to content

prepare_generative_use_cases.md

Latest commit

 

History

History
21 lines (14 loc) · 598 Bytes

prepare_generative_use_cases.md

File metadata and controls

21 lines (14 loc) · 598 Bytes
Raw

Exporting GEN AI Models {#ovms_docs_prepare_genai}

---
maxdepth: 1
hidden:
---

ovms_docs_pull
ovms_demos_common_export
ovms_docs_pull_optimum

Prepare models using OVMS pull mode (recommended).

Prepare models using python script.

Prepare models using OVMS with python optimum pull mode.

Note: For several large generative models on limited memory, use Idle servable management (preview). Configure --cache_dir to reduce model wake-up latency.