Snowflake ML Python

Snowflake ML Python is a set of tools including SDKs and underlying infrastructure to build and deploy machine learning models. With Snowflake ML Python, you can pre-process data, train, manage and deploy ML models all within Snowflake, and benefit from Snowflake’s proven performance, scalability, stability and governance at every stage of the Machine Learning workflow.

Key Components of Snowflake ML Python

The Snowflake ML Python SDK provides a number of APIs to support each stage of an end-to-end Machine Learning development and deployment process.

Snowflake ML Model Development

Snowflake ML Model Development provides a collection of python APIs enabling efficient ML model development directly in Snowflake:

1. Modeling API (snowflake.ml.modeling) for data preprocessing, feature engineering and model training in Snowflake. This includes the snowflake.ml.modeling.preprocessing module for scalable data transformations on large data sets utilizing the compute resources of underlying Snowpark Optimized High Memory Warehouses, and a large collection of ML model development classes based on sklearn, xgboost, and lightgbm.

2. Framework Connectors: Optimized, secure and performant data provisioning for Pytorch and Tensorflow frameworks in their native data loader formats.

Snowflake ML Ops

Snowflake ML Python contains a suite of MLOps tools. It complements the Snowflake Modeling API, and provides end to end development to deployment within Snowflake. The Snowflake ML Ops suite consists of:

1. Registry: A python API allows secure deployment and management of models in Snowflake, supporting models trained both inside and outside of Snowflake.
2. Feature Store: A fully integrated solution for defining, managing, storing and discovering ML features derived from your data. The Snowflake Feature Store supports automated, incremental refresh from batch and streaming data sources, so that feature pipelines need be defined only once to be continuously updated with new data.
3. Datasets: Dataset provide an immutable, versioned snapshot of your data suitable for ingestion by your machine learning models.

Getting started

Learn about all Snowflake ML feature offerings in the Developer Guide.

Have your Snowflake account ready

If you don't have a Snowflake account yet, you can sign up for a 30-day free trial account.

Installation

Snowflake ML Python is pre-installed in Container Runtime notebook environments. Learn more.

In Snowflake Warehouse notebook environments, snowflake-ml-python can be installed using the "Packages" drop-down menu.

Follow the installation instructions in the Snowflake documentation.

Python versions 3.9 to 3.12 are supported. You can use miniconda or anaconda to create a Conda environment (recommended), or virtualenv to create a virtual environment.

Conda channels

The Snowflake Anaconda Channel contains the official snowflake-ml-python package releases. To install snowflake-ml-python from this conda channel:

conda install \
  -c https://repo.anaconda.com/pkgs/snowflake \
  --override-channels \
  snowflake-ml-python

See the developer guide for detailed installation instructions.

The snowflake-ml-python package is also published in conda-forge. To install snowflake-ml-python from conda forge:

conda install \
  -c https://conda.anaconda.org/conda-forge/ \
  --override-channels \
  snowflake-ml-python

Verifying the package

1. Install cosign. This example is using golang installation: installing-cosign-with-go.

2. Download the file from the repository like pypi.

3. Download the signature files from the release tag.

4. Verify signature on projects signed using Jenkins job:

   cosign verify-blob snowflake_ml_python-1.7.0.tar.gz --key snowflake-ml-python-1.7.0.pub --signature resources.linux.snowflake_ml_python-1.7.0.tar.gz.sig
   
   cosign verify-blob snowflake_ml_python-1.7.0.tar.gz --key snowflake-ml-python-1.7.0.pub --signature resources.linux.snowflake_ml_python-1.7.0

NOTE: Version 1.7.0 is used as example here. Please choose the the latest version.