perf(pipeline): optional multiprocessing + configurable ONNX providers for data prep + eval#71

Open

Harikrishnareddyl wants to merge 9 commits into

livekit:mainfrom

Harikrishnareddyl:perf/parallel-augmentation

Commits on Apr 23, 2026

config: add AugmentationConfig.n_workers and mp_context fields
Harikrishnareddyl
committed
augment: optional multiprocessing.Pool for _augment_directory
Harikrishnareddyl
committed
tests: round-trip parity between single-threaded and pool augment
Harikrishnareddyl
committed
docs: document AugmentationConfig.n_workers with benchmarks
Harikrishnareddyl
committed
config: add FeatureExtractionConfig and EvalConfig with ONNX providers
Harikrishnareddyl
committed
features: optional multiprocessing.Pool + configurable ONNX providers
Harikrishnareddyl
committed
eval: configurable ONNX providers and batch_size
Harikrishnareddyl
committed
tests: round-trip parity for parallel feature extraction
Harikrishnareddyl
committed
docs: document n_workers + execution_providers across pipeline
Harikrishnareddyl
committed