Add improvements and fixes to upstream - #223

Closed

sskalnik wants to merge 15 commits into

Stability-AI:mainfrom

sskalnik:sat-pr-v1

Commits on Sep 14, 2025

Upgrade pytorch_lightning 2.1.0 to 2.4.0
sskalnik
committed
1159d11
Add AIF and AIFF support. Use dill because pickling fails on Windows 11.
sskalnik
committed
0f77d40
Use dill for PreEncodedDataset because pickling fails on Windows 11.
sskalnik
committed
4c038a7

Commits on Sep 25, 2025

Initial commit of working SAO-1.0 and SAO-small training configs and scripts. Update .gitignore to ignore raw audio file dataset folder and outputs folder.
sskalnik
committed
3fb8f3d
Create TRAINING_FOR_NOOBS.md
sskalnik
authored
a39109d
Update TRAINING_FOR_NOOBS.md for clarity regarding /rawfiles.
sskalnik
authored
6be3a2f

Commits on Sep 29, 2025

Add support for AdamW8bit from bitsandbytes. Improve custom metadata module logic. Fix issue with FutureWarning about torch.cuda.amp.autocast() vs torch.amp.autocast("cuda").
sskalnik
committed
01c716a

Commits on Oct 4, 2025

Commits on Oct 5, 2025

Add experimental support for google/t5gemma-b-b-ul2. Remove spurious whitespace from TRAINING_FOR_NOOBS.md.
sskalnik
committed
c6a824b

Commits on Oct 6, 2025

Change learning rate to 5e-5 (still experimenting with SAO-small). Use StatefulDataLoader from torchdata so we can resume from mid-epoch checkpoints.
sskalnik
committed
d4d3274

Commits on Oct 8, 2025

Freeze requirements for 2025 Oct 07.
sskalnik
committed
531531a
Remove experiment artifacts.
sskalnik
committed
9b04c67