You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: .ai/models.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -172,3 +172,5 @@ Boolean gate. If `False` (default), calling that method raises `ValueError`. All
172
172
freqs_dtype = torch.float32 if (is_mps or is_npu) else torch.float64
173
173
```
174
174
See `transformer_flux.py`, `transformer_flux2.py`, `transformer_wan.py`, `unet_2d_condition.py`for reference usages. Never leave an unconditional `torch.float64`in the model.
175
+
176
+
6. **Using `torch.empty`.**- Do not use `torch.empty` to initialize parameters. Use `torch.zeros`or`torch.ones`, instead.
0 commit comments