-
Notifications
You must be signed in to change notification settings - Fork 8
Open
Description
We use FBGEMM MoE kernels to optimise inference; however, these kernels are not natively available on Windows (they are only built for manylinux). As a workaround, we are disabling FBGEMM for Windows in #22, but we would prefer to have native ports of these kernels to ensure that performance has parity between the OSes.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working