Skip to content

Port FBGEMM MoE kernels to Windows #24

@philpax

Description

@philpax

We use FBGEMM MoE kernels to optimise inference; however, these kernels are not natively available on Windows (they are only built for manylinux). As a workaround, we are disabling FBGEMM for Windows in #22, but we would prefer to have native ports of these kernels to ensure that performance has parity between the OSes.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions