Tracking: upstream riscv64 wheel support for all forked packages

[gounthar]

Goal

Track progress of upstreaming riscv64 wheel support to all 33 upstream projects we currently fork and build wheels for.

Each fork has an issue describing the upstream approach (cibuildwheel with QEMU, self-hosted native runners, or cross-compilation). As upstream projects add riscv64 to their CI, we can retire our forks one by one.

Upstream Issues by Package

Rust packages (maturin)

• pydantic-core → pydantic/pydantic-core
• tokenizers → huggingface/tokenizers
• watchfiles → samuelcolvin/watchfiles
• safetensors → huggingface/safetensors
• tiktoken → openai/tiktoken
• jiter → pydantic/jiter
• fastar → DoctorJohn/fastar
• openai-harmony → openai/harmony
• rignore → patrick91/rignore
• orjson → ijl/orjson
• hf-xet → huggingface/xet-core
• textual-speedups → willmcgugan/textual-speedups

Rust + C packages

• cryptography → pyca/cryptography
• blake3 → oconnor663/blake3-py

C/C++ packages

• sentencepiece → google/sentencepiece
• cffi → python-cffi/cffi
• zstandard → indygreg/python-zstandard
• pyyaml → yaml/pyyaml
• tree-sitter → tree-sitter/py-tree-sitter
• tree-sitter-bash → tree-sitter/tree-sitter-bash
• pillow → python-pillow/Pillow
• httptools → MagicStack/httptools
• msgspec → jcrist/msgspec
• pyzmq → zeromq/pyzmq
• uvloop → MagicStack/uvloop
• setproctitle → dvarrazzo/py-setproctitle
• multidict → aio-libs/multidict
• frozenlist → aio-libs/frozenlist
• propcache → aio-libs/propcache
• llama-cpp-python → abetlen/llama-cpp-python

C + Fortran

• numpy → numpy/numpy

Large C++ projects

• torch → pytorch/pytorch
• grpcio → grpc/grpc

Approach

For each package, the upstream issue describes three strategies:

1. cibuildwheel with QEMU — add linux_riscv64 to existing CI (recommended for most)
2. Self-hosted native runners — use our BananaPi F3 boards
3. Cross-compilation — for Rust/maturin or C/C++ toolchain packages

Success criteria

A package is "done" when the upstream project publishes manylinux_2_39_riscv64 wheels on PyPI and we can retire our fork.

Context

• PEP 503 index: https://gounthar.github.io/riscv64-python-wheels/simple/
• Wheel repo: https://github.com/gounthar/riscv64-python-wheels
• cibuildwheel riscv64 docs: https://cibuildwheel.pypa.io/en/stable/
• RISE project riscv64 packaging: https://riseproject.dev/2025/05/14/easy-installation-of-binary-python-packages-on-riscv64-devices/