chore(local-inference): bump fork gitlink to 2bdcef890 — portable non-Apple kokoro fast path (thread pool + NEON)#11545
Conversation
…-Apple kokoro fast path (thread pool + NEON) Gitlink 114eee08e -> 2bdcef890 (linear superset: 2bdcef890 ⊃ 114eee08e Accelerate ⊃ ae0a1eed2 converter). Adds KOKORO_USE_PORTABLE_FAST threaded+NEON vocoder hot loops for non-Apple targets (Android/Windows/ Linux) on top of the Apple Accelerate path. Evidence: .github/issue-evidence/kokoro-metal-perf/ README section + portable-fast-parity-microbench.log (23/23 parity vs scalar, conv up to 107x). Follow-up to #11517, which squash-merged with the older gitlink. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
There was a problem hiding this comment.
Your trial has ended. Reactivate Greptile to resume code reviews.
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Closing as superseded by #11584 — the exact bump is already on develop; verification of the pointer itself passedDevelop's gitlink was moved to the identical target by The pointer verification (done here, applies equally to the landed #11584):
|
|
Claude encountered an error —— View job I'll analyze this and get back to you. |
Follow-up to #11517 (squash-merged before this landed): bumps
plugins/plugin-local-inference/native/llama.cppfrom114eee08e(Accelerate-only) to2bdcef890— a linear superset (2bdcef890⊃114eee08eAccelerate ⊃ae0a1eed2converter) adding the portable non-Apple (Android/Windows/Linux) kokoro fast path: internal thread pool over output channels/gate rows + aarch64 NEON AXPY/dot MACs for conv1d/convtranspose1d/linear/LSTM gates, with the scalar loops retained as reference (KOKORO_FORCE_SCALAR).Evidence (
.github/issue-evidence/kokoro-metal-perf/):portable-fast-parity-microbench.log+ README section — 23/23 parity checks vs scalar (max |Δ| 1.9e-5 < 1e-4) on real generator shapes; conv up to 107×, convtranspose 9–19×, LSTM 4.6× vs scalar; NDK aarch64/x86_64 Android cross-compile clean; Apple Accelerate path rebuilt green.Refs #9033.
🤖 Generated with Claude Code