Skip to content

Commit 233fe1f

Browse files
whisper : bypass cross-attention scaling for OpenVINO backend (#3997)
* whisper : bypass cross-attention scaling for OpenVINO backend * whisper : use correct gating flag
1 parent 51de5e8 commit 233fe1f

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

src/whisper.cpp

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2310,7 +2310,9 @@ static struct ggml_cgraph * whisper_build_graph_cross(
23102310
layer.cross_attn_k_w,
23112311
cur);
23122312

2313+
#ifndef GGML_USE_OPENVINO // scaling is handled internally in OpenVINO backend
23132314
Kcross = ggml_scale(ctx0, Kcross, Kscale);
2315+
#endif
23142316

23152317
struct ggml_tensor * Vcross = ggml_mul_mat(ctx0,
23162318
layer.cross_attn_v_w,

0 commit comments

Comments
 (0)