Skip to content

Commit 13972d6

Browse files
committed
add todo
Signed-off-by: Kyle Sayers <[email protected]>
1 parent 5004894 commit 13972d6

File tree

1 file changed

+1
-0
lines changed
  • src/llmcompressor/modifiers/quantization/quantization

1 file changed

+1
-0
lines changed

src/llmcompressor/modifiers/quantization/quantization/mixin.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -151,6 +151,7 @@ def resolved_targets(self) -> Set[str]:
151151
targets.add(target)
152152

153153
if self.resolved_config.kv_cache_scheme is not None:
154+
# TODO: decouple reliance on this regex for matching attention
154155
targets.add("re:.*self_attn$")
155156

156157
return targets

0 commit comments

Comments
 (0)