Repository navigation

Added support of 2-3 bit symmetric mode to LoRA-QAT - #4158

Merged

AlexanderDokuchaev merged 48 commits into

openvinotoolkit:developfrom

andreyanufr:aanuf/2_3_bit_training

Oct 23, 2026

Merged

Added support of 2-3 bit symmetric mode to LoRA-QAT#4158
AlexanderDokuchaev merged 48 commits into
openvinotoolkit:developfrom
andreyanufr:aanuf/2_3_bit_training

Commits on Jul 27, 2026
- Added rapcking of weights to support torch compression for 2-3 bit in nncf side.
  andreyanufr
  committed
  32e2e5d
Commits on Jul 30, 2026
- 1) Removed debug code.
  andreyanufr
  committed
  029d4cf
- Fixed style bugs.
  andreyanufr
  committed
  03ceee7
- Added test for weight repacking.
  andreyanufr
  committed
  db5a21a
- Added test for weight repacking.
  andreyanufr
  committed
  707c35f
Commits on Sep 14, 2026
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  eeb5572
Commits on Sep 15, 2026
- Train 2-3 bit quantizers.
  andreyanufr
  committed
  2c45ac3
Commits on Sep 16, 2026
- Revert experimental changes.
  andreyanufr
  committed
  b0f0240
- Fixed style and removed unused code.
  andreyanufr
  committed
  ab544bb
Commits on Sep 17, 2026
- 1)Added optional equalization for MLP layer.
  andreyanufr
  committed
  fc71994
- Avoid awq in the case of weight equalization.
  andreyanufr
  committed
  8f8cc35
- Added pile dataset for train and PTQ.
  andreyanufr
  committed
  6ad2ffe
Commits on Sep 18, 2026
- Add ultracaht dataset.
  andreyanufr
  committed
  6d94fee
- Added lr scheduler.
  andreyanufr
  committed
  9fdee25
Commits on Sep 21, 2026
- 1) Removed lm_eval validation in the end of training.
  andreyanufr
  committed
  f418fbb
- 1) Added new words to spell check dict.
  andreyanufr
  committed
  4bb71c7
Commits on Sep 24, 2026
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  13a9cd4
Commits on Sep 25, 2026
- 1) Fixed logging of repack_weights.
  andreyanufr
  committed
  547582c
Commits on Sep 30, 2026
- Rename QAT to QAD.
  andreyanufr
  committed
  8ec441a
- Fixed README.
  andreyanufr
  committed
  0369755
Commits on Oct 1, 2026
- Applied suggestions.
  andreyanufr
  committed
  df4691d
- Removed unused comment.
  andreyanufr
  committed
  8c85da3
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  f6e995b
- Update optimum-intel version.
  andreyanufr
  committed
  2a0130d
Commits on Oct 2, 2026
- 1) Added args check.
  andreyanufr
  committed
  b414e89
Commits on Oct 5, 2026
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  ebbeb18
Commits on Oct 6, 2026
- Moved repack_weights to other place.
  andreyanufr
  committed
  ecc6f5a
Commits on Oct 7, 2026
- Moved repack_weights to other place.
  andreyanufr
  committed
  8101998
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  f40ee23
- Added right scale merging for case of Qwen3NextRMSNorm.
  andreyanufr
  committed
  e2df895
- Changes imports order.
  andreyanufr
  committed
  ffc7fa6
- Disable autocast of bfloat16 matmul output to fp32.
  andreyanufr
  committed
  1f558e0
Commits on Oct 8, 2026
- Expand layer norm types for (1+w).
  andreyanufr
  committed
  fc8c8f2
- Move import of ov module to function to avoid error in tests.
  andreyanufr
  committed
  02005cf
- Added type ignore.
  andreyanufr
  committed
  502ecaa
Commits on Oct 9, 2026
- Update README.
  andreyanufr
  committed
  4e801e0
- Update README.
  andreyanufr
  committed
  3a6b3c8
Commits on Oct 12, 2026
- Added small identity matrix to avoid ill-conditioned matrices.
  andreyanufr
  committed
  05bd919
Commits on Oct 16, 2026
- Added group size to args.
  andreyanufr
  committed
  58070b2
Commits on Oct 19, 2026
- Expand possible compression ranges for 2 and 3 bits.
  andreyanufr
  committed
  2c6c42e
- 1) Updated description.
  andreyanufr
  committed
  b50c7fa
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  d2ae606
Commits on Oct 20, 2026
- 1) Added 4 bit as option for compression.
  andreyanufr
  committed
  333f59b
- Remove experimental parameter.
  andreyanufr
  committed
  9aa17e1
- Expand compression args checking for case 2 and 3 bit.
  andreyanufr
  committed
  f4f5d2a
- Potential fix for pull request finding 'Validate scoped quantization modes before inserting FQ'
  
  andreyanufr
  and
  Copilot
  authored
  b837413
- Applied copilot suggestions.
  andreyanufr
  committed
  2d30775
Commits on Oct 23, 2026
- Merge remote-tracking branch 'upstream/develop' into aanuf/2_3_bit_training
  andreyanufr
  committed
  56370fa

Commits

Commits on Jul 27, 2026

Commits on Jul 30, 2026

Commits on Sep 14, 2026

Commits on Sep 15, 2026

Commits on Sep 16, 2026

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Commits on Sep 21, 2026

Commits on Sep 24, 2026

Commits on Sep 25, 2026

Commits on Sep 30, 2026

Commits on Oct 1, 2026

Commits on Oct 2, 2026

Commits on Oct 5, 2026

Commits on Oct 6, 2026

Commits on Oct 7, 2026

Commits on Oct 8, 2026

Commits on Oct 9, 2026

Commits on Oct 12, 2026

Commits on Oct 16, 2026

Commits on Oct 19, 2026

Commits on Oct 20, 2026

Commits on Oct 23, 2026