Skip to content

Fix _remove_answer_from_cache crash with QuantizedCache(backend='hqq') - #290

Merged
maxjeblick merged 2 commits into
NVIDIA:mainfrom
bonginn:fix-hqq-remove-answer-from-cache
Oct 5, 2026
Merged

Fix _remove_answer_from_cache crash with QuantizedCache(backend='hqq')#290
maxjeblick merged 2 commits into
NVIDIA:mainfrom
bonginn:fix-hqq-remove-answer-from-cache

Restore QuantizedCache state after each answer instead of slicing it

aef39ea
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 29, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO