Skip to content

Dequantize the bitsandbytes base before the vLLM weight push - #6922

Open
behroozazarkhalili wants to merge 6 commits into
mainfrom
fix/4973-dequantize-base-before-vllm-push
Open

Dequantize the bitsandbytes base before the vLLM weight push#6922
behroozazarkhalili wants to merge 6 commits into
mainfrom
fix/4973-dequantize-base-before-vllm-push