blob: b814143b7fe22ac5d5e8ef5ce7ffb416480c8c5e (
plain) (
blame)
1
2
3
|
bitsandbytes enables accessible large language models via k-bit quantization
for PyTorch. We provide three main features for dramatically reducing memory
consumption for inference and training.
|