1 Repo
Awesome GitHub RepositoriesBitsAndBytes Quantizers
8-bit model quantization using the bitsandbytes library for reduced memory inference with explicit CUDA tensor management.
Distinct from Quantized Model Implementations: Distinct from Quantized Model Implementations: focuses on the specific bitsandbytes library and its 8-bit quantization technique, not general quantized model versions.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · BitsAndBytes Quantizers. Refine with filters or upvote what's useful.
Awesome BitsAndBytes Quantizers GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- allenai/olmo
allenai/OLMo
6,313Auf GitHub ansehenProvides 8-bit quantization via bitsandbytes for memory-efficient inference on CUDA devices.
Python
