# dvmazur/mixtral-offloading

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/dvmazur-mixtral-offloading).**

2,328 stars · 227 forks · Python · MIT

## Links

- GitHub: https://github.com/dvmazur/mixtral-offloading
- awesome-repositories: https://awesome-repositories.com/repository/dvmazur-mixtral-offloading.md

## Topics

`colab-notebook` `deep-learning` `google-colab` `language-model` `llm` `mixture-of-experts` `offloading` `pytorch` `quantization`

## Description

Run Mixtral-8x7B models in Colab or consumer desktops

## Tags

### Part of an Awesome List

- [Large Language Models](https://awesome-repositories.com/f/awesome-lists/ai/large-language-models.md) — Techniques for running large models on limited hardware.
- [Large Language Models (LLMs)](https://awesome-repositories.com/f/awesome-lists/more/large-language-models-llms.md) — Listed in the “Large Language Models (LLMs)” section of the The Incredible Pytorch awesome list.