# ollama/ollama

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/ollama-ollama).**

174,300 stars · 16,645 forks · Go · MIT

## Links

- GitHub: https://github.com/ollama/ollama
- Homepage: https://ollama.com
- awesome-repositories: https://awesome-repositories.com/repository/ollama-ollama.md

## Topics

`deepseek` `gemma` `gemma3` `glm` `go` `golang` `gpt-oss` `llama` `llama3` `llm` `llms` `minimax` `mistral` `ollama` `qwen`

## Description

Ollama provides a framework for running and managing local machine learning models. It includes a command-line interface for model lifecycle management, such as creation, embedding generation, and configuration, alongside a stable API for programmatic interaction across multiple programming languages.

The platform supports the import of models and adapters in various formats, including GGUF and Safetensors. Users can define custom model behaviors, prompt templates, and system messages through a configuration file format. It also offers tools for fine-tuning models with LoRA adapters and applying quantization to manage memory usage and inference performance.

The software includes infrastructure for cross-platform builds, hardware acceleration for specific graphics processing units, and system-level service management. Installation is supported through automated scripts, and the environment provides utilities for monitoring runtime logs and testing core functionality.

## Tags

### Artificial Intelligence & ML

- [AI Integration APIs](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/model-integration-serving/model-integration-interfaces/ai-integration-apis.md) — Exposes standardized endpoints and official client libraries that allow external applications to communicate seamlessly with locally hosted machine learning models. ([source](https://docs.ollama.com/api))

### Part of an Awesome List

- [AI Agent Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/ai-agent-frameworks.md) — Local runtime for managing and running large language models.
- [AI and Machine Learning](https://awesome-repositories.com/f/awesome-lists/ai/ai-and-machine-learning.md) — Tool for running large language models locally.
- [Application Development Tools](https://awesome-repositories.com/f/awesome-lists/ai/application-development-tools.md) — Tool for running and interacting with large language models locally.
- [Artificial Intelligence](https://awesome-repositories.com/f/awesome-lists/ai/artificial-intelligence.md) — Run local LLMs with a simple API interface.
- [Inference and Serving](https://awesome-repositories.com/f/awesome-lists/ai/inference-and-serving.md) — Tool for running large language models locally.
- [Inference Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-engines.md) — Streamlined tool for running and managing local LLMs.
- [Language Model Development](https://awesome-repositories.com/f/awesome-lists/ai/language-model-development.md) — Tool for running large language models locally.
- [Large Language Models](https://awesome-repositories.com/f/awesome-lists/ai/large-language-models.md) — Local execution of Llama, Mistral, and other open models.
- [LLM Applications](https://awesome-repositories.com/f/awesome-lists/ai/llm-applications.md) — Tool for running local large language models.
- [LLM Providers and Models](https://awesome-repositories.com/f/awesome-lists/ai/llm-providers-and-models.md) — Tool for running large language models locally on your machine.
- [Local AI Assistants](https://awesome-repositories.com/f/awesome-lists/ai/local-ai-assistants.md) — Command-line interface for running local language models.
- [Local Model Deployment](https://awesome-repositories.com/f/awesome-lists/ai/local-model-deployment.md) — Tool for running large language models locally.
- [Model Serving and Inference](https://awesome-repositories.com/f/awesome-lists/ai/model-serving-and-inference.md) — Tool for running various open-source LLMs locally.
- [More to explore](https://awesome-repositories.com/f/awesome-lists/more/more-to-explore.md) — Tool for running local LLMs.