# huggingface/transformers

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/huggingface-transformers).**

161,630 stars · 33,518 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/huggingface/transformers
- Homepage: https://huggingface.co/transformers
- awesome-repositories: https://awesome-repositories.com/repository/huggingface-transformers.md

## Topics

`audio` `deep-learning` `deepseek` `gemma` `glm` `hacktoberfest` `llm` `machine-learning` `model-hub` `natural-language-processing` `nlp` `pretrained-models` `python` `pytorch` `pytorch-transformers` `qwen` `speech-recognition` `transformer` `vlm`

## Description

Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference.

The library features extensive support for model optimization and performance, including techniques like quantization, speculative decoding, and paged memory management for key-value caches. It provides native integration for distributed training across multi-node clusters, as well as flexible APIs for serving models via compatible inference servers. Developers can also utilize built-in utilities for model patching, custom kernel execution, and automated documentation generation to streamline development workflows.

## Tags

### Artificial Intelligence & ML

- [API Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/training-frameworks/api-frameworks.md) — Standardizes the training, fine-tuning, and deployment of models across diverse hardware acceleration backends. ([source](https://huggingface.co/docs/transformers/v5.8.1/main_classes/trainer.md))
- [Vision Transformers](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/frameworks/computer-vision/computer-vision-architectures/vision-transformers.md) — Processes visual data by partitioning images into sequences of patches compatible with transformer architectures. ([source](https://huggingface.co/docs/transformers/v5.8.1/model_doc/vit.md))
- [Hybrid](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-optimization-and-inference/parallelism/hybrid.md) — Coordinates data, pipeline, and tensor parallelism to scale large-scale model training across multi-node clusters. ([source](https://huggingface.co/docs/transformers/v5.8.1/perf_train_gpu_many.md))
- [Byte Pair Encodings](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/language-tools/tokenization-algorithms/byte-pair-encodings.md) — Builds vocabularies by iteratively merging frequent character pairs to perform subword tokenization. ([source](https://huggingface.co/docs/transformers/v5.8.1/tokenizer_summary.md))
- [Chat Template Formatters](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/decoding-generation-controls/chat-template-management/chat-template-formatters.md) — Transforms chat histories into the specific token sequences and control structures required by individual models. ([source](https://huggingface.co/docs/transformers/v5.8.1/chat_templating.md))
- [Qwen2 Language Models](https://awesome-repositories.com/f/artificial-intelligence-ml/language-model-orchestration/large-language-models/qwen2-language-models.md) — Supports advanced architectural features like group query attention and rotary positional embeddings for specialized model families. ([source](https://huggingface.co/docs/transformers/v5.8.1/model_doc/qwen2.md))
- [Large Model Optimizations](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-optimization-and-inference/serving-and-runtime/inference-optimizations/large-model-optimizations.md) — Optimizes memory usage and inference speed through automatic device mapping and half-precision weight support. ([source](https://huggingface.co/docs/transformers/v5.8.1/pipeline_tutorial.md))
- [Checkpoint Resumption](https://awesome-repositories.com/f/artificial-intelligence-ml/training-checkpointing/checkpoint-resumption.md) — Restores training sessions by reloading optimizer, scheduler, and random number generator states from saved checkpoints. ([source](https://huggingface.co/docs/transformers/v5.8.1/trainer_recipes.md))
- [Patterns](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/decoding-generation-controls/tool-calling/patterns.md) — Defines standardized patterns for appending tool execution results and function requests to conversation histories. ([source](https://huggingface.co/docs/transformers/v5.8.1/chat_content_patterns.md))
- [Attention Mechanisms](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/architectures/transformer/attention-mechanisms.md) — Exposes a registry-based interface for implementing custom attention mechanisms or modifying existing model behaviors. ([source](https://huggingface.co/docs/transformers/v5.8.1/internal/modeling_utils.md))
- [Batched Inference Mechanisms](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-optimization-and-inference/serving-and-runtime/inference-optimizations/batched-inference-mechanisms.md) — Enables efficient inference by processing multiple conversation sequences simultaneously in a single forward pass. ([source](https://huggingface.co/docs/transformers/v5.8.1/chat_content_patterns.md))
- [Tokenizer Base Interfaces](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/language-tools/tokenization-interfaces/tokenizer-base-interfaces.md) — Maintains a consistent base class for vocabulary management, encoding, and decoding across various tokenization backends. ([source](https://huggingface.co/docs/transformers/v5.8.1/internal/tokenization_utils.md))
- [Model Quantization](https://awesome-repositories.com/f/artificial-intelligence-ml/model-optimization/quantization/model-quantization.md) — Reduces memory footprints by storing model weights in lower-precision formats while maintaining performance accuracy. ([source](https://huggingface.co/docs/transformers/v5.8.1/quantization/overview.md))
- [Supports](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/decoding-generation-controls/tool-calling/supports.md) — Generates structured function execution requests that allow models to interact directly with host applications. ([source](https://huggingface.co/docs/transformers/v5.8.1/serve-cli/serving.md))
- [Multimodal Input Handlers](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/multimodal-input-handlers.md) — Handles diverse input modalities including audio, video, and images within a unified content processing interface. ([source](https://huggingface.co/docs/transformers/v5.8.1/chat_content_patterns.md))
- [Training Flow Managers](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/machine-learning-training/pipelines-and-orchestration/training-flow-managers.md) — Automates logging, evaluation, and checkpointing schedules through a flexible callback system during training. ([source](https://huggingface.co/docs/transformers/v5.8.1/main_classes/callback.md))
- [Transformers Integration Layers](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-inference-serving/model-integration-pipelines/ai-model-integrations/transformers-integration-layers.md) — Extends standard library functionality with specialized loaders for device mapping, quantization, and custom attention backends. ([source](https://huggingface.co/docs/transformers/v5.8.1/community_integrations/axolotl.md))
- [Data](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-optimization-and-inference/parallelism/data.md) — Synchronizes model training across multiple GPUs to reduce overall computation time through distributed data strategies. ([source](https://huggingface.co/docs/transformers/v5.8.1/perf_train_gpu_many.md))
- [Sequence-to-Sequence Translation Tasks](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/speech-processing/sequence-to-sequence-tasks/sequence-to-sequence-translation-tasks.md) — Facilitates text-to-text translation through integrated model fine-tuning, dataset preprocessing, and streamlined inference pipelines. ([source](https://huggingface.co/docs/transformers/v5.8.1/tasks/translation.md))
- [Chunked Prefill Mechanisms](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/generation-utilities/chunked-prefill-mechanisms.md) — Splits long prompt processing across multiple forward passes to prevent blocking other concurrent requests during generation. ([source](https://huggingface.co/docs/transformers/v5.8.1/continuous_batching_architecture.md))
- [Document Question Answering Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/document-data-intelligence/question-answering/document-question-answering-pipelines.md) — Delivers a high-level interface for performing document question answering by routing image and text inputs through specialized inference pipelines. ([source](https://huggingface.co/docs/transformers/v5.8.1/tasks/document_question_answering.md))
- [Distributed](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/distributed-and-scaling-strategies/training-integrations/distributed.md) — Integrates native components to load models directly into distributed training frameworks, utilizing parallelization and optimization techniques. ([source](https://huggingface.co/docs/transformers/v5.8.1/community_integrations/torchtitan.md))
- [Mixture of Experts](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/fine-tuning-and-customization/model-customization/mixture-of-experts.md) — Captures expert routing indices during inference and replays them during training passes to ensure consistent expert paths in mixture-of-experts models. ([source](https://huggingface.co/docs/transformers/v5.8.1/monkey_patching.md))
- [Text Classification](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/language-tools/text-classification.md) — Assigns labels to text sequences for tasks like sentiment analysis or document categorization through pre-trained machine learning models. ([source](https://huggingface.co/docs/transformers/v5.8.1/tasks/sequence_classification.md))
- [Generation Continuation Modes](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/decoding-generation-controls/chat-generation-strategies/generation-continuation-modes.md) — Configures generation to continue from existing chat history rather than initiating a new assistant turn. ([source](https://huggingface.co/docs/transformers/v5.8.1/chat_templating.md))
- [Edge Model](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/frameworks/inference-runtimes/edge-model.md) — Exports models into a portable format with ahead-of-time memory planning and hardware-specific operation dispatch for edge device inference. ([source](https://huggingface.co/docs/transformers/v5.8.1/community_integrations/executorch.md))
- [Prompt Lookup Decoding](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-optimization-and-inference/serving-and-runtime/inference-optimizations/prompt-lookup-decoding.md) — Proposes candidate tokens by identifying and copying repeating n-grams from input prompts, bypassing the need for an external assistant model. ([source](https://huggingface.co/docs/transformers/v5.8.1/assisted_decoding.md))
- [Parallel Loading](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/data-and-checkpointing/model-loading/parallel-loading.md) — Shards tensors during materialization to allow each rank to load only the necessary portion of weight data during parallel training. ([source](https://huggingface.co/docs/transformers/v5.8.1/weightconverter.md))
- [Asynchronous Batching Execution](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/distributed-and-scaling-strategies/execution-strategies/asynchronous-batching-execution.md) — Overlaps CPU request preparation with GPU computation using multiple streams and graph-based execution to enhance overall throughput. ([source](https://huggingface.co/docs/transformers/v5.8.1/continuous_batching_architecture.md))
- [Memory Efficient Evaluation](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/training-evaluation/memory-efficient-evaluation.md) — Improves evaluation efficiency by offloading accumulated predictions to the CPU and preprocessing logits at the batch level. ([source](https://huggingface.co/docs/transformers/v5.8.1/trainer_recipes.md))
- [Byte Level Encodings](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/language-tools/tokenization-algorithms/byte-level-encodings.md) — Utilizes byte values as a base vocabulary to ensure every input sequence can be tokenized without requiring unknown tokens. ([source](https://huggingface.co/docs/transformers/v5.8.1/tokenizer_summary.md))

### Operating Systems & Systems Programming

- [Paged KV Cache Management](https://awesome-repositories.com/f/operating-systems-systems-programming/kernel-core-internals/process-and-memory-management/memory-management/buffer-and-cache-management/paged-kv-cache-management.md) — Manages key-value cache states using fixed-size blocks to minimize memory fragmentation during inference. ([source](https://huggingface.co/docs/transformers/v5.8.1/continuous_batching_architecture.md))

### Software Engineering & Architecture

- [Configuration Management](https://awesome-repositories.com/f/software-engineering-architecture/application-lifecycle-management/configuration-management.md) — Centralizes hyperparameters and infrastructure settings within a unified class structure for consistent configuration management. ([source](https://huggingface.co/docs/transformers/v5.8.1/main_classes/trainer.md))

### Part of an Awesome List

- [AI and Agents](https://awesome-repositories.com/f/awesome-lists/ai/ai-and-agents.md) — A framework that lets you easily use pre-trained transformer models.
- [AI and Machine Learning](https://awesome-repositories.com/f/awesome-lists/ai/ai-and-machine-learning.md) — State-of-the-art machine learning library for PyTorch and TensorFlow.
- [Computer Vision Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/computer-vision-frameworks.md) — Library for state-of-the-art machine learning models and architectures.
- [Deep Learning](https://awesome-repositories.com/f/awesome-lists/ai/deep-learning.md) — State-of-the-art models for natural language and multimodal tasks.
- [Hugging Face Ecosystem](https://awesome-repositories.com/f/awesome-lists/ai/hugging-face-ecosystem.md) — Library for downloading and training state-of-the-art pretrained models.
- [Language Model Development](https://awesome-repositories.com/f/awesome-lists/ai/language-model-development.md) — Library for accessing state-of-the-art pretrained NLP models.
- [Large Language Models](https://awesome-repositories.com/f/awesome-lists/ai/large-language-models.md) — State-of-the-art machine learning library for PyTorch and TensorFlow.
- [Machine Learning](https://awesome-repositories.com/f/awesome-lists/ai/machine-learning.md) — Framework for state-of-the-art machine learning models.
- [Machine Learning Libraries](https://awesome-repositories.com/f/awesome-lists/ai/machine-learning-libraries.md) — Framework for state-of-the-art ML models.
- [Memory and Context](https://awesome-repositories.com/f/awesome-lists/ai/memory-and-context.md) — Core library for transformer-based sequence modeling and generation.
- [Model Serving and Inference](https://awesome-repositories.com/f/awesome-lists/ai/model-serving-and-inference.md) — Framework for defining and using state-of-the-art ML models.
- [Model Training](https://awesome-repositories.com/f/awesome-lists/ai/model-training.md) — Access thousands of pretrained models for various modalities.
- [Natural Language Processing](https://awesome-repositories.com/f/awesome-lists/ai/natural-language-processing.md) — State-of-the-art NLP tools for transformer models.
- [Neural Network Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/neural-network-frameworks.md) — Large-scale language modeling and transformer-based research.
- [Neural Network Libraries](https://awesome-repositories.com/f/awesome-lists/ai/neural-network-libraries.md) — Ecosystem of pretrained Transformer models for natural language tasks.
- [Pre-trained Language Models](https://awesome-repositories.com/f/awesome-lists/ai/pre-trained-language-models.md) — State-of-the-art library for pre-trained NLP models.
- [Reasoning And Planning](https://awesome-repositories.com/f/awesome-lists/ai/reasoning-and-planning.md) — Provides foundational support for self-consistency in reasoning tasks.
- [Transformer Implementations](https://awesome-repositories.com/f/awesome-lists/ai/transformer-implementations.md) — State-of-the-art library for transformer-based natural language processing.
- [Vision Language Models](https://awesome-repositories.com/f/awesome-lists/ai/vision-language-models.md) — Cutting-edge multimodal model for image and text understanding.
- [Python NLP Libraries](https://awesome-repositories.com/f/awesome-lists/devtools/python-nlp-libraries.md) — State-of-the-art library for Transformer-based models.
- [Bert](https://awesome-repositories.com/f/awesome-lists/more/bert.md) — Listed in the “Bert” section of the Ailia Models awesome list.
- [Named entity recognition](https://awesome-repositories.com/f/awesome-lists/more/named-entity-recognition.md) — Listed in the “Named entity recognition” section of the Ailia Models awesome list.
- [Neural Natural Language Generation](https://awesome-repositories.com/f/awesome-lists/more/neural-natural-language-generation.md) — Listed in the “Neural Natural Language Generation” section of the Awesome Nlg awesome list.
- [Sentiment Analysis](https://awesome-repositories.com/f/awesome-lists/more/sentiment-analysis.md) — Listed in the “Sentiment analysis” section of the Ailia Models awesome list.
- [Zero shot classification](https://awesome-repositories.com/f/awesome-lists/more/zero-shot-classification.md) — Listed in the “Zero shot classification” section of the Ailia Models awesome list.