awesome-repositories.com
Blog
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektÜber unsRanking-MethodikPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
huggingface avatar

huggingface/transformers

0
View on GitHub↗
161,630 Stars·33,518 Forks·Python·Apache-2.0·36 Aufrufehuggingface.co/transformers↗

Transformers

Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference.

The library features extensive support for model optimization and performance, including techniques like quantization, speculative decoding, and paged memory management for key-value caches. It provides native integration for distributed training across multi-node clusters, as well as flexible APIs for serving models via compatible inference servers. Developers can also utilize built-in utilities for model patching, custom kernel execution, and automated documentation generation to streamline development workflows.

Features

  • API Frameworks - Standardizes the training, fine-tuning, and deployment of models across diverse hardware acceleration backends.
  • Vision Transformers - Processes visual data by partitioning images into sequences of patches compatible with transformer architectures.
  • Hybrid - Coordinates data, pipeline, and tensor parallelism to scale large-scale model training across multi-node clusters.
  • Byte Pair Encodings - Builds vocabularies by iteratively merging frequent character pairs to perform subword tokenization.
  • Chat Template Formatters - Transforms chat histories into the specific token sequences and control structures required by individual models.

KI-Suche

Entdecke weitere awesome Repositories

Beschreibe in einfachen Worten, was du brauchst — die KI bewertet tausende kuratierte Open-Source-Projekte nach Relevanz.

Start searching with AI
  • Qwen2 Language Models - Supports advanced architectural features like group query attention and rotary positional embeddings for specialized model families.
  • Large Model Optimizations - Optimizes memory usage and inference speed through automatic device mapping and half-precision weight support.
  • Checkpoint Resumption - Restores training sessions by reloading optimizer, scheduler, and random number generator states from saved checkpoints.
  • Patterns - Defines standardized patterns for appending tool execution results and function requests to conversation histories.
  • Attention Mechanisms - Exposes a registry-based interface for implementing custom attention mechanisms or modifying existing model behaviors.
  • Batched Inference Mechanisms - Enables efficient inference by processing multiple conversation sequences simultaneously in a single forward pass.
  • Tokenizer Base Interfaces - Maintains a consistent base class for vocabulary management, encoding, and decoding across various tokenization backends.
  • Model Quantization - Reduces memory footprints by storing model weights in lower-precision formats while maintaining performance accuracy.
  • Paged KV Cache Management - Manages key-value cache states using fixed-size blocks to minimize memory fragmentation during inference.
  • Configuration Management - Centralizes hyperparameters and infrastructure settings within a unified class structure for consistent configuration management.
  • Supports - Generates structured function execution requests that allow models to interact directly with host applications.
  • Multimodal Input Handlers - Handles diverse input modalities including audio, video, and images within a unified content processing interface.
  • Training Flow Managers - Automates logging, evaluation, and checkpointing schedules through a flexible callback system during training.
  • Transformers Integration Layers - Extends standard library functionality with specialized loaders for device mapping, quantization, and custom attention backends.
  • Data - Synchronizes model training across multiple GPUs to reduce overall computation time through distributed data strategies.
  • Sequence-to-Sequence Translation Tasks - Facilitates text-to-text translation through integrated model fine-tuning, dataset preprocessing, and streamlined inference pipelines.
  • AI and Agents - A framework that lets you easily use pre-trained transformer models.
  • AI and Machine Learning - State-of-the-art machine learning library for PyTorch and TensorFlow.
  • Computer Vision Frameworks - Library for state-of-the-art machine learning models and architectures.
  • Deep Learning - State-of-the-art models for natural language and multimodal tasks.
  • Hugging Face Ecosystem - Library for downloading and training state-of-the-art pretrained models.
  • Language Model Development - Library for accessing state-of-the-art pretrained NLP models.
  • Language Modeling - Distilled BERT version for faster, lighter inference.
  • Large Language Models - State-of-the-art machine learning library for PyTorch and TensorFlow.
  • Machine Learning - Framework for state-of-the-art machine learning models.
  • Machine Learning Libraries - Framework for state-of-the-art ML models.
  • Memory and Context - Core library for transformer-based sequence modeling and generation.
  • Model Architectures - Library for state-of-the-art natural language processing models.
  • Model Serving and Inference - Framework for defining and using state-of-the-art ML models.
  • Model Training - Access thousands of pretrained models for various modalities.
  • Natural Language Processing - State-of-the-art NLP tools for transformer models.
  • Neural Network Frameworks - Large-scale language modeling and transformer-based research.
  • Neural Network Libraries - Ecosystem of pretrained Transformer models for natural language tasks.
  • Pre-trained Language Models - State-of-the-art library for pre-trained NLP models.
  • Reasoning And Planning - Provides foundational support for self-consistency in reasoning tasks.
  • Transformer Implementations - State-of-the-art library for transformer-based natural language processing.
  • Vision Language Models - Cutting-edge multimodal model for image and text understanding.
  • Python NLP Libraries - State-of-the-art library for Transformer-based models.
  • Bert - Listed in the “Bert” section of the Ailia Models awesome list.
  • Named entity recognition - Listed in the “Named entity recognition” section of the Ailia Models awesome list.
  • Neural Natural Language Generation - Listed in the “Neural Natural Language Generation” section of the Awesome Nlg awesome list.
  • Sentiment Analysis - Listed in the “Sentiment analysis” section of the Ailia Models awesome list.
  • Zero shot classification - Listed in the “Zero shot classification” section of the Ailia Models awesome list.
  • Chunked Prefill Mechanisms - Splits long prompt processing across multiple forward passes to prevent blocking other concurrent requests during generation.
  • Document Question Answering Pipelines - Delivers a high-level interface for performing document question answering by routing image and text inputs through specialized inference pipelines.
  • Distributed - Integrates native components to load models directly into distributed training frameworks, utilizing parallelization and optimization techniques.
  • Mixture of Experts - Captures expert routing indices during inference and replays them during training passes to ensure consistent expert paths in mixture-of-experts models.
  • Text Classification - Assigns labels to text sequences for tasks like sentiment analysis or document categorization through pre-trained machine learning models.
  • Generation Continuation Modes - Configures generation to continue from existing chat history rather than initiating a new assistant turn.
  • Edge Model - Exports models into a portable format with ahead-of-time memory planning and hardware-specific operation dispatch for edge device inference.
  • Prompt Lookup Decoding - Proposes candidate tokens by identifying and copying repeating n-grams from input prompts, bypassing the need for an external assistant model.
  • Parallel Loading - Shards tensors during materialization to allow each rank to load only the necessary portion of weight data during parallel training.
  • Asynchronous Batching Execution - Overlaps CPU request preparation with GPU computation using multiple streams and graph-based execution to enhance overall throughput.
  • Memory Efficient Evaluation - Improves evaluation efficiency by offloading accumulated predictions to the CPU and preprocessing logits at the batch level.
  • Byte Level Encodings - Utilizes byte values as a base vocabulary to ensure every input sequence can be tokenized without requiring unknown tokens.

    • Star-Verlauf

    Star-Verlauf für huggingface/transformersStar-Verlauf für huggingface/transformers

    Häufig gestellte Fragen

    Was macht huggingface/transformers?

    Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing…

    Was sind die Hauptfunktionen von huggingface/transformers?

    Die Hauptfunktionen von huggingface/transformers sind: API Frameworks, Vision Transformers, Hybrid, Byte Pair Encodings, Chat Template Formatters, Qwen2 Language Models, Large Model Optimizations, Checkpoint Resumption.

    Welche Open-Source-Alternativen gibt es zu huggingface/transformers?

    Open-Source-Alternativen zu huggingface/transformers sind unter anderem: sgl-project/sglang — Sglang is a high-performance inference engine and serving system designed for large language and multimodal models. It… unslothai/unsloth — Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and… zhaochenyang20/awesome-ml-sys-tutorial — This project provides a comprehensive technical guide and framework for engineering large-scale machine learning… huggingface/tokenizers — This project is a high-performance library for converting raw text into tokens and IDs for machine learning models. It… haifengl/smile — Smile is a comprehensive JVM machine learning library and statistical computing toolkit. It provides a suite of… oxford-cs-deepnlp-2017/lectures — This repository is a deep learning for natural language processing course and curriculum. It provides educational…

    Open-Source-Alternativen zu Transformers

    Ähnliche Open-Source-Projekte, sortiert nach der Anzahl der gemeinsamen Funktionen mit Transformers.
    • sgl-project/sglangAvatar von sgl-project

      sgl-project/sglang

      29,079Auf GitHub ansehen↗

      Sglang is a high-performance inference engine and serving system designed for large language and multimodal models. It provides a programmable interface for orchestrating complex generation workflows, enabling developers to coordinate multi-turn dialogues, tool invocations, and reasoning chains through a domain-specific language. The platform is built to support production-scale deployments, offering an OpenAI-compatible API that allows for integration with existing application ecosystems. The system distinguishes itself through a disaggregated architecture that separates compute-intensive pr

      Pythonattentionblackwellcuda
      Auf GitHub ansehen↗29,079
    • unslothai/unslothAvatar von unslothai

      unslothai/unsloth

      66,628Auf GitHub ansehen↗

      Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade hardware. The platform distinguishes itself through hand-optimized kernels and automated computational graph techniques that maximize hardware throughput. It supports advanced training methodologies, including reinforcement learning for reasoning and efficient adapter-based fin

      Pythonagentdeepseekdeepseek-r1
      Auf GitHub ansehen↗66,628
    • zhaochenyang20/awesome-ml-sys-tutorialAvatar von zhaochenyang20

      zhaochenyang20/Awesome-ML-SYS-Tutorial

      5,371Auf GitHub ansehen↗

      This project provides a comprehensive technical guide and framework for engineering large-scale machine learning systems. It covers the full lifecycle of model development, focusing on the infrastructure and computational principles required to build, train, and serve generative AI models across distributed GPU clusters. The repository distinguishes itself by offering deep-dive tutorials and implementation strategies for complex system challenges. It emphasizes high-performance architectural primitives, such as collective communication orchestration, distributed tensor sharding, and static gr

      Python
      Auf GitHub ansehen↗5,371
    • huggingface/tokenizersAvatar von huggingface

      huggingface/tokenizers

      10,825Auf GitHub ansehen↗

      This project is a high-performance library for converting raw text into tokens and IDs for machine learning models. It functions as a fast text encoder and a text preprocessing pipeline designed to transform strings into numerical representations with high throughput for research and production. The library includes a subword tokenizer trainer used to analyze text datasets and create custom vocabularies using algorithms such as byte-pair encoding and wordpiece. It provides capabilities for subword vocabulary training and text alignment, allowing character offsets to be tracked during normaliz

      Rustbertgptlanguage-model
      Auf GitHub ansehen↗10,825
    Alle 30 Alternativen zu Transformers anzeigen→