awesome-repositories.com
Blog
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektÜber unsRanking-MethodikPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

61 Repos

Awesome GitHub RepositoriesMachine Learning Datasets

Structured collections of data used for training, validating, or testing various machine learning models.

Explore 61 awesome GitHub repositories matching artificial intelligence & ml · Machine Learning Datasets. Refine with filters or upvote what's useful.

Awesome Machine Learning Datasets GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • mlabonne/llm-courseAvatar von mlabonne

    mlabonne/llm-course

    80,178Auf GitHub ansehen↗

    This project is a comprehensive educational curriculum and engineering handbook focused on the lifecycle of large language models. It serves as a structured knowledge base for machine learning practitioners, covering the fundamental mathematical and architectural principles of transformer-based sequence modeling, as well as the practical implementation of supervised instruction fine-tuning and preference-based model alignment. The repository distinguishes itself by providing a deep dive into advanced model composition and optimization techniques. It details methodologies for weight-space mode

    Organizes specialized datasets tailored for supervised fine-tuning and alignment processes to refine model behavior.

    courselarge-language-modelsllm
    Auf GitHub ansehen↗80,178
  • d2l-ai/d2l-zhAvatar von d2l-ai

    d2l-ai/d2l-zh

    78,493Auf GitHub ansehen↗

    This project is an open-source, interactive educational platform designed to teach deep learning through a comprehensive, code-first curriculum. It provides a structured learning path that covers foundational mathematics, modern neural network architectures, and practical optimization techniques, enabling practitioners to master complex artificial intelligence concepts through hands-on experimentation. The platform distinguishes itself by integrating technical explanations with executable Jupyter notebooks. This design allows readers to modify code and hyperparameters in real-time, facilitati

    Supplies foundational training data and methodologies for developing robust image recognition models.

    Pythonbookchinesecomputer-vision
    Auf GitHub ansehen↗78,493
  • tesseract-ocr/tesseractAvatar von tesseract-ocr

    tesseract-ocr/tesseract

    74,751Auf GitHub ansehen↗

    Tesseract is a neural network-based optical character recognition engine designed to convert scanned images and digital documents into machine-readable, searchable text. It functions as both a command-line utility for automating large-scale digitization workflows and a cross-platform library that can be embedded into desktop, mobile, or server-side applications. By utilizing long short-term memory networks, the engine provides robust text extraction across more than one hundred languages and dozens of scripts. The project distinguishes itself through a sophisticated document layout analysis f

    Leverage community-maintained training data to refine recognition accuracy for specialized fonts, unique character sets, and diverse languages.

    C++hacktoberfestlstmmachine-learning
    Auf GitHub ansehen↗74,751
  • d2l-ai/d2l-enAvatar von d2l-ai

    d2l-ai/d2l-en

    29,001Auf GitHub ansehen↗

    This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

    Downloads and parses large-scale text inference corpora into structured premise and hypothesis pairs.

    Pythonbookcomputer-visiondata-science
    Auf GitHub ansehen↗29,001
  • fastai/fastaiAvatar von fastai

    fastai/fastai

    27,862Auf GitHub ansehen↗

    Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza

    Applies geometric transformations like flips, rotations, and zooms to image batches to increase dataset diversity.

    Jupyter Notebookcolabdeep-learningfastai
    Auf GitHub ansehen↗27,862
  • heartexlabs/label-studioAvatar von heartexlabs

    heartexlabs/label-studio

    27,626Auf GitHub ansehen↗

    Label Studio ist ein Tool für die Annotation verschiedener Datentypen und ein Arbeitsbereich für Datenannotation, der entwickelt wurde, um Datensätze für das Training von maschinellem Lernen vorzubereiten. Es fungiert als cloud-integrierte Daten-Pipeline, die Rohdaten aus Speichern importiert, den Annotationsprozess verwaltet und Labels in standardisierte Formate exportiert. Die Plattform verfügt über ein Framework zur Integration von Modellen für maschinelles Lernen, das eine Verbindung zu externen Modellservern herstellt. Dies ermöglicht modellgestützte Annotation und aktives Lernen, wodurch das System Vor-Labeling durchführen und Vorhersagen basierend auf menschlichem Feedback verfeinern kann. Die Software bietet Projektmanagement-Tools zur Organisation von Datensätzen und zur Zuweisung von Aufgaben an Benutzer über rollenbasierte Zugriffe. Sie unterstützt verschiedene Datentypen und nutzt speicherunabhängige Speicheradapter, um eine Verbindung zu lokalen Dateisystemen oder Cloud-Speicheranbietern herzustellen. Die Anwendung kann durch manuelle Einrichtung oder One-Click-Deployments auf Cloud-Infrastruktur installiert werden.

    Creates high quality annotated datasets for training machine learning models across various data formats and types.

    TypeScript
    Auf GitHub ansehen↗27,626
  • humansignal/label-studioAvatar von HumanSignal

    HumanSignal/label-studio

    27,619Auf GitHub ansehen↗

    Label Studio is a multi-modal data annotation platform designed to create and manage high-quality training datasets for machine learning. It functions as a self-hosted, containerized environment that supports secure, private deployments, including air-gapped configurations. The platform provides a centralized workspace for labeling diverse media types, such as images, text, audio, and time-series data, to support supervised and reinforcement learning workflows. The platform distinguishes itself through deep integration with machine learning backends, enabling active learning loops, automated

    | Creating and managing high-quality training datasets for machine learning by labeling diverse media types like images, text, and audio.

    TypeScriptannotationannotation-toolannotations
    Auf GitHub ansehen↗27,619
  • christoschristofidis/awesome-deep-learningAvatar von ChristosChristofidis

    ChristosChristofidis/awesome-deep-learning

    27,569Auf GitHub ansehen↗

    This project is a curated directory of resources, libraries, and frameworks designed to support the development, training, and deployment of neural network models. It serves as a comprehensive guide for navigating the machine learning ecosystem, providing structured access to software utilities and research materials. The directory distinguishes itself by aggregating tools across the entire machine learning lifecycle, ranging from data management and experiment tracking to production-ready model deployment. It functions as a central hub for discovering both foundational academic research and

    Organizes and provides access to diverse datasets for training and validating machine learning models.

    awesomeawesome-listdeep-learning
    Auf GitHub ansehen↗27,569
  • jbhuang0604/awesome-computer-visionAvatar von jbhuang0604

    jbhuang0604/awesome-computer-vision

    23,074Auf GitHub ansehen↗

    This project is a comprehensive, community-driven repository that serves as a centralized catalog for computer vision research and development. It functions as a structured index of academic papers, open-source software libraries, public datasets, and educational tutorials, providing a navigation point for the complex landscape of modern vision technology. The repository distinguishes itself through a taxonomy-based indexing system that maps the relationships between foundational research, influential academic figures, and their corresponding software implementations. By utilizing a lightweig

    Maintains a directory of public datasets and benchmarking tools for vision model evaluation.

    Auf GitHub ansehen↗23,074
  • huggingface/lerobotAvatar von huggingface

    huggingface/lerobot

    21,687Auf GitHub ansehen↗

    This project is a comprehensive research platform designed for the end-to-end lifecycle of robotic learning. It provides a modular framework for training neural network policies—specifically through imitation and reinforcement learning—and deploying them onto physical robotic hardware. By offering a unified interface for hardware abstraction, the platform decouples high-level control logic from the specific sensors and actuators of diverse robotic systems. The framework distinguishes itself through a standardized approach to data and policy management. It utilizes a consistent schema for reco

    Records sensor inputs and motor commands into standardized formats for training datasets.

    Python
    Auf GitHub ansehen↗21,687
  • huggingface/datasetsAvatar von huggingface

    huggingface/datasets

    21,643Auf GitHub ansehen↗

    Datasets is a library designed for the management, processing, and sharing of large-scale data collections for machine learning workflows. It functions as both a data processing framework and a versioning platform, providing tools to organize, filter, and transform massive datasets while ensuring reproducibility across research and development teams. The library distinguishes itself by enabling the handling of datasets that exceed available system memory. It utilizes memory-mapped file access, disk-based caching, and lazy iterative streaming to maintain performance when working with large-sca

    Provides comprehensive tools for organizing, versioning, and managing large collections of training data for machine learning.

    Pythonaiartificial-intelligencecomputer-vision
    Auf GitHub ansehen↗21,643
  • pytorch/visionAvatar von pytorch

    pytorch/vision

    17,743Auf GitHub ansehen↗

    This project is a comprehensive computer vision library for the PyTorch ecosystem, providing a standardized collection of neural network architectures, datasets, and high-performance transformation utilities. It serves as a foundational framework for building, training, and deploying deep learning models, offering a centralized model registry that allows developers to instantiate architectures with pre-trained weights for tasks such as image classification, object detection, and semantic segmentation. The library distinguishes itself through its modular approach to data and compute management

    Applies geometric, color, and structural modifications to images and annotations for data augmentation.

    Pythoncomputer-visionmachine-learning
    Auf GitHub ansehen↗17,743
  • nltk/nltkAvatar von nltk

    nltk/nltk

    14,649Auf GitHub ansehen↗

    This project is a comprehensive Python toolkit designed for natural language processing, research, and education. It functions as a linguistic data processor that provides a standardized framework for managing, cleaning, and analyzing large collections of annotated text corpora and lexical resources. The library distinguishes itself through its integration of both symbolic and statistical methods, allowing users to perform complex tasks ranging from rule-based grammar parsing to machine learning-driven classification. It offers a modular pipeline for text processing, enabling the transformati

    Enables the retrieval of linguistic corpora, models, and tokenizers from remote repositories.

    Pythonmachine-learningnatural-language-processingnlp
    Auf GitHub ansehen↗14,649
  • paddlepaddle/paddledetectionAvatar von PaddlePaddle

    PaddlePaddle/PaddleDetection

    14,243Auf GitHub ansehen↗

    PaddleDetection is an object detection framework designed for the end-to-end development, training, and deployment of computer vision models. It provides a comprehensive library of modular neural network architectures and pipelines that support object detection, instance segmentation, and multi-object tracking tasks. The project distinguishes itself through a configuration-driven approach that decouples model components like backbones and heads, allowing for the flexible assembly of custom vision workflows. It incorporates advanced techniques such as anchor-free detection logic, joint detecti

    Applies geometric transformations to input images to improve model robustness and generalization.

    Pythonblazefacedeepsortdetr
    Auf GitHub ansehen↗14,243
  • conardli/easy-datasetAvatar von ConardLi

    ConardLi/easy-dataset

    13,394Auf GitHub ansehen↗

    Easy-dataset is a comprehensive platform designed for the end-to-end management of machine learning datasets, specifically tailored for language and vision model fine-tuning. It functions as a centralized environment for the entire data lifecycle, encompassing the automated generation of synthetic training data, the structural organization of document collections, and the systematic annotation of individual data points. The platform distinguishes itself through its integrated evaluation and orchestration capabilities. It provides a dedicated suite for benchmarking models, featuring blind side

    Centralizes the organization, cleaning, and management of datasets for machine learning fine-tuning.

    JavaScriptdatasetfine-tuningjavascript
    Auf GitHub ansehen↗13,394
  • aws/aws-cdkAvatar von aws

    aws/aws-cdk

    12,817Auf GitHub ansehen↗

    The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It

    Enables collaborative machine learning to generate insights across datasets without exposing raw training data.

    TypeScriptawscloud-infrastructurehacktoberfest
    Auf GitHub ansehen↗12,817
  • zalandoresearch/fashion-mnistAvatar von zalandoresearch

    zalandoresearch/fashion-mnist

    12,754Auf GitHub ansehen↗

    This project is a computer vision benchmark and image classification dataset used to measure and compare the accuracy of machine learning models. It provides a standardized collection of labeled fashion product images and training data formatted to be compatible with the MNIST dataset structure. The dataset consists of fixed-dimension grayscale images and label-based category mappings, stored in a binary format. It includes pre-split training and testing sets and a static distribution to ensure consistent cross-model benchmarking. The repository supports image classification benchmarking and

    Provides a set of labeled images in a binary format for training, validating, and testing models.

    Pythonbenchmarkcomputer-visionconvolutional-neural-networks
    Auf GitHub ansehen↗12,754
  • alex000kim/nsfw_data_scraperAvatar von alex000kim

    alex000kim/nsfw_data_scraper

    12,575Auf GitHub ansehen↗

    This project is a machine learning data pipeline designed to automate the collection, curation, and preparation of large-scale image datasets. It functions as an image dataset scraper and computer vision curator, providing the necessary infrastructure to aggregate categorized files from web sources and organize them into structured directories for model development. The system distinguishes itself through a batch-processing architecture that integrates data acquisition with automated integrity validation. By scanning files to remove corrupted or invalid images and applying deterministic parti

    Automates the collection and organization of categorized image files from web sources to build training sets.

    Shellcontent-moderationdeep-learningmachine-learning
    Auf GitHub ansehen↗12,575
  • dwyl/english-wordsAvatar von dwyl

    dwyl/english-words

    12,152Auf GitHub ansehen↗

    This project provides a comprehensive collection of English vocabulary designed for programmatic access, dictionary lookups, and linguistic research. It serves as a structured repository of words formatted for integration into software development tasks, including natural language processing and text analysis. The dataset is distributed as static, schema-less files in plain text and universal serialization formats. This approach allows the vocabulary to be consumed by any programming language or runtime environment without requiring external dependencies or complex indexing. The repository s

    Provides comprehensive English word datasets in multiple formats for dictionary lookups and language processing.

    Python
    Auf GitHub ansehen↗12,152
  • nielsrogge/transformers-tutorialsAvatar von NielsRogge

    NielsRogge/Transformers-Tutorials

    11,641Auf GitHub ansehen↗

    This is a collection of tutorials and practical demonstrations for implementing machine learning tasks using the HuggingFace Transformers library. It serves as a guide for applying transformer architectures across computer vision, natural language processing, and audio analysis. The repository provides implementation examples for multimodal model deployment, including the combination of text, image, and audio inputs. It includes resources for optimizing pre-trained models through fine-tuning on custom datasets and provides examples for preparing PyTorch datasets by converting raw files into t

    Provides examples for preparing PyTorch datasets by converting raw files into tensors and batches.

    Jupyter Notebookbertgpt-2layoutlm
    Auf GitHub ansehen↗11,641
Vorherige123…4Nächste
  1. Home
  2. Artificial Intelligence & ML
  3. Machine Learning
  4. Machine Learning Datasets

Unter-Tags erkunden

  • Annotation Dataset Creation1 Sub-TagProcesses for generating high-quality ground truth datasets for training machine learning models. **Distinct from Machine Learning Datasets:** Focuses on the act of creating the annotated dataset rather than the dataset itself as a static collection
  • Annotation PlatformsSoftware environments for labeling and managing datasets for machine learning training. **Distinct from Machine Learning Datasets:** Distinct from Machine Learning Datasets: focuses on the interactive platform for creating labels rather than the static dataset collections themselves.
  • Collaborative TrainingTechniques for training machine learning models across multiple parties without sharing raw data. **Distinct from Machine Learning Datasets:** Distinct from Machine Learning Datasets: focuses on the collaborative training process rather than static data storage.
  • Dataset Analysis ToolsTools specifically for analyzing the statistics and distributions of machine learning datasets. **Distinct from Machine Learning Datasets:** Focuses on the analysis tools rather than the dataset collections themselves.
  • Dataset PartitioningProcesses for splitting datasets into disjoint subsets for training, validation, and testing. **Distinct from Machine Learning Datasets:** Focuses on the act of partitioning data rather than the storage or content of the datasets themselves.
  • Educational DatasetsBuilt-in and remote datasets used within tutorials and courses for hands-on machine learning practice. **Distinct from Machine Learning Datasets:** Distinct from general Machine Learning Datasets: these are specifically curated for educational use within notebook-based courses, not for production model training.
  • Image Classification Datasets5 Sub-TagsDatasets specifically structured for training image recognition models.
  • Interaction Data Collectors1 Sub-TagTools for recording sensor inputs and motor commands into standardized training datasets. **Distinct from Machine Learning Datasets:** Distinct from general ML datasets: focuses on the collection of physical robotic interaction data.
  • Lookalike Audience GeneratorsMachine learning models that identify and segment users sharing characteristics with a seed audience. **Distinct from Machine Learning Datasets:** Distinct from Machine Learning Datasets: focuses on the generative modeling of audience segments rather than static dataset management.
  • Natural Language Processing Datasets2 Sub-TagsDatasets specifically curated for training or evaluating natural language processing models, including text corpora and annotated linguistic data.
  • OCR Training Datasets1 Sub-TagCommunity-maintained datasets specifically for improving optical character recognition accuracy.
  • Object Detection Datasets1 Sub-TagDatasets specifically annotated for identifying and localizing objects within images or video frames.
  • Post-Training Datasets3 Sub-TagsDatasets specifically formatted for supervised fine-tuning or preference alignment of language models.
  • Regression BenchmarksDatasets specifically curated for evaluating continuous value prediction performance.
  • Tensor Conversion UtilitiesTools specifically for transforming raw data into tensors and batches for deep learning frameworks. **Distinct from Machine Learning Datasets:** Focuses on the transformation process into tensors rather than the storage or curation of the datasets themselves
  • VisualizersInteractive visual interfaces for exploring the distributions and properties of machine learning datasets. **Distinct from Machine Learning Datasets:** Focuses on the visual exploration tool rather than the raw data collection.