For an open source framework for machine learning, the strongest matches are dmlc/mxnet (MXNet is a comprehensive deep learning framework that provides), apache/mxnet (This is a comprehensive deep learning framework that provides) and google/flax (Flax is a high-performance deep learning framework built on). paddlepaddle/paddlenlp and brainjs/brain.js round out the shortlist. Each is ranked by relevance to your query, popularity and recent activity.
Explora frameworks, librerías y herramientas open source para construir, entrenar y desplegar modelos de inteligencia artificial.
MXNet is a deep learning framework and distributed machine learning engine designed for training and deploying neural networks. It functions as a hardware-agnostic backend that allows for the development of deep learning models through a hybrid of symbolic and imperative programming. The system distinguishes itself through automatic distributed parallelism, which scales training workloads across multiple GPUs and machines. It features an extensible hardware backend interface that enables the integration of custom accelerators and proprietary libraries without modifying the core source code.
MXNet is a comprehensive deep learning framework that provides native support for distributed training, GPU acceleration, and cross-platform model deployment, directly addressing all the core requirements for building and scaling machine learning models.
This project is a deep learning framework designed for constructing, training, and deploying neural networks across diverse hardware environments. It functions as a high-performance tensor computation library that provides both imperative and symbolic programming interfaces, allowing developers to balance flexible, step-by-step model building with the efficiency of compiled computation graphs. The framework distinguishes itself through a hybrid execution engine that integrates declarative graph compilation with imperative runtime logic. It supports scalable, distributed training across multip
This is a comprehensive deep learning framework that provides the full stack of required features, including distributed training, data pipeline management, GPU acceleration, and production-ready model deployment tools.
Flax is a deep learning framework and JAX neural network library designed for building complex machine learning models. It functions as a distributed training library and model state manager, providing a toolkit for defining flexible neural network architectures and scaling their training across multiple hardware devices. The project is characterized by a design that separates network logic from parameter values to remain compatible with pure functions. It uses hierarchical module composition to organize networks as trees of nested modules and employs a reference-based state management system
Flax is a high-performance deep learning framework built on JAX that provides robust support for neural network construction, distributed training, and state management, making it a core tool for building complex machine learning models.
PaddleNLP is a development library and toolkit for training, fine-tuning, and deploying large and small language models using the PaddlePaddle framework. It provides a comprehensive suite for the entire natural language processing lifecycle, from model development to high-performance inference. The project features a standardized model zoo for loading and managing pre-trained models and tokenizers through a unified interface. It distinguishes itself with a specialized model compression framework that reduces memory footprints via weight precision conversion and lossless size optimization, alo
PaddleNLP is a specialized library for natural language processing that provides robust tools for training, fine-tuning, and deploying transformer-based models, though it is focused on the NLP domain rather than being a general-purpose machine learning framework.
Brain.js is a JavaScript neural network library for building, training, and running machine learning models in the browser or Node.js. It provides implementations for several network types, including feedforward networks, recurrent neural networks for time series forecasting, and autoencoders for data compression and denoising. The library features WebGL-based GPU acceleration to increase the speed of neural network computations on the graphics processor. It also includes a visualization tool that generates SVG images to represent the topology and layers of a feedforward network. The framewo
Brain.js is a neural network library that provides GPU-accelerated training and inference for JavaScript environments, serving as a specialized tool for building machine learning models directly in the browser or Node.js.
LightGBM is a gradient boosting framework used to train decision tree ensembles for classification, regression, and ranking tasks. It functions as a distributed machine learning library and a decision tree ensemble implementation that utilizes leaf-wise growth and histogram-based feature binning. The framework is distinguished by its ability to offload heavy computations to CUDA or OpenCL devices for GPU acceleration and its capacity to parallelize training across multiple nodes using sockets, MPI, or Dask. It includes a specialized categorical feature processor that optimizes partitions for
LightGBM is a high-performance gradient boosting framework that provides robust support for distributed training, GPU acceleration, and model deployment, making it a specialized but powerful tool for machine learning workflows.
Ktransformers is a comprehensive framework designed for the operation, fine-tuning, and serving of large language models. It functions as a heterogeneous inference engine and quantized execution runtime, enabling the deployment of massive models by distributing computational workloads across both CPU and GPU resources. This architecture allows users to bypass local memory constraints, making it possible to run and train models that exceed the capacity of a single device. The project distinguishes itself through specialized support for sparse architectures, particularly mixture-of-experts mode
This framework provides specialized tools for fine-tuning, serving, and distributed inference of large language models, making it a highly capable tool for deploying and optimizing models despite its narrow focus on LLM architectures.
MONAI is a PyTorch-based deep learning framework and library specifically designed for healthcare imaging. It provides a suite of domain-specific neural network architectures, specialized loss functions, and preprocessing pipelines tailored for analyzing multi-dimensional medical data. The project distinguishes itself through a decentralized federated learning system that allows models to learn from datasets across multiple institutions without exchanging raw patient images. It also features AI-assisted medical image annotation tools and a standardized model bundling system to ensure consiste
This is a specialized deep learning framework built on PyTorch that provides a comprehensive suite of tools for the entire medical imaging AI lifecycle, including data processing, distributed training, and model deployment.
This repository serves as a centralized collection of state-of-the-art deep learning architectures and reference implementations designed for research and application development. It provides a comprehensive toolkit for computer vision and natural language processing, offering pre-built models and training pipelines for tasks ranging from image classification and object detection to complex sequence modeling. The project distinguishes itself by providing a flexible execution harness that manages the entire training lifecycle, including data ingestion and backpropagation. It supports scalable
This repository provides a comprehensive collection of reference implementations, training pipelines, and model architectures that serve as a practical toolkit for building and deploying deep learning models.
DeepSpeedExamples is a collection of reference implementations for training and deploying large scale AI models using the DeepSpeed optimization library. It provides Python code examples for training massive models across multiple GPUs through distributed optimization techniques. The repository includes optimized patterns for deploying and running large language model predictions in production environments. It also serves as a guide for model compression to reduce memory footprints and as a source for performance benchmarks to measure execution speed and resource utilization. The project cov
This repository provides reference implementations and examples for the DeepSpeed optimization library rather than serving as a comprehensive machine learning framework or library itself.
PaddleDetection is an object detection framework designed for the end-to-end development, training, and deployment of computer vision models. It provides a comprehensive library of modular neural network architectures and pipelines that support object detection, instance segmentation, and multi-object tracking tasks. The project distinguishes itself through a configuration-driven approach that decouples model components like backbones and heads, allowing for the flexible assembly of custom vision workflows. It incorporates advanced techniques such as anchor-free detection logic, joint detecti
This is a specialized computer vision framework that provides end-to-end support for training, optimizing, and deploying object detection models, though it is focused on vision tasks rather than being a general-purpose machine learning library.
Axolotl is a configuration-driven framework designed for the fine-tuning, evaluation, and quantization of large language models. It functions as a comprehensive orchestrator for distributed training, enabling users to manage complex workflows across multi-node and multi-GPU environments. By utilizing structured configuration files, the platform streamlines the setup of training parameters, dataset paths, and hardware distribution strategies. The project distinguishes itself through its support for diverse training methodologies, including full-parameter tuning, parameter-efficient adaptation,
Axolotl is a specialized framework for fine-tuning and training large language models that provides robust support for distributed training, data processing, and GPU-accelerated workflows, making it a powerful tool for model development.
This project is a comprehensive library of state-of-the-art neural network architectures designed for image classification and feature extraction. It provides a complete deep learning training framework that supports distributed execution, allowing users to build, train, and fine-tune vision models using optimized schedulers and pre-configured training recipes. The library distinguishes itself through a modular backbone architecture that treats neural networks as decoupled feature extractors, enabling the retrieval of multi-scale outputs for downstream tasks like object detection and segmenta
This library provides a comprehensive suite of tools for building, training, and deploying deep learning vision models, including support for distributed training, pre-trained weights, and data processing pipelines.
Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ
Fairseq is a specialized PyTorch-based toolkit for sequence-to-sequence modeling that provides robust support for distributed training, data processing, and model deployment, making it a powerful framework for specific machine learning tasks.
CatBoost is a gradient boosting machine learning library used to train decision tree ensembles for regression, classification, and ranking tasks. It functions as a high-performance framework that provides a categorical data processor for transforming non-numeric features, a distributed trainer for large-scale datasets, and GPU acceleration to speed up model construction. The library distinguishes itself through native handling of categorical data and text features, removing the need for manual encoding. It includes a specialized model interpretability tool that leverages SHAP values and featu
CatBoost is a high-performance gradient boosting library that provides robust tools for data processing, GPU-accelerated training, and model deployment, making it a specialized but powerful framework for machine learning tasks.
PyTorch Lightning is a deep learning research framework that provides a structured environment for organizing machine learning code. It functions as a unified trainer orchestrator, centralizing the execution flow by managing the interaction between hardware resources, data loaders, and model components. By decoupling model architecture from training logic, the framework enables researchers to maintain clean, modular codebases that remain portable across different environments. The framework distinguishes itself through a hardware-agnostic abstraction layer that scales deep learning workloads
PyTorch Lightning is a specialized framework for orchestrating and scaling deep learning training pipelines, providing the necessary abstractions for distributed training and hardware acceleration while focusing on the training lifecycle rather than serving as a comprehensive collection of all ML tools.
This project is a modular research toolkit designed for developing, training, and evaluating deep learning models for object detection, segmentation, and video instance tracking. It provides a flexible training engine that manages complex neural network execution, including distributed training, custom lifecycle hooks, and weight optimization. The framework is built around a hierarchical configuration system that allows users to define architectures, data pipelines, and training hyperparameters through composable, inheritable files. The project distinguishes itself through its highly modular
This is a specialized deep learning framework focused on computer vision tasks like object detection and segmentation, providing robust support for training, data pipelines, and model deployment within the PyTorch ecosystem.
This project is a comprehensive framework for the entire lifecycle of transformer-based language models, supporting everything from foundational pretraining to specialized deployment. It provides a modular toolkit for defining neural network architectures, managing data preparation pipelines, and executing training routines across various scales. The framework is designed to handle the full model development process, including supervised fine-tuning, behavioral alignment, and the integration of agentic capabilities. What distinguishes this framework is its focus on efficient training and adva
This framework provides a comprehensive suite for the end-to-end lifecycle of transformer-based models, including data preparation, training, and deployment, though it is specifically tailored to language models rather than general-purpose machine learning.
Ultralytics is a comprehensive computer vision framework designed for training, validating, and deploying deep learning models across a wide range of visual recognition tasks. It provides a unified interface for core operations including object detection, instance segmentation, pose estimation, and image classification. By utilizing a modular architecture, the platform allows users to swap model components to balance inference speed and accuracy requirements for diverse applications. The framework distinguishes itself through its support for real-time processing and flexible deployment. It in
This is a specialized deep learning framework focused on computer vision that provides a complete lifecycle for training, deploying, and managing models, though it is narrower in scope than a general-purpose machine learning ecosystem.
DSPy is a declarative programming framework designed for building complex language model applications. It treats model interactions as modular, composable programs, allowing developers to define task logic through typed class schemas rather than relying on manually written prompts. By organizing workflows into hierarchical, reusable Python objects, the framework enables the construction of sophisticated AI systems that manage state and execution flow independently. The framework distinguishes itself through an automated optimization engine that iteratively refines prompt instructions and few-
DSPy is a declarative framework for orchestrating and optimizing language model pipelines, serving as a specialized tool for building complex AI applications rather than a general-purpose deep learning library.
DeepSpeedExamples is a collection of reference implementations and scripts for training, fine-tuning, and executing inference on large-scale AI models using DeepSpeed optimization. It provides a distributed model training guide and practical workflows for adapting large language models through memory-efficient techniques. The repository includes specialized implementations for pipeline parallelism to handle models exceeding single GPU memory and a suite of examples for ZeRO memory optimization to reduce per-device overhead. It also features standardized test suites for benchmarking the throug
This repository provides a collection of reference implementations and optimization scripts for the DeepSpeed library rather than serving as a comprehensive machine learning framework itself.
Nanochat is a lightweight execution environment designed for training and running language models on standard consumer hardware. It functions as both a neural network training framework and an inference engine, enabling users to perform backpropagation-based training and model execution directly on general-purpose processors without the need for dedicated graphics hardware. The project distinguishes itself through a suite of optimization tools that prioritize efficiency on local machines. By utilizing memory-mapped weight loading and CPU-optimized vector math, it maximizes throughput for inte
This is a specialized machine learning framework focused on training and running transformer models on consumer hardware, providing essential features like training pipelines, quantization, and inference capabilities.
YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks. What distinguishes this project is its focus on production-ready deployment and model ef
This is a specialized computer vision framework that provides a complete end-to-end pipeline for training, optimizing, and deploying object detection models, though it is focused on a specific domain rather than being a general-purpose machine learning library.
Open-r1 is a framework designed for the large-scale training, distillation, and optimization of language models focused on complex reasoning and programming tasks. It provides a comprehensive suite of tools for managing distributed training jobs across multi-node clusters, enabling the development of high-performance models through reinforcement learning and supervised fine-tuning. The project distinguishes itself by integrating secure, containerized code execution environments directly into the training and evaluation lifecycle. By allowing models to run and verify code snippets against test
This framework provides a specialized, comprehensive suite for the training, distillation, and optimization of reasoning-focused language models, covering key aspects like distributed training and synthetic data pipelines.
| Repositorio | Estrellas | Lenguaje | Licencia | Último push |
|---|---|---|---|---|
| dmlc/mxnet | 20.8K | C++ | Apache-2.0 | |
| apache/mxnet | 20.8K | C++ | apache-2.0 | |
| google/flax | 7.2K | Jupyter Notebook | Apache-2.0 | |
| paddlepaddle/paddlenlp | 13K | Python | Apache-2.0 | |
| brainjs/brain.js | 14.9K | TypeScript | MIT | |
| lightgbm-org/lightgbm | 18.5K | C++ | MIT | |
| kvcache-ai/ktransformers | 17.3K | Python | Apache-2.0 | |
| project-monai/monai | 7.9K | Python | apache-2.0 | |
| tensorflow/models | 77.7K | Python | NOASSERTION | |
| microsoft/deepspeedexamples | 6.8K | Python | Apache-2.0 |