1.6K repositorios
Foundational systems and hardware-level tools required to support the development, deployment, and scaling of machine learning workflows.
Explore 1,649 awesome GitHub repositories matching artificial intelligence & ml · Infrastructure. Refine with filters or upvote what's useful.
Openclaw es una plataforma para gestionar entornos de ejecución de agentes, proporcionando la infraestructura para controlar los ciclos de vida de los agentes, el estado de la sesión y la persistencia del espacio de trabajo. Cuenta con una puerta de enlace centralizada que maneja bucles de modelos, invocación de herramientas y eventos de streaming, al tiempo que admite el enrutamiento multi-agente y la gestión de memoria persistente. El sistema está diseñado para normalizar las firmas de ejecución de herramientas y proporcionar una interfaz estandarizada para la compatibilidad entre proveedores. La plataforma incluye amplias herramientas para desarrolladores, como una interfaz de línea de comandos para la gestión del espacio de trabajo, registro de diagnósticos y una arquitectura de plugins que permite el registro de herramientas y capacidades personalizadas. Admite flujos de trabajo automatizados a través de hooks basados en eventos, programación de tareas e integración con servicios externos. La seguridad se gestiona mediante políticas de ejecución, portabilidad de credenciales y flujos de trabajo de aprobación para las acciones de los agentes. La implementación es compatible con instaladores de infraestructura automatizados y helpers de puerta de enlace en contenedores, con utilidades integradas para copias de seguridad y gestión de configuración. El sistema proporciona un formato estructurado para orquestar flujos de trabajo de varios pasos e incluye herramientas especializadas para la automatización del navegador y la aplicación de parches de código estructurados.
Generates structured JSONL logs and console output with configurable redaction and traffic diagnostics.
Este proyecto es un directorio integral curado por la comunidad que organiza un vasto panorama de bibliotecas, frameworks y herramientas de software de Python. Sirve como una base de conocimientos centralizada diseñada para facilitar la navegación del ecosistema y acelerar el descubrimiento de desarrolladores en todo el ciclo de vida del desarrollo de software. El directorio se distingue por proporcionar un índice estructurado de recursos categorizados por dominio técnico, que van desde utilidades de desarrollo fundamentales hasta campos de ingeniería especializados. Cubre capacidades de alto nivel que incluyen inteligencia artificial, ciencia de datos, desarrollo web y gestión de infraestructura, lo que permite a los desarrolladores identificar soluciones verificadas para desafíos técnicos específicos. El proyecto abarca una amplia superficie de capacidades, incluyendo herramientas para la gestión de dependencias, análisis de código estático y pruebas automatizadas. También cataloga recursos para el almacenamiento de datos persistentes, orquestación de infraestructura en la nube y desarrollo de interfaces, proporcionando una referencia unificada para construir y mantener sistemas de software complejos.
Highlights high-performance frameworks designed for building, training, and tuning complex neural network architectures.
Este proyecto es un directorio curado por la comunidad de software de código abierto diseñado para su implementación en entornos de servidores privados y laboratorios domésticos. Sirve como un recurso integral para descubrir alternativas independientes y autohospedadas a los servicios en la nube convencionales, permitiendo a los usuarios mantener la propiedad total de los datos y el control sobre su infraestructura digital. El directorio está estructurado a través de una taxonomía jerárquica que organiza una vasta colección de aplicaciones en categorías lógicas, que van desde la gestión de medios y análisis de datos hasta la comunicación privada y herramientas de productividad en equipo. Se distingue por un proceso de revisión por pares colaborativo, donde los miembros de la comunidad validan la calidad y relevancia de cada envío para garantizar que el directorio siga siendo preciso y confiable. El proyecto cubre una amplia superficie de capacidades, incluyendo automatización de infraestructura, implementación de servicios basados en contenedores y gestión de configuración declarativa. Estas herramientas ayudan a los usuarios a mantener entornos de servidor reproducibles y gestionar dependencias de servicios complejas en hardware privado. El directorio se mantiene como un repositorio con control de versiones, asegurando que todas las actualizaciones y cambios impulsados por la comunidad sean rastreados y transparentes.
Runs large language models directly on private infrastructure to generate content without relying on external cloud services.
Este proyecto es un repositorio centralizado impulsado por la comunidad de tutoriales prácticos diseñados para facilitar la adquisición de habilidades a través de la construcción práctica de aplicaciones de software del mundo real. Sirve como un directorio integral que agrega documentación externa y materiales instructivos, proporcionando un camino estructurado para que los desarrolladores dominen lenguajes de programación y dominios técnicos específicos. El repositorio se distingue por organizar recursos técnicos dispares en una estructura jerárquica basada en taxonomía que permite a los desarrolladores descubrir y navegar por diversas disciplinas de ingeniería de software. Al agrupar proyectos individuales en secuencias lógicas, proporciona un roadmap que ayuda a los estudiantes a progresar desde conceptos fundamentales hasta la implementación avanzada. El contenido se mantiene a través de contribuciones colaborativas, asegurando que la colección siga siendo un recurso actual y expansivo para la comunidad de desarrolladores. El proyecto cubre una amplia superficie de capacidades, abarcando dominios como el desarrollo web full-stack, ingeniería de aplicaciones móviles y desarrollo de juegos interactivos. Incluye recursos para una amplia gama de lenguajes de programación, que van desde lenguajes de nivel de sistema como C, C++ y Rust hasta lenguajes de alto nivel y funcionales como Python, Ruby, Haskell y Clojure. Estos materiales apoyan el dominio técnico especializado en áreas que incluyen aprendizaje automático, ciencia de datos y programación de redes. El directorio está estructurado para permitir un descubrimiento eficiente por lenguaje de programación y dominio técnico, con una tabla de contenidos clara para ayudar a los usuarios a localizar información específica. Funciona como un índice persistente de enlaces externos, conectando a los desarrolladores con documentación y tutoriales de terceros para profundizar su comprensión de los conceptos técnicos.
Train neural networks and process large-scale datasets by applying mathematical frameworks in real-world project settings.
TensorFlow is a comprehensive machine learning framework designed for the construction, training, and deployment of complex mathematical models. It utilizes a graph-based execution model that represents operations as directed acyclic graphs, enabling automatic differentiation and efficient parallel processing. The system provides high-level interfaces for defining neural network architectures, alongside a robust engine for managing multidimensional array structures and tensor mathematics. The framework distinguishes itself through a scalable distributed runtime that orchestrates workloads acr
Standardizes the toolchain for serializing, optimizing, and serving machine learning models within high-performance production environments.
Ollama is a cross-platform runtime for managing, serving, and executing large language models on local hardware. It functions as a model manager and orchestrator that allows for the downloading, updating, and organization of model weights and configurations to ensure private and offline inference. The system provides a local inference API and a RESTful interface for programmatic model lifecycle management and text generation. It utilizes a compiled C++ backend to handle tensor operations and memory management. To support various hardware configurations, the runtime employs dynamic GPU offloa
Facilitates the downloading and execution of language models on local computing environments for private inference.
Stable Diffusion Web UI is a browser-based interface designed for managing text-to-image generation tasks. It provides a centralized dashboard for controlling generative processes, including native support for multi-stage model architectures to facilitate high-quality image refinement. The platform distinguishes itself through granular control over the generation process, offering tools for precise parameter management and advanced prompt engineering. Users can customize generation styles and capabilities by integrating external model-extension formats, such as textual inversions, low-rank ad
Configures hardware-specific settings to leverage NVIDIA graphics processing units for accelerated computation.
Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference. The library features extensive support for model optimization and
Standardizes the training, fine-tuning, and deployment of models across diverse hardware acceleration backends.
This project is a PyTorch transformer model library and pre-trained model framework. It serves as a deep learning model hub and multimodal inference engine, providing a centralized system for loading, executing, and fine-tuning state-of-the-art model checkpoints. The library focuses on multimodal machine learning, enabling predictions across text, vision, and audio data. It provides specialized capabilities for model framework interoperability, allowing the conversion of weights and definitions between different deep learning libraries. The platform covers the full model lifecycle, including
Ships a multimodal inference engine capable of processing and generating outputs from text, image, and audio data.
LangChain is an orchestration framework designed for building, managing, and deploying applications powered by large language models. It provides a unified integration layer that normalizes disparate model provider APIs into a consistent set of primitives, enabling developers to build complex, multi-step AI workflows that manage state, memory, and tool execution. The project distinguishes itself through a durable execution runtime that maintains persistent state across long-running processes by checkpointing progress to external storage. It models agent workflows as directed graphs, allowing
Abstracts model interfaces to enable seamless provider swapping and side-by-side comparison without modifying core logic.
ComfyUI is a modular generative AI workflow orchestrator and node-based GUI for designing and executing complex diffusion model pipelines. It functions as both a visual interface for building generative logic graphs and a programmable backend API that exposes diffusion model operations for external integration. The system distinguishes itself through a graph-based execution model that supports differential workflow execution, re-running only modified nodes to reduce computation. It features dynamic model offloading to manage memory between system RAM and GPU VRAM and utilizes metadata-embedde
Analyzes input images to use their conceptual elements as inspiration for creating new images.
ComfyUI is a node-based generative AI orchestration engine designed for constructing, testing, and executing complex image and video synthesis pipelines. By utilizing a directed acyclic graph execution model, the platform allows users to build reproducible workflows through modular, interconnected processing blocks without requiring manual code implementation. It serves as both a local environment for high-performance model inference and a production-ready server for deploying generative capabilities. The platform distinguishes itself through its focus on workflow portability and extensibilit
Serves visual, node-based generative pipelines as programmable API endpoints for integration into external software.
llama.cpp is a high-performance C++ inference engine and runtime for executing large language models locally across various hardware architectures. It provides the core components for local model execution, including a dedicated model quantizer for compressing weights into the GGUF format and a system for generating text embeddings for semantic search. The project distinguishes itself through specialized memory and execution optimizations, such as block-wise weight quantization to reduce memory footprints and memory-mapped model loading. It supports structured text generation by using formal
Implements a high-performance C++ engine for executing large language models on consumer-grade hardware.
Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU architectures. The project distinguishes itself by offering a lightweight HTTP server that adheres to standard API specifications, enabling chat completion, embeddings, and reranking services. It includes a suite of tools for model quantization and conversion, which reduces memory us
Executes large language models locally on standard consumer hardware with high performance.
This repository serves as a comprehensive collection of resources, templates, and starter code for building artificial intelligence applications. It provides a centralized hub for developers to access practical implementations of common workflows, including retrieval-augmented generation pipelines and autonomous agent loops, alongside educational materials designed to support rapid prototyping and experimentation. The project distinguishes itself by offering a dual focus on technical implementation and critical analysis. It provides a library of lightweight, single-file agents and tutorials f
Utilities and techniques help reduce token consumption and operational costs while preserving output quality.
This project is a high-level 3D graphics engine designed to render complex, hardware-accelerated environments within web browsers. It provides a comprehensive abstraction layer that manages scene graphs, cameras, and lighting, mapping high-level scene definitions onto low-level graphics APIs. By decoupling these definitions from specific hardware targets, the engine ensures consistent performance across diverse browsers and devices. The framework distinguishes itself through a robust architecture that includes a unified math library for high-frequency spatial calculations and a physically bas
Improves rendering efficiency for large object counts through techniques like instancing and batching.
Godot is a comprehensive, node-based game engine designed for building interactive 2D and 3D applications. It provides an integrated development environment that utilizes a hierarchical scene system to organize objects, propagate spatial transformations, and manage lifecycle events. The engine functions as a cross-platform development suite, allowing developers to author, test, and export software to desktop, mobile, and web environments from a single, unified codebase. The engine distinguishes itself through a modular, component-based architecture that relies on signals-based decoupling for
Normalizes hardware-specific tasks like input, audio, and file I/O across heterogeneous deployment targets.
This project is a comprehensive, open-source educational curriculum designed to guide developers through the mastery of generative artificial intelligence. It provides a structured learning path that covers foundational concepts, prompt engineering, and the practical application of large language models. The repository serves as a central hub for skill acquisition, offering sequential modules that progress from basic model mechanics to advanced architectural patterns. The curriculum distinguishes itself by focusing on the end-to-end lifecycle of intelligent software, including the implementat
Presents methodologies for systematically evaluating and comparing the performance of various large language models.
Immich is a self-hosted media management platform designed to provide a centralized, private repository for photos and videos. It functions as a comprehensive system for organizing, backing up, and viewing personal media collections across mobile devices, web browsers, and external storage locations. By maintaining full control over data ownership and storage infrastructure, the platform ensures that users retain sovereignty over their digital assets. The system distinguishes itself through a distributed architecture that coordinates background media synchronization, real-time filesystem moni
Processes machine learning tasks using externalized models and thread pools to optimize performance for image and text analysis.
DeepSeek-V3 is a large language model that provides comprehensive resources for model utilization, including technical specifications, pre-trained weights, and evaluation benchmarks. The project details the core transformer architecture, including parameter counts and multi-token prediction modules, while supporting native 8-bit floating-point quantization. The repository offers extensive support for local and distributed inference through integration with multiple frameworks and engines. It includes documentation for deploying the model across various hardware configurations, such as GPUs an
Downloadable parameter files and technical configurations enable direct integration of the pre-trained model into custom environments.