1.6K 个仓库
Foundational systems and hardware-level tools required to support the development, deployment, and scaling of machine learning workflows.
Explore 1,649 awesome GitHub repositories matching artificial intelligence & ml · Infrastructure. Refine with filters or upvote what's useful.
Openclaw 是一个用于管理智能体(Agent)执行环境的平台,提供控制智能体生命周期、会话状态和工作区持久化的基础设施。它具有一个处理模型循环、工具调用和流式事件的中心化网关,同时支持多智能体路由和持久化内存管理。该系统旨在规范工具执行签名,并为跨提供商兼容性提供标准化接口。 该平台包括广泛的开发者工具,例如用于工作区管理的命令行界面、诊断日志记录以及允许注册自定义工具和功能的插件架构。它通过事件驱动的钩子、任务调度和与外部服务的集成来支持自动化工作流。安全性通过执行策略、凭据可移植性和智能体操作的审批工作流进行管理。 部署通过自动化基础设施安装程序和容器化网关助手提供支持,并内置了用于备份和配置管理的实用程序。该系统为编排多步工作流提供了结构化格式,并包括用于浏览器自动化和结构化代码补丁的专用工具。
Generates structured JSONL logs and console output with configurable redaction and traffic diagnostics.
这是一个全面的、由社区策划的目录,组织了庞大的 Python 软件库、框架和工具生态。它作为一个中心化知识库,旨在促进生态导航并加速开发者在整个软件开发生命周期中的发现过程。 该目录通过提供按技术领域分类的结构化资源索引脱颖而出,范围从基础开发工具到专业工程领域。它涵盖了人工智能、数据科学、Web 开发和基础设施管理等高级能力,使开发者能够为特定的技术挑战识别经过验证的解决方案。 该项目涵盖了广泛的能力领域,包括依赖管理、静态代码分析和自动化测试工具。它还编目了用于持久数据存储、云基础设施编排和接口开发的资源,为构建和维护复杂软件系统提供了统一的参考。
Highlights high-performance frameworks designed for building, training, and tuning complex neural network architectures.
这是一个由社区策划的开源软件目录,专为在私有服务器环境和家庭实验室中部署而设计。它作为发现主流云服务独立自托管替代方案的综合资源,使用户能够保持对数字基础设施的完全数据所有权和控制权。 该目录通过层级分类法构建,将庞大的应用程序集合组织成逻辑类别,范围从媒体管理和数据分析到私有通信和团队生产力工具。它通过协作同行评审流程脱颖而出,社区成员验证每个提交的质量和相关性,以确保目录保持准确和可靠。 该项目涵盖了广泛的能力领域,包括基础设施自动化、基于容器的服务部署和声明式配置管理。这些工具协助用户维护可复现的服务器环境,并管理私有硬件上的复杂服务依赖。 该目录作为版本控制仓库进行维护,确保所有更新和社区驱动的变更都是可追踪且透明的。
Runs large language models directly on private infrastructure to generate content without relying on external cloud services.
这是一个中心化的、社区驱动的动手教程仓库,旨在通过构建真实世界软件应用程序的实践来促进技能获取。它作为一个综合目录,聚合了外部文档和教学材料,为开发者掌握特定编程语言和技术领域提供了结构化路径。 该仓库通过将分散的技术资源组织成基于分类法的层级结构脱颖而出,使开发者能够发现和导航不同的软件工程学科。通过将单个项目分组为逻辑序列,它提供了一条路线图,帮助学习者从基础概念进步到高级实现。内容通过协作贡献进行维护,确保该集合对于开发者社区而言是一个当前且广泛的资源。 该项目涵盖了广泛的能力领域,跨越了全栈 Web 开发、移动应用工程和交互式游戏开发等领域。它包括针对多种编程语言的资源,从 C、C++ 和 Rust 等系统级语言到 Python、Ruby、Haskell 和 Clojure 等高级和函数式语言。这些材料支持在机器学习、数据科学和网络编程等领域进行专业技术掌握。 该目录旨在通过编程语言和技术领域实现高效发现,并配有清晰的目录以帮助用户定位特定信息。它充当外部链接的持久索引,将开发者连接到第三方文档和教程,以加深他们对技术概念的理解。
Train neural networks and process large-scale datasets by applying mathematical frameworks in real-world project settings.
TensorFlow is a comprehensive machine learning framework designed for the construction, training, and deployment of complex mathematical models. It utilizes a graph-based execution model that represents operations as directed acyclic graphs, enabling automatic differentiation and efficient parallel processing. The system provides high-level interfaces for defining neural network architectures, alongside a robust engine for managing multidimensional array structures and tensor mathematics. The framework distinguishes itself through a scalable distributed runtime that orchestrates workloads acr
Standardizes the toolchain for serializing, optimizing, and serving machine learning models within high-performance production environments.
Ollama is a cross-platform runtime for managing, serving, and executing large language models on local hardware. It functions as a model manager and orchestrator that allows for the downloading, updating, and organization of model weights and configurations to ensure private and offline inference. The system provides a local inference API and a RESTful interface for programmatic model lifecycle management and text generation. It utilizes a compiled C++ backend to handle tensor operations and memory management. To support various hardware configurations, the runtime employs dynamic GPU offloa
Facilitates the downloading and execution of language models on local computing environments for private inference.
Stable Diffusion Web UI is a browser-based interface designed for managing text-to-image generation tasks. It provides a centralized dashboard for controlling generative processes, including native support for multi-stage model architectures to facilitate high-quality image refinement. The platform distinguishes itself through granular control over the generation process, offering tools for precise parameter management and advanced prompt engineering. Users can customize generation styles and capabilities by integrating external model-extension formats, such as textual inversions, low-rank ad
Configures hardware-specific settings to leverage NVIDIA graphics processing units for accelerated computation.
Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference. The library features extensive support for model optimization and
Standardizes the training, fine-tuning, and deployment of models across diverse hardware acceleration backends.
This project is a PyTorch transformer model library and pre-trained model framework. It serves as a deep learning model hub and multimodal inference engine, providing a centralized system for loading, executing, and fine-tuning state-of-the-art model checkpoints. The library focuses on multimodal machine learning, enabling predictions across text, vision, and audio data. It provides specialized capabilities for model framework interoperability, allowing the conversion of weights and definitions between different deep learning libraries. The platform covers the full model lifecycle, including
Ships a multimodal inference engine capable of processing and generating outputs from text, image, and audio data.
LangChain is an orchestration framework designed for building, managing, and deploying applications powered by large language models. It provides a unified integration layer that normalizes disparate model provider APIs into a consistent set of primitives, enabling developers to build complex, multi-step AI workflows that manage state, memory, and tool execution. The project distinguishes itself through a durable execution runtime that maintains persistent state across long-running processes by checkpointing progress to external storage. It models agent workflows as directed graphs, allowing
Abstracts model interfaces to enable seamless provider swapping and side-by-side comparison without modifying core logic.
ComfyUI is a modular generative AI workflow orchestrator and node-based GUI for designing and executing complex diffusion model pipelines. It functions as both a visual interface for building generative logic graphs and a programmable backend API that exposes diffusion model operations for external integration. The system distinguishes itself through a graph-based execution model that supports differential workflow execution, re-running only modified nodes to reduce computation. It features dynamic model offloading to manage memory between system RAM and GPU VRAM and utilizes metadata-embedde
Analyzes input images to use their conceptual elements as inspiration for creating new images.
ComfyUI is a node-based generative AI orchestration engine designed for constructing, testing, and executing complex image and video synthesis pipelines. By utilizing a directed acyclic graph execution model, the platform allows users to build reproducible workflows through modular, interconnected processing blocks without requiring manual code implementation. It serves as both a local environment for high-performance model inference and a production-ready server for deploying generative capabilities. The platform distinguishes itself through its focus on workflow portability and extensibilit
Serves visual, node-based generative pipelines as programmable API endpoints for integration into external software.
llama.cpp is a high-performance C++ inference engine and runtime for executing large language models locally across various hardware architectures. It provides the core components for local model execution, including a dedicated model quantizer for compressing weights into the GGUF format and a system for generating text embeddings for semantic search. The project distinguishes itself through specialized memory and execution optimizations, such as block-wise weight quantization to reduce memory footprints and memory-mapped model loading. It supports structured text generation by using formal
Implements a high-performance C++ engine for executing large language models on consumer-grade hardware.
Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU architectures. The project distinguishes itself by offering a lightweight HTTP server that adheres to standard API specifications, enabling chat completion, embeddings, and reranking services. It includes a suite of tools for model quantization and conversion, which reduces memory us
Executes large language models locally on standard consumer hardware with high performance.
This repository serves as a comprehensive collection of resources, templates, and starter code for building artificial intelligence applications. It provides a centralized hub for developers to access practical implementations of common workflows, including retrieval-augmented generation pipelines and autonomous agent loops, alongside educational materials designed to support rapid prototyping and experimentation. The project distinguishes itself by offering a dual focus on technical implementation and critical analysis. It provides a library of lightweight, single-file agents and tutorials f
Utilities and techniques help reduce token consumption and operational costs while preserving output quality.
This project is a high-level 3D graphics engine designed to render complex, hardware-accelerated environments within web browsers. It provides a comprehensive abstraction layer that manages scene graphs, cameras, and lighting, mapping high-level scene definitions onto low-level graphics APIs. By decoupling these definitions from specific hardware targets, the engine ensures consistent performance across diverse browsers and devices. The framework distinguishes itself through a robust architecture that includes a unified math library for high-frequency spatial calculations and a physically bas
Improves rendering efficiency for large object counts through techniques like instancing and batching.
Godot is a comprehensive, node-based game engine designed for building interactive 2D and 3D applications. It provides an integrated development environment that utilizes a hierarchical scene system to organize objects, propagate spatial transformations, and manage lifecycle events. The engine functions as a cross-platform development suite, allowing developers to author, test, and export software to desktop, mobile, and web environments from a single, unified codebase. The engine distinguishes itself through a modular, component-based architecture that relies on signals-based decoupling for
Normalizes hardware-specific tasks like input, audio, and file I/O across heterogeneous deployment targets.
This project is a comprehensive, open-source educational curriculum designed to guide developers through the mastery of generative artificial intelligence. It provides a structured learning path that covers foundational concepts, prompt engineering, and the practical application of large language models. The repository serves as a central hub for skill acquisition, offering sequential modules that progress from basic model mechanics to advanced architectural patterns. The curriculum distinguishes itself by focusing on the end-to-end lifecycle of intelligent software, including the implementat
Presents methodologies for systematically evaluating and comparing the performance of various large language models.
Immich is a self-hosted media management platform designed to provide a centralized, private repository for photos and videos. It functions as a comprehensive system for organizing, backing up, and viewing personal media collections across mobile devices, web browsers, and external storage locations. By maintaining full control over data ownership and storage infrastructure, the platform ensures that users retain sovereignty over their digital assets. The system distinguishes itself through a distributed architecture that coordinates background media synchronization, real-time filesystem moni
Processes machine learning tasks using externalized models and thread pools to optimize performance for image and text analysis.
DeepSeek-V3 is a large language model that provides comprehensive resources for model utilization, including technical specifications, pre-trained weights, and evaluation benchmarks. The project details the core transformer architecture, including parameter counts and multi-token prediction modules, while supporting native 8-bit floating-point quantization. The repository offers extensive support for local and distributed inference through integration with multiple frameworks and engines. It includes documentation for deploying the model across various hardware configurations, such as GPUs an
Downloadable parameter files and technical configurations enable direct integration of the pre-trained model into custom environments.