58 repositorios
Frameworks for developing AI-native applications.
Distinguishing note: Focuses on application development frameworks rather than simple tools.
Explore 58 awesome GitHub repositories matching artificial intelligence & ml · AI Application Frameworks. Refine with filters or upvote what's useful.
Chat2DB is an AI-powered SQL client and multi-database GUI manager designed for managing various relational and NoSQL database systems. It serves as a visual database management tool and a natural language to SQL interface, allowing users to convert plain text descriptions into executable and optimized queries. The platform distinguishes itself through automated business intelligence capabilities, which include the generation of real-time data visualization dashboards and AI-driven data analysis from spreadsheets. To ensure data privacy, it supports secure local AI deployment, enabling large
Runs large language models on local hardware to process sensitive database metadata without external uploads.
This project is a TypeScript SDK and application framework for integrating large language models into software. It provides a unified interface and multi-provider model wrapper to interact with various AI model providers through a single, consistent API. The toolkit includes a generative UI framework and an AI agent orchestrator. These tools enable the creation of autonomous agents capable of executing functions and the development of AI-driven user interfaces with specialized state management for streaming chatbot components. The framework covers broad capability areas including stream-base
Provides a comprehensive framework for building AI-native applications with a focus on intelligent user interfaces and agents.
This project is a technical curriculum and development guide focused on large language model prompt engineering, fine-tuning, and the creation of retrieval augmented generation applications. It serves as a comprehensive resource for developers to master crafting precise instructions and textual patterns to improve the quality and predictability of model outputs. The material covers the end-to-end workflow of adapting open-source models to specific datasets and integrating language models with vector databases to generate responses based on private information. It also provides a systematic ap
Guides the creation of AI-native applications by combining orchestration frameworks and user interfaces.
Jina is a cloud-native framework for building and deploying multimodal AI applications that process text, images, and audio across distributed microservices. It functions as an inference orchestrator and a distributed model gateway, providing a containerized stack to organize AI executors into operational pipelines. The system manages large language model workloads through token-streamed response delivery and dynamic batching to increase hardware throughput. It utilizes a protocol-agnostic communication layer to route data across different machine learning frameworks. The framework covers hi
Provides a cloud-native framework for building and deploying AI applications that integrate text, images, and audio across distributed microservices.
This project is a comprehensive toolkit for adapting large language models to the Chinese language, providing a specialized framework for fine-tuning, inference, and local deployment. It serves as a coordinated suite for language-specific adaptation, including tools for expanding tokenizers and implementing retrieval-augmented generation. The project distinguishes itself through a complete pipeline for model adaptation, featuring multilingual tokenizer expansion and a fine-tuning framework that supports instruction-based supervised training and adapter merging. It also includes a dedicated de
Integrates models into frameworks to create end-to-end tools for question answering, summarization, and chatbots.
This project is a framework for running Stable Diffusion image generation models on Apple Silicon using Core ML hardware acceleration. It provides a local generative AI pipeline for producing images from text prompts using Swift and Python without relying on external cloud APIs. The system includes a model converter to transform deep learning checkpoints into Core ML formats and a model optimizer to quantize weights and activations. It features a ControlNet integration layer to guide image generation using external signals such as edge and depth maps. Capabilities cover text-to-image generat
Provides dedicated libraries for integrating generative image pipelines into native macOS and iOS applications.
Janus is a multimodal large language model and unified framework that integrates visual understanding and image generation within a single neural network. It functions as both a visual understanding model for analyzing images and a text-to-image generator. The system uses a unified transformer backbone and a multimodal latent space to bridge the gap between text and visual data. This architecture employs decoupled visual encoding and cross-modal tokenization to separate the paths for discriminative understanding and generative tasks, representing images as grids of discrete codes. The projec
Provides a unified framework capable of both interpreting and synthesizing visual content.
NeMo is a multimodal AI framework and toolkit designed for the development, training, and scaling of large language models, generative AI systems, and speech-based models. It functions as an automatic speech recognition toolkit, a text-to-speech engine, and a framework for building models that process and generate combinations of text, image, and audio data. The project serves as a conversational AI orchestrator capable of managing real-time, interruptible voice interactions. It provides specialized workflows for speech translation, converting spoken audio from one language into text or speec
Provides a framework to build and manage models that process and generate combinations of text, image, and audio data.
ai-edu is a comprehensive AI education curriculum and machine learning courseware collection. It provides theoretical tutorials, deep learning lab exercises, and project blueprints designed to teach artificial intelligence fundamentals through a combination of study and practical implementation. The project focuses on a learning-by-doing approach, guiding users from Python programming and neural network basics to advanced topics. It includes specialized instructional content on distributed AI training, MLOps educational guides for model quantization and pruning, and detailed frameworks for im
Provides operational instructions and practical cases for developing vision, language, and speech applications.
MoneyPrinter is an automated short-form video creation pipeline that generates complete YouTube Shorts from a given topic. It combines local LLM-powered script generation with programmatic video assembly, all managed through a database-backed job queue for reliable, restart-tolerant processing. The system uses an Ollama-powered local language model to write video scripts and metadata entirely on-device, keeping data private and offline. It then produces the final video clip using MoviePy for compositing clips, text, and audio, creating a complete YouTube Shorts video without manual editing. V
Writes video scripts and metadata by querying a local Ollama language model, keeping all data processing on-device.
The simplest way to run LLaMA on your local machine
Downloads specific model variants by name from a CDN for local use.
Chainlit is a Python framework designed for building and deploying interactive, stateful conversational AI interfaces. It provides a backend-driven platform that connects language models and agent frameworks to a web-based chat frontend, managing the complexities of session state, message history, and real-time communication. The framework distinguishes itself by offering a component-based UI builder that allows developers to inject interactive widgets, rich media, and data visualizations directly into the chat stream. It supports the visualization of complex agent workflows, enabling users t
Implements secure user authentication and session management for conversational AI applications.
This project is a local AI inpainting tool designed to erase hard-coded subtitles and watermarks from videos and images. It functions as a content-aware media restorer that uses deep learning to reconstruct missing pixels and preserve the original resolution of the source files. The software is distinguished by its local execution model, running inference on host hardware to process media without relying on external cloud APIs. It employs content-aware model selection, allowing the use of different generative algorithms based on media types, such as animation or live action, to optimize visua
Runs generative filling models on host hardware for local media inpainting without cloud APIs.
LAVIS is a multimodal large language model framework and vision-language model library. It provides tools for training and evaluating models that integrate visual, textual, and audio data, serving as a cross-modal feature extractor and a zero-shot visual reasoning engine. The framework distinguishes itself by using frozen-backbone integration, where pretrained encoders remain non-trainable while lightweight adapter layers are updated. It employs cross-modal feature alignment to map different representations into a shared embedding space and utilizes a modular model wrapper to swap vision and
Provides a comprehensive framework for training and evaluating large language models that integrate visual, textual, and audio data.
Este proyecto es una biblioteca y framework de inferencia de modelos de lenguaje de gran tamaño (LLM) diseñado para ejecutar modelos para generación de texto, resolución de problemas y asistencia en codificación. Incluye un framework multimodal para procesar entradas combinadas de imagen y texto, y una implementación de uso de herramientas que permite la ejecución de funciones externas basadas en el razonamiento del modelo. El sistema cuenta con un motor de inferencia de GPU distribuido que reparte las cargas de trabajo de modelos grandes a través de múltiples procesadores gráficos para aumentar la velocidad de procesamiento y cumplir con los requisitos de memoria. También proporciona despliegue de modelos en contenedores a través de imágenes preempaquetadas y dependencias para servir motores de inferencia en entornos aislados. La biblioteca cubre una gama de capacidades que incluyen análisis de entrada multimodal, integración de llamadas a funciones y codificación de relleno (fill-in-the-middle) para predecir segmentos de código faltantes. Además, admite chat interactivo con el modelo a través de una interfaz de línea de comandos para mantener sesiones conversacionales.
Ships a framework for processing combined image and text inputs to describe visual content and answer questions.
WasmEdge is an extensible WebAssembly runtime that executes WebAssembly bytecode in a secure sandbox for cloud, edge, and embedded applications. It functions as a multi-language compiler, compiling applications written in Rust, JavaScript, Go, and Python into WebAssembly bytecode for sandboxed execution, and as a server-side JavaScript runtime that runs JavaScript programs with ES6 modules, NPM packages, and Node.js-compatible APIs. The runtime also serves as an AI inference runtime, executing AI models from JavaScript using WASI-NN plug-ins for inference tasks on personal devices and edge har
Executes AI models on smart devices by running them inside a WebAssembly sandbox with GPU access.
Local Deep Researcher is a fully local web research assistant that uses any LLM hosted by Ollama or LMStudio. Give it a topic and it will generate a web search query, gather web search results, summarize the results of web search, reflect on the summary to examine knowledge gaps, generate a new…
Provides a research agent that runs entirely on local hardware using Ollama-hosted LLMs.
Spring AI is an application framework for Java that provides a portable, fluent API for integrating AI models, tools, and vector stores into applications. It wraps multiple AI providers behind a common interface, allowing developers to switch between chat, embedding, image, and speech models without changing application code. The framework includes a chainable chat client API similar to WebClient or RestClient, supports both synchronous and streaming interactions, and offers structured output conversion that transforms unstructured AI responses into strongly-typed Java objects. The framework
Ships a portable, fluent Java framework for integrating AI models, tools, and vector stores into applications.
Reor is a local AI knowledge management application that stores, links, and searches personal notes using large language models and vector embeddings entirely on the user's device. It functions as a private AI note assistant, keeping all data and processing local for full privacy without relying on external cloud services. The application integrates with Ollama to manage the lifecycle of local LLMs and embedding models, handling downloads, updates, and execution. Notes are imported from markdown files, preserving existing file structure, and are automatically linked through vector-similarity
Downloads, updates, and executes LLMs and embedding models through the Ollama runtime for local AI processing.
LMFlow is a comprehensive suite for large language model fine-tuning, context extension, multimodal processing, and inference execution. It provides a toolkit for updating model parameters through full tuning or memory-efficient adapter algorithms, alongside an inference engine for executing tuned models via command-line or web-based interfaces. The framework includes a dedicated alignment suite for supervised tuning and reward model training to refine model behavior. It features a context window extender to increase maximum input lengths and a multimodal framework for building chatbots that
Provides a framework for building chatbots that process combined image and text inputs.