Self Hosted Ai Starter Kit

This project provides a dockerized AI workflow stack and orchestration templates for deploying a self-hosted AI environment. It establishes a localized infrastructure for building autonomous agents and model chains that process private data on-premises without external cloud dependencies.

The environment is designed to support autonomous agent development, allowing models to dynamically select tools, execute shell commands, and interact with local file systems. It includes integrated vector database support to enable retrieval augmented generation and private document analysis.

The stack covers a broad range of capabilities, including local model inference hosting, node-based workflow sequencing, and stateful conversation memory. It also incorporates text analysis tools for embedding generation, structured information extraction, and automated file system change triggers.

Features

Local Model Inference Servers - Runs large language models on-premises using dedicated inference servers to keep data within a private network.
Self-Hosted AI Environments - Provides a containerized platform specifically configured for local or private server execution of artificial intelligence models and agents.
Local Agent Deployments - Enables deployment of autonomous AI agents on local hardware for privacy and on-premises data interaction.
AI Workflow Orchestration - Integrates model inference and tool calling into structured workflows for interactive chat interfaces.

genkit-ai/genkit

6,141View on GitHub

Genkit is an LLM application framework and generative AI developer toolkit designed for building production AI applications. It serves as an AI workflow orchestrator that coordinates model calls and agentic tool usage through type-safe execution flows. The project provides a unified model interface and plugin architecture to standardize access to diverse large language models, vector stores, and telemetry backends. It distinguishes itself with a dedicated observability suite for tracing execution steps and a developer toolkit for prompting, debugging, and evaluating AI logic via a local inter

cloudwego/eino

9,675View on GitHub

Eino is an AI agent development kit and LLM application framework designed for building autonomous agents and orchestrating complex language model workflows. It serves as a multi-agent orchestration engine and workflow orchestrator, providing a graph-based execution model to route data between models, tools, and retrievers. The framework distinguishes itself through a robust set of multi-agent coordination patterns, including supervisor-led management, sequential flows, and autonomous reasoning loops like ReAct. It features advanced agent execution controls such as active turn preemption, che

JetBrains/koog

3,735View on GitHub

Koog is an LLM agent framework used to build autonomous entities that execute tool-based workflows. It utilizes a graph-based workflow engine to define agent behaviors and decision paths as a directed graph of nodes and edges. The framework distinguishes itself through a model provider orchestrator that enables dynamic switching, load balancing, and automatic fallbacks between different AI backends. It implements the Model Context Protocol to connect agents to remote tool servers and features a RAG memory system using vector embeddings to maintain long-term conversation context. The project

superduper-io/superduper

5,298View on GitHub

Superduper is an AI agent development kit and LLM application framework designed to build autonomous agents and data-driven applications. It functions as a RAG orchestration platform and vector search infrastructure, coordinating AI models with database storage to perform multi-step computations and actions using persisted data states. The project distinguishes itself by providing a database-integrated machine learning pipeline that executes training and inference tasks directly on data hosted within SQL and NoSQL databases. It allows for the deployment of self-hosted AI infrastructure on pri

n8n-ioself-hosted-ai-starter-kit

Self Hosted Ai Starter Kit

Features