docker/genai-stack
Genai Stack
Este proyecto es un stack de desarrollo contenedorizado y framework de aplicaciones para construir sistemas de generación aumentada por recuperación (RAG). Proporciona un sandbox de IA dockerizado que integra entornos de ejecución de modelos locales, grafos de conocimiento y almacenes vectoriales para permitir la creación de chatbots contextuales.
El stack se distingue por su almacén vectorial basado en grafos, que combina grafos de conocimiento estructurados con índices vectoriales para la recuperación de datos tanto semánticos como estructurales. Permite el alojamiento de modelos locales con aceleración de CPU o GPU, facilitando tareas generativas sin depender de APIs externas en la nube.
El framework cubre una amplia gama de capacidades, incluyendo el procesamiento e indexación de documentos PDF, la orquestación de servicios de IA basados en contenedores y la implementación de generación de respuestas fundamentadas. Incluye una interfaz de chat basada en web con streaming de respuestas incremental y una interfaz estandarizada para cambiar entre diferentes proveedores de modelos de lenguaje.
El entorno se inicializa mediante orquestación de contenedores para desplegar rápidamente un stack preconfigurado de modelos y bases de datos.
Features
- LLM Application Frameworks - Provides a comprehensive toolkit for integrating large language models with vector and graph databases to build contextual chatbots.
- Hybrid Vector-Graph Databases - Combines knowledge graphs with vector indices in a single database for semantic and structural data retrieval.
- Container Orchestration Environments - Orchestrates a containerized stack of models, databases, and interfaces for rapid AI environment bootstrapping.
- Vector Knowledge Bases - Uses Neo4j to create a data layer combining structured knowledge graphs and vector embeddings.
- Standard RAG Development - Builds systems that retrieve context from vector and graph databases to provide grounded answers.
- Graph Retrieval Augmented Generation - Combines graph-based knowledge structures with retrieval-augmented generation to provide contextually grounded AI responses.
- LLM Provider Integrations - Implements a standardized interface for connecting to various local and cloud large language model providers.
- LLM Provider Interfaces - Uses a common abstraction layer to seamlessly switch between local model runtimes and cloud AI services.
- Local Model Runtimes - Includes a deployment setup for running open-source language models on local hardware with CPU or GPU acceleration.
- Model Provider Configurations - Provides standardized connection settings and credential management for integrating diverse AI model providers.
- RAG Frameworks - Offers a containerized development environment combining LangChain, Neo4j, and Ollama for building RAG applications.
- Retrieval Augmented Generation Pipelines - Implements a pipeline that fetches relevant document chunks and graph nodes to ground AI responses.
- Text Embedding Generators - Converts text data into numerical vector representations to enable semantic search and similarity analysis.
- Vector Embeddings - Implements a workflow that processes raw PDF text into vector embeddings for semantic retrieval.
- Document Chunking and Embedding Pipelines - Provides an automated pipeline to chunk, embed, and load external documents into a vector-graph database.
- External Data Ingestion - Ingests questions and answers from external APIs, generating embeddings for storage in a graph database.
- Graph Databases - Provides connectivity to a graph database for the storage and retrieval of structured knowledge.
- Graph RAG Frameworks - Implements retrieval-augmented generation using a hybrid of vector and graph-based data structures for grounded answering.
- AI Infrastructure Stacks - Sets up a pre-configured stack of model runtimes and databases using Docker for rapid AI prototyping.
- Pre-Configured Sandbox Deployments - Provides a pre-configured set of containers for deploying local model runtimes and knowledge graphs.
- LLM Deployments - Runs language models and embedding providers in containers to enable offline generative tasks.
- Full-Stack Orchestration - Orchestrates a full stack of AI models and databases using containers for rapid development.
- Local Language Model Hosting - Executes language models in containers with CPU or GPU acceleration for local generative tasks.
- AI Project Bootstrapping - Provides tools for initializing a pre-configured environment with a model runner and graph database.
- Chatbot Containerization - Packages the AI application and its web interface into containers for consistent execution.
- Response Grounding - Produces grounded responses with source citations by constraining model outputs to verified facts within a knowledge base.
- Local Document Indexing - Processes local PDF files into searchable vector stores to enable similarity-based questioning within RAG pipelines.
- Chat Interfaces - Renders a web-based conversational interface for interacting with the integrated AI models.
- LLM Response Streaming - Delivers generated text tokens incrementally from the model to the UI to minimize perceived latency.
- PDF Chatbots - Processes PDF files into text chunks and embeddings for natural language querying.
- PDF Content Querying - Extracts text from PDF documents and indexes it in a vector database to enable natural language querying.
- PDF Document Analyzers - Combines text extraction and semantic search to analyze and query information within local PDF documents.
- Knowledge Graph Builders - Extracts external data and processes it into embedded vectors and graph nodes for retrieval.
- Vector Indexing - Creates specialized vector indexes within a graph database to enable high-dimensional similarity searches for questions and answers.
- AI Interface Deployments - Bootstraps a containerized user interface to interact with integrated AI services.
- PDF Chatbot Deployments - Containerizes a generative AI application to provide an interface for interacting with PDF documents.
- AI Stack Deployments - Wraps AI functionality with a server to serve generative capabilities over HTTP.
- Incremental Response Streaming - Streams tokens incrementally to the user interface to reduce perceived latency during response generation.
