5 repositorios
Architectural patterns that intercept and process specific tool requests locally to prioritize privacy and reduce latency.
Distinct from Local-First Architectures: Distinct from general local-first data persistence; focuses on local execution of AI tools.
Explore 5 awesome GitHub repositories matching software engineering & architecture · Local-First Tool Processing. Refine with filters or upvote what's useful.
This project is a multi-provider AI gateway and proxy server that intercepts and routes requests between AI clients and various large language model providers. It functions as an API protocol translator and model router, mapping incoming requests to specific upstream providers or local runners to provide a unified interface for multiple models. The system distinguishes itself by bridging chat platforms and command line interfaces, converting messages from chat services into managed command line sessions. It further optimizes traffic by executing certain web search and fetch requests locally a
Intercepts web search and fetch requests to process them locally instead of forwarding traffic to upstream providers.
Runs all core AI functions on-device without internet, using local models for privacy and independence.
llama-fs es un gestor de directorios y organizador de sistemas de archivos automatizado que utiliza modelos de lenguaje grandes (LLM) para categorizar, renombrar y ordenar archivos en directorios estructurados. Funciona como un pipeline de datos local que analiza el contenido de los archivos para determinar jerarquías de carpetas y patrones de nombres apropiados. El proyecto enfatiza la privacidad al enrutar el procesamiento de datos a instancias de modelos locales, asegurando que la información sensible de los archivos permanezca en el dispositivo en lugar de enviarse a proveedores en la nube. Utiliza análisis multimodal para procesar imágenes, audio y texto, permitiendo al sistema identificar y clasificar diversos tipos de medios para una organización automática. El sistema incluye monitoreo del sistema de archivos en tiempo real para detectar cambios en directorios y activar tareas de limpieza automatizadas. Admite procesamiento por lotes para reestructurar árboles de directorios completos en una sola operación y síntesis recursiva de directorios para crear automáticamente jerarquías de carpetas anidadas.
Utilizes local-first tool processing to route AI requests to local model instances for data privacy.
ChatLab is a self-hosted chat database and data pipeline designed to normalize, store, and analyze large-scale social conversation histories. It functions as an analytics platform that uses large language models to extract patterns and insights from messaging data imported from multiple platforms. The system distinguishes itself through an AI-powered analysis engine that utilizes vector-based history analysis and agent-based function calling to summarize conversation trends. It further identifies behavioral patterns by generating visual analytics, including heatmaps, word clouds, and activity
Provides a local-first data pipeline with stream parsing and multi-worker processing for chat history analysis.
Short video factory is a local AI content generator and automated video editing tool. It provides a production pipeline that uses large language models to transform text prompts into marketing scripts and rendered short-form videos. The system is designed for local-first execution, running all processing and asset management on the host machine to maintain data privacy. It distinguishes itself through a batch-processing workflow that can sequentially execute copywriting and rendering for multiple items using predefined presets. The software covers a broad range of media capabilities, includi
Runs all AI processing and asset management on the host machine to ensure data privacy.