5 Repos
Architectural patterns that intercept and process specific tool requests locally to prioritize privacy and reduce latency.
Distinct from Local-First Architectures: Distinct from general local-first data persistence; focuses on local execution of AI tools.
Explore 5 awesome GitHub repositories matching software engineering & architecture · Local-First Tool Processing. Refine with filters or upvote what's useful.
This project is a multi-provider AI gateway and proxy server that intercepts and routes requests between AI clients and various large language model providers. It functions as an API protocol translator and model router, mapping incoming requests to specific upstream providers or local runners to provide a unified interface for multiple models. The system distinguishes itself by bridging chat platforms and command line interfaces, converting messages from chat services into managed command line sessions. It further optimizes traffic by executing certain web search and fetch requests locally a
Intercepts web search and fetch requests to process them locally instead of forwarding traffic to upstream providers.
Runs all core AI functions on-device without internet, using local models for privacy and independence.
llama-fs ist ein automatisierter Verzeichnis-Manager und Dateisystem-Organisator, der Large Language Models verwendet, um Dateien zu kategorisieren, umzubenennen und in strukturierte Verzeichnisse zu sortieren. Es fungiert als lokale Daten-Pipeline, die Dateiinhalte analysiert, um geeignete Ordnerhierarchien und Benennungsmuster zu bestimmen. Das Projekt legt Wert auf Datenschutz, indem die Datenverarbeitung an lokale Modellinstanzen weitergeleitet wird, wodurch sichergestellt wird, dass sensible Dateiinformationen auf dem Gerät verbleiben, anstatt an Cloud-Anbieter gesendet zu werden. Es nutzt multimodale Analysen zur Verarbeitung von Bildern, Audio und Text, wodurch das System diverse Medientypen zur automatischen Organisation identifizieren und klassifizieren kann. Das System enthält eine Echtzeit-Überwachung des Dateisystems, um Verzeichnisänderungen zu erkennen und automatisierte Aufräumaufgaben auszulösen. Es unterstützt Batch-Verarbeitung zur Umstrukturierung ganzer Verzeichnisbäume in einem einzigen Vorgang sowie rekursive Verzeichnissynthese zur automatischen Erstellung verschachtelter Ordnerhierarchien.
Utilizes local-first tool processing to route AI requests to local model instances for data privacy.
ChatLab is a self-hosted chat database and data pipeline designed to normalize, store, and analyze large-scale social conversation histories. It functions as an analytics platform that uses large language models to extract patterns and insights from messaging data imported from multiple platforms. The system distinguishes itself through an AI-powered analysis engine that utilizes vector-based history analysis and agent-based function calling to summarize conversation trends. It further identifies behavioral patterns by generating visual analytics, including heatmaps, word clouds, and activity
Provides a local-first data pipeline with stream parsing and multi-worker processing for chat history analysis.
Short video factory is a local AI content generator and automated video editing tool. It provides a production pipeline that uses large language models to transform text prompts into marketing scripts and rendered short-form videos. The system is designed for local-first execution, running all processing and asset management on the host machine to maintain data privacy. It distinguishes itself through a batch-processing workflow that can sequentially execute copywriting and rendering for multiple items using predefined presets. The software covers a broad range of media capabilities, includi
Runs all AI processing and asset management on the host machine to ensure data privacy.