awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
microsoft avatar

microsoft/Foundry-Local

0
View on GitHub↗

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
foundrylocal.ai
↗

Foundry Local

Foundry-Local is a machine learning development tool designed to facilitate private, on-device inference and model management. It provides a local server environment that hosts machine learning models directly on the user's hardware, ensuring that all data processing, including prompt handling and audio transcription, remains within the local environment without requiring external cloud connectivity.

The project distinguishes itself by automating the entire model lifecycle, including the discovery, downloading, and versioning of assets to maintain compatibility with host hardware. It features a hardware-abstraction layer that automatically detects and selects the most efficient available processor for compute-intensive tasks, allowing for hardware-accelerated execution without manual configuration.

Beyond core inference, the tool includes a command-line interface for interactive model exploration and performance verification. It also provides standardized API proxying, which maps incoming requests to local model endpoints using industry-standard protocols to support integration with external software frameworks.

Features

  • Local Model Execution - Runs machine learning models directly on local hardware to ensure complete data privacy and offline functionality.
  • Machine Learning Model APIs - Runs machine learning models directly on local hardware to ensure fast performance and complete data privacy while working offline.
  • Local AI Inference - Executes machine learning models directly on the user device to ensure data privacy and offline functionality.
  • Local LLM API Servers - Provides a local API server that runs machine learning models on-device for private, hardware-accelerated inference.
2,380 stars·331 forks·C++·43 views
  • Privacy and Data Protection - Ensures data privacy by processing all prompts, audio, and model responses locally, preventing sensitive information from leaving the user environment.
  • Local API Servers - Hosts local API servers that follow standard request protocols to facilitate direct data exchange between the application and external software frameworks.
  • Audio Transcriptions - Performs local audio transcription using on-device models to ensure fast processing without requiring network connectivity.
  • Hardware Acceleration Abstractions - Automatically detects and selects the most efficient processor for machine learning tasks to ensure hardware-accelerated execution without manual configuration.
  • Hardware Abstraction Layers - Detects and selects the most efficient available processor to execute compute-intensive tasks across diverse graphics and neural processing units.
  • Hardware Acceleration - Automatically detects and utilizes the best available processor to run machine learning tasks efficiently without manual configuration.
  • On-Device Speech Recognizers - Transcribes spoken language into text using local neural models to provide fast speech recognition without cloud services.
  • Model Lifecycle Managers - Automates the discovery, caching, and versioning of machine learning assets to maintain consistent compatibility with the underlying host hardware.
  • Speech Transcription Engines - Converts audio to text using on-device models to enable private, offline speech recognition without external cloud dependencies.
  • On-Device Transcriptions - Converts spoken language into text using local processing models to maintain user privacy without needing an active internet connection.
  • Interactive Model Inference Sessions - Provides an interactive command-line interface for developers to test inference performance and verify model outputs directly.
  • Machine Learning Trainers - Provides a command-line interface for testing model inference and standardizing API request formats during software development.
  • On-Device Model Management - Discovers, downloads, and versions optimized machine learning models to ensure consistent performance across different local hardware environments.
  • Local Inference Engines - On-device AI platform covering model discovery, sandboxed execution, and evaluation.

    • Star history

    Star history chart for microsoft/foundry-localStar history chart for microsoft/foundry-local

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Curated searches featuring Foundry Local

    Hand-picked collections where Foundry Local appears.
    • Local LLM Execution Runtimes

    Projects sharing features with Foundry Local

    These projects share indexed features with Foundry Local. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • soniqo/speech-swiftsoniqo avatar

      soniqo/speech-swift

      896View on GitHub↗

      This project is a comprehensive toolkit for on-device speech recognition, synthesis, and audio processing, specifically engineered for Apple Silicon. It provides a framework for building real-time, full-duplex voice agents that operate entirely offline, leveraging native hardware acceleration to maintain performance and privacy. By utilizing optimized machine learning models, the library enables local execution of complex audio tasks without reliance on external cloud services. The library distinguishes itself through its specialized focus on local, high-performance voice interaction. It incl

      Swiftapple-siliconasrcoreml
      View on GitHub↗896
    • microsoft/skill-recordermicrosoft avatar

      microsoft/skill-recorder

      5,710View on GitHub↗

      Skill Recorder is a desktop app that records an on-screen work session and turns it into a reusable skill or scheduled automation for AI agents. It captures clicks, app and window switches, visited pages, clipboard previews, terminal activity and spoken narration in the background, controlled by a global shortcut and a floating bar. It can also import an existing MP4 or WebM demonstration instead of recording live. Everything is recorded and stored locally until the user chooses to analyze it. Analysis uses the GitHub Copilot SDK, with sign-in through the browser via enterprise single sign-on

      TypeScriptagent-skillsai-agentsautomation
      View on GitHub↗5,710
    • google-ai-edge/gallerygoogle-ai-edge avatar

      google-ai-edge/gallery

      15,162View on GitHub↗

      This project is a development framework for building edge-based AI agents that perform multimodal inference and system-level automation directly on mobile devices. By prioritizing local-first execution, the platform ensures data privacy and offline functionality, allowing developers to run large language models on hardware without requiring external server connectivity. The framework distinguishes itself through an integrated orchestration layer that connects language models to custom tools, scripts, and native device intents. It provides a structured registry for mapping natural language ins

      Kotlin
      View on GitHub↗15,162
    • cocktailpeanut/dalaicocktailpeanut avatar

      cocktailpeanut/dalai

      12,920View on GitHub↗

      The simplest way to run LLaMA on your local machine

      CSSaillamallm
      View on GitHub↗12,920
    Compare all 30 related projects→

    Frequently asked questions

    What does microsoft/foundry-local do?

    Foundry-Local is a machine learning development tool designed to facilitate private, on-device inference and model management. It provides a local server environment that hosts machine learning models directly on the user's hardware, ensuring that all data processing, including prompt handling and audio transcription, remains within the local environment without requiring external cloud connectivity.

    What are the main features of microsoft/foundry-local?

    The main features of microsoft/foundry-local are: Local Model Execution, Machine Learning Model APIs, Local AI Inference, Local LLM API Servers, Privacy and Data Protection, Local API Servers, Audio Transcriptions, Hardware Acceleration Abstractions.

    Which projects share features with microsoft/foundry-local?

    Projects with overlapping indexed features include: soniqo/speech-swift — This project is a comprehensive toolkit for on-device speech recognition, synthesis, and audio processing,… microsoft/skill-recorder — Skill Recorder is a desktop app that records an on-screen work session and turns it into a reusable skill or scheduled… google-ai-edge/gallery — This project is a development framework for building edge-based AI agents that perform multimodal inference and… cocktailpeanut/dalai — The simplest way to run LLaMA on your local machine. fmhy/fmhy — FMHY is a community-driven index designed to organize and distribute decentralized digital content through… bentoml/bentoml — BentoML is a machine learning model serving framework and GPU-accelerated inference server designed to package,…