microsoft/Foundry-Local

Features

• Local Model Execution - Runs machine learning models directly on local hardware to ensure complete data privacy and offline functionality.
• Machine Learning Model APIs - Runs machine learning models directly on local hardware to ensure fast performance and complete data privacy while working offline.
• Local AI Inference - Executes machine learning models directly on the user device to ensure data privacy and offline functionality.
• Local LLM API Servers - Provides a local API server that runs machine learning models on-device for private, hardware-accelerated inference.
• Privacy and Data Protection - Ensures data privacy by processing all prompts, audio, and model responses locally, preventing sensitive information from leaving the user environment.
• Local API Servers - Hosts local API servers that follow standard request protocols to facilitate direct data exchange between the application and external software frameworks.
• Audio Transcriptions - Performs local audio transcription using on-device models to ensure fast processing without requiring network connectivity.
• Hardware Acceleration Abstractions - Automatically detects and selects the most efficient processor for machine learning tasks to ensure hardware-accelerated execution without manual configuration.
• Hardware Abstraction Layers - Detects and selects the most efficient available processor to execute compute-intensive tasks across diverse graphics and neural processing units.
• Hardware Acceleration - Automatically detects and utilizes the best available processor to run machine learning tasks efficiently without manual configuration.
• On-Device Speech Recognizers - Transcribes spoken language into text using local neural models to provide fast speech recognition without cloud services.
• Model Lifecycle Managers - Automates the discovery, caching, and versioning of machine learning assets to maintain consistent compatibility with the underlying host hardware.
• Speech Transcription Engines - Converts audio to text using on-device models to enable private, offline speech recognition without external cloud dependencies.
• On-Device Transcriptions - Converts spoken language into text using local processing models to maintain user privacy without needing an active internet connection.
• Interactive Model Inference Sessions - Provides an interactive command-line interface for developers to test inference performance and verify model outputs directly.
• Machine Learning Trainers - Provides a command-line interface for testing model inference and standardizing API request formats during software development.
• On-Device Model Management - Discovers, downloads, and versions optimized machine learning models to ensure consistent performance across different local hardware environments.

Star history