Deep Java Library is a Java deep learning framework and JVM model inference engine. It provides a high-level API for building and deploying deep learning models within the Java ecosystem, acting as a cross-platform runtime for executing models across CPUs, GPUs, and mobile devices. The library is engine-agnostic, allowing users to switch between different deep learning engines such as PyTorch, TensorFlow, and MXNet while maintaining a single unified API. This enables the deployment of the same model across different backends without changing the application code. The framework supports the f
AI-on-the-edge-device is an edge AI meter digitizer and computer vision image processor designed to convert images of analog and digital utility meters into numeric values. It functions as an IoT gateway that runs neural network inference locally on hardware to monitor water, power, and gas readings. The system is distinguished by its ability to handle both analog pointers and digital digits through custom-trained neural networks. It includes specialized tools for image alignment, region-of-interest extraction, and hardware-level lighting control to minimize glare on glass surfaces. To mainta
LiteRT-LM is a high-performance inference framework designed to execute large language models locally on mobile, desktop, and IoT hardware. It serves as an on-device model runtime that utilizes CPU, GPU, and NPU acceleration to provide low-latency processing. The framework is distinguished by its ability to process text, vision, and audio inputs through a single multi-modal inference engine. It features a local HTTP server that emulates OpenAI-compatible API endpoints and a WebGPU-based runtime for executing models directly within a web browser. To ensure output reliability, it includes a con
Auto-subs is an AI transcription and automatic captioning tool that converts spoken audio from video files into synchronized subtitles. It functions as a subtitle generator and a transcription bridge, enabling the conversion of speech to text with automatic speaker identification and multi-language translation support. The software prioritizes data privacy by utilizing on-device AI inference to process audio and video files locally on the user's hardware. It distinguishes itself by offering deep integration with professional video editing workflows, allowing users to export timing and transcr
This repository is a collection of sample applications and reference projects for integrating on-device machine learning APIs into mobile applications. It provides implementation examples for both Android and iOS, demonstrating how to embed computer vision and natural language processing models.
The main features of googlesamples/mlkit are: On-Device Inference, Cross-Platform ML Deployment, Machine Learning Integrations, Mobile Vision Implementations, Mobile Reference Implementations, Android ML Examples, iOS ML Examples, Mobile ML Sample Applications.
Open-source alternatives to googlesamples/mlkit include: deepjavalibrary/djl — Deep Java Library is a Java deep learning framework and JVM model inference engine. It provides a high-level API for… xiaomi/mace — Mace is a mobile deep learning inference framework and hardware acceleration engine. It functions as a runtime for… tmoroney/auto-subs — Auto-subs is an AI transcription and automatic captioning tool that converts spoken audio from video files into… jomjol/ai-on-the-edge-device — AI-on-the-edge-device is an edge AI meter digitizer and computer vision image processor designed to convert images of… google-ai-edge/litert-lm — LiteRT-LM is a high-performance inference framework designed to execute large language models locally on mobile,… google/gemma.cpp — gemma.cpp is a C++ inference engine for Gemma, PaliGemma, and Griffin language models, designed to run directly…