awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
Tencent avatar

Tencent/TNN

0
View on GitHub↗

TNN

TNN is a deep learning inference framework designed to execute pre-trained neural networks across mobile, desktop, and server hardware. It functions as a hardware-accelerated runtime and model compression toolkit, providing a unified interface for deploying models in diverse environments.

The framework includes an ONNX model converter to transform models from various training frameworks into a standardized internal format. It distinguishes itself through a combination of model compression tools—including weight quantization and static-code pruning—and a memory management system that reuses buffers between non-dependent nodes to reduce RAM usage.

The system optimizes performance via operator fusion to minimize memory access and employs platform-specific backends to leverage specialized processors and GPUs. It further increases execution speed through low-precision calculations and hardware-specific tuning.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Cross-Platform Inference Frameworks - Provides a unified API to execute pre-trained deep learning models across mobile, desktop, and server environments.
  • ONNX Model Importers - Converts models from various training frameworks into a standardized ONNX format for efficient execution.
  • Deep Learning Inference Engines - Serves as a cross-platform engine for executing pre-trained neural networks on mobile, desktop, and server hardware.
  • Hardware Accelerated AI Runtimes - Provides an execution environment that leverages platform-specific backends and low-precision calculations to increase speed.
  • Hardware-Accelerated Inference - Increases processing speeds by using platform-specific backends and low-precision calculations on CPUs and GPUs.
  • Hardware Acceleration Backends - Provides platform-specific backends to leverage specialized processors and hardware-level optimizations for neural network execution.
  • ONNX Model Exporters - Imports and transforms models from various training frameworks into a standardized ONNX inference format.
  • Memory-Efficient Deep Learning - Reduces the size and memory footprint of machine learning models through quantization, pruning, and buffer reuse.
  • Model Compression Suites - Offers a comprehensive set of tools for reducing model size through weight quantization, code pruning, and buffer reuse.
  • Model Format Converters - Transforms external model representations into a standardized internal format for consistent cross-platform execution.
  • Precision Quantization - Decreases model size and increases speed by converting high-precision weights into low-precision data formats.
  • Model Conversion - Provides tools for transforming trained models into optimized formats for cross-platform deployment.
  • Hardware-Specific Execution Optimizers - Includes hardware-specific execution tuning to increase processing speeds on specialized chipsets and processors.
  • Neural Network Layer Fusions - Combines multiple neural network layers into single kernels to minimize memory access and startup overhead.
  • NPU Inference Execution - Executes deep learning models across various hardware platforms including standard CPUs and dedicated graphics processing units.
  • Inference Execution Interfaces - Runs pre-trained models across mobile, desktop, and server environments using a single, unified execution interface.
  • Model Inference Execution - Executes deep learning models within applications to generate predictions across mobile, desktop, or server hardware.
  • Low Precision Inference - Increases execution speed and reduces memory consumption using low-precision calculations.
  • Neural Network Deployment - Deploys pre-trained neural networks for tasks like object detection and text recognition across diverse hardware platforms.
  • Model Compression - Reduces the memory footprint of neural networks through weight quantization and static-code pruning.
  • Operator Fusions - Optimizes execution flow by fusing operators to reduce memory access and kernel startup overhead.
  • Weight Quantization - Implements weight quantization to decrease model size and improve inference speed.
  • Mobile Model Deployment - Runs neural networks on mobile devices with optimizations for limited memory and hardware-specific acceleration.
  • Model Memory Managers - Manages memory by reusing buffers between non-dependent nodes to minimize total RAM usage.
  • Dependency Pruning - Removes unused operations and framework components during the build process to minimize the final binary size.
  • Neural Network Buffer Reuse - Implements a memory management system that reuses buffers between non-dependent nodes to reduce total RAM usage.
  • Inference Optimization - Uniform inference framework for mobile and server environments.
4,664 stars·771 forks·C++·51 views

Star history

Star history chart for tencent/tnnStar history chart for tencent/tnn

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Frequently asked questions

What does tencent/tnn do?

TNN is a deep learning inference framework designed to execute pre-trained neural networks across mobile, desktop, and server hardware. It functions as a hardware-accelerated runtime and model compression toolkit, providing a unified interface for deploying models in diverse environments.

What are the main features of tencent/tnn?

The main features of tencent/tnn are: Cross-Platform Inference Frameworks, ONNX Model Importers, Deep Learning Inference Engines, Hardware Accelerated AI Runtimes, Hardware-Accelerated Inference, Hardware Acceleration Backends, ONNX Model Exporters, Memory-Efficient Deep Learning.

Which projects share features with tencent/tnn?

Projects with overlapping indexed features include: pytorch/executorch — ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It… tencent/pocketflow — PocketFlow is an integrated toolkit for deep learning model compression, distributed training, and mobile format… tingsongyu/pytorch-tutorial-2nd — This project is a comprehensive instructional resource and course for building neural networks using PyTorch. It… alibaba/mnn — MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a… microsoft/onnxruntime — This project is a cross-platform machine learning inference engine designed to execute pre-trained models across… vllm-project/llm-compressor — llm-compressor is a quantization toolkit and post-training library designed to reduce the memory footprint and size of…

Projects sharing features with TNN

These projects share indexed features with TNN. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • pytorch/executorchpytorch avatar

    pytorch/executorch

    5,161View on GitHub↗

    ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,

    Pythondeep-learningembeddedgpu
    View on GitHub↗5,161
  • tencent/pocketflowTencent avatar

    Tencent/PocketFlow

    2,914View on GitHub↗

    PocketFlow is an integrated toolkit for deep learning model compression, distributed training, and mobile format optimization. It provides a system for reducing the size and complexity of neural networks to improve inference efficiency, featuring a dedicated engine for knowledge distillation and a mobile model optimizer. The framework differentiates itself through an automated hyperparameter tuning system that uses reinforcement learning and statistical models to determine optimal compression ratios and layer-wise bit allocation. It also includes a distributed training system that utilizes mu

    Pythonautomlcomputer-visiondeep-learning
    View on GitHub↗2,914
  • tingsongyu/pytorch-tutorial-2ndTingsongYu avatar

    TingsongYu/PyTorch-Tutorial-2nd

    4,634View on GitHub↗

    This project is a comprehensive instructional resource and course for building neural networks using PyTorch. It covers the fundamental building blocks of deep learning, including tensor manipulation, automatic differentiation, and the construction of modular neural network components. The repository serves as a technical guide for several specialized domains. It provides implementation details for computer vision tasks such as image classification, object detection, and semantic segmentation, as well as natural language processing workflows involving transformers, recurrent networks, and gen

    Jupyter Notebookcomputer-visiondeepsortdiffusion-models
    View on GitHub↗4,634
  • alibaba/mnnalibaba avatar

    alibaba/MNN

    16,423View on GitHub↗

    MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a comprehensive environment for executing, optimizing, and deploying neural network models directly on mobile and resource-constrained edge devices. The framework distinguishes itself through a robust model optimization toolkit that supports quantization, compression, and structural graph manipulation to minimize memory footprint and maximize execution speed. It features a modular architecture that abstracts hardware-specific backends, allowing models to run efficiently across diverse

    C++armconvolutiondeep-learning
    View on GitHub↗16,423
Compare all 30 related projects→