Awesome GitHub RepositoriesVideo Encoding and Decoding

AISystem is a comprehensive AI full-stack infrastructure project covering the entire pipeline from AI chip architecture to high-level training frameworks. It encompasses the development of AI compiler frameworks, inference engines, and distributed training orchestrators designed to coordinate workloads across a heterogeneous compute stack of CPUs, GPUs, and NPUs. The project focuses on the deep integration of software and hardware, employing software-hardware co-design to align tensor layouts with physical memory structures. It provides specialized capabilities for accelerating Transformer mo

FreeRDP is a full software implementation of the Remote Desktop Protocol, providing both client and server capabilities for remote session management. It functions as an RDP client library and a standalone remote desktop client, enabling remote connectivity and interoperability across different operating systems. The project includes a dedicated network device redirector and an RDP gateway client to handle authentication and proxy routing. It allows developers to integrate remote desktop functionality into third-party software applications via its client library. The software covers a wide r

SmarterStreaming is a cross-platform SDK for hardware-accelerated audio and video capture, encoding, and streaming. It provides a complete media pipeline for low-latency RTMP and RTSP streaming, and includes an embedded lightweight RTSP server that can serve live feeds directly from the source device to local network clients without requiring a separate server. The SDK also integrates with GB28181 surveillance platforms, enabling compliant device registration and streaming for standardized video monitoring systems. The project distinguishes itself through a set of integrated capabilities for

JiaoZiVideoPlayer is an Android media player framework used to build mobile video interfaces. It serves as a unified interface layer that abstracts multiple backend playback engines to ensure consistent video delivery on mobile devices. The project integrates ExoPlayer and ijkPlayer, utilizing FFmpeg for broad codec support and efficient media decoding. This cross-backend approach allows the user interface to remain decoupled from specific playback engines, enabling the use of different decoding technologies based on hardware or software requirements. The framework provides a modular playbac

LAVFilters is an open-source media filter pack consisting of splitters and decoders designed for the DirectShow framework. It functions as a set of software components that convert compressed media data into raw formats for hardware or software rendering. The collection includes a media splitter to separate combined audio and video container formats into individual streams, as well as a specialized Blu-ray disc player filter used to identify and extract movie titles and playlists from disc structures. The project provides capabilities for audio and video stream decoding, media stream demuxin

jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

WickedEngine 是一个 C++ 3D 游戏引擎和框架，专为构建高保真三维应用和图形项目而设计。它具有一个现代图形渲染器，实现了当前标准，可在不同硬件上生成复杂的几何图形和光照。 该引擎包含一个独立的视觉场景编辑器，用于设计环境和配置属性，无需编写代码。它还提供了一个集成的 Lua 脚本环境，用于管理运行时逻辑和自动化引擎任务。 该框架涵盖 3D 图形渲染和应用开发，包括一个将外部文件格式转换为原生场景格式的模型导入系统。其架构结合了多 API 图形后端，以支持各种操作系统和硬件接口。

xrdp is an open-source implementation of the Remote Desktop Protocol (RDP) that enables users to establish a remote graphical desktop session to a Linux machine. It provides a standard RDP connection to a Linux desktop, allowing clients to access and interact with the remote system's graphical interface. The project supports a wide range of platforms beyond standard x86 and ARM Linux environments, including macOS, FreeBSD, and other UNIX-like systems. It offers extensive configuration options for remote display management, such as matching the client display to the server screen, dynamic resi

jsmpeg is a JavaScript MPEG1 video decoder and canvas-based video renderer. It functions as a client-side media decoder that processes video frames in JavaScript, rendering them to an HTML5 canvas without relying on native browser video elements. The project provides a low-latency video player capable of receiving binary media data over WebSockets for real-time streaming. It also supports the progressive loading of static video files via Ajax to allow playback to begin before a file is fully downloaded. The system includes capabilities for playback state and event management, allowing for th

SkyReels-V2 is a video generation system that creates, extends, and refines video clips from text descriptions, images, or both. It operates as a diffusion-based video generation model that can produce videos of any duration by denoising frames sequentially, with each new frame conditioned on the ones that came before it. The system supports generating videos from scratch using text prompts, starting from a single image and producing subsequent frames, or constraining both the first and last frames to match user-provided images. What distinguishes SkyReels-V2 is its combination of infinite-le

OpenH264 是一个使用 H.264 标准进行视频编码和解码的库。它提供了将原始视频帧转换为压缩字节流，以及将这些流解压缩回原始像素帧的工具。 该项目包含一个联播（simulcast）视频流生成器，可从单个源生成多种分辨率。此功能支持自适应比特率流媒体和跨不同网络条件的实时视频通信。 该系统实现了包括自适应速率控制、基于切片的并行编码和 YUV 平面缓冲区管理在内的视频处理工作流。它利用基于状态的比特流解析来处理顺序视频帧依赖关系。

Neutts is a neural text-to-speech engine designed for real-time streaming output on edge devices such as phones and laptops. It supports voice cloning from short audio references, enabling zero-shot reproduction of a target speaker's voice, and can be fine-tuned or retrained from scratch for custom voices and styles. The system distinguishes itself through a decoder-only architecture that halves memory and accelerates generation on constrained hardware, combined with quantized model inference for reduced memory footprint. Its streaming decoder loop interleaves synthesis with playback, deliver

这是一系列用于集成 Android 相机硬件和软件 API 的参考实现和代码示例。该项目提供了使用 Jetpack CameraX 库和底层 Camera2 API 实现照片和视频拍摄功能的演示。 该仓库包括针对高性能录制的专门实现，例如高帧率慢动作和高动态范围（HDR）视频。它还具有机器学习视觉示例，演示了如何分析实时相机帧以进行对象检测和二维码扫描。 该项目涵盖了广泛的成像功能，包括静态图像采集、实时取景器渲染和视频质量配置。它进一步详细介绍了使用制造商特定的硬件扩展来应用散景、夜间模式和 HDR 等效果。 这些示例包括用于渲染视觉叠加的坐标映射实用程序，以及用于跟踪录制状态的事件监控功能。

gfx 是一个硬件无关的图形 API 抽象，将一组统一的图形和计算命令转换为多个 GPU 驱动程序的原生指令。它为跨平台渲染和通用 GPU 计算编程提供了一个通用接口。 该项目具有一个中间表示（IR）着色器翻译系统，可将源代码和 SPIR-V 转换为目标特定语言。它采用数据驱动的参考测试框架来验证图形输出在不同硬件平台上保持一致。 功能包括跨多个线程的并行命令缓冲区编码，以及将管线状态封装到单个对象中以最大限度地减少冗余状态更改。该系统管理底层 GPU 资源，包括内存分配、异步缓冲区映射以及通过交换链（swapchains）进行的显式帧呈现。 该实现通过 WebAssembly 针对原生环境和 Web 浏览器，为 WebGL 和 WebGL2 提供翻译层。

该项目是一款媒体播放器软件和数字电视接收器，旨在渲染各种音频和视频文件格式以及数字广播信号。它作为一个 DirectShow 媒体播放器，提供了一个用于管理输出设置和视觉质量的视频渲染界面。 该软件包含数字电视调谐功能，能够通过兼容的硬件调谐卡捕获、录制和播放直播广播信号。它还具有硬件加速媒体解码和内部解码器集成功能，以确保在各种硬件规格下实现多格式播放。 该系统通过使用着色器和色彩管理来管理视频输出，以及为文本和图像覆盖提供字幕渲染。用户可以通过界面布局自定义和创建自定义工具栏来个性化工作区。

DKVideoPlayer is an Android video player library and media playback framework designed to integrate advanced streaming and playback capabilities into mobile applications. It provides a hardware-accelerated video renderer and a customizable UI kit for building player interfaces, including support for picture-in-picture floating windows. The framework distinguishes itself through specialized interactive features, such as real-time comment overlays, frame capture snapshots, and gesture-based controls for adjusting volume, brightness, and playback progress. It also supports multi-stream playback,

VitamioBundle 是一个 Android 多媒体播放器库和播放框架，专为解码和渲染高性能音视频内容而设计。它提供了一个硬件加速视频解码器，以降低移动设备上的 CPU 负载和电池消耗。 该项目包含一个自适应比特率流媒体客户端，可根据网络状况实时调整视频质量，以防止播放中断。它还具有一个视频渲染引擎，能够配置像素格式和色度输出，从而优化移动显示屏的视觉质量。 该库涵盖了广泛的多媒体功能，包括字幕管理、播放速度控制以及用于流加载的自定义 HTTP 标头。它通过集成的 SSL、TLS 和 HTTPS 支持安全的媒体流传输，并利用本地存储缓存来减少带宽使用。