Awesome GitHub RepositoriesMotion Vector Calculation

This project is an educational suite and technical guide designed for mastering video codecs and signal processing. It provides a structured curriculum through an engineering course, interactive labs, and tutorials focused on the fundamental principles of video compression and digital signal processing. The resource includes a technical guide for analyzing specific codecs like AV1, VP9, and H.265. It distinguishes itself by providing a containerized media lab, which ensures a consistent development environment for experimenting with video technology tools and notebooks. The project covers a

This project is an open-source 3D game engine designed for building high-fidelity games, simulations, and cinematic environments. It functions as a robotics simulation platform with native integration for ROS 2 to model robot controllers and sensors. The engine features a multi-threaded Forward+ physically based renderer that supports hardware-accelerated ray tracing and global illumination. The system is built on a modular extension architecture using Gems to add or replace features without modifying core binaries. It includes a native SDK for AWS cloud integration, enabling IAM authenticati

Pose-animator is a system that maps real-time body and face tracking data to 2D vector illustrations. It functions as a skeletal animation engine and motion controller that translates human keypoint recognition into instantaneous SVG path updates. The project enables real-time motion capture from webcam feeds and pose extraction from static images. It utilizes a skeletal rig to link virtual bones to vector character surfaces, allowing for the animation of custom characters and interactive avatars. The tool incorporates client-side machine learning inference for processing camera frames, coor

jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

SAMURAI is a zero-shot visual tracking model that adapts the Segment Anything architecture for video object segmentation. It uses a first-frame prompt, such as a bounding box or mask, to initialize tracking, then employs a motion-aware memory mechanism that stores and updates temporal motion features across frames to guide mask refinement. An online memory update strategy continuously refreshes this memory with new frame predictions, while temporal motion encoding computes optical flow between consecutive frames to inform object boundary and occlusion handling. The system is designed for real

StoryDiffusion is a generative AI system designed for consistent character image and video generation. It utilizes a pluggable cross-attention module to inject shared character representations into pretrained diffusion models, allowing for visual identity stability across multiple images and scenes without retraining the base model. The project features a video generation pipeline that produces temporally coherent sequences from text prompts or condition images. It employs a latent space motion interpolator to predict intermediate frames and semantic motion, enabling long-range video generati

OpenCVSharp is a .NET library that wraps native OpenCV functions, providing C# developers with access to OpenCV's computer vision capabilities through an API that mirrors the native C/C++ style. It serves as a managed wrapper for image processing, feature detection, object detection, and image manipulation tasks, while also handling automatic disposal of unmanaged OpenCV resources like Mat objects to prevent memory leaks in .NET applications. The library enables keypoint detection and descriptor extraction using algorithms such as AKAZE, BRISK, or FAST, with brute-force or FLANN-based matchin

ToonCrafter is a model that combines latent diffusion, reference-based colorization, and sketch-guided control for cartoon animation and interpolation. It functions as a cartoon video interpolation model, a reference-based colorization model, and a sketch-guided animation tool, all built on a latent diffusion animation framework. The project distinguishes itself by integrating three core capabilities into a single pipeline: generating smooth intermediate frames between two cartoon images using diffusion-based priors, transferring color and style from a reference image onto black-and-white ske

AniPortrait 是一个 AI 视频合成流水线，旨在生成照片级逼真的说话肖像和面部动画。它充当说话头像生成器和音频驱动的动画师，将唇部动作、表情和头部姿势与语音或参考视频源同步。 该系统包括一个面部表情迁移工具，用于将源视频中的动作重演到静态参考图像上。它利用带有参考图像调节的潜在扩散模型，在生成的帧中保持视觉身份和一致性。 该流水线涵盖音频到表情的映射、姿势引导的运动控制和照片级逼真的视频合成。它结合了帧插值上采样，以加速生成过程并减少总渲染时间。

MathUtilities 是一个专门的工具包集合，提供用于几何、计算机视觉、数学、物理模拟和信号处理的引擎。它作为一个全面的数学和物理库，专注于技术应用中的线性代数、数值优化和几何计算。 该项目的独特之处在于物理模拟工具包和 3D 几何引擎。这些工具提供了用于 Verlet 积分、迭代逆运动学求解器、通过体积光线步进（raymarching）进行的距离场渲染以及网格几何变形的功能。它还包括一个用于估计相对相机运动和生成鱼眼投影的计算机视觉实用程序。 该库涵盖了广泛的功能领域，包括使用闵可夫斯基差和空间哈希的碰撞检测系统、机器人运动规划，以及使用卡尔曼滤波进行降噪的信号处理。其他功能包括数值数据优化、用于点集拟合的线性代数运算，以及用于对象层次结构的基于反射的 JSON 序列化。

Auto-editor 是一个命令行自动化视频编辑器，使用 FFmpeg 从视频文件中删除静音和无效片段。它作为一个处理套件，具有专门的剪辑生成器，可根据响度阈值、运动分析和语音转文字转录来识别需要修剪的片段。 该工具的特色在于提供灵活的后期制作工作流，允许用户将自动剪辑的时间轴导出为 XML 或 JSON 文件，以便在专业的非线性编辑软件中使用。除了简单的删除，它还可以执行动态播放调整，例如增加静音片段的播放速度，而不是完全删除它们。 该项目涵盖了广泛的媒体处理功能，包括音频标准化、齿音消除以及图层合成、图形叠加和缩放变换等视觉效果。它还支持通过 URL 摄入远程媒体，并提供在渲染最终视频前预览编辑统计信息的实用工具。

lsfg-vk is a Vulkan-based frame generation tool and graphics middleware designed to increase perceived frame rates in graphics applications. It implements a lossless scaling algorithm to insert generated frames between rendered ones, increasing motion smoothness without reducing image quality. The project features a dedicated programming interface for integrating frame generation logic into external applications and includes an application profile manager. This manager allows specific generation settings to be assigned to individual executables, automating configuration upon application start

QualityScaler is an AI video upscaler and local media processing tool designed to increase the resolution and visual quality of videos and images. It uses deep learning models to enhance detail and remove noise, operating as an offline application that executes all computations on local hardware. The project functions as a GPU-accelerated media processor that distributes workloads across multiple graphics cards to increase rendering speed. To prevent memory overflow during high-resolution tasks, it employs a tiled image processing method that splits large assets into smaller sections. The sy

Real-Video-Enhancer is a cross-platform desktop application that utilizes neural networks to upscale resolution, generate intermediate frames, and denoise video files. It functions as a deep learning video processor that runs restoration models through hardware acceleration, dispatching heavy prediction workloads directly to underlying graphics hardware. The software executes optical-flow-based frame interpolation to increase framerates and motion smoothness, alongside dedicated filtering models that remove digital noise and blocky compression artifacts from compressed video streams. Additio

Bar chart race is a Python data visualization library that transforms ordered tabular time-series data into animated bar and line chart races. It operates as an extension for rendering dynamic charts that illustrate how rankings and values change over time. The library interpolates wide-format chronological tables into densely sampled frame sequences, calculating intermediate numeric values to produce fluid motion animations. It orchestrates iterative canvas redraws through a plotting backend while supporting external multimedia encoders to export compressed standard video files. Generated a