Awesome GitHub RepositoriesVideo Processing Tools

FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f

Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process

This project is an educational suite and technical guide designed for mastering video codecs and signal processing. It provides a structured curriculum through an engineering course, interactive labs, and tutorials focused on the fundamental principles of video compression and digital signal processing. The resource includes a technical guide for analyzing specific codecs like AV1, VP9, and H.265. It distinguishes itself by providing a containerized media lab, which ensures a consistent development environment for experimenting with video technology tools and notebooks. The project covers a

CVAT is an open-source, web-based platform designed for annotating images, videos, and 3D point clouds to create high-quality training datasets for machine learning. It functions as a containerized server that orchestrates the entire lifecycle of computer vision data, from initial task creation and manual labeling to quality assurance and final dataset export. The platform distinguishes itself through deep integration with machine learning models, allowing users to deploy custom AI models as serverless functions for automated object detection, tracking, and skeleton annotation. It supports co

MoviePy is a Python video editing library and automated video processor designed for programmatically cutting, concatenating, and manipulating video and audio files. It serves as a non-linear video editor and an interface for FFmpeg to handle the reading, writing, and conversion of diverse media formats and codecs. The library enables automated video composition through the layering of multiple video and audio streams using transparency and coordinate-based positioning. It supports dynamic content generation by inserting text overlays and performing custom video frame processing where raw fra

PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer

Este proyecto es una guía de ingeniería multimedia basada en C y un framework de procesamiento multimedia diseñado para gestionar códecs, frames y paquetes dentro del ecosistema de FFmpeg y Libav. Proporciona documentación técnica y patrones de implementación para transcodificación, remuxing y redimensionamiento de datos de vídeo y audio. El proyecto incluye un entorno de desarrollo en contenedores que encapsula las bibliotecas multimedia y toolchains necesarias dentro de una imagen virtual para garantizar entornos de compilación consistentes. El framework cubre una gama de flujos de trabajo de ingeniería multimedia, incluyendo streaming de bitrate adaptativo, remuxing de contenedores multimedia y extracción de metadatos. También proporciona capacidades para el procesamiento de streams, como la sincronización de audio-vídeo y el redimensionamiento de resolución, junto con herramientas para registrar detalles de códecs y tiempos.

ffmpeg-python is a Python wrapper that translates programmatic method calls into command-line arguments for executing FFmpeg media processing tasks. It functions as a multimedia transcoding interface and a media stream capture tool, allowing for the recording of live audio and video from hardware devices and network sources. The library features a fluent interface for constructing complex directed graphs of audio and video filters through method chaining. It also includes an FFprobe metadata extractor that retrieves structured technical properties from media files and returns them as Python d

This project is a TensorFlow-based neural style transfer framework designed to apply the artistic textures and colors of a painting to images and videos. It utilizes a feed-forward image stylizer that transforms visual appearance in a single pass, avoiding the need for iterative optimization. The system includes a deep learning training pipeline that teaches convolutional neural networks to replicate specific styles using perceptual loss functions. It also features a video frame processor that decomposes video files into individual images for sequential stylization and reassembly. The softwa

Owncast is a self-hosted live streaming server that provides full control over broadcast infrastructure and audience data. It functions as an RTMP video streaming server, accepting incoming video feeds and distributing them to viewers through HLS-based segmented streaming. The platform includes a built-in, stateful web-based chat interface that enables real-time viewer engagement during broadcasts. The project distinguishes itself through deep integration with the decentralized Fediverse, allowing servers to automatically broadcast stream status updates and notify followers across distributed

tracking.js is a browser computer vision library written in JavaScript for performing real-time image analysis and object tracking directly within a web browser. It functions as a real-time object tracker, a color tracking tool, and a face detection utility. The library enables the detection and monitoring of specific color ranges, human faces, and known visual patterns across consecutive video frames. It extracts visual features and descriptors from images to identify distinct landmarks for matching and tracking. The project covers broad computer vision capabilities, including the ability t

RobustVideoMatting is a deep learning video matting tool and PyTorch library designed to remove backgrounds from videos and extract human subjects. It utilizes a temporal video segmentation model to ensure consistent matting and reduce flickering across video frames. The project includes a cross-platform model exporter that converts trained neural networks into various runtime formats. This allows for model deployment across multiple environments, including web and mobile applications. The framework provides capabilities for temporal video background removal and AI video post-production with

react-native-skia is a cross-platform graphics framework that provides a high-performance 2D graphics engine for rendering shapes, paths, and images. It functions as a vector graphics engine and UI animation toolkit, allowing for hardware-accelerated visuals across mobile and web platforms. The project is distinguished by its integration of the Skia 2D graphics library, enabling a shader and filter pipeline for complex pixel-level effects. It supports the rendering of Lottie animations exported from After Effects and the execution of animations directly on the UI thread to maintain fluid moti

node-fluent-ffmpeg es un envoltorio de Node.js para FFmpeg que proporciona una interfaz fluida para ejecutar comandos multimedia y procesar archivos. Funciona como un gestor de procesos que maneja el ciclo de vida de los binarios externos de FFmpeg, permitiendo la transcodificación multimedia programática, la generación de miniaturas de video y la extracción de metadatos a través de ffprobe. La biblioteca se distingue por un constructor de comandos que traduce llamadas a métodos de JavaScript en argumentos de línea de comandos. Cuenta con monitoreo de progreso basado en eventos para rastrear fotogramas procesados y rendimiento, así como la capacidad de enrutar datos multimedia procesados directamente a flujos escribibles para su manejo en tiempo real. El proyecto cubre amplias capacidades de procesamiento multimedia, incluyendo la configuración de codificación para propiedades de audio y video, definiciones complejas de filtergraph para efectos visuales y de audio, y gestión de entrada para concatenar múltiples fuentes. También incluye herramientas para sondear contenedores y flujos multimedia para recuperar metadatos técnicos.

ytdlnis is a mobile application that serves as a graphical client for the yt-dlp engine on Android. It functions as a media downloader and manager, providing a user interface to retrieve video and audio from websites. The project distinguishes itself by integrating directly with the Android system share menu and intents to trigger background downloads from external apps. It includes a dedicated authentication cookie manager to import and sync browser session data, enabling the retrieval of private, age-restricted, or premium content. The application covers broad capability areas including au

SerpentAI is a game AI development kit and computer vision framework designed for building autonomous agents that interact with video games. It serves as a game input automation tool and a machine learning model integration engine, allowing developers to create agents that perceive game states and execute actions. The framework utilizes a plugin-based agent architecture to provide modular extensions for game-specific logic and behaviors. It features a specialized system for training, bundling, and deploying machine learning classifiers to recognize visual contexts and game states in real time

Editly es un motor de vídeo programático y ensamblador automatizado headless. Funciona como un editor de vídeo declarativo que genera exportaciones en MP4 y GIF a partir de datos estructurados o código, eliminando la necesidad de una interfaz gráfica de usuario manual. El sistema se distingue por su capacidad para integrar shaders de fragmentos GLSL como capas visuales dentro de una línea de tiempo programática. Utiliza un modelo basado en configuración para definir clips, capas y pistas de audio, permitiendo el ensamblaje reproducible de vídeo y la generación de gráficos programáticos personalizados. El motor cubre una amplia gama de capacidades de producción multimedia, incluyendo secuenciación de vídeo no lineal, reescalado de activos y mezcla de audio multipista con normalización y ducking automáticos. Gestiona la composición visual mediante renderizado basado en canvas para superposiciones de texto, subtítulos y efectos de simulación de cámara como zoom y paneo. El motor de renderizado y sus dependencias están disponibles como una imagen contenedorizada para una ejecución consistente en diferentes entornos.

This is a cross-platform media processing library that reads, writes, encodes, and decodes media in both browser and server environments. It supports common container formats including ISOBMFF, Matroska, Ogg, MPEG-TS, and HLS, and handles codec operations through a combination of WebCodecs API and WebAssembly-based encoders. Media is processed in streaming pipelines that maintain constant memory usage and automatically apply backpressure from output speed to all upstream components. The library distinguishes itself through a plugin-based codec registration system that allows extending support

AnimeGAN es una red generativa antagónica (GAN) y traductor de imágenes desarrollado con TensorFlow. Está diseñado para la transferencia de estilo de foto a anime, utilizando un sistema de aprendizaje profundo para transformar fotografías del mundo real y fotogramas de video en imágenes de estilo anime. El sistema incluye un convertidor de video a anime que aplica transformaciones visuales consistentes a través de fotogramas secuenciales. Admite tanto el entrenamiento de redes generativas en datasets artísticos para replicar estilos específicos como la extracción de pesos del generador a partir de puntos de control (checkpoints) para una inferencia eficiente. El proyecto proporciona utilidades para el refinamiento de imágenes, incluyendo suavizado de bordes y desenfoque para mejorar las transiciones visuales. También gestiona el procesamiento de archivos de video a través de pipelines de fotogramas secuenciales.

VoTT es un software de anotación de visión artificial y herramienta de preparación de datasets para machine learning. Es una aplicación de escritorio diseñada para dibujar cuadros delimitadores (bounding boxes) y asignar etiquetas a objetos en imágenes y videos para crear datasets de entrenamiento para modelos de detección de objetos. La aplicación utiliza una interfaz de escritorio multiplataforma para gestionar recursos de imagen y video. Cuenta con una integración de almacenamiento local para manejar grandes archivos multimedia directamente desde el sistema de archivos de la máquina host e incluye muestreo de video controlado por tasa de fotogramas para extraer imágenes específicas de flujos de video para su etiquetado. El software cubre el ciclo de vida completo de los datos, incluyendo la importación de recursos desde almacenamiento local o en la nube y la conversión de datos anotados a varios formatos de machine learning mediante exportaciones basadas en esquemas. También incorpora cifrado basado en tokens para proteger la configuración sensible del proyecto.