steveseguin/vdo.ninja

Features

• Low-Latency Streaming - Establishes direct, low-latency audio and video connections between browsers using the WebRTC protocol.
• P2P Media Routing Services - Establishes direct, encrypted peer-to-peer video connections and data channels between remote publishers and viewers.
• Peer Connectivity - Creates direct, low-latency peer-to-peer video and audio connections using unique identifiers.
• Guest Lobby Management - Provides workflows for organizing participants in virtual lobbies and waiting rooms before they enter a live production session.
• Live Stream Ingestion - Provides the ability to ingest live video and audio directly from hardware inputs like USB cameras for professional broadcasting.
• Stream Identity Persistence - Assigns stable identifiers to media feeds to maintain consistent connectivity across browser refreshes.
• External Feed Integrations - Routes remote video and audio streams directly into OBS Studio or browser-based production tools.
• Virtual Audio Routing - Directs audio streams into virtual audio cables to be used as microphone sources in other software.
• Professional Production Routing - Directs remote audio feeds into virtual cables, DAWs, or multitrack recordings to ensure high-fidelity sound production.
• Broadcast Software Bridges - Acts as a peer-to-peer bridge to remotely trigger actions and manage settings in broadcast software.
• Adaptive Quality Adjustments - Dynamically adjusts resolution and bitrate in real-time to maintain stream stability and visual quality.
• Quality Optimization - Balances video codecs and audio settings to optimize fidelity across varying network connection speeds.
• Multitrack Recording - Captures each participant on separate lossless WAV tracks for professional post-production mixing.
• System Audio Capture - Captures and transmits system-level internal audio output during screen share sessions.
• Stream Configuration - Customizes video, audio, and connection settings through parameters to tune streaming performance.
• Automated Video Layout Mixing - VDO.Ninja combines several remote video streams into a single automated layout using identifiers in the URL.
• Desktop and Application Capture - Enables the capture of specific application windows or the entire desktop to be transmitted as a live stream.
• Individual Stream Embeddings - Provides unique identifiers for individual streams so they can be placed and cropped independently in a layout.
• Mixed Video Broadcasting - VDO.Ninja streams a single combined output to all guests to reduce CPU and bandwidth consumption.
• Mobile Production Workflows - Enables high-quality video and audio streaming from mobile devices using specialized native application versions.
• Multi-Source Video Composition - Synchronizes and combines multiple remote video feeds into a single composed recording or broadcast stream.
• Production Software Integration - Provides specialized links for high-resolution capture and multi-source recording in professional studio software.
• Remote Feed Coordination - Coordinates multiple video feeds via a director role or manual link pairing for professional production.
• WebRTC Video Chat - Enables live peer-to-peer video chat using WebRTC connections between publishers and viewers.
• Stream Routing - Generates isolated direct links for each participant to enable fine-grained mixing and layout control.
• RTMP Protocol Packaging - Packages web-based video feeds into RTMP containers for publishing to external services like YouTube.
• Video Streaming - Transmits low-latency audio and video feeds between remote broadcast software instances.
• Video Scene Layouts - Manages the spatial arrangement and dynamic positioning of multiple remote video feeds within a production scene.
• Professional Audio Hardware Integration - Connects USB microphones and external audio interfaces to ensure high-quality sound for remote production.
• Camera Feed Capture - Transmits live video feeds from a local webcam or virtual camera to remote participants.
• Virtual Room Orchestrators - Organizes participants into named virtual spaces and subgroups to manage visibility and director-led guest flows.
• Guest Flow Routing - Moves guests between virtual rooms to stage participants in a lobby before moving them into live production.
• Video Stream Room Routing - Publishes video feeds into shared room environments to allow directors to manage sources and layouts.
• Connection Stability Features - Utilizes relay and meshcast options to mitigate packet loss and maintain stability on unstable networks.
• Peer Connection Recovery - Automatically attempts to restore failed peer connections using a configurable retry depth.
• Server-Relayed Mesh Distribution - Implements a server-relayed mesh distribution to stream high-resolution video to multiple viewers simultaneously.
• Relay Fallbacks - Provides fallback mechanisms to route video through specialized media servers when direct P2P connections are unstable.
• Peer-to-Peer Optimization Tools - Optimizes network routing by disabling relay servers to ensure the lowest possible latency for P2P connections.
• Persistent Network Connections - Maintains long-lived connections by automatically re-establishing lost peers and triggering periodic reloads.
• Screen Sharing - Streams a local desktop view to remote participants in real time for collaborative watching.
• Remote Guest Integrations - Provides the core capability of connecting remote guests to a professional production workflow via unique links.
• Media Streaming Protocol Bridging - Converts between RTMP, SRT, WHIP, and WebRTC to ensure connectivity regardless of browser or network restrictions.
• URL Parameter Configuration - Defines stream quality, hardware settings, and room behavior by encoding configuration directives directly into connection URLs.
• Latency Minimizers - Optimizes packet timing and bypasses processing pipelines to minimize audio capture and transmission delay.
• End-to-End Encryption - Applies AES-based end-to-end encryption to all audio and video media feeds.
• User Administration - Performs administrative actions such as transferring users to rooms and managing scene assignments.
• Studio Control Interfaces - Provides a control interface for programmatically managing PTZ cameras, audio levels, and scene layouts via API and MIDI.
• Client-Side Media Processing - Implements real-time background removal and face tracking using machine learning models directly within the browser.
• Encrypted Peer-to-Peer Transfers - Protects peer-to-peer broadcasts using a combination of end-to-end encryption and password requirements.
• Face Tracking - Detects and tracks spatial coordinate information of faces to drive visual effects.
• Resolution Constraints - Constrains the maximum width and height of video streams to prevent excessive bandwidth consumption.
• Aggregate Bitrate Limits - Defines a maximum combined bitrate for all video feeds within a scene to manage overall network capacity.
• Custom Bitrate Limits - Provides the ability to set custom bitrate limits for viewers and groups to manage bandwidth consumption.
• High-Fidelity Link Provisioning - Creates pre-configured connection links optimized for high-bitrate 1080p60 ingestion.
• Individual Stream Bitrate Caps - Caps the bitrate of a specific video stream to strictly control the amount of transmitted data.
• Media Visibility Restrictions - Mutes and hides video and audio feeds for users not assigned to specific production groups.
• Stream Recorders - Saves live video and audio streams as perfect copies to local storage without transcoding on headless Linux/WSL systems.
• Headless Cloud Recording - Uses a cloud-based environment to capture a stream and save it via FFmpeg.
• Cloud Storage Synchronization - Uploads recording chunks to cloud providers via OAuth to ensure redundancy.
• Access Link Generators - Generates shareable links for viewers to access streams while restricting publishing permissions.
• Stream Relays - Utilizes server-side relays to synchronize and forward media streams for distribution and recording.
• Multichannel Stream Routing - Sends different guest feeds to separate audio channels within a single scene output for professional mixing.
• Media Session Capture - Records the synchronized audio and visual output of a composed scene into a single video file.
• Remote Command Surfaces - Forwards remote commands over the network to a local API to control studio software and hardware.
• Screen Sharing - Automatically triggers the camera sharing process and provides controls for managing screen-sharing content.
• Browser-Based Recorders - Captures video and audio directly within the browser with support for segmenting recordings into chunks.
• Background Removal Tools - Eliminates video backgrounds to make subjects transparent for overlaying in production software.
• Chroma Keying - Removes specific color ranges from a video feed using HSL-based chroma key detection.
• Direct Feed Publishing - Streams live feeds from OBS Studio directly to a peer network without needing a browser window.
• Studio Coordination - Syncs layout states and triggers scene changes through direct commands to OBS Studio.
• Self-Hosted Deployments - Deploys the entire application on a private HTTPS server, including optional TURN setup.
• Video Quality Adjustments - Provides predefined quality levels for remote video feeds to balance resolution and stability.
• Audio Channel Assignments - Assigns guests to a preferred audio channel upon joining a session for consistent routing.
• Audio Group Management - Organizes users into specific audio groups to control who can hear and speak to one another.
• Cross-Group Audio Visibility - Permits audio streams to remain audible to all participants even when assigned to different groups.
• Audio Hardware Routing - Directs audio streams to specific hardware output devices using a device name or unique identifier.
• Low-Latency Drivers - Utilizes specialized Windows drivers to transmit professional audio with minimal latency.
• Raw Audio Captures - Captures uncompressed PCM audio to preserve high-fidelity sound for professional production.
• High-Fidelity Audio Streaming - Offers high-fidelity audio optimization by increasing bitrate and disabling noise cancellation for stereo sound.
• Scene-Based Audio Muting - Silences audio from streams that are not currently active in the scene to prevent audio doubling.
• Audio Processing - Processes incoming audio using real-time noise suppression, echo cancellation, and equalizers.
• Inter-Application Audio Routing - Directs browser audio output to virtual cables so streaming applications can capture feeds.
• Jitter Buffers - Implements a playback buffer to eliminate audio and video stuttering caused by network jitter.
• Screen and Audio Capture - Captures video and audio from a computer screen or specific application window.
• Live Capture and Recording - Captures live video and audio from cameras and screens directly to files with configurable codecs.
• Client-Side Backup Recording - Provides the ability to record audio and video directly in the guest's browser for clean, local backups.
• Stream Layout Coordination - Coordinates multiple participants within a shared room to manage stream layouts and production settings.
• Automated Source Integrations - Programmatically adds and configures remote media sources as browser sources within a production environment.
• Broadcast Software Integration - Hosts a media sender page within a broadcasting software dock for streamlined local media sharing.
• Virtual Camera Drivers - Exports remote video streams into virtual camera drivers for use in external communication software.
• DAW Plugin Interfaces - Streams audio from remote sources directly into digital audio workstations using a dedicated plugin interface.
• Digital Face Filters - Overlays digital graphics onto detected faces in a video stream using custom effects models.
• Dynamic Media Configuration - Allows guests to dynamically modify their own video and audio settings without disconnecting from the session.
• External Media Feed Ingestion - Integrates with third-party tools to record high-quality solo feeds as dedicated video sources.
• Frame Rate Capping - Caps maximum video bitrate and frames per second to ensure system stability and prevent crashes.
• Network-Based Quality Scaling - Automatically scales video quality for group calls based on the participants' network and device performance.
• Adaptive Pixel Encoding - Enables selection of different encoding formats to balance visual quality with available network bandwidth and hardware acceleration.
• Encoder Priority Profiles - Allows users to choose whether the encoder prioritizes high resolution for detail or smooth framerates.
• Large-Scale Video Distribution - Broadcasts high-quality video feeds to large audiences through dedicated distribution networks.
• Live Captioning Integrations - Integrates real-time speech-to-text transcription to provide live captions for audio streams.
• Live Video Manipulation - Processes live video streams in real-time to apply effects like green screens and face filters.
• Grid Layout Customization - Allows for the configuration of the visual arrangement of streams and the application of custom styles to the video grid.
• Multi-Stream Monitoring - Allows operators to view and monitor multiple remote video streams simultaneously within a single production interface.
• Face Masking Tools - Applies anonymous overlays to detected faces to ensure identity privacy in video streams.
• Recording Stabilization - Sends video in discrete chunks to ensure consistent recording quality even when latency is minimized.
• Hardware Accelerated Media Encoders - Offloads video compression to dedicated hardware to minimize CPU load during high-definition streaming.
• NDI Protocol Streaming - Routes peer-to-peer video feeds into the NDI protocol for integration into professional studio environments.
• Hardware-Accelerated Video Pipelines - Utilizes single-board computers as encoders to provide hardware-accelerated video streaming pipelines.
• Media Stream Synchronizers - Aligns incoming remote video feeds with local audio sources to eliminate latency offsets.
• MIDI Hardware Integration - Triggers global hotkeys and remote commands by routing signals from MIDI hardware to the software.
• ML Background Replacements - VDO.Ninja uses machine learning to remove the sender's background and replace it with a custom image.
• Network Stream Scene Integration - Maps viewing sources to scene numbers so displays update automatically when guests change.
• Playback Buffering Management - Sets specific audio and video buffer delays to synchronize remote streams with local external sources.
• Production Talkback Channels - Creates an audio-only return channel allowing remote directors to communicate with mobile users.
• Raw Media Data Transport - Transmits uncompressed video frames and audio data to a parent window for custom mixing.
• Network Media Archiving - Pulls raw video sources from the network and writes them to local storage or RTSP servers.
• Network Stream Ingestion - Ingests remote video sources delivered via the WHEP protocol for low-latency production monitoring.
• Neural Face Renderers - Renders a real-time face mesh over video streams using machine learning to track facial features.
• Real-Time Video Filtering - Applies low-latency visual effects such as background blur, virtual greenscreens, and digital zoom to live feeds.
• Remote Parameter Control - Adjusts bitrate, volume, and recording states for local or remote participants in real-time.
• Remote Video Monitoring - Allows viewing of remote video feeds to check framing and quality without being in the primary mix.
• Stream Failover Systems - Configures scenes with backup feeds that automatically take over if the primary guest connection drops.
• Broadcast Signal Routing - Routes low-latency video sources and scenes to network destinations for broadcasting on social platforms.
• Composited Feed Streaming - Routes a composited scene or cropped source from broadcasting software into a peer-to-peer feed.
• Stream Metadata Transmission - Sends dynamic settings and status indicators, such as tally lights, alongside the media stream.
• Realtime Media Routing - Redirects media feeds through external servers using WHIP and WHEP for low-latency distribution and recording.
• Encoding Bypasses - Saves encoded video to disk as discrete chunks without re-encoding to reduce CPU overhead.
• Hardware-Accelerated Captures - Publishes selected game or application windows using hardware-accelerated encoding for low latency.
• Simultaneous Multi-Quality Streams - Transmits high-quality and low-quality monitor paths simultaneously to optimize bandwidth across different viewers.
• Stream Quality Parameterization - Adjusts resolution, frame rate, and codecs to balance visual fidelity against network load.
• Video Encoding and Decoding - Selects the appropriate compression standard to optimize for available hardware encoding.
• Video Feed Cropping - Adjusts the visible area of a video slot using cropping controls to remove unwanted edges.
• Video Feed Transformations - Mirrors or rotates the remote video feed using dedicated buttons or programmatic API commands.
• Video Frame Capture - Sends raw video frames or captured images to the parent window for custom video elements.
• Video Ingestion Interfaces - Provides interfaces for ingesting live video data from physical cameras and capture cards.
• Virtual Green Screens - Replaces video backgrounds with solid green to facilitate chroma keying in external production software.
• Virtual Video Routing - Enables sending remote video feeds into meeting applications as if they were shared windows.
• Stream Health Visualizations - Visualizes packet loss and overall stream health using color-coded graphs for each media feed.
• Remote Command Execution - Executes remote commands via HTTP and WebSockets to trigger hotkeys and actions on external devices.
• MIDI and OSC Interfaces - Interfaces external MIDI controllers with the software to trigger production actions or adjust settings.
• MIDI Data Exchange - Sends MIDI device output from a remote hardware controller to a computer over peer connections.
• MIDI Track Routing - Sends and receives MIDI messages between remote browsers and local hardware devices.
• MIDI Output Controls - Issues chat commands and manages overlays using physical MIDI controllers or virtual MIDI devices.
• Advanced Mobile Camera Controls - Streams video from mobile devices using ultra-wide lenses, dual-camera mixing, and UVC capture.
• WebView Application Wrappers - Embeds streaming functionality into native mobile or desktop applications using the WebView API.
• Adaptive Bitrate Controllers - Dynamically adjusts video stream quality and bitrates using software caps and sender defaults to ensure stability.
• Viewer Bitrate Restrictions - Restricts the viewing bitrate for guests to optimize network capacity and ensure stream stability.
• Automated Session Connection - Automatically triggers the joining of rooms and scenes using pre-selected audio and video devices.
• Protocol-Based Video Publishing - Sends video feeds from studio software using the WHIP protocol to achieve precise bitrate control.
• Participant Management - Provides tools for monitoring remote participants, muting sources, and broadcasting talkback.
• Access-Controlled Rooms - Manages room entry through a combination of approval gates, passwords, identity verification, and capacity limits.
• Room Provisioning - Establishes shared named spaces that multiple users can join for real-time audio and video exchange.
• Iframe Messaging - Integrates video streams into external websites via an iframe with two-way communication capabilities.
• Group Membership Control - Programmatically adds or removes users from specific video groups via API requests.
• Hardware Control APIs - Toggles local camera and microphone states and switches between available input and output hardware devices.
• Integrated Stream Chats - Provides a dedicated web-based chat environment for participants to communicate during a live stream.
• Invite Link Management - Creates customized URLs for guests and sources to pre-configure streaming parameters.
• Low Bitrate Audio Coding - Adjusts the outbound audio data rate to balance sound fidelity with available network bandwidth.
• Chat Message Sending APIs - Sends private chat messages and initiates solo audio or video chats with remote guests programmatically.
• Mobile Camera Integration - Connects mobile device cameras as network video sources for integration into studio software.
• Stream Reconnection Management - Manages stream connectivity by loading specific IDs, disconnecting users, or forcing page reloads.
• Streaming Resolution Management - Sets the maximum width and height of the video stream to manage CPU load.
• Peer Connection Monitoring - Visualizes peer-to-peer connection states between users to troubleshoot communication failures.
• Peer-to-Peer Data Exchange - Sends serializable data payloads, chat messages, or raw MIDI signals to connected clients via P2P.
• WebRTC Data Channels - Sends arbitrary data payloads and control signals between connected peers using WebRTC data channels.
• Audio Relay Fallbacks - Routes audio through a central director as a fallback when direct peer-to-peer connections are unavailable.
• Peer-to-Peer Tunneling - Uses peer-to-peer connections to transport non-video data between clients as a tunneling service.
• Peer-to-Peer Media Libraries - Transmits arbitrary JSON payloads and MIDI signals between clients via direct peer-to-peer data channels.
• Room-Based Client Grouping - Organizes connected participants into named rooms for coordinated broadcasting and group chat.
• Subtitle Translation Overlays - Provides real-time translation of spoken text for display as bilingual subtitle overlays on video streams.
• TURN Relays - Sets up a private TURN server to facilitate peer-to-peer connections across firewalls.
• Audio-Only Stream Modes - Disables video transmission to reduce bandwidth usage and prevent audio synchronization delays.
• Automated Hardware Device Selection - Matches specific device names or IDs to automatically select audio sources during session setup.
• Embedded Player Authentication - Uses unique access tokens for embedded players to eliminate manual sign-in screens for production sources.
• Entry Approval Gates - Implements a pending state for incoming guests that requires explicit director approval for entry.
• Password Access Restrictions - Requires case-sensitive alphanumeric passwords to secure specific stream or room IDs.
• Stream Access Restrictions - Uses audience keys to prevent viewers from publishing their own media to a specific stream ID.
• Participant Interaction Partitioning - Restricts the visibility and audibility of participants to ensure they only interact with their own subgroup.
• Role-Based Access Control - Assigns specific capabilities and transmission settings to participants based on their assigned role.
• Broadcasting Protocol Integrations - Bridges professional broadcast streams into the web environment using standardized WHIP and WHEP ingest and playback protocols.
• Broadcast Readiness Auditing - Runs automated bandwidth and hardware stress tests to verify guest compatibility before a broadcast.
• Connection Health Monitors - Displays live statistics on bitrate and packet loss to identify network bottlenecks.
• Performance Reporting - Provides detailed reports on bitrate, latency, and hardware specifications for stream performance analysis.
• Media Fluidity Prioritization - Balances resolution and frame rate by prioritizing either image detail or motion smoothness.
• Remote Hardware Controls - Manages PTZ cameras and external hardware using MIDI, API, and WebHID protocols from a remote browser.
• Stream Management - Manages video states and executes play or pause commands via message listeners and events.
• Stream Performance Analysis - Provides real-time diagnostic graphs for analyzing bitrate and packet loss to assess stream performance.
• User Group Management - Segments participants into sub-groups to control media visibility and audibility within a session.
• Media Quality Testing - Evaluates network stability and latency using a video-echo test to ensure broadcast quality.
• Video Frame Rate Configurators - Sets stream resolution and frame rate using predefined quality tiers for consistent delivery.
• Max Frame Rate Caps - Sets a maximum frames-per-second threshold and automatically scales down to manage resources.
• Video Surface Visual Effects - Applies filters, blurring, and image overlays directly to the video feed on the publisher side.
• Background Blurring - VDO.Ninja applies a machine-learning effect to obscure the sender's background with configurable intensity.
• PTZ Hardware Control - Triggers physical pan, tilt, and zoom adjustments of cameras via API requests or embedded messages.
• Quality Presets - Provides pre-defined resolution and aspect ratio presets to ensure consistent video feed quality.
• Dynamic Content Slot Managers - Assigns guests to fixed positional slots so viewing sources follow the slot regardless of the person.
• Layout Management - Provides a visual interface for organizing and arranging multiple guest views within the application window.
• Comments and Live Chat Overlays - Aggregates real-time messages from external platforms into a lightweight, on-screen chat overlay for viewers.
• Real-time Stream Uploads - Streams local recordings directly to cloud storage in real-time for remote backup.

Star history