brianchirls/Seriously.js
Seriously.js
Seriously.js is a WebGL video processing framework and browser-based graphics engine designed for real-time video composition and image manipulation. It functions as a node-based visual compositor that organizes media sources and effects into a directed acyclic graph, using a custom fragment shader compiler to transform these graphs into optimized GLSL shaders for GPU-accelerated rendering.
The engine features a modular web media pipeline and a plugin-based architecture, allowing for the integration of custom effects, input sources, and output targets. It enables the development of interactive media compositions where user interface inputs can dynamically bind to shader variables to update visual effect properties in real time.
The framework supports multi-source media import from webcams, canvases, image files, and 3D engine outputs. Its processing capabilities cover visual effects such as color grading, blurring, distortions, and chroma keying, alongside tools for node transformation controls and the extraction of raw pixel data from any point in the processing chain.
Features
- Node-Based Video Compositing - Implements a node-graph interface for combining and manipulating video elements within a processing pipeline.
- Web-Based Graphics Acceleration - Implements a hardware-accelerated graphics engine in the browser using WebGL for real-time video and texture processing.
- GPU-Accelerated Image Processing Frameworks - Provides a GPU-accelerated framework for applying real-time filters and effects to video and image streams.
- Node-to-GLSL Compilers - Provides a custom compiler that transforms node-based processing graphs into optimized GLSL shaders.
- Graph-to-Shader Compilers - Translates node-based graph configurations into optimized GLSL fragment shaders for high-performance GPU rendering.
- Hardware-Accelerated Video Pipelines - Provides a hardware-accelerated video pipeline for real-time compositing and image manipulation via WebGL.
- Node-Based Visual Effects - Uses a directed graph of functional blocks to build complex image transformations and visual compositions.
- Node-Graph Pipelines - Designs visual composition pipelines as a directed acyclic graph of transforming nodes.
- Real-Time Video Filtering - Provides low-latency processing of live video streams to apply real-time visual effects and distortions.
- Texture-Backed Video Rendering - Renders video frames as textures within a GPU pipeline to enable real-time geometric transformations and visual processing.
- Video Textures - Treats live video streams as textures within a WebGL context to enable real-time GPU-accelerated pixel manipulation.
- Visual Effects Composition - Enables complex visual compositions by blending multiple video layers using shaders, filters, and transformations.
- Visual Effects Engines - Provides a comprehensive engine for applying color grading, blurring, distortions, and chroma keying to video content.
- Visual Pipeline DAG Executors - Implements a video processing pipeline where media sources and effects are organized as a directed acyclic graph.
- Real-Time Visual Effect Processors - Implements a real-time visual effect processor that applies custom fragment shaders to media sources in the browser.
- Media Filter Pipelines - Ships a modular media pipeline for applying frame-level transformations and effects to ingested web media.
- Real-Time Shader Parameters - Allows real-time modification of shader properties via UI bindings for immediate visual feedback.
- Multimedia Source Ingestion - Ingests visual data from webcams, canvases, image files, video elements, and 3D engine outputs.
- Node Transformation Controls - Includes tools to adjust the position, rotation, scale, and skew of individual processing nodes in the visual graph.
- Browser Rendering Plugins - Enables the development of custom plugins to extend browser rendering with specialized media sources and effects.
- Modular Plugin Architectures - Features a modular plugin architecture for adding custom input sources, visual effects, and output targets.
- Plugin-Based Architectures - Employs a plugin-based architecture allowing the registration of custom media sources and visual effects.
