Projects sharing features with Projectm

Rythm.js is a JavaScript animation framework designed to synchronize visual interface elements with audio playback or live microphone input. It functions as a DOM manipulation tool that maps real-time audio frequency data to CSS properties, allowing web elements to pulse, move, and transform in response to sound. The library distinguishes itself by providing granular frequency-band mapping, which allows developers to isolate specific ranges like bass, mids, or treble to trigger targeted visual responses. By integrating with the Web Audio API, it processes audio signals to drive dynamic geomet

EZAudio is an audio library for Apple platforms that provides standardized interfaces for microphone capture, file playback, and hardware output. It functions as a low-latency audio processor and visualization framework designed to manipulate audio buffers and route signals with minimal delay. The project features a hardware-accelerated waveform renderer for drawing real-time audio amplitudes and rolling plots. It also includes a Fast Fourier Transform analyzer that converts time-domain audio samples into frequency-domain data for spectral analysis. The library covers a broad range of capabi

Librosa is a Python audio analysis library and digital signal processing framework. It functions as a feature extraction suite and music information retrieval tool designed to analyze the structural and sonic characteristics of audio signals. The library provides specialized capabilities for music analysis, including dynamic tempo tracking to identify rhythmic pulses and spectral feature extraction to compute harmonic spectra, chroma variants, and onset points. It also serves as a time-series audio processor for synchronizing audio streams. The system covers a broad range of audio processing

f3d is a fast 3D model viewer and rendering engine designed for visualizing 3D meshes, CAD files, and point clouds. It operates across multiple deployment profiles, functioning as a lightweight desktop application, a scientific data visualizer for volumetric and scalar datasets, a headless rendering engine for automated image generation, and a WebAssembly-based renderer for web applications. The project distinguishes itself through specialized support for Gaussian Splatting scene reconstructions and the ability to visualize complex scientific formats such as VTK, NetCDF, and HDF. It features

Real-time audio streaming over the network.

StreamFX-Public is a collection of OBS Studio plugins and software components designed for broadcast enhancement. It provides a suite of visual effects, filters, hardware-accelerated encoders, and professional video encoding tools to expand the capabilities of the host application. The project distinguishes itself through the support of professional mezzanine video codecs, including DNxHR, ProRes, and Cineform, for high-fidelity post-production editing. It also implements hardware-accelerated recording via GPU cores and AMD AMF to reduce CPU overhead during live broadcasts. The toolset cover

This project is a collection of open-source shader programs and playable demonstration scenes for the Godot game engine. It serves as a shader library providing 2D and 3D visual effects, as well as a collection of post-processing shaders for modifying the final rendered image. The library includes specific implementations for spatial effects on 3D objects, such as outlines and dissolve transitions, and planar effects for 2D sprites, including palette swapping and glow. These effects are paired with standalone demo scenes that provide a playable preview of the graphical results. The repositor

Editly is a headless, programmatic video engine and automated assembler. It functions as a declarative video editor that generates MP4 and GIF exports from structured data or code, removing the need for a manual graphical user interface. The system is distinguished by its ability to integrate GLSL fragment shaders as visual layers within a programmatic timeline. It uses a configuration-based model to define clips, layers, and audio tracks, allowing for reproducible video assembly and the generation of custom programmatic graphics. The engine covers a broad range of media production capabilit

Pixel is a 2D game library and graphics engine for the Go programming language. It provides a hardware-accelerated renderer for drawing sprites, geometric shapes, and text, utilizing an optimized system of batching and transformation matrices. The project functions as a comprehensive toolkit for two-dimensional interactive applications, combining a graphics engine with a 2D vector math library for affine transformations and coordinate space projections. It includes a dedicated input manager that tracks keyboard presses and mouse movements using a polling-based system rather than asynchronous

The Book of Shaders is an interactive educational guide and curriculum for learning GLSL fragment shader programming to create procedural graphics and visual effects. It provides a structured learning path and a categorized reference guide for data types, built-in functions, and mathematical operations used in shader development. The project features a web-based shader sandbox and interactive editor that allows for real-time iteration and visualization of GLSL code. Users can experiment with procedural art and share their results via unique URLs. The curriculum covers a wide range of graphic

This library is a jQuery plugin that provides interactive, hardware-accelerated fluid surface simulations for web-based user interfaces. It renders realistic water ripple animations over existing DOM elements, allowing static backgrounds to respond dynamically to user input. The plugin distinguishes itself by utilizing WebGL fragment shaders to calculate pixel displacement and fluid motion in real time. By mapping background images as textures and injecting coordinate-based disturbances, it creates responsive visual feedback that reacts to mouse movements and clicks without disrupting the und

glslViewer is a console-based GLSL shader sandbox and renderer designed for the real-time testing and iteration of fragment and vertex shaders. It functions as a live-reloading viewer that automatically updates visual output when source files are modified on disk. The system also operates as a headless renderer, capable of generating frames and exporting images without a physical display. The project is distinguished by its support for multi-pass rendering, utilizing framebuffer ping-ponging and convolution pyramids to execute complex visual effects. It features an integrated OSC controller t

Cobe is a WebGL globe library designed for interactive 3D geographic data visualization. It functions as a canvas-based map component that renders a world map, allowing for the plotting of latitude and longitude coordinates via markers and connecting arcs. The library distinguishes itself by linking standard HTML elements to 3D coordinates using CSS anchor positioning. This integration enables the attachment of DOM elements, such as labels and tooltips, directly to markers and arcs on the sphere. The system covers geographic data plotting and network connection mapping, utilizing automated r

pyAudioAnalysis is a Python library and framework for audio signal processing and analysis. It provides tools for extracting mathematical representations of sound, such as spectrograms, and implements a system for training and evaluating machine learning models to classify audio segments based on acoustic patterns. The project includes dedicated utilities for audio segmentation, which allow for the removal of silence and the detection of specific audio events to divide recordings into meaningful sections. It also provides data visualization capabilities that use dimensionality reduction to ma

This project is a Stable Diffusion video generator that creates moving imagery by interpolating between text prompts within a generative model's latent space. It functions as a tool for AI video generation and latent space interpolation, transforming descriptive text into visual sequences. The system specifically enables audio-reactive visuals by synchronizing the rate of image interpolation to the beat and rhythm of an audio file. It produces these sequences through morphing video generation, which transitions smoothly between different text prompts. The project includes a graphical user in

Tixl is a node-based motion graphics engine and procedural generation tool used to create 3D geometry and shaders. It utilizes a directed acyclic graph of operators and GPU-accelerated compute kernels to generate complex 3D shapes, particularly through the use of signed distance functions and particle simulations. The engine is highly extensible via a C# development framework that supports hot code reloading, allowing custom operator logic to be injected into the active runtime without restarting. It further distinguishes itself as a lighting controller, capable of translating 3D spatial attr

rnnoise is a real-time speech denoising library that uses a recurrent neural network to suppress background noise from live voice audio. It is implemented as a lightweight C library with a minimal API, designed for easy integration into audio applications that need low-latency noise reduction. The library employs a gated recurrent unit (GRU) architecture and frequency-domain feature extraction to capture temporal dependencies in speech, operating on short audio frames sequentially for streaming use. It also includes a training pipeline that allows users to train custom noise suppression model

This project is an AI voice training framework and singing voice conversion tool. It uses VITS and SoftVC technologies to transform the timbre of singing and spoken audio recordings, allowing a user to change the vocal characteristics of a recording to match a specific target speaker. The system provides a web-based voice converter interface for managing model checkpoints and performing timbre transformation and pitch shifting. It supports exporting trained models to the ONNX format for use in external interfaces and lightweight runtimes. The framework covers the full production pipeline, in

ThinkDSP is a Python-based audio signal processing framework and educational resource designed for studying the mathematical properties of digital audio and waveforms. It functions as a digital signal processing library that provides tools for performing frequency analysis and harmonic decomposition of sound waves. The project covers the fundamentals of audio frequency analysis and sound synthesis, enabling the decomposition of sound into harmonics to analyze or modify spectral content. It facilitates Python audio programming by providing the means to manipulate audio files and generate synth

Seek-Tune is an audio fingerprinting library that implements a Shazam-like algorithm for identifying songs from audio recordings. It generates acoustic fingerprints from audio signals and matches them against a known database to recognize songs. The library converts audio into a time-frequency spectrogram using FFT-based frequency analysis, then extracts peak points to create compact, unique fingerprints for each song. It uses combinatorial hashing to combine nearby peak pairs into hash values with time offsets, enabling efficient database lookup and matching through a peak-pair matching algo

This project is a GPU-accelerated fluid renderer and interactive WebGL visualizer. It functions as a fluid dynamics sandbox for experimenting with the real-time movement and behavior of liquids. The simulation calculates density, pressure, and vorticity using GPU shaders to maintain high performance. It includes atmospheric visual effects such as bloom and sunrays, alongside tools for capturing the simulation state as static images. The underlying architecture utilizes fragment-shader rendering and ping-pong texture buffering to manage fluid physics. Multi-pass post-processing is used to app

Brooklyn is a web-based visualizer and animation loop player that functions as an Apple-inspired screensaver. It uses an HTML5 Canvas rendering pipeline to draw high-fidelity motion graphics to a screen buffer for full-screen display. The project recreates specific visual animations from a 2018 Apple technology event. It features a customizable animation loop where the playback sequence and repetition counts can be configured. The system includes a theme-driven color mapping engine that allows users to toggle between light and dark color schemes. Playback is managed through state-driven tran

Nannou is a creative coding framework for Rust designed for building interactive visual and audio sketches. It provides a loop-based API with hardware-accelerated 2D and 3D rendering, serving as a toolkit for generative art production and multimedia installation design. The framework is distinguished by its comprehensive hardware communication interface, which bridges software with physical devices via MIDI, OSC, DMX, serial, and laser DAC protocols. It also includes specialized projection mapping tools for warping visual output to fit non-standard physical surfaces and a dedicated GPU shader

This library is a declarative framework for creating complex motion sequences and visual transitions within Flutter applications. It provides a unified interface for orchestrating interface element transformations, property updates, and animation lifecycles without requiring manual controller management or boilerplate code. The framework distinguishes itself through a fluent builder pattern that allows developers to chain multiple independent motion effects into a single execution pipeline. It supports advanced visual customization by integrating custom fragment shaders for GPU-accelerated re

LittleJS is a lightweight HTML5 2D game engine designed for building web games using Canvas and WebGL without external dependencies. It integrates a WebGL sprite renderer, a 2D physics engine for arcade-style collisions and rigid-body dynamics, and a grid-based A* pathfinding system for entity navigation. The engine is distinguished by its procedural audio synthesizer, which generates music and sound effects at runtime using parameter arrays to minimize file sizes. It also features a comprehensive graphics pipeline that supports custom fragment-shader post-processing and a dynamic 2D lighting

Omnizart is a deep learning framework designed for automatic music transcription and music information retrieval. It functions as a toolkit for analyzing polyphonic audio recordings to extract structured musical information, including notes, chord progressions, drum events, and rhythmic patterns. The system provides a modular pipeline that orchestrates the entire lifecycle of audio analysis, from initial feature extraction and data preparation to model inference. Users can apply pre-trained models to transcribe audio directly or utilize the included utilities to train and fine-tune neural net