viser-project/viser
Viser
Viser is a Python 3D visualization framework and remote scene server that renders 3D primitives, point clouds, and meshes in a web browser. It functions as a server-client system that synchronizes scene state and camera poses to a web client via WebSockets.
The framework provides specialized capabilities for robotics and computer vision, including a URDF robot visualizer for loading robot models and joint states, as well as a GPU-accelerated Gaussian splatting viewer for high-fidelity volumetric rendering. It also supports the visualization of human body models and skinned meshes for pose analysis.
The system includes tools for building interactive web interfaces with GUI controls, command palettes, and embedded data visualizations. These interfaces allow for direct interaction with 3D scenes, including camera state management, object selection via ray-casting, and the ability to stream visualizations from remote servers over SSH.
Features
- 3D Scene Renderers - Functions as a remote server that streams 3D primitives and spatial data to a web client for real-time inspection.
- Remote 3D Scene Servers - Implements a backend system that synchronizes 3D scene state and camera poses to a web client via WebSockets.
- Gaussian Splat Rendering - Provides a specialized GPU pipeline to render high-fidelity 3D scenes represented as 3D Gaussians.
- URDF Parsing and Visualization - Parses URDF files to construct and visualize kinematic chains and joint hierarchies for robot models.
- Three-Dimensional Visualizations - Displays data in 3D space to analyze spatial relationships in robotics and computer vision.
- 3D Visualization Integrations - Provides a programmatic Python interface to embed 3D rendering and interactive controls for technical data visualization.
- Frameworks - Provides a server-client system for rendering 3D primitives, point clouds, and meshes in a web browser using Python.
- Point Cloud Visualizers - Renders point clouds, meshes, and coordinate frames to visualize complex spatial data and transformations.
- Primitive Rendering - Renders 3D shapes and objects in a web client to visualize spatial data for robotics and vision.
- Computer Vision Debugging Tools - Allows for the inspection of point clouds and meshes to debug vision algorithms and spatial mapping.
- Client Side Rendering - Offloads 3D scene composition and primitive rendering to the browser using a WebGL-based graphics library.
- Gaussian Splatting Viewers - Provides a GPU-accelerated browser-based viewer for interactively exploring 3D Gaussian splatting models.
- Spatial Object Manipulation - Provides synchronized 3D viewports and GUI controls to manipulate three-dimensional geometry.
- Python 3D Visualization Frameworks - Offers a Python-based framework for rendering 3D primitives, point clouds, and meshes in a web browser.
- Robot Model Visualizations - Provides interactive rendering of robot geometry and joint states via URDF files.
- Interactive Controllers - Provides custom GUIs with sliders and buttons to programmatically adjust 3D geometry and camera viewpoints.
- Robotics Visualization Tools - Provides specialized tools for visualizing coordinate transforms, point clouds, and synchronized robotic data.
- Remote Procedure Call Bridges - Facilitates communication between the Python host and web client via serialized command messages to execute server-side logic.
- 3D Scene Interaction Handlers - Enables remote manipulation and interaction of 3D environments via a web client.
- Interactive Interface Design - Facilitates the development of custom visual interfaces that respond to user input to control 3D scenes.
- WebSocket State Synchronization - Synchronizes real-time scene state and user interactions between the server and client using bidirectional WebSockets.
- Web 3D Frameworks - Provides a framework for building web-based interfaces with synchronized 3D viewports and interactive GUI controls.
- Visualizers - Provides capabilities to parse and visualize sparse reconstruction outputs and 3D scans from external tools.
- Visualizers - Displays human body models using pose parameters and skinned mesh deformation for anatomy analysis.
- Visualizers - Renders skinned meshes and body models to analyze human anatomy and movement parameters.
- Debugging Tools - Visualizes URDF robot models and joint states in a browser to analyze kinematic movements.
- Remote Visualization Streaming - Allows users to stream and interact with 3D scenes hosted on remote servers over SSH.
- Object Selection Ray Casting - Implements ray-casting from the camera through the cursor to enable precise selection and manipulation of 3D objects.
- 3D Viewpoint Control - Allows programmatic management of camera perspectives, including position and orientation, for automated scene viewing.
- Camera Interaction Controllers - Tracks and controls camera poses in real-time to manage position and orientation.
- GUI Widget Toolkits - Provides a toolkit of buttons, sliders, and modal dialogs to build interactive GUIs for scene control.
- Declarative UI Layouts - Provides a system for defining complex user interface structures on the server that map to client-side widgets.
