# realsenseai/librealsense

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/realsenseai-librealsense).**

8,541 stars · 4,970 forks · C++ · apache-2.0

## Links

- GitHub: https://github.com/realsenseai/librealsense
- Homepage: https://realsenseai.com/
- awesome-repositories: https://awesome-repositories.com/repository/realsenseai-librealsense.md

## Topics

`camera-api` `computer-vision` `developer-kits` `hardware` `library` `librealsense` `sdk`

## Description

The Intel RealSense SDK is a software development kit providing drivers and libraries for interfacing with depth cameras to capture color, depth, and infrared data streams. It includes a depth camera driver for device discovery and sensor configuration, a stereo vision library for computing depth maps and aligning frames, and a 3D point cloud generator to transform depth and infrared frames into spatial representations.

The SDK distinguishes itself through on-chip depth calculation and stereo calibration, using internal vision processors to reduce host CPU load. It supports hardware-level stream synchronization via physical sync cables and offers an integration layer to expose camera data and inertial measurement unit measurements as topics and services for robot operating systems.

The project covers a broad range of capabilities including IMU sensor integration for spatial orientation tracking, high-precision depth capture with geometric distortion correction, and multi-camera concurrent operation. It also provides tools for camera calibration, virtual hardware simulation, and zero-copy data transfer to optimize high-resolution frame processing.

## Tags

### Artificial Intelligence & ML

- [Depth Estimation](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/computer-vision/object-pose-estimations/monocular-depth-estimators/multi-view-depth-estimators/depth-estimation.md) — Computes depth maps and spatial data using an internal vision processor to reduce host CPU load.
- [High Precision Depth Sensing](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/computer-vision/object-pose-estimations/monocular-depth-estimators/multi-view-depth-estimators/depth-estimation/high-precision-depth-sensing.md) — Measures object distance with sub-millimeter accuracy at short ranges using a stereo vision system. ([source](https://realsenseai.com/stereo-depth-cameras/stereo-depth-camera-d405/))
- [Depth Frame Filtering](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/computer-vision/object-pose-estimations/monocular-depth-estimators/multi-view-depth-estimators/depth-estimation/depth-frame-filtering.md) — Aligns depth data to color frames and applies filters to refine the resulting images. ([source](https://dev.realsenseai.com/docs/csharp-wrapper))

### Hardware & IoT

- [Depth Camera SDKs](https://awesome-repositories.com/f/hardware-iot/depth-camera-sdks.md) — Provides a comprehensive SDK for interfacing with depth cameras to capture color, depth, and infrared data.
- [Peripheral Device Managers](https://awesome-repositories.com/f/hardware-iot/connectivity-iot/internet-of-things/device-management/peripheral-device-managers.md) — Discovers connected devices, retrieves hardware specifications, and performs remote resets over a network. ([source](https://github.com/realsenseai/librealsense/blob/development/wrappers/rest-api/README.md))
- [Hardware Device Discovery](https://awesome-repositories.com/f/hardware-iot/hardware-device-discovery.md) — Fetches hardware details such as serial numbers and firmware versions via dedicated service calls. ([source](https://dev.realsenseai.com/docs/ros2-wrapper))
- [Sensor Drivers](https://awesome-repositories.com/f/hardware-iot/integration-performance/hardware-interfacing-integration/hardware-integration/device-sensors/external-integrations/sensor-integrations/sensor-drivers.md) — Provides a hardware abstraction layer for device discovery and raw data ingestion from depth sensors.
- [Distributed Clock Synchronizers](https://awesome-repositories.com/f/hardware-iot/distributed-clock-synchronizers.md) — Aligns data streams from multiple cameras using hardware links or external sync cables for precise timing. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d457-gmsl-fakra/))
- [Inertial Measurement Unit Interfaces](https://awesome-repositories.com/f/hardware-iot/inertial-measurement-unit-interfaces.md) — Accesses an onboard IMU to track camera movement and refine environmental awareness. ([source](https://realsenseai.com/stereo-depth-cameras/real-sense-depth-camera-d455/))
- [Inertial Environmental Tracking](https://awesome-repositories.com/f/hardware-iot/inertial-measurement-unit-interfaces/inertial-environmental-tracking.md) — Uses an inertial measurement unit to refine depth awareness and environmental tracking during movement. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d457-gmsl-fakra/))
- [Inertial Frame Alignment](https://awesome-repositories.com/f/hardware-iot/inertial-measurement-unit-interfaces/inertial-frame-alignment.md) — Aligns spatial orientation with depth frames using time-stamped inertial measurement unit data. ([source](https://realsenseai.com/stereo-depth-cameras/depth-camera-d435i/))
- [Spatial Orientation Tracking](https://awesome-repositories.com/f/hardware-iot/inertial-measurement-unit-interfaces/spatial-orientation-tracking.md) — Measures spatial movement and orientation using a built-in inertial measurement unit. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d555-poe/))
- [Sensor Configuration](https://awesome-repositories.com/f/hardware-iot/integration-performance/hardware-interfacing-integration/hardware-integration/device-sensors/sensor-configuration.md) — Provides tools to update sensor options like exposure and gain and manage stream profiles. ([source](https://github.com/realsenseai/librealsense/blob/development/wrappers/rest-api/README.md))

### Part of an Awesome List

- [Camera Calibration](https://awesome-repositories.com/f/awesome-lists/ai/pose-estimation/camera-calibration.md) — Injects calibration data to ensure millimeter-level accuracy of captured depth measurements. ([source](https://realsenseai.com/))
- [Stereo Calibration](https://awesome-repositories.com/f/awesome-lists/ai/pose-estimation/camera-calibration/stereo-calibration.md) — Automatically calibrates stereo cameras in seconds without requiring the use of specialized targets. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d457-gmsl-fakra/))
- [Point Cloud](https://awesome-repositories.com/f/awesome-lists/data/point-cloud.md) — Transforms depth and infrared data into 3D point sets to represent physical space. ([source](https://dev.realsenseai.com/docs/using-depth-camera-with-raspberry-pi-3))
- [Pose Estimation](https://awesome-repositories.com/f/awesome-lists/ai/pose-estimation.md) — Extracts spatial orientation and positioning information from pose frames. ([source](https://dev.realsenseai.com/docs/csharp-wrapper))
- [Robot Operating System Wrappers](https://awesome-repositories.com/f/awesome-lists/devtools/camera-integration/robot-operating-system-wrappers.md) — Exposes camera data and IMU measurements as topics and services for robot operating systems.
- [High Resolution Sensor Streaming](https://awesome-repositories.com/f/awesome-lists/devtools/hardware-simulation/sensor-data-simulation/sensor-data-streaming/high-resolution-sensor-streaming.md) — Captures depth and color imagery using global shutter sensors to minimize motion blur. ([source](https://cdn.jsdelivr.net/gh/realsenseai/librealsense@master/README.md))
- [Camera Topic Exposure](https://awesome-repositories.com/f/awesome-lists/devtools/ros-libraries-and-tools/camera-topic-exposure.md) — Exposes camera data as topics and services for seamless integration within a ROS 2 ecosystem. ([source](https://dev.realsenseai.com/docs/ros2-wrapper))
- [Data Streaming Interfaces](https://awesome-repositories.com/f/awesome-lists/devtools/ros-libraries-and-tools/data-streaming-interfaces.md) — Streams data to nodes via a compatible interface to avoid installing additional software in robot operating system ecosystems. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d555-poe/))
- [Concurrent Device Operation](https://awesome-repositories.com/f/awesome-lists/media/camera-integration/concurrent-device-operation.md) — Connects and runs several depth sensors simultaneously without causing signal interference. ([source](https://realsenseai.com/stereo-depth-cameras/stereo-depth-camera-d405/))

### Graphics & Multimedia

- [Point Cloud Generators](https://awesome-repositories.com/f/graphics-multimedia/3d-point-cloud-spatial-mappers/point-cloud-generators.md) — Transforms depth and infrared frames into three-dimensional spatial representations.
- [Camera Data Ingestion](https://awesome-repositories.com/f/graphics-multimedia/camera-data-ingestion.md) — Provides language bindings and framework wrappers to ingest depth and color streams for easier processing. ([source](https://dev.realsenseai.com/docs/code-samples))
- [Depth-Color Alignment](https://awesome-repositories.com/f/graphics-multimedia/depth-color-alignment.md) — Synchronizes RGB data with depth maps using an image signal processor to ensure aligned visual information. ([source](https://realsenseai.com/stereo-depth-cameras/stereo-depth-camera-d405/))
- [Real-time Depth Streaming](https://awesome-repositories.com/f/graphics-multimedia/real-time-depth-streaming.md) — Captures real-time depth and color information at specified resolutions and frame rates. ([source](https://dev.realsenseai.com/docs/using-depth-camera-with-raspberry-pi-3))
- [Stereo Vision Reconstruction](https://awesome-repositories.com/f/graphics-multimedia/stereo-vision-reconstruction.md) — Computes depth maps and estimates movement using an on-chip vision processor and digital signal processor. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d555-poe/))
- [Depth Accuracy Metrics](https://awesome-repositories.com/f/graphics-multimedia/depth-accuracy-metrics.md) — Evaluates the precision and fill rate of distance data to verify performance in specific environments. ([source](https://cdn.jsdelivr.net/gh/realsenseai/librealsense@master/README.md))
- [Geometric Distortion Correction](https://awesome-repositories.com/f/graphics-multimedia/graphics-engines-rendering/rendering/post-processing-effects/lens-distortion/geometric-distortion-correction.md) — Applies geometric distortion correction and temporal noise reduction to improve imagery quality. ([source](https://realsenseai.com/ruggedized-industrial-stereo-depth/d555-poe/))
- [Real-time Point Cloud Streaming](https://awesome-repositories.com/f/graphics-multimedia/real-time-point-cloud-streaming.md) — Sends frame timestamps, metadata, and 3D point cloud data to clients using a persistent socket connection. ([source](https://github.com/realsenseai/librealsense/blob/development/wrappers/rest-api/README.md))
- [RGB and Depth Synchronization](https://awesome-repositories.com/f/graphics-multimedia/rgb-and-depth-synchronization.md) — Synchronizes color and depth images into a single message for simplified spatial analysis. ([source](https://dev.realsenseai.com/docs/ros2-wrapper))

### Programming Languages & Runtimes

- [Cross-Language Bindings Layers](https://awesome-repositories.com/f/programming-languages-runtimes/language-interoperability/foreign-function-interfaces/cross-language-bindings-layers.md) — Exposes low-level C++ hardware interfaces to higher-level languages via standardized wrapper libraries.

### Data & Databases

- [Hardware Stream Synchronization](https://awesome-repositories.com/f/data-databases/data-synchronization/temporal-stream-synchronization/hardware-stream-synchronization.md) — Aligns data from multiple sensors using physical sync cables and hardware triggers for precise timing.
- [Image Buffer Sharing](https://awesome-repositories.com/f/data-databases/serialization-frameworks/zero-copy/image-buffer-sharing.md) — Transforms image data into arrays using a shared buffer protocol to avoid expensive memory copying.

### DevOps & Infrastructure

- [Sensor Data Publishing](https://awesome-repositories.com/f/devops-infrastructure/infrastructure/cluster-service-orchestration/service-discovery/server-metadata-registries/server-metadata-publishers/sensor-data-publishing.md) — Streams accelerometer and gyroscope samples including metadata and synchronization information. ([source](https://dev.realsenseai.com/docs/ros2-wrapper))
- [Virtual Hardware Simulators](https://awesome-repositories.com/f/devops-infrastructure/virtual-hardware-interfaces/virtual-hardware-simulators.md) — Creates software-defined camera devices to emulate physical sensor behavior for testing and development.

### Networking & Communication

- [Data Compression](https://awesome-repositories.com/f/networking-communication/data-compression.md) — Reduces bandwidth usage by applying compression plugins to color, depth, and infrared data streams. ([source](https://dev.realsenseai.com/docs/ros2-wrapper))
- [Vision Stream Compression](https://awesome-repositories.com/f/networking-communication/data-compression/vision-stream-compression.md) — Applies modular compression algorithms to color and depth data to reduce network bandwidth usage.

### Scientific & Mathematical Computing

- [Real-time Volumetric Captures](https://awesome-repositories.com/f/scientific-mathematical-computing/3d-data-processing-libraries/volumetric-data-processing/real-time-volumetric-captures.md) — Coordinates data from several sensors simultaneously for real-time volumetric scene capture and 3D scanning. ([source](https://realsenseai.com/stereo-depth-cameras/real-sense-depth-camera-d455/))
- [Buffer-Protocol Array Integration](https://awesome-repositories.com/f/scientific-mathematical-computing/buffer-protocol-array-integration.md) — Transforms depth and color image data into NumPy arrays using the buffer protocol for zero-copy transfers. ([source](https://dev.realsenseai.com/docs/python2))

### Software Engineering & Architecture

- [Zero-Copy Mechanisms](https://awesome-repositories.com/f/software-engineering-architecture/performance-reliability/performance-optimization/data-handling-throughput/zero-copy-mechanisms.md) — Reduces latency and CPU overhead for high-resolution frames by using zero-copy communication between internal processes. ([source](https://dev.realsenseai.com/docs/ros2-wrapper))