androidx/media
Media
Android Media is a framework library providing the primary system components for audio and video playback, session management, and media routing on Android. It includes a multimedia API for processing raw media streams, managing MIDI devices, and rendering video frames.
The project features a dedicated metadata manager for organizing descriptive labels, content channels, and DRM configurations, alongside a session controller that synchronizes playback state with external controllers and manages media shortcuts for wearable devices.
The library covers a broad range of capabilities including audio attribute configuration, media library browsing, and playback control for streaming and local files. It also provides tools for ad playback management and video processing, such as transcoding formats, trimming clips, and applying visual effects to frames.
Features
- Media Capture and Playback - Implements a comprehensive system for audio and video streaming with controls for pausing, seeking, and session management.
- Multimedia APIs - Provides a comprehensive programming interface for raw media stream processing, MIDI device management, and video frame rendering.
- Audio Hardware Routing - Provides mechanisms to route audio streams to specific hardware outputs and system sound tracks.
- Audio Routing Policies - Defines audio attributes and usage policies to control how sound is routed and captured on the device.
- Content Mapping Schemas - Links media items to descriptive labels and DRM configurations using a structured metadata schema.
- Local Media Library Management - Organizes media content libraries and metadata to allow users to browse and select items for playback.
- Media Content Streaming - Plays audio or video using standardized player implementations or custom base classes.
- Media Playback Controls - Shares playback state with external controllers and handles remote commands for media applications.
- Playback Session Management - Handles audio and video playback sessions and controls the state of the media stream.
- Remote Session Synchronization - Shares playback state with external sources and receives remote control commands.
- Session Controllers - Synchronizes playback state with external controllers and manages media shortcuts on wearable devices.
- Media Metadata Managers - Provides tools for attaching and organizing descriptive labels and structural metadata for media items and playlists.
- MIDI Hardware Integration - Enables interaction with MIDI hardware and the processing of musical data streams within applications.
- Android Media Frameworks - Provides the primary framework library for audio and video playback, session management, and media routing on Android.
- Metadata Managers - Organizes descriptive labels, content channels, and DRM configurations for media items and playlists.
- Player Abstractions - Decouples playback logic from specific media engines using a common set of controls and state query methods.
- Media Content Managers - Defines media content configurations including DRM, live playback settings, clipping, and subtitles.
- Usage & Capture Policies - Sets audio usage, content types, and capture policies to define the platform audio track.
- Media Editing Tools - Provides capabilities for transcoding formats, trimming clips, cropping frames, and adding custom effects.
- Premium Audiovisual Enhancements - Integrates advanced enhancements including HDR, spatial audio, and picture-in-picture modes for media playback.
- Raw Media Data Transport - Transports uncompressed media data between processes using shared memory and data streams.
- Video Frame Processing - Applies changes and visual effects to individual video frames using a processing graph.
- Processing Graphs - Implements a graph-based pipeline for applying sequential visual effects and transformations to video frames.
- Video Playback Components - Displays video frames and playback controls using dedicated view components or drawing surfaces.
- Video Editing - Provides tools for transcoding formats, trimming clips, and applying visual effects to video files.
- Media Library Access - Provides interfaces for navigating structured content libraries to select media items for playback.
- Shared Memory Arrays - Moves raw media data between processes using shared memory mapped files to avoid expensive copying.
- Playback State Synchronizations - Synchronizes playback state between external controllers and OS overlays to maintain consistency.
