cyrildiagne/ar-cutpaste
Ar Cutpaste
ar-cutpaste is an augmented reality asset extraction tool and prototype designed to isolate objects from a live camera feed and transfer them into image editing software. It functions as a mobile-to-desktop bridge that uses machine learning to remove backgrounds from live images, creating digital cutouts for use in image composition.
The system establishes a local server connection to transmit image data and spatial coordinates from a mobile device to a design application. This bridge uses a remote socket mechanism and a secure password to inject captured assets directly into a desktop workspace.
The project covers computer vision for object extraction and real-time coordinate mapping to translate camera input into positioning data within a digital editor. It manages the end-to-end pipeline of capturing physical elements via a mobile client and relaying them through a local network for digital composition.
Features
- Image Background Removal - Uses machine learning to isolate specific objects from a live camera feed by removing the surrounding background.
- AI Background Removal and Inpainting - Uses AI-powered models to isolate foreground subjects from a live camera feed by removing the background.
- AR Asset Capture - Extracts real-world objects using a camera and machine learning for use as digital assets in design software.
- Object Extraction - Employs computer vision and machine learning to isolate and extract specific elements from a live camera feed.
- Cross-Device Creative Workflows - Sends images and spatial coordinates from a mobile device to a computer to optimize the editing process.
- Mobile-to-Desktop Photo Transfers - Transmits image data and coordinates from a mobile device to a desktop application using a local server connection.
- Real-Time - Implements a data pipeline that streams captured objects from a mobile device directly into an image editor.
- Creative Software Bridges - Provides a secure remote connection that links a mobile application to a design tool for asset transfer.
- AR Asset Extraction Tools - Provides a system using machine learning to isolate objects from a camera feed and transfer them to editing software.
- Spatial Coordinate Mappings - Translates mobile camera input into precise positioning data for asset placement within a digital image editor.
- Augmented Reality - Functions as an experimental prototype combining camera input and computer vision for spatial asset composition.
- Application Input Bridges - Establishes a persistent socket connection to a design software instance for secure asset injection.
- Digital Asset Composition - Facilitates the movement of captured physical elements into a digital editor for composite image creation.
- Local Network Asset Relays - Transfers coordinate data and image assets between a mobile client and desktop application via a local network.
- Asset Streaming Architectures - Uses a client-server architecture to stream captured images from mobile to a workspace via a middle layer.
- Miscellaneous Tools - Augmented reality tool for capturing surroundings.
Star history
How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
