lightningpixel/modly
Modly
Modly is a local AI 3D model generator that converts two-dimensional images into three-dimensional meshes. It is a privacy-focused tool that processes data directly on the host graphics card using GPU-accelerated inference.
The system serves as an extensible AI model framework, allowing the integration of external model extensions and runtime files from remote repositories. It utilizes a manifest-driven plugin architecture to add new generation methods by loading metadata and files from external version control systems.
The toolset includes a command-line interface for triggering generation workflows and exporting mesh assets for scriptable automation. It also features model management systems to track the download, loading status, and real-time event streams of deployed AI models.
Features
- Image-to-Mesh Generation - Provides the core capability of converting 2D images into 3D polygonal meshes using local AI processing.
- Local 3D Generation Runtimes - Creates 3D mesh models from 2D images using AI models running locally on the user's GPU.
- AI Model Integrations - Allows the integration of custom AI models and generation methods via external repositories and manifests.
- GPU-Accelerated Inference - Executes AI model computations directly on the host GPU to ensure high performance and data privacy.
- 3D Asset Generators - Generates 3D meshes and textures from image inputs while maintaining all data on the local machine.
- Generative 3D Modeling - A desktop application that synthesizes 3D shapes and textures from images using local AI models.
- Inference Workflow Automations - Exposes 3D generation and mesh export processes through a command-line interface for scriptable inference workflows.
- 3D Generation Command-Line Interfaces - Provides a command-line interface for triggering 3D generation processes and exporting meshes for automated agents.
- GPU-Accelerated 3D Generation Tools - Provides a privacy-focused tool for generating 3D models from photos using local GPU acceleration.
- Remote Profile Loading - Downloads and integrates additional generation methods by fetching runtime files and profiles from external repositories.
- Manifest-Based Plugin Loading - Implements a manifest-driven architecture to load modular AI model extensions and runtime files.
- AI Model Management - Manages the lifecycle of local AI models, including downloading, loading, and monitoring deployment status.
- AI Command Line Automation - Automates the 3D generation and export pipeline through a dedicated command-line interface.
- Event-Driven Model Streaming - Utilizes real-time event streams to monitor the progress of AI model generation and deployment.
- Model Extension Modules - Supports modular model extensions to augment the system's generative 3D capabilities.
- 3D Design Workflow Automations - Automates 3D generation and mesh export workflows through a scriptable command-line interface.
- AI Model Deployment Monitors - Includes a system to track the download and loading status of AI models via real-time event streams.
- AI Tools - Tool for converting images to 3D models.
