lightningpixel/modly
Modly
Modly este un generator local de modele 3D bazat pe AI care convertește imagini bidimensionale în mesh-uri tridimensionale. Este un instrument axat pe confidențialitate care procesează datele direct pe placa grafică a gazdei folosind inferență accelerată prin GPU.
Sistemul servește drept framework extensibil pentru modele AI, permițând integrarea extensiilor de modele externe și a fișierelor de runtime din repository-uri remote. Utilizează o arhitectură de plugin-uri bazată pe manifest pentru a adăuga noi metode de generare prin încărcarea metadatelor și a fișierelor din sisteme externe de control al versiunilor.
Setul de instrumente include o interfață de linie de comandă (CLI) pentru declanșarea fluxurilor de lucru de generare și exportul activelor de tip mesh pentru automatizare prin scripturi. De asemenea, dispune de sisteme de gestionare a modelelor pentru a urmări descărcarea, starea de încărcare și fluxurile de evenimente în timp real ale modelelor AI desfășurate.
Features
- Image-to-Mesh Generation - Provides the core capability of converting 2D images into 3D polygonal meshes using local AI processing.
- Local 3D Generation Runtimes - Creates 3D mesh models from 2D images using AI models running locally on the user's GPU.
- AI Model Integrations - Allows the integration of custom AI models and generation methods via external repositories and manifests.
- GPU-Accelerated Inference - Executes AI model computations directly on the host GPU to ensure high performance and data privacy.
- 3D Asset Generators - Generates 3D meshes and textures from image inputs while maintaining all data on the local machine.
- Generative 3D Modeling - A desktop application that synthesizes 3D shapes and textures from images using local AI models.
- Inference Workflow Automations - Exposes 3D generation and mesh export processes through a command-line interface for scriptable inference workflows.
- 3D Generation Command-Line Interfaces - Provides a command-line interface for triggering 3D generation processes and exporting meshes for automated agents.
- GPU-Accelerated 3D Generation Tools - Provides a privacy-focused tool for generating 3D models from photos using local GPU acceleration.
- Remote Profile Loading - Downloads and integrates additional generation methods by fetching runtime files and profiles from external repositories.
- Manifest-Based Plugin Loading - Implements a manifest-driven architecture to load modular AI model extensions and runtime files.
- AI Model Management - Manages the lifecycle of local AI models, including downloading, loading, and monitoring deployment status.
- AI Command Line Automation - Automates the 3D generation and export pipeline through a dedicated command-line interface.
- Event-Driven Model Streaming - Utilizes real-time event streams to monitor the progress of AI model generation and deployment.
- Model Extension Modules - Supports modular model extensions to augment the system's generative 3D capabilities.
- 3D Design Workflow Automations - Automates 3D generation and mesh export workflows through a scriptable command-line interface.
- AI Model Deployment Monitors - Includes a system to track the download and loading status of AI models via real-time event streams.
- AI Tools - Tool for converting images to 3D models.
