carson-katri/dream-textures
Dream Textures
Dream Textures is a Stable Diffusion integration for Blender that provides tools for text-to-image generation, depth projection, and node-based processing within a 3D environment. It functions as an AI texture generator capable of producing image textures and concept art from text prompts and scene renders.
The system features a depth-to-image projection tool that maps generated imagery onto 3D models using depth data for spatial alignment. It also includes a node-based AI image processor for creating procedural visual effects and a dedicated toolset for AI-assisted inpainting and outpainting to modify specific image regions or expand boundaries.
The software covers broader capabilities including image resolution upscaling, prompt template construction, and generation history management. It supports hybrid execution by allowing users to perform tasks via local GPU processing or by offloading heavy rendering tasks to remote cloud servers.
Features
- Texture Synthesis - Generates surface textures and PBR maps for 3D assets using text prompts within a 3D workspace.
- Text-to-Image Generators - Produces textures and concept art from text prompts using Stable Diffusion pipelines directly within a 3D environment.
- Image Inpainting - Allows for the generative filling of specific image regions based on text prompts and masks.
- Node-Based Generative Pipelines - Integrates image generation into a visual graph system for constructing multi-stage generative AI workflows.
- Depth-Color Alignment - Uses scene depth data to align generated textures with 3D model geometry for spatially accurate mapping.
- Node-Based Material Generation - Uses a node-based system to combine generated textures into complex, programmable visual effects.
- Image-to-3D Texture Engines - Transfers AI generated 2D image textures onto 3D digital representations using depth and spatial data.
- Inpainting and Outpainting Tools - Provides tools to modify images by filling in masked areas or extending boundaries for seamless textures.
- Node-Based Image Processing - A system that connects image generation and processing capabilities into a node-based workflow for complex visual effects.
- Stable Diffusion Blender Integrations - Integrates Stable Diffusion text-to-image generation directly into the Blender 3D environment for texture creation.
- Texture Projection Mapping - A technique in the product for mapping generated imagery onto 3D models and scenes using depth-to-image processing.
- Generative Texture Mappers - Synthesizes and maps AI-generated surface details onto 3D geometry using text prompts and scene renders.
- Resolution Upscalers - Increases the resolution of low-fidelity generated images by synthesizing high-frequency details.
- Hybrid Local-Remote AI Routing - Toggles between local GPU processing and remote API calls to handle varying hardware specifications.
- Remote Inference Offloaders - Delegates heavy computational generation tasks to external cloud servers to bypass local hardware constraints.
- Prompt Templates - Implements a system for constructing detailed image descriptions using structured templates for consistent visual results.
- Remote AI Generation Offloading - Allows offloading heavy image generation tasks to remote cloud servers when local GPU hardware is insufficient.
- Depth Buffer Textures - Creates imagery based on scene color and depth by utilizing depth buffer textures from the rendering pipeline.
- Texture and Material Tools - Stable Diffusion integration for the shader editor.
