# acly/krita-ai-diffusion **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/acly-krita-ai-diffusion).** 9,755 stars · 540 forks · Python · gpl-3.0 ## Links - GitHub: https://github.com/Acly/krita-ai-diffusion - Homepage: https://www.interstice.cloud - awesome-repositories: https://awesome-repositories.com/repository/acly-krita-ai-diffusion.md ## Topics `generative-ai` `krita-plugin` `stable-diffusion` ## Description This project is a plugin for Krita that integrates Stable Diffusion image generation and editing tools directly into the painting interface. It functions as a remote diffusion backend client, bridging the digital canvas to local or remote servers to handle the computation required for AI image generation. The system distinguishes itself through a real-time painting interface that translates brushstrokes into generated imagery as the artist works. It acts as a structural orchestrator, using sketches, depth maps, and poses to maintain precise composition, and provides a generative inpainting tool for filling, extending, or modifying specific image regions. The broader capability surface includes text-to-image generation, image style transfer, and high-resolution tiled upscaling. It supports regional prompting linked to layers, a state-based history tracking system for iterative retrieval, and the integration of node-based workflows for automating complex generation pipelines. The software includes tools for local AI server hosting and system diagnostics collection to troubleshoot technical integration. ## Tags ### Artificial Intelligence & ML - [Generative Painting Assistants](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-assistants/generative-painting-assistants.md) — Translates live brushstrokes and sketches into high-quality imagery in real time within the painting interface. - [AI Image Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-image-generation.md) — Functions as an AI image generator that creates artwork based on text prompts and reference images. - [Text-to-Image Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/generative-ai-pipelines/text-to-image-generators.md) — Implements pipelines that generate high-resolution artwork from natural language text prompts. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) - [Image Inpainting](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/generative-ai-pipelines/text-to-image-generators/image-inpainting.md) — Provides generative inpainting for filling, extending, or modifying specific image regions via masks. - [Image Composition Controls](https://awesome-repositories.com/f/artificial-intelligence-ml/image-composition-controls.md) — Orchestrates image generation using sketches, depth maps, and poses to maintain precise structural composition. - [Image Editing](https://awesome-repositories.com/f/artificial-intelligence-ml/image-generation/image-editing.md) — Alters existing image content based on natural language instructions and generative AI. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) - [Model Server Clients](https://awesome-repositories.com/f/artificial-intelligence-ml/model-server-clients.md) — Provides the connectivity layer that bridges the painting interface to the diffusion backend for heavy computation. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) - [Structural Guidance](https://awesome-repositories.com/f/artificial-intelligence-ml/structural-guidance.md) — Provides mechanisms for enforcing spatial and geometric constraints using sketches and depth maps during image generation. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) - [Generation Iteration Tracking](https://awesome-repositories.com/f/artificial-intelligence-ml/generation-iteration-tracking.md) — Stores and previews previous prompts and results to compare different iterations of generated images. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) - [Diffusion Model Managers](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/generative-ai-models/diffusion-model-managers.md) — Includes tools for importing, organizing, and switching between different pre-trained diffusion model checkpoints. - [Node-Based Generative Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/workflow-execution-backends/node-based-generative-pipelines.md) — Supports node-based generative pipelines that translate visual graphs into sequences of API calls. - [Generative Upscalers](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-upscalers.md) — Implements generative upscaling to increase image size and detail to professional resolutions. - [Regional Prompting](https://awesome-repositories.com/f/artificial-intelligence-ml/image-region-reconstruction/regional-prompting.md) — Enables the mapping of specific text descriptions to image coordinates using Krita's layer and mask system. - [Neural Style Transfer](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-style-transfer.md) — Applies styles, compositions, or features from reference images to new generations. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) ### User Interface & Experience - [Interface Plugin Architectures](https://awesome-repositories.com/f/user-interface-experience/interface-plugin-architectures.md) — Integrates generative AI controls and custom panels directly into the Krita painting interface as a plugin. ### Part of an Awesome List - [Stable Diffusion Tools](https://awesome-repositories.com/f/awesome-lists/ai/stable-diffusion-tools.md) — Integrates Stable Diffusion image generation and editing tools directly into the Krita painting interface. ### DevOps & Infrastructure - [Remote Infrastructure Clients](https://awesome-repositories.com/f/devops-infrastructure/remote-infrastructure-clients.md) — Acts as a bridge connecting the digital painting canvas to a local or remote server for AI computation. ### Graphics & Multimedia - [AI Concept Art Workflows](https://awesome-repositories.com/f/graphics-multimedia/concept-art-production/ai-concept-art-workflows.md) — Provides a specialized workflow for creating and refining initial artwork using text prompts and structural guidance. - [Generative Inpainting and Expansion](https://awesome-repositories.com/f/graphics-multimedia/generative-inpainting-and-expansion.md) — Adds or removes objects and expands canvas boundaries using generative inpainting and selections. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md)) - [Real-Time AI Painting Interfaces](https://awesome-repositories.com/f/graphics-multimedia/real-time-ai-painting-interfaces.md) — Translates live brushstrokes into generated imagery as the artist works for immediate visual feedback. - [Real-Time Canvas Interpretation](https://awesome-repositories.com/f/graphics-multimedia/real-time-canvas-interpretation.md) — Translates live brushstrokes into generated imagery to provide immediate visual feedback to the artist. - [AI Upscaling](https://awesome-repositories.com/f/graphics-multimedia/image-editing-processing/image-enhancement-tools/ai-upscaling.md) — Provides high-resolution tiled upscaling to increase image detail without exceeding GPU memory limits. ### Development Tools & Productivity - [Generation History Buffers](https://awesome-repositories.com/f/development-tools-productivity/change-tracking/state-tracking-utilities/state-history-buffers/generation-history-buffers.md) — Caches generation parameters and images in a local database for iterative retrieval and comparison. ### Security & Cryptography - [Local Generative AI Hosting](https://awesome-repositories.com/f/security-cryptography/local-hosting-security/local-generative-ai-hosting.md) — Manages and configures diffusion models on local hardware for offline generative processing. ([source](https://docs.interstice.cloud/installation)) ### Software Engineering & Architecture - [Asynchronous Task Queues](https://awesome-repositories.com/f/software-engineering-architecture/asynchronous-task-queues.md) — Implements a background task queue to handle image generation requests without freezing the user interface. - [Diffusion Model Presets](https://awesome-repositories.com/f/software-engineering-architecture/project-management-governance/project-management/project-lifecycle-management/project-configuration-presets/configuration-presets/prompt-presets/diffusion-model-presets.md) — Allows customization of checkpoints, samplers, and weights to create tailored visual styles. ([source](https://cdn.jsdelivr.net/gh/acly/krita-ai-diffusion@main/README.md))