2 Repos
Modifying visual content based on natural language commands while preserving non-targeted regions.
Distinct from Image Editing: Focuses on natural language instructions for precise local modification rather than general generative editing.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Instruction-Based Editing. Refine with filters or upvote what's useful.
OmniGen2 is a unified image generation model and multimodal large language model designed to handle text-to-image generation, image-to-image tasks, and image editing within a single framework. It functions as a causal language model visual engine capable of generating and editing images based on combined text and visual inputs. The system features in-context visual composition and subject-driven generation, allowing it to extract subjects from reference images and place them into new scenes. It also supports instruction-based image editing, where specific objects or styles are modified via na
Modifies specific objects or styles in an image via natural language commands.
ml-mgie is a multimodal machine learning framework and image editor designed for instruction-based image manipulation. It utilizes multimodal large language models to translate natural language prompts into precise visual modifications, functioning as a text-to-image editing model. The system is a research implementation focused on aligning visual imagination with textual commands. It employs a training process based on image-pair datasets and descriptive instructions to learn how to execute complex visual edits. The framework covers capabilities in AI-powered visual content creation, includ
Provides a framework for modifying visual content based on natural language instructions while preserving non-targeted regions.