Awesome GitHub RepositoriesImage Diffusion Models

Stable Diffusion is a generative machine learning pipeline that synthesizes high-resolution visual content by performing iterative denoising within a compressed latent space. By mapping natural language embeddings into pixel outputs through conditioned probabilistic processes, the framework enables the generation of images from text prompts and the transformation of existing visual inputs based on semantic instructions. The architecture utilizes a modular execution environment that decouples model loading, scheduler logic, and inference components to support diverse hardware configurations. I

Sglang is a high-performance inference engine and serving system designed for large language and multimodal models. It provides a programmable interface for orchestrating complex generation workflows, enabling developers to coordinate multi-turn dialogues, tool invocations, and reasoning chains through a domain-specific language. The platform is built to support production-scale deployments, offering an OpenAI-compatible API that allows for integration with existing application ecosystems. The system distinguishes itself through a disaggregated architecture that separates compute-intensive pr

Flux is a diffusion model inference engine designed for text-to-image generation and image-to-image manipulation. It provides a system for executing open-weight models to transform natural language descriptions into visual imagery or to modify existing images. The project distinguishes itself through a flow-matching framework for image generation and a structural image controller. This controller allows for guided synthesis by using depth maps and Canny edge detection to constrain the geometry and composition of the output. The toolkit covers a broad range of image editing capabilities, incl

Audiocraft is a deep learning audio library and machine learning framework designed for training, fine-tuning, and evaluating generative models for music and sound effects. It functions as a text-to-music generative model and a neural audio codec, providing the tools necessary to compress audio signals into discrete representations and synthesize high-fidelity waveforms from textual descriptions. The framework is distinguished by its ability to combine multiple conditioning signals, allowing for the generation of audio based on text prompts, melodic excerpts, or style-based audio clips. It al

Lama Cleaner is an AI-powered image editing application focused on inpainting, object removal, and generative filling. It provides a suite of tools for erasing unwanted elements from photos and filling the resulting gaps using generative artificial intelligence. The project includes specialized capabilities for image outpainting to extend borders, background removal through object segmentation, and face restoration to fix visual defects. It also features an image upscaler to increase resolution and clarity via super-resolution AI, as well as a Stable Diffusion-based editor for replacing speci

F5-TTS is a text-to-speech system that utilizes a flow matching engine and diffusion transformers to generate fluent synthetic speech. It functions as a multilingual speech synthesizer and neural training framework, providing tools for voice cloning and high-performance inference serving. The project distinguishes itself through a voice cloning toolkit capable of mimicking specific speaker characteristics and tones from reference audio clips. It supports cross-lingual generation, allowing for the synthesis of audio across various global languages or the mixing of multiple languages within a s

This project is a machine learning research automation system designed to manage the full research lifecycle, from idea discovery to final paper submission. It utilizes markdown-based skill templates to execute autonomous research tasks and manage iterative loops of deep review and experimentation. The system distinguishes itself through integrated capabilities for academic communication and integrity auditing. It can automate the generation of LaTeX papers, conference slide decks, and evidence-grounded peer review rebuttals. To ensure rigor, it employs cross-model review routing and adversar

Z-Image is an AI image editing engine and generation framework designed for photorealistic synthesis and the refinement of diffusion models. It functions as a multilingual text-to-image renderer and a system for training custom foundation models to generate and edit visuals using natural language instructions. The project distinguishes itself through a reasoning-based prompt enhancer that expands simple descriptions into detailed visual instructions using a structured reasoning chain. It also features specialized capabilities for rendering high-quality Chinese and English typography within ge

This is a PyTorch implementation of a text-to-image model designed for synthesizing high-fidelity images from natural language descriptions. It utilizes a diffusion image generator to transform latent embeddings into visual data through an iterative denoising process. The system employs a two-stage latent mapping process, using a CLIP-based latent prior to map text embeddings to image embeddings before decoding them into pixels. It features a cascading diffusion decoder that produces high-resolution imagery by passing low-resolution outputs through a sequence of models at increasing scales.

RoomGPT is a generative AI image processor designed to transform photographs of existing rooms into redesigned interior spaces. It functions as an AI interior design generator and room visualizer that applies new styles and layouts to uploaded images using machine learning models. The system utilizes diffusion-based image transformation and prompt-template engineering to modify visual environments and generate home decor visualizations. These capabilities allow for the creation of diverse interior design variations based on specific style prompts. The infrastructure includes client-side imag

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

Facechain is a generative AI toolchain and portrait generator designed to create personalized synthetic identities and consistent digital portraits. It provides a pipeline for training and refining diffusion models to produce subject-driven image synthesis from reference photos. The project focuses on digital twin generation, enabling the creation of a personalized model from a single image to maintain identity consistency across various poses and artistic styles. It utilizes identity fusion and similarity sorting to balance facial accuracy with stylized visual effects. The toolkit covers a

IC-Light is a diffusion-based image editor and generative tool designed for controlling the illumination of foreground subjects. It functions as an image relighting system that uses latent diffusion models to modify lighting effects on isolated subjects. The project provides two primary methods for lighting control: text-based relighting, which uses descriptive prompts and lighting directions, and background-based relighting, which conditions the foreground lighting to match the visual properties of a provided background image. Beyond illumination, the system includes a surface normal estima

This is a classifier-guided diffusion framework for high-fidelity image generation. It implements a cascaded diffusion pipeline that chains a base diffusion model with a dedicated upsampler to progressively increase image resolution in stages, and uses classifier-guided diffusion sampling to steer the reverse diffusion process toward higher-quality outputs. The framework provides tools for training diffusion models from scratch using distributed processes with gradient accumulation, as well as training classifier models that provide gradient-based guidance during sampling. It supports both un

AI NovelGenerator is a tool for generating long-form fiction using large language models. It functions as a narrative architect and writing assistant, automating the creation of multi-chapter novels while managing the overall story structure and character tracking. The project distinguishes itself through a semantic context retrieval system and an AI story consistency checker. These tools use semantic search to recall specific story details from previous chapters and scan generated text for plot contradictions or behavioral inconsistencies. The system covers a full narrative lifecycle, inclu

Acest proiect este un framework neuronal de text-to-speech și un model PyTorch conceput pentru a sintetiza vorbirea umană. Convertește textul scris în audio sintetic prin prezicerea mel spectrogramelor, care servesc drept reprezentare intermediară pentru generarea vocii. Sistemul include un model de condiționare pentru WaveNet pentru a asigura o ieșire audio cu sunet natural. Oferă un framework de antrenare distribuită care utilizează procesarea multi-GPU și precizia mixtă automată pentru a optimiza viteza de antrenare și a reduce utilizarea memoriei. Proiectul acoperă întregul pipeline de sinteză neuronală a vorbirii, de la antrenarea modelului folosind seturi de date de text și audio până la generarea vocilor artificiale. Utilizează un encoder-decoder convoluțional și atenție secvență-la-secvență pentru a mapa caracteristicile lingvistice la cadre acustice.

AnyText este un framework de sinteză vizuală a textului și un model de difuzie latentă conceput pentru a genera și edita text în interiorul imaginilor. Funcționează ca un generator de text prin difuzie multilingv care îmbină datele despre glife și tușe în caracteristicile latente ale imaginii pentru a asigura plasarea și randarea precisă a caracterelor. Sistemul permite modificarea sau înlocuirea caracterelor și cuvintelor existente în imagini, păstrând în același timp contextul vizual înconjurător. Suportă crearea de efecte de text stilizate prin utilizarea unui pipeline de îmbinare a ponderilor (weight-merging) care combină ponderi de model specializate și straturi de adaptare pentru a extinde capacitățile lingvistice și estetice. Framework-ul acoperă o gamă de capabilități, inclusiv generarea vizuală de text multilingv, personalizarea aspectului textului pentru fonturi și culori, și antrenarea modelelor text-to-image. Include, de asemenea, instrumente de evaluare a calității pentru a cuantifica acuratețea textului vizual și fidelitatea imaginii folosind metrici de distanță și precizie.

Acest proiect este un framework de modele generative bazat pe PyTorch, conceput pentru a transforma zgomotul în distribuții complexe de date prin învățarea câmpurilor vectoriale și a căilor de probabilitate. Acesta servește drept toolkit multimodal pentru generarea de text și imagini sintetice prin fluxuri de probabilitate. Biblioteca se distinge prin suportul pentru integrări continue, discrete și pe varietăți Riemanniene. Acest lucru permite framework-ului să gestioneze o varietate de tipuri de date, inclusiv date categorice prin „discrete-state flow matching” și spații non-euclidiene prin integrare pe varietăți Riemanniene. Toolkit-ul acoperă întregul pipeline generativ, incluzând definirea căilor de probabilitate, regresia câmpurilor vectoriale și utilizarea solverelor de ecuații diferențiale pentru eșantionarea datelor. Aceste capabilități permit antrenarea și inferența modelelor generative capabile să creeze conținut sintetic pe mai multe modalități.

Acest proiect este o resursă educațională cuprinzătoare și un curs pentru construirea de rețele neuronale folosind PyTorch. Acoperă elementele fundamentale ale deep learning-ului, inclusiv manipularea tensorilor, diferențierea automată și construcția componentelor modulare de rețele neuronale. Repository-ul servește drept ghid tehnic pentru mai multe domenii specializate. Oferă detalii de implementare pentru sarcini de computer vision, cum ar fi clasificarea imaginilor, detecția obiectelor și segmentarea semantică, precum și fluxuri de lucru de procesare a limbajului natural (NLP) care implică transformatoare, rețele recurente și modele generative. În plus, include o referință pentru AI generativ, concentrându-se în mod specific pe sinteza de imagini prin modele de difuzie și rețele adversariale. Materialul se extinde către optimizarea modelelor și pipeline-uri de deployment. Acoperă tehnici pentru reducerea dimensiunii modelelor și creșterea vitezei de inferență prin cuantizare și exportul modelelor în formate precum ONNX și TensorRT. Alte domenii de capabilitate includ ingineria datelor pentru încărcarea paralelă, evaluarea modelelor folosind metrici personalizate și deployment-ul modelelor de limbaj mari (LLM) open-source. Proiectul este livrat în principal sub formă de serie de Jupyter Notebooks.

ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,