Awesome GitHub RepositoriesBinary Mask Generators

This project is a TensorFlow and Keras implementation of the Mask R-CNN architecture. It provides a framework for performing simultaneous object detection and instance segmentation, transforming raw images into segmented masks and bounding boxes for individual object identification. The toolset enables custom computer vision training through fine-tuning pre-trained weights and integrating user-provided datasets. It includes capabilities for distributed GPU training to accelerate the optimization of large vision models. The framework covers model evaluation using standard precision metrics an

Moondream is a small-scale vision language model designed to reason across images to generate captions and answer natural language questions. It functions as an edge-optimized system capable of performing visual question answering, image captioning, and object detection. The project distinguishes itself through a lightweight architecture designed for local inference on embedded devices, workstations, and air-gapped hardware. It supports the execution of models on local GPUs and Apple Silicon to ensure data privacy and low latency. The system's capabilities include identifying precise object

YOLOv9 is a real-time computer vision framework and deep learning model designed for image classification, object detection, and instance segmentation. It functions as both a vision model and a trainer, allowing for the optimization of neural network weights on custom datasets using single or multiple GPUs. The framework utilizes programmable gradient information to perform high-speed identification and location of multiple objects within images and video streams. It extends beyond bounding box detection to provide instance segmentation and panoptic segmentation, which labels every pixel in a

This project is a modular PyTorch framework for training and evaluating object detection and instance segmentation models. It serves as a computer vision research tool and a deep learning inference engine designed to identify object locations, classes, and pixel-level masks within images. The framework implements a two-stage inference pipeline that utilizes region proposal networks and a symmetric mask-head architecture. It provides specialized capabilities for instance segmentation, object bounding box detection, and human pose estimation via anatomical keypoint detection. The system includ

FastSAM is an image segmentation framework that uses convolutional neural networks to isolate visual elements and generate masks for detectable objects within images. It provides a system for both automatic all-object segmentation and promptable image segmentation. The project utilizes an inference-optimized architecture to reduce computational overhead, enabling faster mask generation and real-time visual analysis. It supports the creation of precise masks through various prompt inputs, including points, bounding boxes, and text descriptions. The framework covers broader computer vision cap

This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene

Backgroundremover is an AI-powered tool that removes backgrounds from both images and videos, accessible through a command-line interface and a Python API. At its core, it uses a pre-trained deep learning model to classify each pixel as foreground or background, producing a binary mask for removal. The tool distinguishes itself through multiple integration methods and output capabilities. It can process images and videos via Unix pipeline data streams, operate as an HTTP API server, or be called programmatically within Python scripts. Users can choose among different AI models to balance proc

mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and restoration. It provides the infrastructure to build and train models for tasks such as text-to-image and text-to-video generation, 3D-aware content synthesis, and high-fidelity image translation using diffusion models and generative adversarial networks. The project distinguishes itself through specialized capabilities for generative model personalization, including techniques for fine-tuning subjects and styles. It also supports advanced visual manipulations such as latent space interp

Yolact es un framework de visión artificial y modelo de segmentación de instancias en tiempo real. Utiliza una red neuronal totalmente convolucional para detectar objetos y generar máscaras a nivel de píxel para imágenes y flujos de video. El sistema emplea la generación de máscaras prototípicas para crear prototipos de máscara globales que se combinan linealmente para obtener resultados específicos de instancia. Incorpora capas convolucionales deformables y agrupación de regiones de interés (RoI) deformable para adaptar el muestreo espacial a las formas irregulares de los objetos. El framework cubre el ciclo de vida completo de desarrollo del modelo, incluyendo el entrenamiento en conjuntos de datos personalizados, evaluación de precisión mediante precisión media promedio (mAP) y el uso de entrenamiento distribuido multi-GPU para escalar la velocidad de procesamiento. También proporciona utilidades de procesamiento de medios para aplicar máscaras de segmentación a imágenes y exportar archivos de video anotados. El proyecto incluye herramientas de persistencia de estado para la gestión de puntos de control y reanudación del entrenamiento, junto con registro para grabar métricas y valores de pérdida.

Este proyecto es un framework de segmentación de imágenes multimodal y un modelo de visión de texto a máscara. Sirve como un segmentador visual basado en SAM diseñado para aislar objetos distintos dentro de imágenes y videos convirtiendo prompts de lenguaje natural y otras entradas en máscaras semánticas a nivel de píxel. El sistema funciona como un framework de segmentación de imágenes multimodal que integra señales de texto, imagen y audio para generar máscaras. Incluye un rastreador de objetos de video interactivo que aísla y rastrea entidades visuales a través de fotogramas de video utilizando imágenes de referencia o consultas textuales. El framework proporciona capacidades para el etiquetado semántico de imágenes, asignando nombres de categorías a las máscaras a través de un vocabulario predefinido. También admite la edición interactiva de imágenes a través de la memoria del historial de sesiones y se refiere a la coincidencia de características para extraer objetos basados en regiones de imágenes de referencia.

Adetailer es una extensión de inpainting para Stable Diffusion y potenciador de detalles automatizado que identifica regiones específicas de la imagen para mejorar la calidad mediante inpainting dirigido. Funciona como una herramienta de enmascaramiento de imágenes por IA que utiliza modelos de detección para crear máscaras precisas para la edición automatizada de imágenes. El sistema se distingue por integrar guías estructurales, como profundidad y pose, para restringir el proceso de inpainting y mantener la consistencia anatómica. También admite la asignación de prompts específicos para objetos, permitiendo que instrucciones de texto únicas se asignen a múltiples objetos detectados dentro de una misma imagen utilizando tokens separadores. La herramienta proporciona una pipeline completa para el refinamiento de imágenes, cubriendo la generación automatizada de máscaras, transformaciones morfológicas de máscaras y filtrado de objetos basado en umbrales de confianza y relaciones de tamaño. Combina estas capacidades en un proceso iterativo de detección, enmascaramiento y difusión para refinar detalles sin alterar la composición global.

This software is a watermark removal system that uses machine learning and image inpainting to delete unwanted text or logos from images. It reconstructs missing pixels to match the original background, ensuring visual consistency through pretrained models. The project includes a masking utility to isolate specific regions for content replacement using binary masks, bounding boxes, or brush strokes. It also features a batch processor that applies these cleaning tasks to large sets of images via a predefined file list. The system handles image preparation by normalizing dimensions and aspect

Este proyecto es un kit de herramientas de bioimagen y suite de análisis en Python, diseñado para procesar y analizar imágenes de microscopía y médicas. Proporciona una colección de herramientas para la cuantificación de imágenes, segmentación de imágenes médicas y flujos de trabajo generales de bioimagen. La suite incluye capacidades especializadas para cuantificar datos biológicos, como medir la complejidad de ramificación neuronal mediante análisis de Sholl, calcular distribuciones de tamaño de partículas y rastrear el área de heridas en ensayos de scratch. También cuenta con una librería de segmentación de imágenes médicas que implementa arquitecturas U-Net para aislar estructuras anatómicas en datos 3D y utiliza redes generativas antagónicas (GANs) para crear imágenes científicas sintéticas para el aumento de datasets. En términos generales, el proyecto cubre primitivas de procesamiento de imágenes, incluyendo reducción de ruido, mejora de contraste y transformaciones morfológicas. Proporciona utilidades de gestión de datasets para convertir anotaciones entre formatos COCO, YOLO y máscaras binarias, así como herramientas de machine learning para entrenar redes neuronales e implementar transferencia de pesos basada en autoencoders. Los flujos de trabajo de análisis se proporcionan como una serie de Jupyter Notebooks interactivos.

MODNet is a deep learning image segmenter and portrait matting model designed to isolate human subjects from backgrounds. It generates high-quality alpha mattes for images and video using only standard RGB input, removing the requirement for manual trimap guides. The framework is optimized for real-time inference and provides utilities to export pre-trained model weights into specialized formats for deployment on target hardware. The project covers the full workflow for portrait isolation, including supervised matting model training on labeled datasets, real-time video background removal, an

sam-hq is a collection of pre-trained vision foundation models and adapters designed for high-quality image segmentation, multimodal feature extraction, and depth estimation. It provides a zero-shot vision model capable of performing segmentation and classification across diverse domains without requiring task-specific training. The project features a high-quality image segmentation tool based on the Segment Anything Model that generates precise masks from spatial prompts. It includes a multimodal feature extractor to generate high-dimensional vector embeddings from both image and text inputs

AnyDoor is a zero-shot image customization framework designed to transfer specific objects from reference images into new scenes without requiring additional model training. It functions as a diffusion-based object insertion tool that enables the placement of objects into target environments while preserving their original identity, lighting, and posture. The system supports both single and multi-object insertion, allowing several distinct objects from different references to be composed into a single target image. It utilizes a segmentation mechanism for mask refinement to clean and sharpen

Segment Geospatial is a Python toolkit for isolating geographic features in remote sensing imagery using the Segment Anything Model. It functions as a remote sensing image processor that converts map tiles into georeferenced formats to generate segmentation masks from satellite data. The system enables the extraction of geographic objects through automatic mask generation or manual prompts, such as text descriptions, bounding boxes, and interactive markers. It supports timeseries imagery segmentation to track or identify objects across sequences of images over different dates and provides a g

TextRecognitionDataGenerator is a system for creating synthetic text images and character masks to train and test optical character recognition models. It functions as a dataset tool that generates artificial images by combining dictionary words with specific fonts and backgrounds to produce training sets for machine learning. The project includes a handwriting simulation engine that uses machine learning models to produce synthetic handwritten text. It also features a document degradation simulator that applies skew, blur, and distortion to images to mimic the visual quality of scanned physi

BiRefNet is a PyTorch image segmentation framework designed for high-precision binary mask generation. It functions as a bilateral image segmentation model used to isolate foreground objects from complex backgrounds, as well as a specialized tool for camouflaged object detection and industrial defect detection. The project is designed for export to the ONNX format, which facilitates cross-platform deployment and inference. It supports custom model fine-tuning on user-provided image and mask datasets to adapt the model for specialized professional use cases. The system covers high-resolution

TotalSegmentator is a medical image segmentation tool and AI-driven organ segmenter designed to isolate anatomical structures from CT scans. It functions as a deep learning anatomy parser and quantitative radiomics analyzer, providing a framework for identifying diverse body tissues and bones to create precise anatomical masks. The system distinguishes itself through a comprehensive medical analysis suite that includes patient biometric estimation for demographics such as age, sex, weight, and height. It further provides specialized clinical index calculations and modality and phase classific