Awesome GitHub RepositoriesPatch Embedding Modules

This library provides a comprehensive collection of modular building blocks and research-backed architectures for implementing vision transformers within the PyTorch framework. It serves as a centralized repository for constructing, training, and analyzing attention-based models, offering a wide array of specialized variants designed for image classification and visual representation learning. The project distinguishes itself through a focus on architectural efficiency and flexibility, supporting diverse input formats including non-square images and volumetric data like video. It incorporates

This project is a research library and toolkit for deep learning computer vision, focused on implementing transformer and mixer-based architectures for image classification. It processes visual data by converting images into sequences of patches, allowing standard attention mechanisms to capture global dependencies without relying on traditional convolutional operations. The framework distinguishes itself through its support for multimodal embedding analysis, which maps images and text into a shared latent vector space. This capability enables zero-shot classification and cross-modal retrieva

Code release for ConvNeXt model

PlugNPlay-Modules is a collection of reusable PyTorch computer vision modules and deep learning architectural components. It provides a library of standardized building blocks for constructing neural networks, focusing on attention mechanisms, signal processing layers, and feature fusion modules. The project is distinguished by its extensive variety of attention primitives, covering spatial, channel, and temporal weighting, as well as specialized variants like deformable, frequency-enhanced, and linear-complexity attention. It also implements advanced signal processing tools within the neural

DeiT es un framework de vision transformer para PyTorch diseñado para la clasificación de imágenes. Implementa una arquitectura basada en transformers que procesa imágenes como secuencias de parches aplanados utilizando capas de auto-atención (self-attention) y modelado de secuencias consciente de la posición en lugar de filtros convolucionales. El proyecto se centra en el entrenamiento eficiente en datos a través de un framework de destilación de conocimiento. Este sistema permite que un modelo estudiante imite las etiquetas blandas (soft labels) de un modelo profesor de alto rendimiento para mejorar la precisión y la generalización, particularmente cuando se entrena con conjuntos de datos más pequeños. La librería cubre el ciclo de vida completo de desarrollo, incluyendo el entrenamiento de clasificación de imágenes, la optimización de la pérdida de entropía cruzada y el despliegue de pesos preentrenados para inferencia. También incluye una herramienta de benchmarking para evaluar el rendimiento y la precisión del modelo frente a conjuntos de datos estándar.

SegFormer is a semantic segmentation framework and transformer-based model designed for pixel-level image classification. It provides a deep learning architecture that assigns class labels to pixels using a hierarchical transformer encoder and a multi-layer perceptron decoder. The framework utilizes a hierarchical transformer encoder to process multi-scale features through a pyramid of blocks and an all-MLP decoder to aggregate these features without complex attention mechanisms. It incorporates overlap patch embedding to preserve local continuity and sequential self-attention reduction to ma