Back to shi-labs/compact-transformers
Projects sharing features with Compact Transformers
30 open-source projects similar to shi-labs/compact-transformers, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
- stevengrove/vtpack
StevenGrove/vtpack
This repo is an official implementation for "Dynamic Grained Encoder for Vision Transformers" (NeurIPS2021) on PyTorch framework.
Python - shi-labs/neighborhood-attention-transformer
SHI-Labs/Neighborhood-Attention-Transformer
1,181View on GitHubNeighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022
Pythonneighborhood-attentionpytorch - facebookresearch/convit
facebookresearch/convit
This repository contains PyTorch code for ConViT. It builds on code from the Data-Efficient Vision Transformer and from timm.
Python - microsoft/vision-longformer
microsoft/vision-longformer
This project provides the source code for the vision longformer paper.
Python - facebookresearch/deit
facebookresearch/deit
4,348View on GitHubDeiT is a PyTorch vision transformer framework designed for image classification. It implements a transformer-based architecture that processes images as sequences of flattened patches using self-attention layers and position-aware sequence modeling instead of convolutional filters. The project focuses on data-efficient training through a knowledge distillation framework. This system allows a student model to mimic the soft labels of a high-performance teacher model to improve accuracy and generalization, particularly when training on smaller datasets. The library covers the full development
Python
