The main features of megengine/replknet are: Attention Free Architectures.
Open-source alternatives to megengine/replknet include: amoza-theodore/mdmlp. andrew-qibin/visionpermutator. antonyvigouret/pay-attention-to-mlps. atten4vis/demystifylocalvit. badripatro/simba. aliborji/splitmixer.