awesome-repositories.comCategoriesBlog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
allenai avatar

allenai/longformer

0
View on GitHub↗
2,196 stars·286 forks·Python·Apache-2.0·4 viewsarxiv.org/abs/2004.05150↗

Longformer

Longformer and LongformerEncoderDecoder (LED) are pretrained transformer models for long documents.

Features

  • Language Modeling - Transformer architecture for long-document processing.
  • Transformer Architectures - Efficient attention mechanism for processing long document sequences.

Star history

Star history chart for allenai/longformerStar history chart for allenai/longformer

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Open-source alternatives to Longformer

Similar open-source projects, ranked by how many features they share with Longformer.
  • ari-holtzman/degenA

    ari-holtzman/degen

    0View on GitHub↗
    View on GitHub↗0
  • facebookresearch/spanbertfacebookresearch avatar

    facebookresearch/SpanBERT

    907View on GitHub↗

    This repository contains code and models for the paper: SpanBERT: Improving Pre-training by Representing and Predicting Spans. If you prefer to use Huggingface, please check out this link -- https://huggingface.co/SpanBERT

    Python
    View on GitHub↗907
  • facebookresearch/xlmfacebookresearch avatar

    facebookresearch/XLM

    2,930View on GitHub↗

    PyTorch original implementation of Cross-lingual Language Model Pretraining.

    Python
    View on GitHub↗2,930
  • allenai/dont-stop-pretrainingA

    allenai/dont-stop-pretraining

    0View on GitHub↗
    View on GitHub↗0
See all 20 alternatives to Longformer→

Frequently asked questions

What does allenai/longformer do?

Longformer and LongformerEncoderDecoder (LED) are pretrained transformer models for long documents.

What are the main features of allenai/longformer?

The main features of allenai/longformer are: Language Modeling, Transformer Architectures.

What are some open-source alternatives to allenai/longformer?

Open-source alternatives to allenai/longformer include: ari-holtzman/degen. facebookresearch/spanbert — This repository contains code and models for the paper: SpanBERT: Improving Pre-training by Representing and… facebookresearch/xlm — PyTorch original implementation of Cross-lingual Language Model Pretraining. google-research/albert — ALBERT. google-research/bert — This project is a transformer-based language model and natural language processing toolkit designed to generate deep… allenai/dont-stop-pretraining.