awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com

Bahdanau attention mechanism

Ranking updated Aug 31, 2026

For bahdanau attention, the first results are google/seq2seq, dsgiitr/d2l-pytorch and tensorflow/nmt (This official sequence-to-sequence neural machine translation tutorial provides a foundational TensorFlow implementation of the Bahdanau additive attention mechanism with educational documentation). d2l-ai/d2l-en and spro/practical-pytorch round out the shortlist. Compare the match explanations and check the project documentation against your requirements.

Compare the top open-source Bahdanau attention implementations for sequence-to-sequence models, ranked by stars and activity to help you pick the right one.

Bahdanau attention mechanism

Find the best repos with AI.We'll search the best matching repositories with AI.
  • google/seq2seqgoogle avatar

    google/seq2seq

    5,621View on GitHub↗

    This is a TensorFlow-based encoder-decoder framework and model library used for mapping input sequences to output sequences. It functions as a deep learning sequence mapper designed to transform sequential data from one domain to another. The library provides tools for implementing sequence-to-sequence modeling across multiple domains, including neural machine translation, automatic text summarization, and image captioning generation. The framework incorporates recurrent neural networks and utilizes attention-based contextualization to weight input sequences. It supports multiple decoding st

    This repository provides a TensorFlow-based sequence-to-sequence framework utilizing recurrent neural networks and attention mechanisms for neural machine translation, though it focuses on a broader framework rather than an isolated educational implementation of the Bahdanau mechanism.

    PythonRecurrent Neural NetworksEncoder-Decoder Architectures
    View on GitHub↗5,621
  • dsgiitr/d2l-pytorchdsgiitr avatar

    dsgiitr/d2l-pytorch

    4,353View on GitHub↗

    This project is an educational codebase and reference library that translates theoretical deep learning concepts into executable PyTorch code. It serves as a practical implementation of a deep learning textbook, providing a course-like structure of guided exercises and architectural examples for learning purposes. The repository includes a library of standard neural network architectures, including linear, convolutional, recurrent, and transformer models. It specifically implements a variety of deep learning patterns such as multilayer perceptrons, VGG networks, gated recurrent units, and lon

    This repository provides educational implementations of deep learning models including sequence-to-sequence architectures and attention mechanisms in PyTorch, making it a valuable learning resource though it is designed as a broad textbook companion rather than a dedicated attention library.

    Jupyter NotebookRecurrent Neural NetworksSequence-to-Sequence ModelsEncoder-Decoder Architectures
    View on GitHub↗4,353
  • tensorflow/nmttensorflow avatar

    tensorflow/nmt

    6,461View on GitHub↗

    This project is a neural machine translation system used to build models that automatically translate text from one language to another. It utilizes sequence-to-sequence modeling to transform variable-length input sequences into corresponding output sequences. The system implements bidirectional recurrent neural network encoding and attention mechanisms to capture contextual information and focus on specific parts of the source text during translation. To manage training and inference, it employs separate computational graphs and supports distributing model layers across multiple GPU devices.

    This official sequence-to-sequence neural machine translation tutorial provides a foundational TensorFlow implementation of the Bahdanau additive attention mechanism with educational documentation.

    PythonAttention Scoring Functions
    View on GitHub↗6,461
  • d2l-ai/d2l-end2l-ai avatar

    d2l-ai/d2l-en

    29,001View on GitHub↗

    This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

    This educational platform provides detailed, executable implementations of sequence-to-sequence models with additive Bahdanau attention using PyTorch, TensorFlow, and other frameworks, directly matching the learning and code requirements.

    PythonEncoder-Decoder ArchitecturesAttention Scoring FunctionsRecurrent Layers
    View on GitHub↗29,001
  • spro/practical-pytorchspro avatar

    spro/practical-pytorch

    4,546View on GitHub↗

    Practical PyTorch is a collection of deep learning tutorials and guides focused on implementing recurrent neural networks. The project provides practical code for building sequence models and sequence-to-sequence architectures using the PyTorch framework. The repository covers the implementation of models for neural machine translation, character-level text generation, and text classification. It includes examples for transforming input sequences into output sequences for machine translation and synthesizing new text. The project also extends to sequence data prediction and time series analy

    This repository provides educational deep learning tutorials in PyTorch focusing on sequence-to-sequence models and neural machine translation, serving as a helpful implementation resource for the requested mechanism even though it functions as a collection of guides rather than a dedicated library.

    Jupyter NotebookRecurrent Neural Networks
    View on GitHub↗4,546
  • bentrevett/pytorch-seq2seqbentrevett avatar

    bentrevett/pytorch-seq2seq

    5,697View on GitHub↗

    This is a collection of educational Jupyter Notebook tutorials that teach sequence-to-sequence modeling using PyTorch and TorchText, focused on neural machine translation. The project provides hands-on guides for building and training encoder-decoder architectures with recurrent neural networks like LSTM and GRU, implementing attention mechanisms that allow the decoder to focus on relevant input tokens during sequence generation. The tutorials cover the full pipeline of machine translation, from tokenizing multilingual text using language-specific tokenizers to training multi-layer encoder-de

    This repository provides educational Jupyter Notebook tutorials implementing sequence-to-sequence models with recurrent neural networks and attention mechanisms in PyTorch, making it a great resource for learning neural machine translation.

    Jupyter NotebookNeural Machine TranslationAttention MechanismsEncoder-Decoder Attention Decoders
    View on GitHub↗5,697
  • graykode/nlp-tutorialgraykode avatar

    graykode/nlp-tutorial

    14,855View on GitHub↗

    This repository serves as an educational resource for learning the foundational architectures of natural language processing through concise code implementations. It provides a structured collection of deep learning models designed to process and understand human language, focusing on the core mechanics of neural network sequence modeling and text analysis. The project distinguishes itself by offering direct, hands-on implementations of complex architectures, including Transformers, attention mechanisms, and word embedding generation. By utilizing tensor-based computational graphs and gradien

    This repository provides educational deep learning tutorials with implementations of foundational natural language processing architectures, including attention mechanisms and sequence-to-sequence models using popular frameworks.

    Jupyter NotebookEncoder-Decoder Architectures
    View on GitHub↗14,855
  • kyubyong/transformerKyubyong avatar

    Kyubyong/transformer

    4,470View on GitHub↗

    This project is a TensorFlow implementation of a transformer model, providing a text-to-text deep learning framework designed to recognize and generate sequence patterns. It functions as an attention-based sequence model and a neural machine translation framework for converting text from one language to another. The system implements the transformer network architecture, utilizing multi-head attention and positional encoding to process sequential data. It provides the necessary tools for transformer model training and machine translation inference, allowing for the execution of trained models

    This project implements the Transformer architecture using multi-head self-attention rather than the older recurrent sequence-to-sequence model with additive Bahdanau attention, making it the wrong attention mechanism for this search.

    PythonSequence-to-Sequence ModelsEncoder-Decoder Architectures
    View on GitHub↗4,470
  • binroot/tensorflow-bookBinRoot avatar

    BinRoot/TensorFlow-Book

    4,431View on GitHub↗

    This project is a collection of TensorFlow machine learning examples providing reference implementations for various neural network paradigms. It covers supervised, unsupervised, reinforcement, and sequential learning models. The repository includes implementations for convolutional neural networks focused on image classification and ranking, as well as recurrent neural networks for time-series forecasting and sequence-to-sequence translation. It further provides examples of reinforcement learning agents trained via reward optimization and unsupervised learning techniques such as autoencoders

    This repository is a broad collection of TensorFlow machine learning tutorials and reference models rather than a dedicated implementation of the Bahdanau attention mechanism, making it a general educational resource rather than the specific component sought.

    Jupyter NotebookRecurrent Neural NetworksSequence-to-Sequence ModelsEncoder-Decoder Architectures
    View on GitHub↗4,431
  • labmlai/annotated_deep_learning_paper_implementationslabmlai avatar

    labmlai/annotated_deep_learning_paper_implementations

    66,981View on GitHub↗

    This project is a collection of deep learning research papers translated into annotated code. It serves as a resource for reproducing academic research, providing implementations of transformers, diffusion models, and reinforcement learning architectures. The library distinguishes itself by using a side-by-side annotation format that combines executable Python code with descriptive markdown notes. This approach provides a structured way to explain the logic of neural network papers alongside their PyTorch-based implementations. The codebase covers several major capability areas, including ge

    This repository provides literate-programming implementations of various deep learning papers rather than a dedicated sequence-to-sequence Bahdanau attention model, making it an educational building block rather than the specific mechanism implementation requested.

    PythonAnnotated Code Implementations
    View on GitHub↗66,981
Compare the top 10 at a glance
RepositoryStarsLanguageLicenseLast push
google/seq2seq5.6KPythonApache-2.0Oct 15, 2020
dsgiitr/d2l-pytorch4.4KJupyter NotebookApache-2.0Jul 25, 2024
tensorflow/nmt
6.5K
Python
Apache-2.0
Oct 9, 2022
d2l-ai/d2l-en29KPythonNOASSERTIONAug 18, 2024
spro/practical-pytorch4.5KJupyter NotebookMITJul 1, 2021
bentrevett/pytorch-seq2seq5.7KJupyter NotebookMITJan 20, 2024
graykode/nlp-tutorial14.9KJupyter NotebookmitFeb 21, 2024
kyubyong/transformer4.5KPythonApache-2.0May 21, 2023
binroot/tensorflow-book4.4KJupyter NotebookMITMar 17, 2023
labmlai/annotated_deep_learning_paper_implementations67KPythonMITJan 22, 2026

Related searches

  • Rotary positional embeddings
  • a framework for agents with long-term memory
  • a library for accelerating transformer inference
  • a library for RLHF and preference alignment
  • a library for speeding up LLM token generation
  • a reranking library for RAG retrieval
  • a hybrid retrieval engine for RAG
  • a search engine mixing keywords and vectors