Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
-
Updated
Nov 22, 2025 - Python
#
attention-mechanism
Here are 1,985 public repositories matching this topic...
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
deep-learning transformers pytorch transformer lstm rnn gpt language-model attention-mechanism gpt-2 gpt-3 linear-attention rwkv chatgpt
-
Updated
Nov 14, 2025 - Python
all kinds of text classification models and more with deep learning
nlp text-classification tensorflow classification convolutional-neural-networks sentence-classification fasttext attention-mechanism multi-label memory-networks multi-class textcnn textrnn
-
Updated
Sep 28, 2023 - Python
A concise but complete full-attention transformer with a set of promising experimental features from various papers
-
Updated
Nov 7, 2025 - Python
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
-
Updated
Feb 17, 2024 - Python
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
computer-vision deep-learning transformers transformer awesome-list vit papers attention-mechanism attention-mechanisms self-attention transformer-architecture transformer-models detr vision-transformer transformer-cv transformer-with-cv transformer-awesome visual-transformer
-
Updated
Jul 30, 2024
A collection of important graph embedding, classification and representation learning papers with implementations.
deepwalk kernel-methods attention-mechanism network-embedding graph-kernel graph-kernels graph-convolutional-networks classification-algorithm node2vec weisfeiler-lehman graph-embedding graph-classification graph-attention-networks graph-representation-learning graph2vec deep-graph-kernels netlsd graph-attention-model structural-attention node-embedding
-
Updated
Mar 18, 2023 - Python
A TensorFlow Implementation of the Transformer: Attention Is All You Need
-
Updated
May 21, 2023 - Python
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
-
Updated
Apr 9, 2022 - Python
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
roadmap neural-network cnn dnn tts speech-synthesis speech-recognition rnn seq2seq automatic-speech-recognition papers language-model attention-mechanism speaker-verification voice-conversion timit-dataset acoustic-model diffusion-models singing-voice-synthesis recognition-synthesis
-
Updated
Oct 19, 2023
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
-
Updated
Jul 6, 2023 - Python
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
computer-vision pytorch image-captioning show-attend-and-tell attention-mechanism encoder-decoder pytorch-tutorial mscoco
-
Updated
Jul 28, 2022 - Python
Keras Attention Layer (Luong and Bahdanau scores).
-
Updated
Nov 17, 2023 - Python
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
python machine-learning deep-learning speech transformers python3 pytorch speech-recognition speech-to-text attention-mechanism whisper speech-processing asr speaker-diarization attention-model attention-is-all-you-need attention-seq2seq attention-visualization attention-network multilingual-models
-
Updated
Sep 9, 2025 - Python
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
python deep-learning jupyter pytorch attention attention-mechanism graph-attention-networks self-attention pytorch-implementation gat graph-attention-network pytorch-gat gat-tutorial
-
Updated
Nov 17, 2022 - Jupyter Notebook
Reformer, the efficient Transformer, in Pytorch
-
Updated
Jun 21, 2023 - Python
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
-
Updated
Oct 29, 2022 - Python
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
deep-learning transformers artificial-intelligence attention-mechanism non-autoregressive audio-generation
-
Updated
Apr 24, 2025 - Python
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
-
Updated
Nov 18, 2020 - Python
基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口
reinforcement-learning deep-learning sentiment-analysis text-classification tensorflow nlu knowledge-graph recommendation nlg ner attention-mechanism ir dialogue-systems slot-filling oriented-dialogs intent-detection django-restful chatbot-cn tenserflow-serving text-correct
-
Updated
Jun 13, 2021
Improve this page
Add a description, image, and links to the attention-mechanism topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the attention-mechanism topic, visit your repo's landing page and select "manage topics."