rl4co • Rank 16.6 • Science 54%

A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)

how_attentive_are_gats • Rank 6.9 • Science 54%

Code for the paper "How Attentive are Graph Attention Networks?" (ICLR'2022)

rlor • Rank 5.7 • Science 54%

Reinforcement learning for operation research problems with OpenAI Gym and CleanRL

proteinn-structure-predictor • Rank 1.6 • Science 57%

A transformer network trained to predict end-to-end single sequence protein structure as a set of angles given amino acid sequences.

lite_llama • Rank 6.4 • Science 44%

A light llama-like llm inference framework based on the triton kernel.

https://github.com/google-research/scenic • Rank 12.8 • Science 36%

Scenic: A Jax Library for Computer Vision Research and Beyond

gpt • Rank 1.8 • Science 44%

Generative Pre-trained Transformer in PyTorch from scratch

gcvit • Rank 9.0 • Science 36%

Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer

https://github.com/astrazeneca/selfpad • Rank 2.5 • Science 36%

The official implementation of "Improving Antibody Humanness Prediction using Patent Data".

DeepMove • Rank 5.1 • Science 23%

[WWW 2018] DeepMove: Predicting Human Mobility with Attentional Recurrent Network

fluence • Rank 8.2 • Science 10%

A deep learning library based on Pytorch focussed on low resource language research and robustness

https://github.com/ai-forever/ner-bert • Rank 7.1 • Science 10%

BERT-NER (nert-bert) with google bert https://github.com/google-research.

https://github.com/carlosholivan/timbre-classification-multiheadattention • Rank 1.1 • Science 10%

rose • Science 54%

PyTorch implementation of Rotary Spatial Embeddings

layer_norm_expressivity_role • Science 54%

Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)

https://github.com/christophreich1996/swin-transformer-v2 • Science 10%

PyTorch reimplementation of the paper "Swin Transformer V2: Scaling Up Capacity and Resolution" [CVPR 2022].

multiscale-adversarial-attention-gates • Science 67%

Code for the paper: Valvano G. et al. (2021), Learning to Segment from Scribbles using Multi-scale Adversarial Attention Gates

cell-detr • Science 54%

Official and maintained implementation of the paper "Attention-Based Transformers for Instance Segmentation of Cells in Microstructures" [BIBM 2020].

https://github.com/adicksonlab/agdiff • Science 49%

Implementation of AGDIFF: Attention-Enhanced Diffusion for Molecular Geometry Prediction

reactive-mise-en-scene • Science 67%

Unity plugin using on-screen object position as proxy for player attention. Objects are assigned a "tendency" which, together with attention measurements, enables custom loading of prefabs to adapt narrative environments over time.

cyberdreamcatcher • Science 54%

An Attentive Graph Agent for Topology-Adaptive Cyber Defence

https://github.com/buaadreamer/nlpkiller • Science 13%

nlp intro project

https://github.com/christophreich1996/maxvit • Science 10%

PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [ECCV 2022].

https://github.com/contextlab/attention-memory-task • Science 13%

An experiment used to explore interactions between covert attention and recognition memory

saits • Science 67%

The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-series imputation (impute multivariate incomplete time series containing NaN missing data/values with machine learning). https://arxiv.org/abs/2202.08516