Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of rwkv-lm

rwkv-lm - RWKV-v5

stable release for rwkv v5

- Python
Published by BlinkDL about 2 years ago

rwkv-lm - RWKV-v4neo

Just a stable release.

- Python
Published by BlinkDL about 3 years ago

rwkv-lm - RWKV v2 - RNN with Transformer Performance

Attached model : ctx1024-layer6-emb512 on enwik8 with 1.65 dev perplexity (0.72 BPC)

- Python
Published by BlinkDL almost 4 years ago

rwkv-lm - 0.02

v0.02 with RWKV, MHAshift, MHArotary, MHA_pro, and time-shift mixing.

- Python
Published by BlinkDL over 4 years ago

rwkv-lm - 0.01

first release with RWKV, MHArotary, MHApro, and time-shift mixing.

- Python
Published by BlinkDL over 4 years ago