awesome-attention-heads - v2.0

What's Changed

• Add a potentially relevant paper by @fc2869 in https://github.com/IAAR-Shanghai/Awesome-Attention-Heads/pull/11

New Contributors

• @fc2869 made their first contribution in https://github.com/IAAR-Shanghai/Awesome-Attention-Heads/pull/11

Full Changelog: https://github.com/IAAR-Shanghai/Awesome-Attention-Heads/compare/v1.0...v2.0

- TeX
Published by Ki-Seki about 1 year ago

awesome-attention-heads - New survey on LLM attention heads

Since we created and continuously updated this Awesome-Attention-Heads repository, we realized it's time to systematically summarize the work and provide a clear research status to researchers. Thus, our survey, "Attention Heads of Large Language Models: A Survey", has been released. The LaTeX code for the survey is now available.

🔗 Related links: arXiv Page: https://arxiv.org/abs/2409.03752 Hugging Face: https://huggingface.co/papers/2409.03752

- TeX
Published by fan2goa1 over 1 year ago