Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/buaadreamer/llmkiller

LLM手撕代码合集

https://github.com/buaadreamer/llmkiller

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (0.7%) to scientific vocabulary
Last synced: 11 months ago · JSON representation

Repository

LLM手撕代码合集

Basic Info
  • Host: GitHub
  • Owner: BUAADreamer
  • Language: Python
  • Default Branch: master
  • Homepage:
  • Size: 14.6 KB
Statistics
  • Stars: 15
  • Watchers: 1
  • Forks: 1
  • Open Issues: 0
  • Releases: 0
Created over 1 year ago · Last pushed over 1 year ago
Metadata Files
Readme

README.md

LLM手撕代码合集

目录

  • 注意力(Attention)
    • [x] MHA
    • [x] MQA
    • [x] GQA
    • [x] MHA + KVCache
    • [x] MHCA
  • 基础机器学习算法
    • [x] Linear Regression SGD
    • [x] K-Means
    • [x] Layer-Normalization
    • [x] Batch-Normalization
  • 解码算法
    • [x] Greedy Search
    • [x] Temperature sampling
    • [x] Top-K sampling
    • [x] Top-P (Nucleus) sampling
    • [ ] Beam Search
  • 神经网络
    • [x] MLP Regression SGD
    • [ ] CNN
    • [ ] RNN
    • [ ] LSTM
    • [ ] 二维卷积
  • 位置编码
    • [x] 绝对位置编码
    • [x] 可学习位置编码
    • [x] 相对位置编码
    • [x] ROPE

Owner

  • Login: BUAADreamer
  • Kind: user
  • Location: Beijing
  • Company: Beihang University

GitHub Events

Total
  • Watch event: 12
  • Push event: 7
  • Create event: 2
Last Year
  • Watch event: 12
  • Push event: 7
  • Create event: 2

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 6
  • Total Committers: 1
  • Avg Commits per committer: 6.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 6
  • Committers: 1
  • Avg Commits per committer: 6.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
fzc 1****3@q****m 6
Committer Domains (Top 20 + Academic)
qq.com: 1

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels