https://github.com/blinkdl/fast.c
Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (1.8%) to scientific vocabulary
Keywords from Contributors
Repository
Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
Basic Info
Statistics
- Stars: 72
- Watchers: 5
- Forks: 2
- Open Issues: 1
- Releases: 0
Metadata Files
README.md
fast.c
Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
Current optimization target:
CPU = AMD 7700 (Zen 4)
DRAM = DDR5-6000 dual channel
SSD = 4 x PCIE5.0x4
Current results:
NVME raw speed = 53+ GB/s
DRAM processing = 60.8 GB/s
SSD processing = 29.4 GB/s (huge room for improvements, such as ovelapping io & compute, raw fs)
GEMV int8/32 = 75 ~ 147 GB/s (?!)
Owner
- Name: PENG Bo
- Login: BlinkDL
- Kind: user
- Website: https://rwkv.com/
- Twitter: BlinkDL_AI
- Repositories: 7
- Profile: https://github.com/BlinkDL
RWKV is all you need
GitHub Events
Total
- Issues event: 1
- Watch event: 66
- Issue comment event: 2
- Push event: 8
- Fork event: 2
Last Year
- Issues event: 1
- Watch event: 66
- Issue comment event: 2
- Push event: 8
- Fork event: 2
Issues and Pull Requests
Last synced: 11 months ago
All Time
- Total issues: 1
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 1
- Total pull request authors: 0
- Average comments per issue: 0.0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 1
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 1
- Pull request authors: 0
- Average comments per issue: 0.0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- ubergarm (1)