https://github.com/blinkdl/fast.c

Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.

https://github.com/blinkdl/fast.c

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (1.8%) to scientific vocabulary

Keywords from Contributors

transformer
Last synced: 11 months ago · JSON representation

Repository

Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.

Basic Info
  • Host: GitHub
  • Owner: BlinkDL
  • License: apache-2.0
  • Language: C
  • Default Branch: main
  • Homepage:
  • Size: 25.4 KB
Statistics
  • Stars: 72
  • Watchers: 5
  • Forks: 2
  • Open Issues: 1
  • Releases: 0
Created over 1 year ago · Last pushed over 1 year ago
Metadata Files
Readme License

README.md

fast.c

Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.

Current optimization target:

CPU = AMD 7700 (Zen 4)

DRAM = DDR5-6000 dual channel

SSD = 4 x PCIE5.0x4

Current results:

NVME raw speed = 53+ GB/s

DRAM processing = 60.8 GB/s

SSD processing = 29.4 GB/s (huge room for improvements, such as ovelapping io & compute, raw fs)

GEMV int8/32 = 75 ~ 147 GB/s (?!)

Owner

  • Name: PENG Bo
  • Login: BlinkDL
  • Kind: user

RWKV is all you need

GitHub Events

Total
  • Issues event: 1
  • Watch event: 66
  • Issue comment event: 2
  • Push event: 8
  • Fork event: 2
Last Year
  • Issues event: 1
  • Watch event: 66
  • Issue comment event: 2
  • Push event: 8
  • Fork event: 2

Committers

Last synced: about 1 year ago

All Time
  • Total Commits: 14
  • Total Committers: 2
  • Avg Commits per committer: 7.0
  • Development Distribution Score (DDS): 0.357
Past Year
  • Commits: 14
  • Committers: 2
  • Avg Commits per committer: 7.0
  • Development Distribution Score (DDS): 0.357
Top Committers
Name Email Commits
blinkdl a@a****m 9
PENG Bo 3****L 5
Committer Domains (Top 20 + Academic)
a.com: 1

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 1
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 1
  • Total pull request authors: 0
  • Average comments per issue: 0.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 1
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 0
  • Average comments per issue: 0.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • ubergarm (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels