Science Score: 44.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (1.8%) to scientific vocabulary
Keywords
Keywords from Contributors
Repository
A model compilation solution for various hardware
Basic Info
- Host: GitHub
- Owner: bytedance
- License: apache-2.0
- Language: MLIR
- Default Branch: main
- Homepage: https://byteir.ai
- Size: 16.1 MB
Statistics
- Stars: 439
- Watchers: 12
- Forks: 54
- Open Issues: 23
- Releases: 6
Topics
Metadata Files
README-zh_cn.md
ByteIR项目
English | 中文
ByteIR项目是字节跳动的模型编译解决方案。ByteIR包括编译器、运行时和前端，并提供端到端的模型编译解决方案。 尽管所有的ByteIR组件（编译器/运行时/前端）一起提供端到端的解决方案，并且都在同一个代码库下，但每个组件在技术上都可以独立运行。
ByteIR名字由来
ByteIR这个名称是个公司内部的历史遗留物。ByteIR项目并不是一个IR规范定义项目。相反，在大多数情况下，ByteIR直接使用上游的几个MLIR方言和Google Mhlo。大多数ByteIR编译器的pass与所选的上游MLIR方言和Google Mhlo兼容。
为何选择使用ByteIR
- 最先进的模型: ByteIR会负责维护前端模型转换到Stablehlo，并且提供模型库（近期开放）方便科研和测试。
- 方便好用:
ByteIR直接使用上游MLIR方言和Google Mhlo，为编译器提供兼容的passes和基础设施。允许混合使用passes去建构编译器，这包括ByteIR，上游MLIR方言，Mhlo或是自己写的passes。
- 新硬件支持: ByteIR提供大量Mhlo和Linalg方言的图优化，Loop优化，或者张量优化，新硬件编译器可以复用，大大化简编译器开发。
项目状态
ByteIR目前仍处于早期阶段。在这个阶段，我们的目标是为广泛的深度学习加速器以及通用CPU和GPU提供定义明确、必要的构建块和基础架构支持，以进行模型编译。因此，并没有将针对特定架构的高度调优的kernel代码作为优先考虑。当然，欢迎任何有关优先考虑特定架构的贡献。
编译器
ByteIR编译器是一个基于MLIR的，用于CPU/GPU/ASIC的编译器。
Runtime
ByteIR Runtime是一个通用、轻量级的runtime，能够接入现成的kernel库和ByteIR编译器生成的kernel。
前端
ByteIR前端支持Tensorflow，PyTorch，和ONNX。
各组件的交互接口
每个ByteIR组件在技术上都可以独立运行。组件之间有预定义的交互接口。
前端和编译器之间使用Stablehlo
ByteIR前端和ByteIR编译器通过Stablehlo方言进行交互（注意在开发过程中Stablehlo的版本可能会更新）。这也意味着，任何生成兼容版本Stablehlo的前端都可以与ByteIR编译器交互，并且任何使用兼容版本Stablehlo的编译器都可以与ByteIR前端交互。
编译器和runtime之间使用ByRE
ByteIR编译器和ByteIR Runtime通过ByRE格式进行交互，其版本可能在开发过程中更新。ByRE方言在ByteIR编译器中被定义为一种ByRE格式，目前支持生成文本形式或者带有版本控制的字节码形式。其他ByRE格式正在开发中。
出版与引用
ByteIR是许多字节跳动的杰出研究人员和实习生共同努力的成果。以下是我们的公开演讲列表： * Linalg is All You Need to Optimize Attention -- C4ML'23 * ByteIR: 迈向端到端的AI编译 -- China SoftCon'23
如果您认为ByteIR有用，请考虑引用。
@misc{byteir2023,
title = {{ByteIR}},
author = {Cao, Honghua and Chang, Li-Wen and Chen, Chongsong and Jiang, Chengquan and Jiang, Ziheng and Liu, Liyang and Liu, Yuan and Liu, Yuanqiang and Shen, Chao and Wang, Haoran and Xiao, Jianzhe and Yao, Chengji and Yuan, Hangjian and Zhang, Fucheng and Zhang, Ru and Zhang, Xuanrun and Zhang, Zhekun and Zhang, Zhiwei and Zhu, Hongyu and Liu, Xin},
url = {https://github.com//bytedance/byteir},
year = {2023}
}
License
ByteIR项目采用Apache License v2.0。
Owner
- Name: Bytedance Inc.
- Login: bytedance
- Kind: organization
- Location: Singapore
- Website: https://opensource.bytedance.com
- Twitter: ByteDanceOSS
- Repositories: 255
- Profile: https://github.com/bytedance
Citation (CITATION.cff)
cff-version: 1.2.0
title: ByteIR
message: >-
If you find this repository useful, please consider citing.
type: generic
authors:
- given-names: Honghua
family-names: Cao
email: shenchao.0@bytedance.com
affiliation: ByteDance
- given-names: Li-Wen
family-names: Chang
email: liwen.chang@bytedance.com
affiliation: ByteDances
- given-names: Chongsong
family-names: Chen
email: chongsong.chen@bytedance.com
affiliation: ByteDance
- given-names: Chengquan
family-names: Jiang
email: jiangchengquan@bytedance.com
affiliation: ByteDance
- given-names: Ziheng
family-names: Jiang
email: ziheng.jiang@bytedance.com
affiliation: ByteDance
- given-names: Liyang
family-names: Liu
email: liuliyang.louis@bytedance.com
affiliation: ByteDance
- given-names: Yuan
family-names: Liu
email: liuyuan.leo@bytedance.com
affiliation: ByteDance
- given-names: Yuanqiang
family-names: Liu
email: liuyuanqiang.yqliu@bytedance.com
affiliation: ByteDance
- given-names: Chao
family-names: Shen
email: shenchao.0@bytedance.com
affiliation: ByteDance
- given-names: Haoran
family-names: Wang
email: wanghaoran.bj@bytedance.com
affiliation: ByteDance
- given-names: Jianzhe
family-names: Xiao
email: jianzhe.xiao@bytedance.com
affiliation: ByteDance
- given-names: Chengji
family-names: Yao
email: chengji.yao@bytedance.com
affiliation: ByteDance
- given-names: Hangjian
family-names: Yuan
email: yuanhangjian@bytedance.com
affiliation: ByteDance
- given-names: Fucheng
family-names: Zhang
email: zhangfucheng.jason@bytedance.com
affiliation: ByteDance
- given-names: Ru
family-names: Zhang
email: zhangru.1994@bytedance.com
affiliation: ByteDance
- given-names: Xuanrun
family-names: Zhang
email: zhangxuanrun@bytedance.com
affiliation: ByteDance
- given-names: Zhekun
family-names: Zhang
email: zhekun.zhang@bytedance.com
affiliation: ByteDance
- given-names: Zhiwei
family-names: Zhang
email: zhangzhiwei.177@bytedance.com
affiliation: ByteDance
- given-names: Hongyu
family-names: Zhu
email: zhuhongyu.11@bytedance.com
affiliation: ByteDance
- given-names: Xin
family-names: Liu
email: liuxin.ai@bytedance.com
affiliation: ByteDance
repository-code: 'https://github.com//bytedance/byteir'
abstract: >-
The ByteIR Project is a ByteDance model compilation solution.
keywords:
- 'byteir, mlir'
license: Apache License v2.0
license-url: https://github.com/bytedance/byteir/blob/main/LICENSE
version: '0.0.1'
date-released: '2023-02-06'
identifiers:
- type: url
value: "https://github.com/bytedance/byteir"
description: The GitHub URL
GitHub Events
Total
- Issues event: 8
- Watch event: 66
- Delete event: 35
- Issue comment event: 14
- Push event: 81
- Pull request review comment event: 4
- Pull request event: 87
- Pull request review event: 41
- Fork event: 8
- Create event: 38
Last Year
- Issues event: 8
- Watch event: 66
- Delete event: 35
- Issue comment event: 14
- Push event: 81
- Pull request review comment event: 4
- Pull request event: 87
- Pull request review event: 41
- Fork event: 8
- Create event: 38
Committers
Last synced: 9 months ago
Top Committers
| Name | Commits | |
|---|---|---|
| Yuanqiang Liu | l****u@b****m | 210 |
| Li-Wen Chang | 1****z | 41 |
| liuquanbo-byte | l****o@b****m | 31 |
| Chenhui Huang | h****w@b****m | 27 |
| xg | z****0@b****m | 23 |
| Jiawei Wu | w****l@b****m | 19 |
| Xinyu Yang | y****2@b****m | 13 |
| Yan Xu | 4****Y | 13 |
| Chengji Yao | y****i@h****m | 11 |
| Zhekun(Josh) Zhang | 3****2 | 10 |
| lonely eagle | l****2@b****m | 8 |
| Mi Jiazhi | 5****i | 4 |
| yyp0 | s****o@b****m | 3 |
| jianwenyyy | 4****y | 2 |
| Boian Petkantchin | s****y@y****m | 1 |
| Ikko Eltociear Ashimine | e****r@g****m | 1 |
| JackyChenYi | c****8@b****m | 1 |
| Jiaxing Ding | d****9@b****m | 1 |
| Wenlei Bao | 1****o | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 6 months ago
All Time
- Total issues: 16
- Total pull requests: 132
- Average time to close issues: 26 days
- Average time to close pull requests: 4 days
- Total issue authors: 13
- Total pull request authors: 16
- Average comments per issue: 2.19
- Average comments per pull request: 0.27
- Merged pull requests: 108
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 3
- Pull requests: 45
- Average time to close issues: about 1 month
- Average time to close pull requests: 9 days
- Issue authors: 3
- Pull request authors: 7
- Average comments per issue: 1.33
- Average comments per pull request: 0.07
- Merged pull requests: 36
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- FengJungle (4)
- zhekunz2 (4)
- Connor-XY (2)
- lyffly (2)
- victorygogogo (1)
- shirya0928 (1)
- GithubXxz (1)
- gglin001 (1)
- alphaRGB (1)
- Xinyu302 (1)
- PineWu (1)
- zhao-han (1)
- feiyuvl (1)
- bytedance-oss-robot (1)
- APeiZou (1)
Pull Request Authors
- qingyunqu (224)
- heromapwrd (43)
- liwenchangbdbz (39)
- YellowHCH (38)
- Connor-XY (26)
- XG-zheng (24)
- Vremold (23)
- Xinyu302 (18)
- yaochengji (16)
- zhekunz2 (10)
- linuxlonelyeagle (9)
- Mi-Jiazhi (6)
- yyp0 (6)
- jianwenyyy (2)
- sogartar (1)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
- Total downloads: unknown
- Total dependent packages: 0
- Total dependent repositories: 0
- Total versions: 1
proxy.golang.org: github.com/bytedance/byteir
- Documentation: https://pkg.go.dev/github.com/bytedance/byteir#section-documentation
- License: apache-2.0
-
Latest release: v1.4.0
published over 2 years ago