Data

Tools

Indexes

Applications

Experiments

Open Source Science

iree-base-compiler

A retargetable MLIR-based machine learning compiler and runtime toolkit.

https://github.com/iree-org/iree

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    6 of 234 committers (2.6%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (11.6%) to scientific vocabulary

Keywords

compiler cuda jax machine-learning mlir onnx pytorch runtime spirv tensorflow vulkan

Keywords from Contributors

distributed deep-neural-networks autograding tensors transformers cryptocurrencies audio deepseek speech-recognition gemma
Last synced: 6 months ago · JSON representation ·

Repository

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Basic Info
  • Host: GitHub
  • Owner: iree-org
  • License: apache-2.0
  • Language: C++
  • Default Branch: main
  • Homepage: http://iree.dev/
  • Size: 214 MB
Statistics
  • Stars: 3,329
  • Watchers: 92
  • Forks: 751
  • Open Issues: 1,372
  • Releases: 0
Topics
compiler cuda jax machine-learning mlir onnx pytorch runtime spirv tensorflow vulkan
Created over 6 years ago · Last pushed 6 months ago
Metadata Files
Readme Contributing License Citation Codeowners Authors Maintainers

README.md

IREE: Intermediate Representation Execution Environment

IREE (Intermediate Representation Execution Environment, pronounced as "eerie") is an MLIR-based end-to-end compiler and runtime that lowers Machine Learning (ML) models to a unified IR that scales up to meet the needs of the datacenter and down to satisfy the constraints and special considerations of mobile and edge deployments.

See our website for project details, user guides, and instructions on building from source.

IREE Discord Status pre-commit OpenSSF Best Practices

Project news

Project status

Release status

Releases notes are published on GitHub releases.

| Package | Release status | | -- | -- | GitHub release (stable) | GitHub Release GitHub release (nightly) | GitHub Release iree-base-compiler | PyPI version iree-base-runtime | PyPI version

For more details on the release process, see https://iree.dev/developers/general/release-management/.

Build status

CI PkgCI

Nightly build status

| Operating system | Build status | | -- | --: | Linux | CI - Linux arm64 clang macOS | CI - macOS x64 clang macOS | CI - macOS arm64 clang

For the full list of workflows see https://iree.dev/developers/general/github-actions/.

Communication channels

Related project channels

  • MLIR topic within LLVM Discourse: IREE is enabled by and heavily relies on MLIR. IREE sometimes is referred to in certain MLIR discussions. Useful if you are also interested in MLIR evolution.

Architecture overview

IREE Architecture IREE Architecture

See our website for more information.

Presentations and talks

Community meeting recordings: IREE YouTube channel

Date | Title | Recording | Slides ---- | ----- | --------- | ------ 2025-06-10 | Data-Tiling in IREE: Achieving High Performance Through Compiler Design (AsiaLLVM) | recording | slides 2025-05-17 | Introduction to GPU architecture and IREE's GPU CodeGen Pipeline | recording | slides 2025-02-12 | The Long Tail of AI: SPIR-V in IREE and MLIR (Vulkanised) | recording | slides 2024-10-01 | Unveiling the Inner Workings of IREE: An MLIR-Based Compiler for Diverse Hardware | recording | 2021-06-09 | IREE Runtime Design Tech Talk | recording | slides 2020-08-20 | IREE CodeGen (MLIR Open Design Meeting) | recording | slides 2020-03-18 | Interactive HAL IR Walkthrough | recording | 2020-01-31 | End-to-end MLIR Workflow in IREE (MLIR Open Design Meeting) | recording | slides

License

IREE is licensed under the terms of the Apache 2.0 License with LLVM Exceptions. See LICENSE for more information.

Owner

  • Name: iree-org
  • Login: iree-org
  • Kind: organization

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you want to cite IREE, feel free to use this"
title: "IREE"
abstract: >-
  An MLIR-based compiler and runtime for ML models from multiple frameworks.
date-released: 2019-09-18
authors:
  - name: "The IREE Authors"
contact:
  - family-names: Vanik
    given-names: Ben
    email: ben.vanik@gmail.com
    affiliation: Advanced Micro Devices, Inc.
  - family-names: Laurenzo
    given-names: Stella
    email: stellaraccident@gmail.com
    affiliation: Advanced Micro Devices, Inc.
license: "Apache-2.0 WITH LLVM-exception"
url: "https://iree.dev/"
repository-code: "https://github.com/iree-org/iree"
keywords:
  - compiler
  - "machine learning"
  - "deep learning"
  - "artificial intelligence"

Committers

Last synced: 11 months ago

All Time
  • Total Commits: 15,966
  • Total Committers: 234
  • Avg Commits per committer: 68.231
  • Development Distribution Score (DDS): 0.861
Past Year
  • Commits: 2,169
  • Committers: 102
  • Avg Commits per committer: 21.265
  • Development Distribution Score (DDS): 0.852
Top Committers
Name Email Commits
Ben Vanik b****k@g****m 2,220
Scott Todd s****d@g****m 1,388
Geoffrey Martin-Noble g****n@g****m 1,091
Han-Chung Wang h****g@g****m 966
Lei Zhang a****t@g****m 941
iree-copybara-bot i****t@g****m 919
Submodule Synchronize Action i****t@g****m 769
Stella Laurenzo s****t@g****m 572
bjacob b****b@g****m 543
MaheshRavishankar 1****r 482
Thomas t****x@g****m 394
Marius Brehler m****r@i****e 361
Stella Laurenzo l****o@g****m 355
Rob Suderman s****n@g****m 348
Jerry Wu c****w@g****m 325
Quinn Dawkins q****s@g****m 313
Jakub Kuderski k****k@g****m 229
Phoenix Meadowlark m****k@g****m 219
Nicolas Vasilache n****e 204
Kunwar Grover g****s@g****m 165
Ahmed S. Taei a****n 149
CindyLiu h****l@g****m 145
Max191 4****1 138
Jacques Pienaar j****r@g****m 123
Ian Wood i****4@u****u 100
mariecwhite m****e@g****m 99
Sean Silva s****n@g****m 86
Mahesh Ravishankar r****m@g****m 85
Matthias Springer s****m@g****m 84
Benjamin Kramer k****b@g****m 81
and 204 more...
Committer Domains (Top 20 + Academic)
google.com: 66 amd.com: 11 arm.com: 5 iml.fraunhofer.de: 4 nod-labs.com: 2 roofline.ai: 2 sifive.com: 2 ed.ac.uk: 1 kintel.net: 1 celest.fr: 1 rediffmail.com: 1 nvidia.com: 1 alibaba-inc.com: 1 apache.org: 1 alanli.org: 1 github.com: 1 syrmia.com: 1 gymni.ch: 1 hyv5.cn: 1 bobmuniz.com: 1 u.northwestern.edu: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 1,293
  • Total pull requests: 5,362
  • Average time to close issues: 6 months
  • Average time to close pull requests: 16 days
  • Total issue authors: 183
  • Total pull request authors: 158
  • Average comments per issue: 2.26
  • Average comments per pull request: 1.1
  • Merged pull requests: 3,623
  • Bot issues: 0
  • Bot pull requests: 26
Past Year
  • Issues: 819
  • Pull requests: 3,949
  • Average time to close issues: 13 days
  • Average time to close pull requests: 6 days
  • Issue authors: 130
  • Pull request authors: 119
  • Average comments per issue: 1.6
  • Average comments per pull request: 1.02
  • Merged pull requests: 2,767
  • Bot issues: 0
  • Bot pull requests: 24
View more stats
Top Authors
Issue Authors
  • hanhanW (110)
  • benvanik (87)
  • ScottTodd (73)
  • pdhirajkumarprasad (73)
  • IanWood1 (51)
  • sogartar (45)
  • krzysz00 (44)
  • bjacob (34)
  • Max191 (34)
  • stellaraccident (29)
  • nirvedhmeshram (28)
  • Alex-Vasile (27)
  • monorimet (26)
  • qedawkins (26)
  • rsuderman (24)
Pull Request Authors
  • hanhanW (523)
  • ScottTodd (464)
  • benvanik (328)
  • qedawkins (323)
  • IanWood1 (322)
  • Max191 (317)
  • bjacob (263)
  • MaheshRavishankar (251)
  • Groverkss (232)
  • nirvedhmeshram (155)
  • kuhar (150)
  • pashu123 (120)
  • krzysz00 (103)
  • bangtianliu (102)
  • marbre (100)
Top Labels
Issue Labels
bug 🐞 (557) enhancement ➕ (119) infrastructure (92) codegen (88) compiler/dialects (46) codegen/rocm (43) codegen/llvm (42) performance ⚡ (36) codegen/spirv (32) runtime (20) cleanup 🧹 (19) bindings/python (17) quality of life 😊 (16) support (16) good first issue 🌱 (15) infrastructure/benchmark (14) onboarding/codegen (13) integrations/pytorch (12) documentation (12) codegen/nvvm (12) hal/hip (11) hal/api (11) regression (11) integrations/onnx (11) platform/windows 🚪 (9) integrations/stablehlo (8) hal/vulkan (8) runtime/tools (7) help wanted (7) codegen/hip (6)
Pull Request Labels
infrastructure (303) benchmarks:x86_64 (105) compiler/dialects (98) documentation (98) cleanup 🧹 (96) benchmarks:comp-stats (72) benchmarks:android-cpu (71) bindings/python (65) benchmarks:vulkan-nvidia (59) benchmarks:cuda (58) benchmarks:android-gpu (49) hal/amdgpu (48) platform/windows 🚪 (41) hal/api (41) runtime (37) zombie 🧟 (36) dependencies (26) codegen/rocm (26) hal/hip (25) bug 🐞 (24) integrations/onnx (23) compiler/tools (20) infrastructure/benchmark (19) integrations/pytorch (18) codegen (17) hal/cuda (15) integrations/tensorflow (14) performance ⚡ (14) runtime/tools (13) hal/vulkan (13)

Packages

  • Total packages: 6
  • Total downloads:
    • pypi 65,076 last-month
  • Total dependent packages: 7
    (may contain duplicates)
  • Total dependent repositories: 58
    (may contain duplicates)
  • Total versions: 107
  • Total maintainers: 6
pypi.org: iree-runtime

IREE Python Runtime Components

  • Versions: 25
  • Dependent Packages: 6
  • Dependent Repositories: 28
  • Downloads: 6,473 Last month
Rankings
Stargazers count: 1.5%
Forks count: 2.4%
Dependent repos count: 2.7%
Average: 3.6%
Dependent packages count: 4.8%
Downloads: 6.6%
Maintainers (5)
google-iree-pypi-deploy stellaraccident saienduri marbre scotttodd
Last synced: 6 months ago
pypi.org: iree-tools-tf

IREE TensorFlow Compiler Tools

  • Versions: 29
  • Dependent Packages: 1
  • Dependent Repositories: 15
  • Downloads: 4,033 Last month
Rankings
Stargazers count: 1.5%
Forks count: 2.4%
Dependent repos count: 3.7%
Average: 4.1%
Dependent packages count: 4.8%
Downloads: 8.2%
Maintainers (4)
google-iree-pypi-deploy stellaraccident scotttodd safaizal
Last synced: 6 months ago
pypi.org: iree-tools-tflite

IREE TFLite Compiler Tools

  • Versions: 28
  • Dependent Packages: 0
  • Dependent Repositories: 15
  • Downloads: 5,456 Last month
Rankings
Stargazers count: 1.5%
Forks count: 2.4%
Dependent repos count: 3.7%
Average: 5.2%
Downloads: 8.3%
Dependent packages count: 10.1%
Maintainers (2)
google-iree-pypi-deploy stellaraccident
Last synced: 6 months ago
proxy.golang.org: github.com/iree-org/iree
  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 5.5%
Average: 5.6%
Dependent repos count: 5.8%
Last synced: 6 months ago
pypi.org: iree-base-compiler

IREE Python Compiler API

  • Versions: 9
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 24,527 Last month
Rankings
Dependent packages count: 10.1%
Downloads: 10.6%
Average: 25.7%
Dependent repos count: 56.6%
Maintainers (4)
stellaraccident marbre scotttodd safaizal
Last synced: 6 months ago
pypi.org: iree-base-runtime

IREE Python Runtime Components

  • Versions: 9
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 24,587 Last month
Rankings
Dependent packages count: 10.1%
Downloads: 12.2%
Average: 26.3%
Dependent repos count: 56.6%
Maintainers (4)
stellaraccident marbre scotttodd safaizal
Last synced: 6 months ago

Dependencies

.github/workflows/benchmark_compilation.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
.github/workflows/benchmark_execution.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
.github/workflows/benchmark_large.yml actions
  • sarisia/actions-status-discord 61114b793b460ee85fe38ad3fccc78c7ead38d55 composite
.github/workflows/benchmark_trigger.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
.github/workflows/build_all.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
.github/workflows/build_and_test_android.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
.github/workflows/build_benchmark_tools.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
.github/workflows/build_e2e_test_artifacts.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
.github/workflows/build_package.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/upload-artifact 0b7f8abb1508181956e8e162db84b466c27e18ce composite
  • benc-uk/workflow-dispatch 798e70c97009500150087d30d9f11c5444830385 composite
  • dwenegar/upload-release-assets 5bc3024cf83521df8ebfadf00ad0c4614fd59148 composite
  • ilammy/msvc-dev-cmd 7315a94840631165970262a99c72cfb48a65d25d composite
.github/workflows/ci.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
  • actions/setup-python d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435 composite
  • google-github-actions/auth v1 composite
  • ilammy/msvc-dev-cmd 7315a94840631165970262a99c72cfb48a65d25d composite
  • sarisia/actions-status-discord 61114b793b460ee85fe38ad3fccc78c7ead38d55 composite
.github/workflows/lint.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/setup-python d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435 composite
.github/workflows/oneshot_candidate_release.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/create-release 0cb9c9b65d5d1901c1f53e5e66eaf4afd303e70e composite
  • ad-m/github-push-action 40bf560936a8022e68a3c00e7d2abefaf01305a6 composite
  • benc-uk/workflow-dispatch 798e70c97009500150087d30d9f11c5444830385 composite
.github/workflows/pkgci.yml actions
.github/workflows/pkgci_build_packages.yml actions
  • actions/cache 88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8 composite
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/upload-artifact 0b7f8abb1508181956e8e162db84b466c27e18ce composite
.github/workflows/pkgci_regression_test_cpu.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/download-artifact 9bc31d5ccc31df68ecc42ccf4149144866c47d8a composite
  • actions/setup-python 61a6322f88396a6271a6ee3565807d608ecaddd1 composite
.github/workflows/post_benchmark_comment.yaml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
.github/workflows/publish_website.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/setup-python d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435 composite
  • google-github-actions/auth v1 composite
.github/workflows/run_iree_dispatch_profiler.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
.github/workflows/run_shark_tank.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
.github/workflows/samples.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
.github/workflows/schedule_candidate_release.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/create-release 0cb9c9b65d5d1901c1f53e5e66eaf4afd303e70e composite
  • benc-uk/workflow-dispatch 798e70c97009500150087d30d9f11c5444830385 composite
.github/workflows/setup.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
.github/workflows/validate_and_publish_release.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/setup-python d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435 composite
  • ad-m/github-push-action 40bf560936a8022e68a3c00e7d2abefaf01305a6 composite
  • dawidd6/action-download-artifact 5e780fc7bbd0cac69fc73271ed86edf5dcb72d67 composite
  • eregon/publish-release 46913fa2b3f7edc7345ae3c17f6d1b093a54916d composite
.devcontainer/docker-compose.base.yml docker
runtime/bindings/tflite/java/build.gradle maven
  • com.android.support:support-annotations 22.2.0 implementation
build_tools/benchmarks/reporting/requirements.txt pypi
  • jinja2 ==2.11.3
  • pandas ==1.5.0
build_tools/github_actions/ci_requirements.txt pypi
  • cmake >=3.18.4
  • ninja *
build_tools/github_actions/runner/instance_deleter/requirements.txt pypi
  • flask >=2.1
  • functions-framework >=3.2
  • google-auth >=2.15
  • google-cloud-compute >=1.8
  • google-cloud-error-reporting >=1.6
  • requests >=2.27
build_tools/python_deploy/pypi_deploy_requirements.txt pypi
  • twine *
compiler/pyproject.toml pypi
compiler/setup.py pypi
  • PyYAML *
  • numpy *
docs/api_docs/python/requirements.txt pypi
  • commonmark ==0.9.1
  • enum_tools ==0.6.4
  • iree-compiler *
  • iree-runtime *
  • myst-parser ==0.15.2
  • sphinx ==4.2.0
  • sphinx_rtd_theme ==1.0.0
  • sphinx_toolbox ==2.15.0
docs/website/requirements.txt pypi
  • mkdocs-material ==9.2.3
  • mkdocs-redirects ==1.2.1
experimental/dispatch_profiler/requirements.txt pypi
  • numpy *
experimental/distributed/python/pyproject.toml pypi
  • iree-compiler *
  • iree-runtime *
  • jax [cpu]
  • mpi4py *
  • numpy *
experimental/regression_suite/pyproject.toml pypi
experimental/regression_suite/setup.py pypi
  • PyYAML *
  • numpy *
  • pytest *
  • pytest-xdist *
integrations/tensorflow/python_projects/iree_tf/pyproject.toml pypi
integrations/tensorflow/python_projects/iree_tf/setup.py pypi
integrations/tensorflow/python_projects/iree_tflite/pyproject.toml pypi
integrations/tensorflow/python_projects/iree_tflite/setup.py pypi
integrations/tensorflow/test/requirements.txt pypi
  • Pillow >=9.2.0 test
  • keras >=2.7.0 test
  • protobuf >=3.20.3,<4 test
  • tf-nightly ==2.15.0.dev20230824 test
runtime/bindings/python/iree/runtime/build_requirements.txt pypi
  • PyYAML >=5.4.1
  • nanobind >=1.4.0
  • numpy >=1.19.4
  • pip >=21.3
  • pybind11 >=2.10.1
  • requests >=2.28.0
  • setuptools >=62.4.0
  • wheel >=0.36.2
runtime/pyproject.toml pypi
runtime/setup.py pypi
  • PyYAML *
  • numpy *
tests/e2e/collectives/run_requirements.txt pypi
  • mpi4py ==3.1.4 test
  • numpy * test
.github/workflows/pkgci_regression_test_amdgpu_rocm.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/download-artifact 9bc31d5ccc31df68ecc42ccf4149144866c47d8a composite
  • actions/setup-python 61a6322f88396a6271a6ee3565807d608ecaddd1 composite
.github/workflows/pkgci_regression_test_amdgpu_vulkan.yml actions
  • actions/checkout 8f4b7f84864484a7bf31766abe9204da3cbe65b3 composite
  • actions/download-artifact 9bc31d5ccc31df68ecc42ccf4149144866c47d8a composite
  • actions/setup-python 61a6322f88396a6271a6ee3565807d608ecaddd1 composite
integrations/pjrt/ctstools/setup.py pypi
integrations/pjrt/python_packages/iree_cpu_plugin/pyproject.toml pypi
integrations/pjrt/python_packages/iree_cpu_plugin/setup.py pypi
integrations/pjrt/python_packages/iree_cuda_plugin/pyproject.toml pypi
integrations/pjrt/python_packages/iree_cuda_plugin/setup.py pypi
integrations/pjrt/python_packages/iree_rocm_plugin/pyproject.toml pypi
integrations/pjrt/python_packages/iree_rocm_plugin/setup.py pypi
integrations/pjrt/python_packages/iree_vulkan_plugin/pyproject.toml pypi
integrations/pjrt/python_packages/iree_vulkan_plugin/setup.py pypi
integrations/pjrt/requirements.txt pypi
  • iree-compiler ==20230922.653
  • jaxlib ==0.4.17.dev20230922
tests/e2e/stablehlo_models/mnist_train_test/generate_test_data_requirements.txt pypi
  • iree-jax 26006ef5842a604e28ea71e65e9224ad20f028e9 test
  • jax ==0.4.2 test
  • numpy ==1.24.2 test