Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/ami-iit/onnx-cpp-benchmark

Simple tool to profile onnx inference with C++ APIs.

https://github.com/ami-iit/onnx-cpp-benchmark

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.6%) to scientific vocabulary

Keywords

gpu onnx onnxruntime onnxruntime-gpu pixi
Last synced: 6 months ago · JSON representation

Repository

Simple tool to profile onnx inference with C++ APIs.

Basic Info
  • Host: GitHub
  • Owner: ami-iit
  • License: bsd-3-clause
  • Language: C++
  • Default Branch: main
  • Homepage:
  • Size: 80.1 KB
Statistics
  • Stars: 1
  • Watchers: 4
  • Forks: 1
  • Open Issues: 3
  • Releases: 2
Topics
gpu onnx onnxruntime onnxruntime-gpu pixi
Created over 2 years ago · Last pushed over 2 years ago
Metadata Files
Readme License

README.md

onnx-cpp-benchmark

Simple tool to profile onnx inference with C++ APIs.

Installation

With conda-forge dependencies

Linux/macOS

~~~ mamba create -n onnxcppbenchmark compilers cli11 onnxruntime==cuda cmake ninja pkg-config cudnn cudatoolkit onnxruntime-cpp==cuda mamba activate onnxcppbenchmark git clone https://github.com/ami-iit/onnx-cpp-benchmark cd onnx-cpp-benchmark mkdir build cd build cmake -GNinja -DCMAKEINSTALLPREFIX=$CONDA_PREFIX .. ninja ~~~

Windows

~~~ mamba create -n onnxcppbenchmark compilers cli11 onnxruntime==cuda cmake ninja pkg-config cudnn cudatoolkit onnxruntime-cpp==cuda mamba activate onnxcppbenchmark git clone https://github.com/ami-iit/onnx-cpp-benchmark cd onnx-cpp-benchmark mkdir build cd build cmake -GNinja -DCMAKEINSTALLPREFIX=%CONDA_PREFIX%\Library .. ninja ~~~

Usage

Download a simple .onnx file and run the benchmark on it.

```shell curl -L https://huggingface.co/ami-iit/mann/resolve/3a6fa8fe38d39deae540e4aca06063e9f2b53380/ergocubSN00026j49e.onnx -o ergocubSN00026j49e.onnx

Use default options

onnx-cpp-benchmark ergocubSN00026j49e.onnx

Specify custom options

onnx-cpp-benchmark ergocubSN00026j49e.onnx --iterations 100 --batch_size 5 --backend onnxruntimecpu ```

Current supported backends: * onnxruntimecpu : ONNX Runtime with CPU * onnxruntimecuda : ONNX Runtime with CUDA

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

License

BSD 3-Clause

Owner

  • Name: Artificial and Mechanical Intelligence
  • Login: ami-iit
  • Kind: organization
  • Location: Italy

GitHub Events

Total
Last Year

Committers

Last synced: 7 months ago

All Time
  • Total Commits: 8
  • Total Committers: 2
  • Avg Commits per committer: 4.0
  • Development Distribution Score (DDS): 0.125
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Silvio Traversaro s****o@t****t 7
Giovanni Fregonese g****t@g****m 1
Committer Domains (Top 20 + Academic)
traversaro.it: 1

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 5
  • Total pull requests: 8
  • Average time to close issues: 2 months
  • Average time to close pull requests: 13 days
  • Total issue authors: 2
  • Total pull request authors: 2
  • Average comments per issue: 3.6
  • Average comments per pull request: 0.63
  • Merged pull requests: 7
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • traversaro (2)
  • giotherobot (2)
Pull Request Authors
  • traversaro (7)
  • giotherobot (1)
Top Labels
Issue Labels
Pull Request Labels

Dependencies

.github/workflows/ci.yml actions
  • actions/checkout v2 composite