Anira Real-time Principle Check

Introduction

This repository serves as a supplementary resource for the anira library, an architecture for neural network inference in real-time audio application.

This repository contains two validation tests / builds: - validate-anira: validate real-time saftey of the proposed architecture of anira - validate-inference-engines: evaluation of real-time violations of the inference engines: LibTorch, ONNXRuntime, and Tensorflow Lite - evaluate number of violations in multiple inferences - evaluate types of violations in multiple inferences

Tests are conducted under diverse conditions to ensure robust analysis: Each inference engine is evaluated using three models over ten iterations, alongside varied audio processing configurations for adaptability and real-time compliance assessment.

The analysis utilizes code sanitizers specifically designed to detect potential real-time violations during runtime. We leverage RadSan, a real-time safety testing tool optimized for C and C++ environments. RadSan is engineered to identify real-time violations, including but not limited to, memory allocation/deallocation and thread synchronization issues.

How to Use

The tests are currently only supported on macOS, Linux, WSL:

Get Radsan Docker: bash docker pull realtimesanitizer/radsan-clang

Clone repository and get submodules: bash git clone --recursive https://github.com/tu-studio/anira-rt-principle-check/ cd anira-rt-principle-check

Prepare docker: ```bash

Start RadSan docker image with mounted directory

sudo docker run -v $(pwd):/anira-rt-principle-check -it realtimesanitizer/radsan-clang /bin/bash

Install necessary dependencies:

apt-get update && apt-get install -y git cmake ```

Build inside docker: ``` cd anira-rt-principle-check/ cmake . -B cmake-build-release -DCMAKEBUILDTYPE=Release

cmake --build cmake-build-release --config Release --target simple-real-time-violations cmake --build cmake-build-release --config Release --target validate-anira cmake --build cmake-build-release --config Release --target validate-inference-engines Execute: bash RADSANERRORMODE=continue ./cmake-build-release/simple-real-time-violations 2>&1 | tee cmake-build-release/simple-real-time-violations.txt RADSANERRORMODE=continue ./cmake-build-release/validate-anira 2>&1 | tee cmake-build-release/validate-anira.txt RADSANERRORMODE=continue ./cmake-build-release/validate-inference-engines 2>&1 | tee cmake-build-release/validate-inference-engines.txt ```

Contributors

• Valentin Ackva
• Fares Schulz

License

This project is licensed under Apache-2.0.