MooBench: A micro-benchmark for performance overhead measurement of observability tools - Release 1.0.2

What's Changed

• Add unit tests using bats, replacing old testCorrectness workflows
• Rename artifacts to avoid calling everything benchmark: benchmark.sh -> measure.sh, tools/benchmark -> tools/SuT-Java, tools/pybenchmark -> SuT-python
• Update github actions: ssh-agent@v0.10.0, setup-java@v5, checkout@v6, R dependency to 4.4.2
• Update java dependencies: logback-classic to 1.5.37, gradlew to 9.6.1

- Shell
Published by DaGeRe 13 days ago

MooBench: A micro-benchmark for performance overhead measurement of observability tools - 1.0.1 Release

• Add CITATION.cff

- Shell
Published by DaGeRe 3 months ago

MooBench: A micro-benchmark for performance overhead measurement of observability tools - 1.0.0 Release

This is the initial stable release of MooBench. It provides the foundation for reproducible observability benchmarking.

It consists of: - System-under-test: Reference applications for both Java and Python. - Usable Automations: Full benchmarking support for: - Java: elasticapm, inspectIT, Kieker, OpenTelemetry, pinpoint, Scouter, Skywalking - Python: OpenTelemetry - Analysis: Integrated scripts for processing and visualizing benchmark results.

The remaining observability benchmarking automations (Kieker-python, SPASSmeter, bpftrace-java) are experimental and not considered stable.

This version allows reproducing the results of Reichelt, D. G., Yang, S., Hansson, M., & Hasselbring, W. (2026). Benchmarking the Overhead of Distributed Tracing Agents. Proceedings of the 17th ACM/SPEC International Conference on Performance Engineering. https://doi.org/10.1145/3777884.3797004

- Shell
Published by DaGeRe 3 months ago