online-root-cause-analysis

Online concept drift detection and explanation.

https://github.com/giobbu/online-root-cause-analysis

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (8.7%) to scientific vocabulary

Keywords

kafka-producer online-change-point-detection spark-streaming-consumer streaming-data
Last synced: 6 months ago · JSON representation ·

Repository

Online concept drift detection and explanation.

Basic Info
  • Host: GitHub
  • Owner: giobbu
  • License: gpl-3.0
  • Language: Jupyter Notebook
  • Default Branch: main
  • Homepage:
  • Size: 4.35 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Topics
kafka-producer online-change-point-detection spark-streaming-consumer streaming-data
Created 9 months ago · Last pushed 8 months ago
Metadata Files
Readme License Citation

README.md

Status License: GPL v3

Online Root Cause Analysis

Docker Setup

Installation

Check if Docker Compose is installed: bash docker-compose -v If not installed, follow the Docker Getting Started Docs.

Built Image

To build the image:

bash docker-compose build

Check that the image has been successfully pulled:

bash docker image list

Example output:

bash REPOSITORY TAG IMAGE ID CREATED SIZE giobbu/kafka-spark-app latest <containerId> About an hour ago 10.6GB

Run the Application

To start the container:

bash docker-compose run --rm app * --rm: flag to remove the container after it stops.

Start Zookeper and Kafka services

Logged as root user in usr/bin start kafka server

bash start_services.sh

Check kafka.log and zookeeper.log are in home/guest

bash anaconda3 kafka kafka.log notebooks spark zookeeper.log

Spark Installation

In home/guest

bash pyspark --version

Output

``bash Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _/ / '_/ // ./_,// //_\ version 3.5.6 /_/

Using Scala version 2.12.18, OpenJDK 64-Bit Server VM, 11.0.25 ```

Start Jupyter Notebook

Switch to guest user bash su guest And start jupyter notebook

bash notebook Connect to http://127.0.0.1:8889/tree?token=<token>

Docker Configuration Details (TODO)

Dockerfile

Docker-Compose

  • Services
  • Volume

Owner

  • Name: Giovanni Buroni
  • Login: giobbu
  • Kind: user
  • Location: Lisbon, Portugal

Citation (CITATION.cff)

cff-version: 1.2.0
title: Online Root Cause Analysis
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Giovanni
    family-names: Buroni
    email: giovanniburoni@gmail.com
    name-particle: giovanni
identifiers:
  - type: url
    value: 'https://github.com/giobbu'
repository-code: 'https://github.com/giobbu/online-root-cause-analysis'
abstract: Online concept drift detection and root cause analysis.
keywords:
  - Concept-Drift
  - Streaming-Analytics
  - Root-Cause-Analysis
license: GPL-3.0
commit: 6e2992e
version: 0.1.0-alpha
date-released: '2025-06-10'

GitHub Events

Total
  • Issues event: 6
  • Push event: 26
  • Create event: 2
Last Year
  • Issues event: 6
  • Push event: 26
  • Create event: 2

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 26
  • Total Committers: 1
  • Avg Commits per committer: 26.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 26
  • Committers: 1
  • Avg Commits per committer: 26.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
giobbu g****i@g****m 26

Issues and Pull Requests

Last synced: 8 months ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • giobbu (5)
Pull Request Authors
Top Labels
Issue Labels
enhancement (2) documentation (1) bug (1)
Pull Request Labels

Dependencies

Dockerfile docker
  • rockylinux 8 build
docker-compose.yml docker
  • giobbu/kafka-spark-app latest