loggzip

https://github.com/brogao/loggzip

Science Score: 31.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (9.0%) to scientific vocabulary

Last synced: 10 months ago · JSON representation ·

Repository

Basic Info

Host: GitHub
Owner: brogao
License: other
Language: Python
Default Branch: master
Size: 3.26 MB

Statistics

Stars: 0
Watchers: 1
Forks: 0
Open Issues: 0
Releases: 0

Created over 2 years ago · Last pushed over 1 year ago

Metadata Files

Readme License Citation

Logparser

We recommend installing the logparser package and requirements via pip install.

This project includes the baseline used in LogGzip.

Log parsers available: Publication Parser Paper Title Benchmark QSIC'08 AEL Abstracting Execution Logs to Execution Events for Enterprise Applications, by Zhen Ming Jiang, Ahmed E. Hassan, Parminder Flora, Gilbert Hamann. CNSM'15 LenMa Length Matters: Clustering System Log Messages using Length of Words, by Keiichi Shima. ↗️ CIKM'16 LogMine LogMine: Fast Pattern Recognition for Log Analytics, by Hossein Hamooni, Biplob Debnath, Jianwu Xu, Hui Zhang, Geoff Jiang, Adbullah Mueen. [NEC] ↗️ ICDM'16 Spell Spell: Streaming Parsing of System Event Logs, by Min Du, Feifei Li. ↗️ ICWS'17 Drain Drain: An Online Log Parsing Approach with Fixed Depth Tree, by Pinjia He, Jieming Zhu, Zibin Zheng, and Michael R. Lyu. ↗️ TSE'20 Logram Logram: Efficient Log Parsing Using n-Gram Dictionaries, by Hetong Dai, Heng Li, Che-Shao Chen, Weiyi Shang, and Tse-Hsun (Peter) Chen. ↗️ TSC'23 Brain Brain: Log Parsing with Bidirectional Parallel Tree, by Siyu Yu, Pinjia He, Ningjiang Chen, Yifan Wu. ↗️

```

In particular, the package depends on the following requirements. Note that regex matching in Python is brittle, so we recommend fixing the regex library to version 2022.3.2.

python 3.8+
regex 2023.10.3
numpy
pandas
scipy
scikit-learn

Get started

Run the benchmark:

For each log parser, we provide a benchmark script to run log parsing on the loghub_24 datasets for evaluating parsing accuarcy. You can also use other benchmark datasets for log parsing.

cd logparser/LogGzip python benchmark.py

Owner

Login: brogao
Kind: user

Repositories: 1
Profile: https://github.com/brogao

Citation (CITATION)

@inproceedings{Logparser,
  author       = {Jieming Zhu and
                  Shilin He and
                  Jinyang Liu and
                  Pinjia He and
                  Qi Xie and
                  Zibin Zheng and
                  Michael R. Lyu},
  title        = {Tools and benchmarks for automated log parsing},
  booktitle    = {Proceedings of the 41st International Conference on Software Engineering:
                  Software Engineering in Practice (ICSE)},
  pages        = {121--130},
  year         = {2019}}

@inproceedings{DSN16,
  author       = {Pinjia He and
                  Jieming Zhu and
                  Shilin He and
                  Jian Li and
                  Michael R. Lyu},
  title        = {An Evaluation Study on Log Parsing and Its Use in Log Mining},
  booktitle    = {Annual {IEEE/IFIP} International Conference on Dependable Systems
                  and Networks (DSN)},
  pages        = {654--661},
  year         = {2016}
}

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science