Data

Tools

Indexes

Applications

Experiments

Open Source Science

snowman

Welcome to Snowman App – a Data Matching Benchmark Platform.

https://github.com/hpi-information-systems/snowman

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (16.4%) to scientific vocabulary

Keywords

benchmark data-matching data-stewards duplicate-detection entity-resolution kpis matching snowman
Last synced: 6 months ago · JSON representation

Repository

Welcome to Snowman App – a Data Matching Benchmark Platform.

Basic Info
Statistics
  • Stars: 38
  • Watchers: 6
  • Forks: 2
  • Open Issues: 54
  • Releases: 14
Topics
benchmark data-matching data-stewards duplicate-detection entity-resolution kpis matching snowman
Created about 5 years ago · Last pushed about 3 years ago
Metadata Files
Readme License Citation

README.md

logo

Snowman

General Documentation Release

Comparing data matching algorithms is still an unsolved topic in both industry and research. With snowman, developers and researchers are able to compare the performance of different data matching solutions or improve new algorithms. Besides traditional metrics, the tool also considers economic aspects like Soft KPIs.

Benchmark Dashboard

This tool is developed as part of a bachelor's project in collaboration with SAP SE.

Research Project

This tool has been published as part of the the paper "Frost: Benchmarking and Exploring Data Matching Results" (2022) at VLDB. More details on reproducing results shown within the paper can found here.

Current state

In Q1 and Q2 of 2021, we reached the following milestones:

[x] Milestone 1: Ability to add/delete datasets, experiments and matching solutions; binary comparison and basic behavior analysis; executable on all major platform
[x] Milestone 2: Compare more than two experiments and create new experiments based on results; survey Soft KPIs, allow comparison based on KPIs
[x] Milestone 3: Allow individual thresholds for experiments, extend Soft KPIs further and allow advanced evaluation of matching solutions

The precise progress is tracked through Github issues and project boards. Please get in touch in case you want a special feature included :)

After reaching milestone 3, we plan to continue to work on further features which will broaden the tools abilities and features.

Showcase

To show off some key features that Snowman offers, we created a small introductory video:

Snowman Showcase

Contributing

Contribution guidelines will follow soon. Until then, feel free to open an issue to report a bug or request a feature.
In case you want to contribute code, please first open an associated issue and afterwards a pull request containing the proposed solution.

Development

See our development guide for more information on how to get started.

Documentation

Please see our documentation for further information: Snowman Docs

Licenses

Copyright 2021 Hasso Plattner Institute. Licensed under the MIT license.

A complete list of all dependencies and their individual licenses can be found within our documentation.

Owner

  • Name: Information Systems at HPI
  • Login: HPI-Information-Systems
  • Kind: organization
  • Email: felix.naumann@hpi.de
  • Location: Germany

Ensuring reproducibility for all of our research

GitHub Events

Total
  • Watch event: 1
Last Year
  • Watch event: 1

Dependencies

app/package-lock.json npm
  • 1607 dependencies
app/package.json npm
  • @craco/craco ^6.1.1 development
  • @testing-library/jest-dom ^5.11.6 development
  • @testing-library/react ^11.2.2 development
  • @testing-library/user-event ^12.6.0 development
  • @types/d3 ^6.3.0 development
  • @types/file-saver ^2.0.2 development
  • @types/jest ^26.0.19 development
  • @types/katex ^0.11.0 development
  • @types/lodash ^4.14.167 development
  • @types/papaparse ^5.2.5 development
  • @types/react ^16.14.2 development
  • @types/react-beautiful-dnd ^13.0.0 development
  • @types/react-dom ^16.9.10 development
  • @types/react-redux ^7.1.14 development
  • @types/react-table ^7.0.29 development
  • @types/react-virtualized ^9.21.10 development
  • @types/react-window ^1.8.2 development
  • @types/redux ^3.6.0 development
  • @types/redux-thunk ^2.1.0 development
  • typescript ^4.1.3 development
  • webpack 4.44.2 development
  • @ionic/react ^5.0.7
  • @types/react-beautiful-dnd ^13.0.0
  • @types/react-table ^7.0.29
  • @types/react-window ^1.8.2
  • auto-bind ^4.0.0
  • chart.js ^3.0.2
  • d3 ^6.6.0
  • file-saver ^2.0.5
  • immer ^9.0.6
  • immutable ^4.0.0-rc.12
  • ionicons ^5.4.0
  • katex ^0.12.0
  • lodash ^4.17.20
  • react ^17.0.1
  • react-beautiful-dnd ^13.0.0
  • react-dom ^17.0.1
  • react-elastic-carousel ^0.11.0
  • react-redux ^7.2.2
  • react-scripts 4.0.1
  • react-table ^7.6.3
  • react-toastify ^7.0.3
  • react-tooltip ^4.2.14
  • react-virtualized ^9.22.3
  • react-window ^1.8.6
  • redux ^4.0.5
  • redux-devtools-extension ^2.13.9
  • redux-thunk ^2.3.0
  • snowman-library file:../library
  • styled-components ^5.2.1
  • ts-enum-util ^4.0.2
library/package-lock.json npm
  • balanced-match 1.0.2 development
  • brace-expansion 1.1.11 development
  • concat-map 0.0.1 development
  • fs.realpath 1.0.0 development
  • glob 7.1.6 development
  • inflight 1.0.6 development
  • inherits 2.0.4 development
  • minimatch 3.0.4 development
  • once 1.4.0 development
  • path-is-absolute 1.0.1 development
  • rimraf 3.0.2 development
  • typescript 4.2.4 development
  • wrappy 1.0.2 development
library/package.json npm
  • rimraf ^3.0.2 development
  • typescript ^4.1.3 development
package-lock.json npm
  • 1736 dependencies
package.json npm
  • @types/react-dom ^17.0.0 development
  • @typescript-eslint/eslint-plugin ^4.10.0 development
  • @typescript-eslint/parser ^4.10.0 development
  • cpx ^1.5.0 development
  • eslint ^7.15.0 development
  • eslint-config-prettier ^7.0.0 development
  • eslint-config-react ^1.1.7 development
  • eslint-plugin-prettier ^3.3.0 development
  • eslint-plugin-react ^7.21.5 development
  • eslint-plugin-simple-import-sort ^7.0.0 development
  • npm-license-crawler ^0.2.1 development
  • prettier ^2.2.1 development
  • react ^17.0.1 development
  • react-dom ^17.0.1 development
  • react-scripts 4.0.1 development
  • start-server-and-test ^1.12.0 development
  • stylelint ^13.8.0 development
  • stylelint-config-property-sort-order-smacss ^7.0.0 development
  • stylelint-config-standard ^20.0.0 development
  • typescript ^4.1.3 development
requirements.txt pypi
  • mkdocs *
  • mkdocs-material *
.github/workflows/docs.yml actions
  • actions/cache v2 composite
  • actions/checkout v2 composite
  • actions/setup-node v1 composite
  • actions/setup-python v2 composite
.github/workflows/general.yml actions
  • actions/cache v2 composite
  • actions/checkout v2 composite
  • actions/setup-node v1 composite
.github/workflows/package.yml actions
  • actions/cache v2 composite
  • actions/checkout v2 composite
  • actions/setup-node v1 composite
  • actions/upload-artifact v2 composite
.github/workflows/release.yml actions
  • actions/cache v2 composite
  • actions/checkout v2 composite
  • actions/download-artifact v2 composite
  • actions/setup-node v1 composite
  • actions/upload-artifact v2 composite
  • softprops/action-gh-release v1 composite
wrapper/package-lock.json npm
  • 915 dependencies
wrapper/package.json npm
  • @types/better-sqlite3 ^7.5.0 development
  • @types/chmodr ^1.0.0 development
  • @types/cookie-parser ^1.4.2 development
  • @types/cors ^2.8.9 development
  • @types/dashdash ^1.14.0 development
  • @types/express ^4.17.9 development
  • @types/jest ^26.0.20 development
  • @types/lru-cache ^5.1.0 development
  • @types/node ^14.14.14 development
  • @types/rimraf ^3.0.0 development
  • @types/tmp ^0.2.0 development
  • electron ^18.2.0 development
  • electron-builder ^23.0.3 development
  • electron-rebuild ^3.2.7 development
  • jest ^26.6.3 development
  • rimraf ^3.0.2 development
  • run-script-os ^1.1.5 development
  • ts-jest ^26.4.4 development
  • typescript ^4.1.3 development
  • axios ^0.21.1
  • better-sqlite3 ^7.5.1
  • binary-search ^1.3.6
  • chmodr git+https://github.com/phpfs/chmodr.git
  • cookie-parser ^1.4.4
  • cors ^2.8.5
  • csv-parse ^4.15.1
  • csv-stringify ^5.6.1
  • dashdash ^2.0.0
  • express ^4.16.4
  • express-openapi-validator ^4.10.10
  • fs-extra ^9.1.0
  • lru-cache ^6.0.0
  • rxjs ^6.6.6
  • snowman-library file:../library
  • tmp ^0.2.1
  • topological-sort ^0.3.0
  • wait-for-localhost ^3.3.0
  • winston ^3.2.1