roar-benchmark

A Benchmark for NFT Rarity Meters

https://github.com/fasghq/roar-benchmark

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (7.8%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

A Benchmark for NFT Rarity Meters

Basic Info
  • Host: GitHub
  • Owner: fasghq
  • License: mit
  • Language: Python
  • Default Branch: main
  • Size: 119 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 2 years ago · Last pushed about 2 years ago
Metadata Files
Readme License Citation

README.md

ROAR

A Benchmark for NFT Rarity Meters.

Installation

```console

Clone a repo

git clone https://github.com/fasghq/ROAR-benchmark.git

Create virtual envoronment and install required packages

python3 -m venv roar-venv source roar-venv/bin/activate pip3 install -r requirements.txt ```

Verification of rarity meters implementations

As part of our benchmark showcase, we also performed a set of verification experiments to ensure the accuracy of our implementation. Custom implementations of OpenRarity, rarity.tools, NFTGo and Kramer can be found in the performance_evaluation directory.

The command for running verification tests:

console python -m pytest examples

Results

To visualize the comparison of rarity meters on the entire dataset, we use performance profiles.

Assume we have $C$ NFT collections: $\mathbb{X}^1, \ldots, \mathbb{X}^C$. Denote the performance measure of m-th rarity meter $Rm$ on c-th collection $\mathbb{X}^c$ as $F{m, c} = F(R_m; \mathbb{X}^c)$.

Then, performance profile of rarity meter $Rm$ in a rarity meter set $R1, \ldots, R_m$ on ROAR benchmark is defined as:

$$ \rho(\tau; Rm) = \dfrac{1}{C} \sum \limits{c = 1}^{C} [ F{m, c} + \tau \geq \max{ ( F{i, c} ) }_{i = 1}^{M} ] $$

The results can be seen on the graph below:

Rarity meters performance profiles for ROAR benchmark

Citation

TODO

Owner

  • Name: Dmitry
  • Login: fasghq
  • Kind: user

GitHub Events

Total
Last Year

Dependencies

examples/node_modules/@nftgo/gorarity/dist/cjs/package.json npm
examples/node_modules/@nftgo/gorarity/dist/mjs/package.json npm
examples/node_modules/@nftgo/gorarity/package.json npm
  • @types/jest ^29.4.0 development
  • @types/node ^18.14.0 development
  • @typescript-eslint/eslint-plugin ^5.52.0 development
  • @typescript-eslint/parser ^5.52.0 development
  • eslint ^8.34.0 development
  • eslint-config-prettier ^8.6.0 development
  • eslint-plugin-prettier ^4.2.1 development
  • husky ^8.0.0 development
  • jest 29.4.0 development
  • onchange ^7.1.0 development
  • prettier ^2.8.4 development
  • ts-jest ^29.0.5 development
  • ts-node ^10.9.1 development
  • typescript 4.9.5 development
examples/node_modules/data-uri-to-buffer/package.json npm
  • @types/jest ^27.0.2 development
  • @types/node ^12.20.36 development
  • jest ^27.3.1 development
  • ts-jest ^27.0.7 development
  • typescript ^4.4.4 development
examples/node_modules/fetch-blob/package.json npm
  • @types/node ^17.0.9 development
  • c8 ^7.11.0 development
  • typescript ^4.5.4 development
  • node-domexception ^1.0.0
  • web-streams-polyfill ^3.0.3
examples/node_modules/formdata-polyfill/package.json npm
  • @types/google-closure-compiler ^0.0.19 development
  • @types/node ^16.7.10 development
  • google-closure-compiler ^20210808.0.0 development
  • fetch-blob ^3.1.2
examples/node_modules/node-domexception/package.json npm
examples/node_modules/node-fetch/package.json npm
  • abort-controller ^3.0.0 development
  • abortcontroller-polyfill ^1.7.1 development
  • busboy ^1.4.0 development
  • c8 ^7.7.2 development
  • chai ^4.3.4 development
  • chai-as-promised ^7.1.1 development
  • chai-iterator ^3.0.2 development
  • chai-string ^1.5.0 development
  • coveralls ^3.1.0 development
  • form-data ^4.0.0 development
  • formdata-node ^4.2.4 development
  • mocha ^9.1.3 development
  • p-timeout ^5.0.0 development
  • stream-consumers ^1.0.1 development
  • tsd ^0.14.0 development
  • xo ^0.39.1 development
  • data-uri-to-buffer ^4.0.0
  • fetch-blob ^3.1.4
  • formdata-polyfill ^4.0.10
examples/node_modules/web-streams-polyfill/es2018/package.json npm
examples/node_modules/web-streams-polyfill/es6/package.json npm
examples/node_modules/web-streams-polyfill/package.json npm
  • @microsoft/api-extractor ^7.13.4 development
  • @rollup/plugin-inject ^4.0.2 development
  • @rollup/plugin-replace ^2.4.2 development
  • @rollup/plugin-strip ^2.0.0 development
  • @rollup/plugin-typescript ^8.2.1 development
  • @types/node ^14.14.37 development
  • @typescript-eslint/eslint-plugin ^4.21.0 development
  • @typescript-eslint/parser ^4.21.0 development
  • @ungap/promise-all-settled ^1.1.2 development
  • eslint ^7.23.0 development
  • jasmine ^3.7.0 development
  • micromatch ^4.0.2 development
  • rollup ^2.44.0 development
  • rollup-plugin-terser ^7.0.2 development
  • ts-morph ^10.0.2 development
  • tslib ^2.2.0 development
  • typescript ^4.2.4 development
  • wpt-runner ^3.2.1 development
examples/node_modules/web-streams-polyfill/ponyfill/es2018/package.json npm
examples/node_modules/web-streams-polyfill/ponyfill/es6/package.json npm
examples/node_modules/web-streams-polyfill/ponyfill/package.json npm
examples/package-lock.json npm
  • @nftgo/gorarity 1.0.1
  • data-uri-to-buffer 4.0.1
  • fetch-blob 3.2.0
  • formdata-polyfill 4.0.10
  • node-domexception 1.0.0
  • node-fetch 3.3.2
  • web-streams-polyfill 3.2.1
examples/package.json npm
  • @nftgo/gorarity ^1.0.1
  • node-fetch ^3.3.2
requirements.txt pypi
  • iniconfig ==2.0.0
  • natsort ==8.4.0
  • numpy ==1.26.4
  • packaging ==24.0
  • pandas ==2.2.2
  • pluggy ==1.4.0
  • pytest ==8.1.1
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.1
  • six ==1.16.0
  • tqdm ==4.66.2
  • tzdata ==2024.1