bars

BARS: Towards Open Benchmarking for Recommender Systems https://openbenchmark.github.io/BARS

https://github.com/reczoo/bars

Science Score: 41.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (8.2%) to scientific vocabulary

Keywords

benchmarking collaborative-filtering ctr-prediction item-matching ranking recommender-system
Last synced: 6 months ago · JSON representation ·

Repository

BARS: Towards Open Benchmarking for Recommender Systems https://openbenchmark.github.io/BARS

Basic Info
  • Host: GitHub
  • Owner: reczoo
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Homepage:
  • Size: 4.24 MB
Statistics
  • Stars: 377
  • Watchers: 4
  • Forks: 60
  • Open Issues: 2
  • Releases: 0
Topics
benchmarking collaborative-filtering ctr-prediction item-matching ranking recommender-system
Created over 5 years ago · Last pushed over 1 year ago
Metadata Files
Readme License Citation

README.md

BARS

BARS is a project aimed for open BenchmArking for Recommender Systems: https://openbenchmark.github.io/BARS

Despite the significant progress made in both research and practice of recommender systems over the past two decades, there is a lack of a widely-recognized benchmark in this field. This not only increases the difficulty in reproducing existing studies, but also incurs inconsistent experimental results among them, which largely limit the practical value and potential impact of research in this field. In this project, we make our initiative efforts towards open benchamrking for recommender systems. The BARS benchmark project allows anyone to easily follow and contribute, and hopefully drive more solid and reproducible research on recommender systems.

The BARS benchmark currently covers the following two tasks.

Ongoing projects:

  • BARS-Rerank: An Open Benchmark for Listwise Reranking
  • BARS-MTL: An Open Benchmark for Multi-Task Recommendation

🔥 Citation

If you find our benchmarks helpful in your research, please kindly cite the following paper.

Jieming Zhu, Quanyu Dai, Liangcai Su, Rong Ma, Jinyang Liu, Guohao Cai, Xi Xiao, Rui Zhang. BARS: Towards Open Benchmarking for Recommender Systems. The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2022. [Bibtex]

Contributing

We welcome any contribution that could help improve the BARS benchmark. Check the start guide on how to contribute.

Discussion

If you have any questions or feedback about the BARS benchamrk, please open a new issue or join our WeChat group.

Scan QR code

Owner

  • Name: RECZOO
  • Login: reczoo
  • Kind: organization

Open Science by XUEPAI

Citation (CITATION)

@incollection{BARS,
  author    = {Jieming Zhu and
               Quanyu Dai and
               Liangcai Su and
               Rong Ma and
               Jinyang Liu and
               Guohao Cai and
               Xi Xiao and
               Rui Zhang},
  title     = {BARS: Towards Open Benchmarking for Recommender Systems},
  booktitle = {The 45th International ACM SIGIR Conference on Research 
               and Development in Information Retrieval (SIGIR'22)},
  year      = {2022}
}

GitHub Events

Total
  • Issues event: 3
  • Watch event: 25
  • Issue comment event: 2
  • Push event: 1
  • Fork event: 3
Last Year
  • Issues event: 3
  • Watch event: 25
  • Issue comment event: 2
  • Push event: 1
  • Fork event: 3

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 177
  • Total Committers: 10
  • Avg Commits per committer: 17.7
  • Development Distribution Score (DDS): 0.638
Past Year
  • Commits: 5
  • Committers: 1
  • Avg Commits per committer: 5.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
xpai 7****i 64
Slc s****3@1****m 47
kremomao k****o@t****m 17
kyriemao k****o@f****m 16
zhujiem z****m@u****o 16
Dansheng 3****g 8
zhujiem 7****m 6
Jamie Zhu j****u 1
xpai x****i@n****m 1
Dansheng s****3@1****m 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 55
  • Total pull requests: 0
  • Average time to close issues: about 1 month
  • Average time to close pull requests: N/A
  • Total issue authors: 26
  • Total pull request authors: 0
  • Average comments per issue: 2.02
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 13
  • Pull requests: 0
  • Average time to close issues: 14 days
  • Average time to close pull requests: N/A
  • Issue authors: 5
  • Pull request authors: 0
  • Average comments per issue: 0.69
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • zhujiem (3)
  • ywangwxd (3)
  • Zeng-B-B (2)
  • lemyx (2)
  • dengyayin (2)
  • houWenK (2)
  • JoshonSmith (2)
  • discivigour (2)
  • Aliang-CN (1)
  • sdfsfdx (1)
  • Xueqi-Li (1)
  • junkangwu (1)
  • lsquser (1)
  • Kailianghu (1)
  • Isuxiz (1)
Pull Request Authors
Top Labels
Issue Labels
documentation (1)
Pull Request Labels

Dependencies

candidate_matching/libs/CollMetric/requirements.txt pypi
  • numpy *
  • scikit-learn *
  • scipy *
  • tensorflow *
  • toolz *
  • tqdm *