https://github.com/ai-forever/ruscode

Official repository for RusCode benchmark dataset (NAACL 2025)

https://github.com/ai-forever/ruscode

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (6.8%) to scientific vocabulary

Keywords

benchmark dataset kandinsky naacl2025 russian-dataset text-to-image
Last synced: 5 months ago · JSON representation

Repository

Official repository for RusCode benchmark dataset (NAACL 2025)

Basic Info
  • Host: GitHub
  • Owner: ai-forever
  • Default Branch: main
  • Homepage:
  • Size: 1.5 MB
Statistics
  • Stars: 4
  • Watchers: 4
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Topics
benchmark dataset kandinsky naacl2025 russian-dataset text-to-image
Created about 1 year ago · Last pushed about 1 year ago
Metadata Files
Readme

README.md

RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation

Official repository for RusCode benchmark dataset (NAACL 2025)

Text-to-image generation models have gained popularity among users around the world. However, many of these models exhibit a strong bias toward English-speaking cultures, ignoring or misrepresenting the unique characteristics of other language groups, countries, and nationalities. The lack of cultural awareness can reduce the generation quality and lead to undesirable consequences such as unintentional insult, and the spread of prejudice. In contrast to the field of natural language processing, cultural awareness in computer vision has not been explored as extensively.

We propose a RusCode benchmark for evaluating the quality of text-to-image generation containing elements of the Russian cultural code. To do this, we form a list of 19 categories that best represent the features of Russian visual culture. Our final dataset consists of 1250 text prompts in Russian and their translations into English. The prompts cover a wide range of topics, including complex concepts from art, popular culture, folk traditions, famous people's names, natural objects, scientific achievements, etc.

Categories

categories

References

references

Statistic

The ratio of the number of collected prompts by each category in the RusCode dataset ruscode

Citation

You can cite the paper using the following BibTeX entry:

@misc{vasilev2025ruscoderussianculturalcode,
  title={RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation}, 
  author={Viacheslav Vasilev and Julia Agafonova and Nikolai Gerasimenko and Alexander Kapitanov and Polina Mikhailova and Evelina Mironova and Denis Dimitrov},
  year={2025},
  eprint={2502.07455},
  archivePrefix={arXiv},
  primaryClass={cs.CV},
  url={https://arxiv.org/abs/2502.07455}, 
}

Owner

  • Name: AI Forever
  • Login: ai-forever
  • Kind: organization
  • Location: Armenia

Creating ML for the future. AI projects you already know. We are non-profit organization with members from all over the world.

GitHub Events

Total
  • Watch event: 3
  • Member event: 1
  • Push event: 4
  • Create event: 2
Last Year
  • Watch event: 3
  • Member event: 1
  • Push event: 4
  • Create event: 2

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 5
  • Total Committers: 2
  • Avg Commits per committer: 2.5
  • Development Distribution Score (DDS): 0.4
Past Year
  • Commits: 5
  • Committers: 2
  • Avg Commits per committer: 2.5
  • Development Distribution Score (DDS): 0.4
Top Committers
Name Email Commits
vivasilev s****8@y****u 3
Alexander Kapitanov s****r@b****u 2
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 8 months ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels