https://github.com/dimits-ts/synthetic_moderation_experiments
Experiments relating to synthetic LLM user-agents and LLM facilitators in online discussions
https://github.com/dimits-ts/synthetic_moderation_experiments
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (4.9%) to scientific vocabulary
Keywords
Repository
Experiments relating to synthetic LLM user-agents and LLM facilitators in online discussions
Basic Info
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Topics
Metadata Files
README.md
Evaluating Online Moderation Strategies Through Synthetic Discussion Generation
Synthetic dataset generation using the SynDisco library. Experiments exploring the effect of various LLM moderation strategies in online conversations.
Project Structure
run.pyExecution scriptdata/Input and output data of the experimentsdata/annotation_input/Configuration files for the synthetic annotation jobsdata/annotation_output/Annotation output (JSON format)data/discussions_input/Configuration files for the synthetic discussion jobsdata/discussions_output/Logs of the executed synthetic discussions (JSON format)data/datasets/Exported CSV datasets (original + ablation)data/run_configs/YAML configuration files for running the experiments
notebooks/Analyzing the experimentsnotebooks/tasks/Shared notebook modulesnotebooks/ablation.ipynbAblation studynotebooks/moderation.ipynbModerator intervention analysisnotebooks/timeseries.ipynbTimeseries analysis of synthetic discussionsnotebooks/toxicity_aq.ipynbGeneral discussion quality analysis
graphs/Exported graphs used in the paper
Owner
- Name: Dimitris Tsirmpas
- Login: dimits-ts
- Kind: user
- Repositories: 1
- Profile: https://github.com/dimits-ts
I like playing around with data and building stuff.
GitHub Events
Total
- Issues event: 1
- Delete event: 20
- Issue comment event: 4
- Push event: 169
- Pull request event: 40
- Create event: 24
Last Year
- Issues event: 1
- Delete event: 20
- Issue comment event: 4
- Push event: 169
- Pull request event: 40
- Create event: 24
Committers
Last synced: over 1 year ago
Top Committers
| Name | Commits | |
|---|---|---|
| Dimitris Tsirmpas | t****m@g****m | 13 |
| Dimitris Tsirmpas | 7****s | 1 |
Issues and Pull Requests
Last synced: 6 months ago
All Time
- Total issues: 1
- Total pull requests: 43
- Average time to close issues: N/A
- Average time to close pull requests: 1 minute
- Total issue authors: 1
- Total pull request authors: 1
- Average comments per issue: 0.0
- Average comments per pull request: 0.0
- Merged pull requests: 39
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 1
- Pull requests: 43
- Average time to close issues: N/A
- Average time to close pull requests: 1 minute
- Issue authors: 1
- Pull request authors: 1
- Average comments per issue: 0.0
- Average comments per pull request: 0.0
- Merged pull requests: 39
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- NielsRogge (1)
Pull Request Authors
- dimits-ts (45)