Data

Tools

Indexes

Applications

Experiments

Open Source Science

id-abusive-language-detection

The Dataset for Abusive Language Detection in Indonesian Social Media

https://github.com/okkyibrohim/id-abusive-language-detection

Science Score: 41.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: sciencedirect.com
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (9.1%) to scientific vocabulary
Last synced: 10 months ago · JSON representation ·

Repository

The Dataset for Abusive Language Detection in Indonesian Social Media

Basic Info
  • Host: GitHub
  • Owner: okkyibrohim
  • Language: TeX
  • Default Branch: master
  • Size: 134 KB
Statistics
  • Stars: 26
  • Watchers: 0
  • Forks: 9
  • Open Issues: 0
  • Releases: 0
Created about 8 years ago · Last pushed over 6 years ago
Metadata Files
Readme Citation

README.md

id-abusive-language-detection

About this data

Here we provide our dataset for abusive language detection in the Indonesian language. This dataset is provided in two types of labeling: * In redatasettwo_labels.csv, the dataset coded into two labels, that are 1 (not abusive language) and 2 (abusive language); * In redatasetthree_labels.csv, the dataset coded into three labels, that are 1 (not abusive language), 2 (abusive but not offensive), and 3 (offensive language).

Due to the Twitter's Terms of Service, we do not provide the tweet ID. All username and URL in this dataset are changed into USER and URL.

For text normalization in our experiment, we build small typo and slang words dictionaries named kamusalay.csv, that contain two columns (first columns are the typo and slang words, and the second one is the formal words). Here the examples of mapping: * beud --> banget * jgn --> jangan * loe --> kamu

More detail

If you want to know how this dataset was build (including the explanation of crawling and annotation technique) and how we did our experiment in abusive language detection in Indonesian language using this dataset, you can read our paper in here: https://www.sciencedirect.com/science/article/pii/S1877050918314583.

How to cite us

This dataset can be used for free, but if you want to publish paper/publication using this dataset, please cite this publication:

Ibrohim, M.O., Budi, I.. A Dataset and Preliminaries Study for Abusive Language Detection in Indonesian Social Media. Procedia Computer Science 2018;135:222-229. (Every paper template may have different citation writting. For LaTex user, you can see citation.bib).

License

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Owner

  • Name: Muhammad Okky Ibrohim
  • Login: okkyibrohim
  • Kind: user
  • Location: Turin, Italy
  • Company: Dipartimento di Informatica, Università degli Studi di Torino

PhD Student at Università degli Studi di Torino Contact: muhammadokky.ibrohim@unito.it

Citation (citation.bib) 

@article{IBROHIM2018222,
title = "A Dataset and Preliminaries Study for Abusive Language Detection in Indonesian Social Media",
journal = "Procedia Computer Science",
volume = "135",
pages = "222 - 229",
year = "2018",
note = "The 3rd International Conference on Computer Science and Computational Intelligence (ICCSCI 2018) : Empowering Smart Technology in Digital Era for a Better Life",
issn = "1877-0509",
doi = "https://doi.org/10.1016/j.procs.2018.08.169",
url = "http://www.sciencedirect.com/science/article/pii/S1877050918314583",
author = "Muhammad Okky Ibrohim and Indra Budi",
keywords = "abusive language, twitter, machine learning"
}

GitHub Events

Total
  • Watch event: 1
  • Fork event: 1
Last Year
  • Watch event: 1
  • Fork event: 1