https://github.com/daniel-furman/nlp-dataset-mixing-experiments

Data-source mixing for social media caption classification

https://github.com/daniel-furman/nlp-dataset-mixing-experiments

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (4.6%) to scientific vocabulary

Keywords

domain-adaptation machine-learning nlp
Last synced: 10 months ago · JSON representation

Repository

Data-source mixing for social media caption classification

Basic Info
  • Host: GitHub
  • Owner: daniel-furman
  • License: mit
  • Language: Jupyter Notebook
  • Default Branch: main
  • Homepage:
  • Size: 7.37 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 2
  • Open Issues: 0
  • Releases: 0
Topics
domain-adaptation machine-learning nlp
Created about 4 years ago · Last pushed about 4 years ago
Metadata Files
Readme License

README.md

NLP-experiments-social-media

Abstract


Domain shift often hinders the predictive performance of machine learning models where it counts most, on unseen data. However, social media datasets in NLP are in general inflexible to domain shift as they are commonly sourced solely from Twitter, which fails to capture the variation of natural language that exists across different social media platforms. Here, we examined the potential of multi-platform mixing for domain adaptation by combining Instagram captions in equal proportion to Tweets for two authorship analysis tasks. The resulting SVM and LR classifiers saw significant boosts in performance when compared to otherwise identical models constructed entirely from Tweets (6% average F1 increase), as measured in cross-domain testing on Facebook captions.

Background Figures


Figure 1: Bert embeddings EDA | Figure 2: Dataframe head :---------------------------------:|:----------------------------------------: |

Results


Figure 3: Modeling experimental results :---------------------------------:

Owner

  • Name: Daniel Furman
  • Login: daniel-furman
  • Kind: user
  • Location: San Francisco
  • Company: @twosixcapital

Master’s student, UC Berkeley School of Information. University of Pennsylvania alum. DS @twosixcapital. Prev MLE @understory.ai.

GitHub Events

Total
Last Year

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 15
  • Total Committers: 1
  • Avg Commits per committer: 15.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Daniel Furman d****n@g****m 15

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels