Data

Tools

Indexes

Applications

Experiments

Open Source Science

comstream

In this project, we implemented a topic detection system on Twitter. This system reads tweets from a data stream and assigns them to one of the existing clusters or a new one. Each cluster acts as an agent, which makes the proposed approach a multi-agent system. There is also a coordinator, who monitors the whole system and coordinates the agent.

https://github.com/alinajafi1998/comstream

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 1 DOI reference(s) in README
  • ✓
    Academic publication links
    Links to: springer.com
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.7%) to scientific vocabulary

Keywords

clustering-algorithm data-stream elixir labse multi-agent nlp topic-detection
Last synced: 6 months ago · JSON representation ·

Repository

In this project, we implemented a topic detection system on Twitter. This system reads tweets from a data stream and assigns them to one of the existing clusters or a new one. Each cluster acts as an agent, which makes the proposed approach a multi-agent system. There is also a coordinator, who monitors the whole system and coordinates the agent.

Basic Info
  • Host: GitHub
  • Owner: AliNajafi1998
  • License: mit
  • Language: Python
  • Default Branch: Labse
  • Homepage:
  • Size: 1.66 MB
Statistics
  • Stars: 26
  • Watchers: 3
  • Forks: 6
  • Open Issues: 0
  • Releases: 0
Topics
clustering-algorithm data-stream elixir labse multi-agent nlp topic-detection
Created over 5 years ago · Last pushed over 3 years ago
Metadata Files
Readme License Citation

README.md

ComStream


Introduction:

In this project, we implemented a topic detection system on Twitter. This system reads tweets from a data stream, and assigns them to one of the existing clusters or a new one. Each cluster acts as an agent, which makes the proposed approach a multi-agent system. There is also a coordinator, who monitors the whole system and coordinates the agent.The proposed approach has been experimented on two datasets: The COVID-19 and the FA CUP. This project has been explained with greater detail in a paper, publicly available in ComStreamClust .

System Overview

logo

How to use the code ? :hugs:

Data file must be a pandas DataFrame in pickle format having these columns :

  • text
  • created_at
  • status_id

For example : example

warning: Data must be sorted based on created_at in ascending order

Requirements

  • pandas
  • colorama

Contributers:

Owner

  • Name: Ali Najafi
  • Login: AliNajafi1998
  • Kind: user
  • Location: Istanbul, Turkey

Machine Learning Engineer - MSc Computer Science - Sabanci University

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Najafi"
  given-names: "Ali"
  orcid: "http://orcid.org/0000-0001-5304-2456"

- family-names: "Gholipour-Shilabin"
  given-names: "Araz"
 
- family-names: "Dehkharghani"
  given-names: "Rahim"
  
- family-names: "Mohammadpur-Fard"
  given-names: "Ali"
  
- family-names: "Asgari-Chenaghlu"
  given-names: "Meysam"
  
title: "ComStreamClust: a Communicative Multi-Agent Approach to Text Clustering in Streaming Data"
version: 2.0.4
doi: 10.1007/s40745-022-00426-4
date-released: 2022-06-10
url: "https://github.com/AliNajafi1998/ComStream"

GitHub Events

Total
  • Watch event: 1
  • Fork event: 1
Last Year
  • Watch event: 1
  • Fork event: 1