Data

Tools

Indexes

Applications

Experiments

Open Source Science

eyes

Public Opinion Mining System of Taiwanese Forums

https://github.com/r05323028/eyes

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (8.5%) to scientific vocabulary

Keywords

crawler data-engineering data-mining data-science graphql javascript natural-language-processing opinion-mining public-opinion python react redux tailwindcss task-queue
Last synced: 6 months ago · JSON representation ·

Repository

Public Opinion Mining System of Taiwanese Forums

Basic Info
Statistics
  • Stars: 120
  • Watchers: 3
  • Forks: 18
  • Open Issues: 0
  • Releases: 4
Topics
crawler data-engineering data-mining data-science graphql javascript natural-language-processing opinion-mining public-opinion python react redux tailwindcss task-queue
Created over 4 years ago · Last pushed over 3 years ago
Metadata Files
Readme License Code of conduct Citation Authors

README.md

DOI Release License Testing Coverage

eyes is a Public Opinion Mining System focusing on taiwanese forums such as PTT, Dcard.

Features

  • :fire: Article monitor: helps you capture the trend at a glance.
  • :fire: Entity monitor: helps you spy on a specific entity.
  • :fire: Weak supervision: let you generate & update model without human effort.
  • :fire: Well-integrated with spaCy: let you train models by yourself or use trained models in model hub simply.

Screenshots

Articles Dashboard Post Modal Entities Dashboard Entity Dashboard Entity Timeline

Architecture

eyes system architecture

Architecture

Tech Stack

Infrastructure

  • Argo Workflows
  • Celery, Flower
  • Kubernetes, Helm Charts
  • MySQL
  • Redis

API

  • FastAPI
  • SQLAlchemy ORM
  • GraphQL

Web

  • React + Redux-Saga
  • Tailwindcss

ML

  • spaCy
  • skweak

License

MIT

Owner

  • Name: Sean
  • Login: r05323028
  • Kind: user
  • Location: Taipei, Taiwan
  • Company: TSMC

Software Engineer @TSMC, ex-Data Scientist @kklab-com. MS degree @ NTU, Taiwan. Interested in Machine Learning, Natural Language Processing, Data Science.

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
  - family-names: "Sean"
    given-names: "Chang"
    orcid: "https://orcid.org/0000-0002-2620-5878"
title: "Eyes: Taiwanese Public Opinion Mining System"
version: 0.1.0-alpha.4
doi: 10.5281/zenodo.5590319
date-released: 2021-10-22
url: "https://github.com/r05323028/eyes"

GitHub Events

Total
  • Watch event: 2
Last Year
  • Watch event: 2

Dependencies

web/package-lock.json npm
  • 1623 dependencies
web/package.json npm
  • autoprefixer ^9.8.6 development
  • eslint ^7.32.0 development
  • postcss ^7.0.36 development
  • tailwindcss npm:@tailwindcss/postcss7-compat@^2.2.8 development
  • @apollo/client ^3.4.10
  • @craco/craco ^6.2.0
  • @nivo/core ^0.73.0
  • @nivo/line ^0.73.0
  • @reduxjs/toolkit ^1.6.1
  • @tailwindcss/typography ^0.4.1
  • @testing-library/jest-dom ^5.11.4
  • @testing-library/react ^11.1.0
  • @testing-library/user-event ^12.1.10
  • axios ^0.21.4
  • daisyui ^1.14.0
  • graphql ^15.5.3
  • javascript-color-gradient ^1.3.2
  • lodash ^4.17.21
  • moment ^2.29.1
  • prop-types ^15.7.2
  • react ^17.0.2
  • react-dom ^17.0.2
  • react-redux ^7.2.5
  • react-router-dom ^5.2.1
  • react-scripts 4.0.3
  • react-sigma ^1.2.35
  • react-use ^17.3.1
  • redux ^4.1.1
  • redux-saga ^1.1.3
  • web-vitals ^1.0.1
web/yarn.lock npm
  • 1623 dependencies
poetry.lock pypi
  • 121 dependencies
pyproject.toml pypi
  • Sphinx ^4.1.2 develop
  • isort ^5.9.3 develop
  • pre-commit ^2.15.0 develop
  • pylint ^2.9.6 develop
  • pytest ^6.0 develop
  • pytest-cov ^2.12.1 develop
  • yapf ^0.31.0 develop
  • PyYAML ^5.4.1
  • SQLAlchemy ^1.4.22
  • SQLAlchemy-Utils ^0.37.8
  • bs4 ^0.0.1
  • celery ^5.1.2
  • click ^7.0
  • fake-useragent ^0.1.11
  • fastapi ^0.68.1
  • flower ^1.0.0
  • graphene ^2.1.9
  • graphene-sqlalchemy ^2.3.0
  • lxml ^4.6.3
  • mysqlclient ^2.0.3
  • pydantic ^1.8.2
  • python ~3.7
  • python-dotenv ^0.19.0
  • requests ^2.26.0
  • rich ^10.6.0
  • skweak ^0.2.13
  • spacy ^3.1.2
  • uvicorn ^0.15.0