Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/altaris/ielove-scraper

ielove.co.jp scraper

https://github.com/altaris/ielove-scraper

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.9%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

ielove.co.jp scraper

Basic Info
  • Host: GitHub
  • Owner: altaris
  • License: mit
  • Language: Python
  • Default Branch: main
  • Size: 268 KB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created almost 3 years ago · Last pushed over 1 year ago
Metadata Files
Readme Changelog License

README.md

ielove

Python 3 License Code style

ielove.co.jp scraper

Howto

Start a celery worker

sh . ./secret.env export MONGO_USER=$MONGO_INITDB_ROOT_USERNAME export MONGO_PASSWORD=$MONGO_INITDB_ROOT_PASSWORD celery -A ielove.tasks worker --loglevel=INFO

Scrape a property page

sh python3 -m ielove get-property https://www.ielove.co.jp/chintai/c1-397758400

If commiting to database:

sh . ./secret.env export MONGO_USER=$MONGO_INITDB_ROOT_USERNAME export MONGO_PASSWORD=$MONGO_INITDB_ROOT_PASSWORD python3 -m ielove get-property --commit https://www.ielove.co.jp/chintai/c1-397758400

Start the webui

sh python3 -m ielove.webui

Contributing

Dependencies

  • python3.10 or newer;
  • requirements.txt for runtime dependencies;
  • requirements.dev.txt for development dependencies.
  • make (optional);

Simply run

sh virtualenv venv -p python3.10 . ./venv/bin/activate pip install --upgrade pip pip install -r requirements.txt pip install -r requirements.dev.txt

Documentation

Simply run

sh make docs

This will generate the HTML doc of the project, and the index file should be at docs/index.html. To have it directly in your browser, run

sh make docs-browser

Code quality

Don't forget to run

sh make

to format the code following black, typecheck it using mypy, and check it against coding standards using pylint.

Owner

  • Name: Cédric
  • Login: altaris
  • Kind: user
  • Location: Japan
  • Company: RIKEN

GitHub Events

Total
  • Push event: 2
Last Year
  • Push event: 2

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels