Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/datamade/cookiecutter-scrapy

Cookie Cutter for Scrapy Projects

https://github.com/datamade/cookiecutter-scrapy

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (5.1%) to scientific vocabulary
Last synced: 9 months ago · JSON representation

Repository

Cookie Cutter for Scrapy Projects

Basic Info
  • Host: GitHub
  • Owner: datamade
  • Language: Python
  • Default Branch: main
  • Size: 5.86 KB
Statistics
  • Stars: 1
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 1 year ago · Last pushed over 1 year ago
Metadata Files
Readme

README.md

DataMade cookiecutter for scrapy scrapers

This cookiecutter sets up a new scrapy project for you. It defers in a few ways from what you would get from scrapy startproject to align with DataMade's scraping practices.

  1. scrapy crawl will exit after the first exception.
  2. if an error is encountered, scrapy crawl will exit with a non-zero exit code.
  3. the project contains a setup.py file wich will allow you to install the scraper with pip like a normal package. when installed this way, you can run scrapy crawl your_spider_name without having to be in a scrapy project.

Owner

  • Name: datamade
  • Login: datamade
  • Kind: organization
  • Email: info@datamade.us
  • Location: Chicago, IL

We build open source technology using open data to empower journalists, researchers, governments and advocacy organizations.

GitHub Events

Total
  • Watch event: 1
  • Push event: 1
  • Create event: 2
Last Year
  • Watch event: 1
  • Push event: 1
  • Create event: 2

Issues and Pull Requests

Last synced: about 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels