Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/actionseval/scrapy

https://github.com/actionseval/scrapy

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (9.3%) to scientific vocabulary
Last synced: 9 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: actionseval
  • License: bsd-3-clause
  • Language: Python
  • Default Branch: main
  • Size: 1.33 MB
Statistics
  • Stars: 0
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created 11 months ago · Last pushed 11 months ago
Metadata Files
Readme Changelog Contributing License Code of conduct Security Authors

README.rst 

|logo|

.. |logo| image:: https://raw.githubusercontent.com/scrapy/scrapy/master/docs/_static/logo.svg
   :target: https://scrapy.org
   :alt: Scrapy
   :width: 480px

|version| |python_version| |ubuntu| |macos| |windows| |coverage| |conda| |deepwiki|

.. |version| image:: https://img.shields.io/pypi/v/Scrapy.svg
   :target: https://pypi.org/pypi/Scrapy
   :alt: PyPI Version

.. |python_version| image:: https://img.shields.io/pypi/pyversions/Scrapy.svg
   :target: https://pypi.org/pypi/Scrapy
   :alt: Supported Python Versions

.. |ubuntu| image:: https://github.com/scrapy/scrapy/workflows/Ubuntu/badge.svg
   :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AUbuntu
   :alt: Ubuntu

.. |macos| image:: https://github.com/scrapy/scrapy/workflows/macOS/badge.svg
   :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AmacOS
   :alt: macOS

.. |windows| image:: https://github.com/scrapy/scrapy/workflows/Windows/badge.svg
   :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AWindows
   :alt: Windows

.. |coverage| image:: https://img.shields.io/codecov/c/github/scrapy/scrapy/master.svg
   :target: https://codecov.io/github/scrapy/scrapy?branch=master
   :alt: Coverage report

.. |conda| image:: https://anaconda.org/conda-forge/scrapy/badges/version.svg
   :target: https://anaconda.org/conda-forge/scrapy
   :alt: Conda Version

.. |deepwiki| image:: https://deepwiki.com/badge.svg
   :target: https://deepwiki.com/scrapy/scrapy
   :alt: Ask DeepWiki

Scrapy_ is a web scraping framework to extract structured data from websites.
It is cross-platform, and requires Python 3.9+. It is maintained by Zyte_
(formerly Scrapinghub) and `many other contributors`_.

.. _many other contributors: https://github.com/scrapy/scrapy/graphs/contributors
.. _Scrapy: https://scrapy.org/
.. _Zyte: https://www.zyte.com/

Install with:

.. code:: bash

    pip install scrapy

And follow the documentation_ to learn how to use it.

.. _documentation: https://docs.scrapy.org/en/latest/

If you wish to contribute, see Contributing_.

.. _Contributing: https://docs.scrapy.org/en/master/contributing.html

Owner

  • Login: actionseval
  • Kind: user

GitHub Events

Total
  • Push event: 1
Last Year
  • Push event: 1

Dependencies

.github/workflows/heuristic.yaml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
.github/workflows/hybrid.yaml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
.github/workflows/model.yaml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
.github/workflows/reference.yaml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
docs/requirements.txt pypi
  • sphinx ==8.1.3
  • sphinx-hoverxref ==1.4.2
  • sphinx-notfound-page ==1.0.4
  • sphinx-rtd-dark-mode ==1.3.0
  • sphinx-rtd-theme ==3.0.2
pyproject.toml pypi
  • PyDispatcher >=2.0.5; platform_python_implementation == "CPython"
  • PyPyDispatcher >=2.1.0; platform_python_implementation == "PyPy"
  • Twisted >=21.7.0
  • cryptography >=37.0.0
  • cssselect >=0.9.1
  • defusedxml >=0.7.1
  • itemadapter >=0.1.0
  • itemloaders >=1.0.1
  • lxml >=4.6.0
  • packaging *
  • parsel >=1.5.0
  • protego >=0.1.15
  • pyOpenSSL >=22.0.0
  • queuelib >=1.4.2
  • service_identity >=18.1.0
  • tldextract *
  • w3lib >=1.17.0
  • zope.interface >=5.1.0