Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/chasmani/public-rising-entropy-of-english

https://github.com/chasmani/public-rising-entropy-of-english

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (6.8%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: chasmani
  • Language: Python
  • Default Branch: main
  • Size: 50.6 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 2 years ago · Last pushed about 2 years ago
Metadata Files
Readme

README.md

The Rising Entropy of English in the Attention Economy

Code and data for the paper: "The Rising Entropy of English in the Attention Economy".

Contact repo owner for more information.

Note: The folder gutenberg under utilities is from another project, found at https://github.com/pgcorpus/gutenberg. The tools in this folder were used to clean text in a standardised way.

The project is tested on python 3.9 to 3.10. To run, you first need to install the package dependencies, e.g. by:

pip3 install -r requirements.txt

The data/results folder includes results from measures on the corpora.

If you wish to replciate the anlaysis, you will first need to download the various text corpora. There are links to these in the main paper, or you can Google them, or contact the repo owner. For each, save the files in data/copora/<corpus_name>/raw.

Owner

  • Name: Chasmani
  • Login: chasmani
  • Kind: user

GitHub Events

Total
Last Year

Dependencies

requirements.txt pypi
  • Automat ==20.2.0
  • Babel ==2.11.0
  • Bottleneck ==1.3.5
  • Flask ==2.2.2
  • HeapDict ==1.0.1
  • Jinja2 ==3.1.2
  • Markdown ==3.4.1
  • MarkupSafe ==1.1.1
  • Pillow ==9.4.0
  • Protego ==0.1.16
  • PyDispatcher ==2.0.5
  • PyJWT ==2.4.0
  • PyQt5-sip ==12.11.0
  • PySocks ==1.7.1
  • PyWavelets ==1.4.1
  • PyYAML ==6.0
  • Pygments ==2.15.1
  • QDarkStyle ==3.0.2
  • QtAwesome ==1.2.2
  • QtPy ==2.2.0
  • Rtree ==1.0.1
  • SQLAlchemy ==1.3.22
  • Scrapy ==2.8.0
  • Send2Trash ==1.8.0
  • Sphinx ==5.0.2
  • TBB ==0.2
  • Twisted ==22.10.0
  • Unidecode ==1.2.0
  • WTForms ==2.3.3
  • WTForms-SQLAlchemy ==0.2
  • Werkzeug ==2.2.3
  • aiobotocore ==2.5.0
  • aiofiles ==0.6.0
  • aiohttp ==3.8.3
  • aioitertools ==0.7.1
  • aiosignal ==1.2.0
  • aiosqlite ==0.18.0
  • alabaster ==0.7.12
  • anaconda-catalogs ==0.2.0
  • anaconda-client ==1.11.3
  • anaconda-navigator ==2.4.2
  • anaconda-project ==0.11.1
  • anyio ==3.5.0
  • appdirs ==1.4.4
  • applaunchservices ==0.3.0
  • appnope ==0.1.2
  • appscript ==1.1.2
  • argon2-cffi ==21.3.0
  • argon2-cffi-bindings ==21.2.0
  • arrow ==1.2.3
  • astroid ==2.14.2
  • astropy ==5.1
  • asttokens ==2.0.5
  • async-timeout ==4.0.2
  • atomicwrites ==1.4.0
  • attrs ==22.1.0
  • autopep8 ==1.6.0
  • backcall ==0.2.0
  • backports.functools-lru-cache ==1.6.4
  • backports.tempfile ==1.0
  • backports.weakref ==1.0.post1
  • bcrypt ==3.2.0
  • beautifulsoup4 ==4.12.2
  • binaryornot ==0.4.4
  • black ==0.0
  • bleach ==4.1.0
  • bokeh ==3.1.1
  • boltons ==23.0.0
  • botocore ==1.29.76
  • brotlipy ==0.7.0
  • certifi ==2023.5.7
  • cffi ==1.15.1
  • chardet ==4.0.0
  • charset-normalizer ==2.0.4
  • click ==7.1.2
  • cloudpickle ==2.2.1
  • clyent ==1.2.2
  • colorama ==0.4.6
  • colorcet ==3.0.1
  • comm ==0.1.2
  • conda ==23.5.2
  • conda-build ==3.25.0
  • conda-content-trust ==0.1.3
  • conda-libmamba-solver ==23.5.0
  • conda-pack ==0.6.0
  • conda-package-handling ==2.1.0
  • conda-repo-cli ==1.0.41
  • conda-token ==0.4.0
  • conda-verify ==3.4.2
  • conda_index ==0.2.3
  • conda_package_streaming ==0.8.0
  • constantly ==15.1.0
  • contourpy ==1.0.5
  • cookiecutter ==1.7.3
  • cryptography ==39.0.1
  • cssselect ==1.1.0
  • cycler ==0.11.0
  • cytoolz ==0.12.0
  • dask ==2023.6.0
  • datasets ==2.12.0
  • datashader ==0.15.0
  • datashape ==0.5.4
  • debugpy ==1.5.1
  • decorator ==5.1.1
  • defusedxml ==0.7.1
  • diff-match-patch ==20200713
  • dill ==0.3.6
  • distributed ==2023.6.0
  • docstring-to-markdown ==0.11
  • docutils ==0.18.1
  • entrypoints ==0.4
  • et-xmlfile ==1.1.0
  • executing ==0.8.3
  • fastjsonschema ==2.16.2
  • filelock ==3.9.0
  • flake8 ==6.0.0
  • fonttools ==4.25.0
  • frozenlist ==1.3.3
  • fsspec ==2023.4.0
  • future ==0.18.3
  • gensim ==4.3.0
  • glob2 ==0.7
  • gmpy2 ==2.1.2
  • greenlet ==2.0.1
  • h11 ==0.14.0
  • h5py ==3.7.0
  • holoviews ==1.16.2
  • huggingface-hub ==0.15.1
  • hvplot ==0.8.4
  • hyperlink ==21.0.0
  • idna ==3.4
  • imagecodecs ==2021.8.26
  • imageio ==2.31.1
  • imagesize ==1.4.1
  • imbalanced-learn ==0.10.1
  • importlib-metadata ==6.0.0
  • incremental ==21.3.0
  • inflection ==0.5.1
  • iniconfig ==1.1.1
  • intake ==0.6.8
  • intervaltree ==3.1.0
  • ipykernel ==6.19.2
  • ipython ==8.12.0
  • ipython-genutils ==0.2.0
  • ipywidgets ==8.0.4
  • isort ==5.9.3
  • itemadapter ==0.3.0
  • itemloaders ==1.0.4
  • itsdangerous ==1.1.0
  • jaraco.classes ==3.2.1
  • jedi ==0.18.1
  • jellyfish ==0.9.0
  • jinja2-time ==0.2.0
  • jmespath ==0.10.0
  • joblib ==1.2.0
  • json5 ==0.9.6
  • jsonpatch ==1.32
  • jsonpointer ==2.1
  • jsonschema ==4.17.3
  • jupyter ==1.0.0
  • jupyter-console ==6.6.3
  • jupyter-events ==0.6.3
  • jupyter-ydoc ==0.2.4
  • jupyter_client ==8.1.0
  • jupyter_core ==5.3.0
  • jupyter_server ==2.5.0
  • jupyter_server_fileid ==0.9.0
  • jupyter_server_terminals ==0.4.4
  • jupyter_server_ydoc ==0.8.0
  • jupyterlab ==3.6.3
  • jupyterlab-pygments ==0.1.2
  • jupyterlab-widgets ==3.0.5
  • jupyterlab_server ==2.22.0
  • keyring ==23.13.1
  • kiwisolver ==1.4.4
  • lazy-object-proxy ==1.6.0
  • lazy_loader ==0.2
  • libarchive-c ==2.9
  • libmambapy ==1.4.1
  • linkify-it-py ==2.0.0
  • llvmlite ==0.40.0
  • lmdb ==1.4.1
  • locket ==1.0.0
  • lxml ==4.9.2
  • lz4 ==4.3.2
  • markdown-it-py ==2.2.0
  • matplotlib ==3.7.1
  • matplotlib-inline ==0.1.6
  • mccabe ==0.7.0
  • mdit-py-plugins ==0.3.0
  • mdurl ==0.1.0
  • mistune ==0.8.4
  • more-itertools ==8.12.0
  • mpmath ==1.2.1
  • msgpack ==1.0.3
  • multidict ==6.0.2
  • multipledispatch ==0.6.0
  • multiprocess ==0.70.14
  • munkres ==1.1.4
  • mypy-extensions ==0.4.3
  • navigator-updater ==0.4.0
  • nbclassic ==0.5.5
  • nbclient ==0.5.13
  • nbconvert ==6.5.4
  • nbformat ==5.7.0
  • nest-asyncio ==1.5.6
  • networkx ==2.8.4
  • nltk ==3.7
  • notebook ==6.5.4
  • notebook_shim ==0.2.2
  • numba ==0.57.0
  • numexpr ==2.8.4
  • numpy ==1.24.3
  • numpydoc ==1.5.0
  • openpyxl ==3.0.10
  • otree ==5.10.3
  • packaging ==23.0
  • pandas ==1.5.3
  • pandocfilters ==1.5.0
  • panel ==1.1.0
  • param ==1.13.0
  • parsel ==1.6.0
  • parso ==0.8.3
  • partd ==1.2.0
  • pathlib ==1.0.1
  • pathspec ==0.10.3
  • patsy ==0.5.3
  • pep8 ==1.7.1
  • pexpect ==4.8.0
  • pickleshare ==0.7.5
  • pip ==23.1.2
  • pkginfo ==1.9.6
  • platformdirs ==2.5.2
  • plotly ==5.9.0
  • pluggy ==1.0.0
  • ply ==3.11
  • pooch ==1.4.0
  • powerlaw ==1.5
  • poyo ==0.5.0
  • prometheus-client ==0.14.1
  • prompt-toolkit ==3.0.36
  • psutil ==5.9.0
  • ptyprocess ==0.7.0
  • pure-eval ==0.2.2
  • py-cpuinfo ==8.0.0
  • pyOpenSSL ==23.0.0
  • pyarrow ==11.0.0
  • pyasn1 ==0.4.8
  • pyasn1-modules ==0.2.8
  • pycodestyle ==2.10.0
  • pycosat ==0.6.4
  • pycparser ==2.21
  • pyct ==0.5.0
  • pycurl ==7.45.2
  • pydocstyle ==6.3.0
  • pyerfa ==2.0.0
  • pyflakes ==3.0.1
  • pylint ==2.16.2
  • pylint-venv ==2.3.0
  • pyls-spyder ==0.4.0
  • pyobjc-core ==9.0
  • pyobjc-framework-Cocoa ==9.0
  • pyobjc-framework-CoreServices ==9.0
  • pyobjc-framework-FSEvents ==9.0
  • pyodbc ==4.0.34
  • pyparsing ==3.0.9
  • pyrsistent ==0.18.0
  • pytest ==7.3.1
  • python-dateutil ==2.8.2
  • python-json-logger ==2.0.7
  • python-lsp-black ==1.2.1
  • python-lsp-jsonrpc ==1.0.0
  • python-lsp-server ==1.7.2
  • python-multipart ==0.0.5
  • python-slugify ==5.0.2
  • python-snappy ==0.6.1
  • pytoolconfig ==1.2.5
  • pytz ==2022.7
  • pyviz-comms ==2.3.0
  • pyzmq ==25.1.0
  • qstylizer ==0.2.2
  • qtconsole ==5.4.2
  • queuelib ==1.5.0
  • regex ==2022.7.9
  • requests ==2.29.0
  • requests-file ==1.5.1
  • requests-toolbelt ==0.9.1
  • responses ==0.13.3
  • rfc3339-validator ==0.1.4
  • rfc3986-validator ==0.1.1
  • rope ==1.7.0
  • ruamel-yaml-conda ==0.17.21
  • ruamel.yaml ==0.17.21
  • s3fs ==2023.4.0
  • sacremoses ==0.0.43
  • scikit-image ==0.20.0
  • scikit-learn ==1.2.2
  • scipy ==1.10.1
  • seaborn ==0.12.2
  • service-identity ==18.1.0
  • setuptools ==67.8.0
  • sip ==6.6.2
  • six ==1.16.0
  • smart-open ==5.2.1
  • sniffio ==1.2.0
  • snowballstemmer ==2.2.0
  • sortedcontainers ==2.4.0
  • soupsieve ==2.4
  • sphinxcontrib-applehelp ==1.0.2
  • sphinxcontrib-devhelp ==1.0.2
  • sphinxcontrib-htmlhelp ==2.0.0
  • sphinxcontrib-jsmath ==1.0.1
  • sphinxcontrib-qthelp ==1.0.3
  • sphinxcontrib-serializinghtml ==1.1.5
  • spyder ==5.4.3
  • spyder-kernels ==2.4.3
  • stack-data ==0.2.0
  • starlette ==0.14.1
  • statsmodels ==0.13.5
  • sympy ==1.11.1
  • tables ==3.8.0
  • tabulate ==0.8.10
  • tblib ==1.7.0
  • tenacity ==8.2.2
  • terminado ==0.17.1
  • text-unidecode ==1.3
  • textdistance ==4.2.1
  • threadpoolctl ==2.2.0
  • three-merge ==0.1.1
  • tifffile ==2021.7.2
  • tinycss2 ==1.2.1
  • tldextract ==3.2.0
  • tokenizers ==0.13.2
  • toml ==0.10.2
  • tomli ==2.0.1
  • tomlkit ==0.11.1
  • toolz ==0.12.0
  • torch ==2.0.1
  • tornado ==6.2
  • tqdm ==4.65.0
  • traitlets ==5.7.1
  • transformers ==4.29.2
  • typing_extensions ==4.6.3
  • uc-micro-py ==1.0.1
  • ujson ==5.4.0
  • urllib3 ==1.26.16
  • uvicorn ==0.13.4
  • w3lib ==1.21.0
  • watchdog ==2.1.6
  • wcwidth ==0.2.5
  • webencodings ==0.5.1
  • websocket-client ==0.58.0
  • websockets ==10.1
  • whatthepatch ==1.0.2
  • wheel ==0.38.4
  • widgetsnbextension ==4.0.5
  • wrapt ==1.14.1
  • wurlitzer ==3.0.2
  • xarray ==2022.11.0
  • xlwings ==0.29.1
  • xxhash ==2.0.2
  • xyzservices ==2022.9.0
  • y-py ==0.5.9
  • yapf ==0.31.0
  • yarl ==1.8.1
  • ypy-websocket ==0.8.2
  • zict ==2.2.0
  • zipp ==3.11.0
  • zope.interface ==5.4.0
  • zstandard ==0.19.0
utilities/gutenberg/requirements.txt pypi
  • argparse *
  • lxml *
  • nltk *
  • numpy *
  • pandas *