Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/commoncrawl/cc-webgraph-statistics

Statistics of Common Crawl monthly Web Graphs

https://github.com/commoncrawl/cc-webgraph-statistics

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (4.1%) to scientific vocabulary
Last synced: 11 months ago · JSON representation

Repository

Statistics of Common Crawl monthly Web Graphs

Basic Info
Statistics
  • Stars: 5
  • Watchers: 7
  • Forks: 1
  • Open Issues: 0
  • Releases: 0
Created over 1 year ago · Last pushed 11 months ago
Metadata Files
Readme License

README.md

cc-webgraph-statistics

image

Web page showing statistics and plots derived from Common Crawl's monthly Web Graphs, and generation tools.

Setup

cd src make

Updating

cd src make update

Modifications

Sometimes you may want to generate the HTML without generating the plots. You can do this with:

cd src make noplot

Owner

  • Name: Common Crawl Foundation
  • Login: commoncrawl
  • Kind: organization
  • Email: info@commoncrawl.org

Common Crawl provides an archive of webpages going back to 2007.

GitHub Events

Total
  • Issues event: 3
  • Watch event: 4
  • Issue comment event: 3
  • Public event: 1
  • Push event: 24
  • Pull request review event: 1
  • Pull request event: 2
  • Create event: 1
Last Year
  • Issues event: 3
  • Watch event: 4
  • Issue comment event: 3
  • Public event: 1
  • Push event: 24
  • Pull request review event: 1
  • Pull request event: 2
  • Create event: 1

Committers

Last synced: 12 months ago

All Time
  • Total Commits: 40
  • Total Committers: 2
  • Avg Commits per committer: 20.0
  • Development Distribution Score (DDS): 0.1
Past Year
  • Commits: 40
  • Committers: 2
  • Avg Commits per committer: 20.0
  • Development Distribution Score (DDS): 0.1
Top Committers
Name Email Commits
Thom Vaughan t****m@c****g 36
Sebastian Nagel s****n@c****g 4
Committer Domains (Top 20 + Academic)
commoncrawl.org: 2

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 2
  • Total pull requests: 2
  • Average time to close issues: about 23 hours
  • Average time to close pull requests: about 20 hours
  • Total issue authors: 1
  • Total pull request authors: 1
  • Average comments per issue: 0.5
  • Average comments per pull request: 1.0
  • Merged pull requests: 2
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 2
  • Pull requests: 2
  • Average time to close issues: about 23 hours
  • Average time to close pull requests: about 20 hours
  • Issue authors: 1
  • Pull request authors: 1
  • Average comments per issue: 0.5
  • Average comments per pull request: 1.0
  • Merged pull requests: 2
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • sebastian-nagel (2)
Pull Request Authors
  • sebastian-nagel (2)
Top Labels
Issue Labels
Pull Request Labels

Dependencies

src/requirements.txt pypi
  • markdown *
  • pandas *
  • plotnine *
  • tqdm *