patcit

Making Patent Citations Uncool Again

https://github.com/cverluise/patcit

Science Score: 18.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
○
codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
○
Committers with academic emails
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (9.6%) to scientific vocabulary

Keywords

economics innovation patent-citations patents science

Keywords from Contributors

interactive mesh interpretability profiles sequences generic projection standardization optim embedded

Last synced: 11 months ago · JSON representation ·

Repository

Making Patent Citations Uncool Again

Basic Info

Host: GitHub
Owner: cverluise
License: mit
Language: Jupyter Notebook
Default Branch: master
Homepage: https://cverluise.github.io/PatCit/
Size: 24.8 MB

Statistics

Stars: 111
Watchers: 20
Forks: 12
Open Issues: 13
Releases: 3

Topics

economics innovation patent-citations patents science

Created almost 7 years ago · Last pushed about 3 years ago

Metadata Files

Readme Contributing License Code of conduct Citation

README

Warning: this is partly deprecated

Build Project

shell script git clone cd patcit/ git submodule add https://github.com/kermitt2/grobid.git # If not done yet pipenv install --dev # or `pip -r requirements.txt` if you don"t use pipenv pipenv install -e . # or `pip install -e .` if you don"t use pipenv

Prepare data

PatStat data are provided in large .zip chunks. We want:

small chunks (for easier parallel processing)
in .gz format (for easy streaming through smart_open)

shell script cd PscUniverse/ sh prepare_tls214.sh data/path # Nb: no trailing "/"

Take a :zzz: ... or a :coffee: , that should take 15-20min.

Process data

Grobid + CrossRef API

Start Grobid server

shell script cd grobid/ ./gradlew run

Nb: don't forget to fill the grobid-home/config/grobid.properties to make sure that your requests to CrossRef API can be properly identified. See here for more details.

Start processing data

shell script python3 process-citations.py data/path

Disclaimer

Although we use multi threading, don't expect to process very large amounts of data with this method.

Bottlenecks:

- Grobid supports 10 concurrent engines
- CrossRef API supports 30 requests per second

All in all, you can reasonably expect to process ~4 citations per second, ie 100,000 in 7 hours.

Grobid + Biblio-Glutton (on AWS)

AWS Set up

Start EC2
Update ES policy strategy with IPv4 EC2

Start biblio-glutton

shell script cd biblio-glutton/lookup/ ./gradlew clean build java -jar build/libs/lookup-service-1.0-SNAPSHOT-onejar.jar server data/config/config.yml curl localhost:8080/service/data # Check that the service is running properly

Start Grobid

shell script cd SciCit/grobid/ ./gradlew run curl -X POST -d "citations=Graff, Expert. Opin. Ther. Targets (2002) 6(1): 103-113" localhost:8070/api/processCitation

Start Processing

```shell script cd SciCit/

pipenv install --dev

pipenv shell python bin/ProcessCitations.py ~/data/small_chunks/

```

Owner

Name: Cyril Verluise
Login: cverluise
Kind: user
Location: Paris
Company: Economics of Innovation Lab @ Collège de France

Website: https://cverluise.github.io/
Repositories: 12
Profile: https://github.com/cverluise

Phd Student in Economics & Data scientist. Interested in knowledge creation and diffusion. Currently working on patent related projects.

Citation (CITATION)

@dataset{cyril_verluise_2020_4244176,
  author       = {Cyril Verluise and
                  Gabriele Cristelli and
                  Kyle Higham and
                  Lucas Violon and
                  Gaétan de Rassenfosse},
  title        = {{PatCit: A Comprehensive Dataset of Patent
                   Citations}},
  month        = mar,
  year         = 2020,
  publisher    = {Zenodo},
  version      = {0.3.0},
  doi          = {10.5281/zenodo.4244176},
  url          = {https://doi.org/10.5281/zenodo.4244176}
}

GitHub Events

Total

Watch event: 4
Fork event: 1

Last Year

Watch event: 4
Fork event: 1

Committers

Last synced: over 2 years ago

All Time

Total Commits: 403
Total Committers: 4
Avg Commits per committer: 100.75
Development Distribution Score (DDS): 0.02

Past Year

Commits: 0
Committers: 0
Avg Commits per committer: 0.0
Development Distribution Score (DDS): 0.0

Top Committers

Name	Email	Commits
Cyril Verluise	c**e@g**m	395
Cyril Verluise	3****e	6
Tom Morris	t**s@g**m	1
dependabot[bot]	4****]	1

Issues and Pull Requests

Last synced: over 2 years ago

All Time

Total issues: 25
Total pull requests: 9
Average time to close issues: 3 months
Average time to close pull requests: 4 months
Total issue authors: 10
Total pull request authors: 2
Average comments per issue: 1.52
Average comments per pull request: 0.44
Merged pull requests: 2
Bot issues: 0
Bot pull requests: 8

Past Year

Issues: 1
Pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 1
Pull request authors: 0
Average comments per issue: 0.0
Average comments per pull request: 0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

cverluise (14)
SuperMayo (2)
gderasse (2)
verginer (1)
n3ssuno (1)
cchikis (1)
Antoberge (1)
felixpoege (1)
leflix311 (1)
kylehigham (1)

Pull Request Authors

dependabot[bot] (8)
tfmorris (1)

Top Labels

Issue Labels

enhancement (14) beta (10) parsing (5) documentation (4) good first issue (4) help wanted (3) bug (1)

Pull Request Labels

dependencies (8)

Dependencies

poetry.lock pypi

appdirs 1.4.4 develop
cfgv 3.2.0 develop
distlib 0.3.1 develop
filelock 3.0.12 develop
future 0.18.2 develop
identify 1.5.6 develop
jinja2 2.11.2 develop
livereload 2.6.3 develop
lunr 0.5.8 develop
markdown 3.3.3 develop
markupsafe 1.1.1 develop
mkdocs 1.1.2 develop
mkdocs-material 6.1.3 develop
mkdocs-material-extensions 1.0.1 develop
nltk 3.5 develop
nodeenv 1.5.0 develop
pre-commit 2.7.1 develop
pygments 2.7.2 develop
pymdown-extensions 8.0.1 develop
pyyaml 5.3.1 develop
toml 0.10.1 develop
tornado 6.1 develop
virtualenv 20.0.35 develop
asyncio 3.4.3
attrs 20.2.0
beautifulsoup4 4.9.3
blis 0.4.1
boltons 20.2.1
boto 2.49.0
boto3 1.15.16
botocore 1.18.16
catalogue 1.0.0
certifi 2020.6.20
chardet 3.0.4
click 7.1.2
colorama 0.4.4
cymem 2.0.3
dateparser 0.7.6
en_core_web_sm 2.3.1
face 20.1.1
fuzzysearch 0.7.3
glom 20.8.0
idna 2.10
importlib-metadata 2.0.0
jmespath 0.10.0
joblib 0.17.0
jsonschema 3.2.0
lxml 4.5.2
murmurhash 1.0.2
numpy 1.19.2
pandas 1.1.3
plac 1.1.3
plotly 4.11.0
preshed 3.0.2
pycld2 0.41
pyrsistent 0.17.3
python-dateutil 2.8.1
pytz 2020.1
regex 2020.10.15
requests 2.24.0
retrying 1.3.3
s3transfer 0.3.3
scikit-learn 0.23.2
scipy 1.5.2
shellingham 1.3.2
six 1.15.0
sklearn 0.0
smart-open 1.11.1
soupsieve 2.0.1
spacy 2.3.2
spacy-lookups-data 0.3.2
srsly 1.0.2
tabulate 0.8.7
thinc 7.4.1
threadpoolctl 2.1.0
tqdm 4.50.2
typer 0.3.2
tzlocal 2.1
urllib3 1.25.10
wasabi 0.8.0
zipp 3.3.0

pyproject.toml pypi

Pygments ^2.7.2 develop
mkdocs-material ^6.1.3 develop
pre-commit ^2.0.1 develop
pymdown-extensions ^8.0.1 develop
asyncio ^3.4.3
beautifulsoup4 ^4.8.2
dateparser ^0.7.6
en_core_web_sm *
fuzzysearch ^0.7.3
glom ^20.8.0
jsonschema ^3.2.0
lxml ^4.5.2
numpy ^1.18.1
pandas ^1.0.2
plotly ^4.11.0
pycld2 ^0.41
python ^3.7
sklearn ^0.0
smart_open ^1.9.0
spacy ^2.3.2
spacy-lookups-data ^0.3.2
tabulate ^0.8.7
tqdm ^4.50.2
typer ^0.3.2
wasabi ^0.8.0

requirements.txt pypi

asyncio ==3.4.3
attrs ==20.2.0
beautifulsoup4 ==4.9.3
blis ==0.4.1
boltons ==20.2.1
boto ==2.49.0
boto3 ==1.15.16
botocore ==1.18.16
catalogue ==1.0.0
certifi ==2020.6.20
chardet ==3.0.4
click ==7.1.2
colorama ==0.4.4
cymem ==2.0.3
dateparser ==0.7.6
face ==20.1.1
fuzzysearch ==0.7.3
glom ==20.8.0
idna ==2.10
importlib-metadata ==2.0.0
jmespath ==0.10.0
joblib ==0.17.0
jsonschema ==3.2.0
lxml ==4.5.2
murmurhash ==1.0.2
numpy ==1.19.2
pandas ==1.1.3
plac ==1.1.3
plotly ==4.11.0
preshed ==3.0.2
pycld2 ==0.41
pyrsistent ==0.17.3
python-dateutil ==2.8.1
pytz ==2020.1
regex ==2020.10.15
requests ==2.24.0
retrying ==1.3.3
s3transfer ==0.3.3
scikit-learn ==0.23.2
scipy ==1.5.2
shellingham ==1.3.2
six ==1.15.0
sklearn ==0.0
smart-open ==1.11.1
soupsieve ==2.0.1
spacy ==2.3.2
spacy-lookups-data ==0.3.2
srsly ==1.0.2
tabulate ==0.8.7
thinc ==7.4.1
threadpoolctl ==2.1.0
tqdm ==4.50.2
typer ==0.3.2
tzlocal ==2.1
urllib3 ==1.25.10
wasabi ==0.8.0
zipp ==3.3.0

patcit

Science Score: 18.0%

Keywords

Keywords from Contributors

Repository

Basic Info

Statistics

Topics

Metadata Files

README-dev.md

README

Build Project

Prepare data

Process data

Grobid + CrossRef API

Disclaimer

Grobid + Biblio-Glutton (on AWS)

pipenv install --dev

Owner

Citation (CITATION)

GitHub Events

Total

Last Year

Committers

All Time

Past Year

Top Committers

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Dependencies