coansys

Content Analysis System is a framework for mining scientific publications using Apache Hadoop.

https://github.com/ceon/coansys

Science Score: 28.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
○
codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
✓
Committers with academic emails
22 of 37 committers (59.5%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (1.9%) to scientific vocabulary

Last synced: 11 months ago · JSON representation ·

Repository

Content Analysis System is a framework for mining scientific publications using Apache Hadoop.

Basic Info

Host: GitHub
Owner: CeON
License: agpl-3.0
Language: Java
Default Branch: master
Homepage: http://coansys.ceon.pl/
Size: 28.2 MB

Statistics

Stars: 27
Watchers: 14
Forks: 21
Open Issues: 13
Releases: 0

Created about 14 years ago · Last pushed over 4 years ago

Metadata Files

Readme License Citation

CoAnSys

COntent ANalysis SYStem is a framework for mining scientific publications using Apache Hadoop. It is primarily developed by employees of the Centre for Open Science (CeON) at Interdisciplinary Centre for Mathematical and Computational Modelling (ICM), University of Warsaw (UW).

Owner

Name: Centre for Open Science
Login: CeON
Kind: organization
Location: Warsaw, Poland

Website: https://icm.edu.pl/en
Repositories: 27
Profile: https://github.com/CeON

Citation (citation-matching/.gitignore)

# use glob syntax.
syntax: glob
*.ser
*.class
*~
*.bak
#*.off
*.old

# eclipse conf file
.settings
.classpath
.project
.manager
.scala_dependencies

# idea
.idea
*.iml

# building
target
build
null
tmp*
temp*
dist
test-output
build.log
*.cache-tests

# other scm
.svn
.CVS
.hg*

# switch to regexp syntax.
#  syntax: regexp
#  ^\.pc/

#SHITTY output not in target directory
build.log

*/.cache-main
*/*.log

GitHub Events

Total

Last Year

Committers

Last synced: over 2 years ago

All Time

Total Commits: 2,620
Total Committers: 37
Avg Commits per committer: 70.811
Development Distribution Score (DDS): 0.721

Past Year

Commits: 0
Committers: 0
Avg Commits per committer: 0.0
Development Distribution Score (DDS): 0.0

Top Committers

Name	Email	Commits
pdendek	p**k@i**l	730
Mateusz Fedoryszak	m**d@i**l	446
Artur Czeczko	a**o@i**l	341
Adam Kawa	k**a@i**l	298
Michał Woś	w**u@s**l	168
kura	k**a@l**t	161
Michał Woś	m**s@i**l	105
Piotr Wendykier	p**r@i**l	94
Adam Kawa	a**a@h**l	75
pi3141592	p**k@g**m	44
Krzysztof Mądry	m**k@i**l	26
kura	k**a@l**n	23
lukdumi	l**s@g**m	20
Mateusz Neumann	M**n@i**l	19
Michał Woś	m**s@h**l	12
Łukasz Dumiszewski	l**i@i**l	9
piotrw	p**w@p**r	9
Lukasz Bolikowski	l**i@g**m	5
krzywojc	k**c@i**l	5
wendykierp		5
kura	k**a@d**l	3
kura	k**a@d**l	3
Michał Politowski	m**l@i**l	3
Mateusz Neumann	m**n@d**n	2
Michał Oniszczuk	m**k@g**m	2
Piotr Dendek	p**k@h**l	1
m	m@m****)	1
kura	k**a@d**l	1
akawa	a**a@u**n	1
mafju	m**u@t**)	1
and 7 more...

Committer Domains (Top 20 + Academic)

icm.edu.pl: 11 hadoop.vls.icm.edu.pl: 3 spark-m3.vls.icm.edu.pl: 1 dhcp-151.eduroam.core.icm.edu.pl: 1 dhcp-156.eduroam.core.icm.edu.pl: 1 thousand.(none): 1 ubuntu.ubuntu-domain: 1 dhcp-173.eduroam.core.icm.edu.pl: 1 m-icm.(none): 1 dragonfly.localdomain: 1 dhcp-139.eduroam.core.icm.edu.pl: 1 dhcp-175.eduroam.core.icm.edu.pl: 1 lodos.localdomain: 1 students.mimuw.edu.pl: 1

Dependencies

affiliation-organization-matching/affiliation-organization-matching-impl/pom.xml maven

${project.groupId}:models ${project.version}
com.google.guava:guava 15.0
javax.servlet:javax.servlet-api 3.1.0
org.apache.spark:spark-core_2.10
org.apache.spark:spark-graphx_2.10

affiliation-organization-matching/affiliation-organization-matching-workflow/pom.xml maven

pl.edu.icm.coansys:affiliation-organization-matching-impl 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

ceon-scala-commons-lite/pom.xml maven

org.apache.hadoop:hadoop-common ${hadoop.common.version} provided
com.jsuereth:scala-arm_${scala.binary.version} 1.3
com.typesafe:scalalogging-slf4j_${scala.binary.version} 1.0.1
commons-io:commons-io 2.4
org.apache.commons:commons-math 2.2
org.jdom:jdom 1.1
org.scala-lang:scala-library ${scala.version}
tw.edu.ntu.csie:libsvm 3.1
junit:junit 4.10 test

citation-matching/citation-matching-coansys-code/pom.xml maven

${project.groupId}:citation-matching-core-code ${project.version}
org.apache.spark:spark-core_2.10
org.apache.spark:spark-sql_2.10
pl.edu.icm.spark-utils:spark-utils

citation-matching/citation-matching-coansys-workflow/pom.xml maven

pl.edu.icm.coansys:citation-matching-coansys-code 1.11-SNAPSHOT
pl.edu.icm.coansys:citation-matching-coansys-code 1.11-SNAPSHOT test
pl.edu.icm.oozie:oozie-runner test

citation-matching/citation-matching-core-code/pom.xml maven

${project.groupId}:models ${project.version}
com.beust:jcommander
com.google.guava:guava 11.0
com.jsuereth:scala-arm_2.10 1.3
javax.servlet:javax.servlet-api 3.1.0
org.apache.spark:spark-core_2.10
org.apache.spark:spark-sql_2.10
org.scala-lang:scala-library
pl.edu.icm.cermine:cermine-impl 1.11
pl.edu.icm.coansys:ceon-scala-commons-lite ${project.version}
pl.edu.icm.coansys:commons ${project.version}
pl.edu.icm.spark-utils:spark-utils

citation-matching/pom.xml maven

org.mockito:mockito-all test

commons/pom.xml maven

com.google.protobuf:protobuf-java
org.apache.commons:commons-lang3
org.apache.hadoop:hadoop-client
org.apache.hadoop:hadoop-mapreduce-client-app
org.apache.hadoop:hadoop-mapreduce-client-common
org.apache.hadoop:hadoop-mapreduce-client-core
org.apache.hadoop:hadoop-yarn-api
org.apache.hadoop:hadoop-yarn-client
org.apache.hadoop:hadoop-yarn-common
org.apache.pig:pig
org.codehaus.jackson:jackson-mapper-asl
org.slf4j:slf4j-api
org.slf4j:slf4j-simple
org.springframework:spring-context
org.springframework:spring-core
pl.edu.icm.coansys:models ${project.version}
org.apache.pig:pigunit test

deduplication-document/deduplication-document-impl/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:disambiguation ${project.version}
org.springframework:spring-aop
org.springframework:spring-beans
org.springframework:spring-context
org.springframework:spring-core
org.springframework:spring-expression
org.apache.mrunit:mrunit 0.9.0-incubating test
org.springframework:spring-test test

deduplication-document/deduplication-document-workflow/pom.xml maven

pl.edu.icm.coansys:deduplication-document-impl 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

deduplication-organization/deduplication-organization-impl/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:models ${project.version}
com.google.guava:guava 15.0
javax.servlet:javax.servlet-api 3.1.0
org.apache.spark:spark-core_2.10
org.apache.spark:spark-graphx_2.10

deduplication-organization/deduplication-organization-workflow/pom.xml maven

pl.edu.icm.coansys:deduplication-organization-impl 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

disambiguation/pom.xml maven

com.sun.el:el-ri 1.0
pl.edu.icm.coansys:commons 1.11-SNAPSHOT

disambiguation-author/disambiguation-author-auxil/pom.xml maven

${project.groupId}:disambiguation-author-logic ${project.version}
com.google.guava:guava 16.0
org.apache.spark:spark-core_2.10
org.apache.spark:spark-mllib_2.10

disambiguation-author/disambiguation-author-comac-facade/pom.xml maven

pl.edu.icm.coansys:disambiguation-author-workflow 1.11-SNAPSHOT

disambiguation-author/disambiguation-author-logic/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:disambiguation ${project.version}
com.beust:jcommander 1.48
com.github.scopt:scopt_2.10 3.5.0
com.google.guava:guava 15.0
javax.servlet:javax.servlet-api 3.1.0
org.antlr:antlr-runtime 3.4
org.apache.commons:commons-lang3 3.2.1
org.apache.spark:spark-core_2.10
org.apache.spark:spark-graphx_2.10
org.reflections:reflections 0.9.9-RC1
pl.edu.icm.ceon:ceon-commons 1.0.0
pl.edu.icm.coansys:models ${project.version}
org.apache.pig:pigunit test

disambiguation-author/disambiguation-author-spark-jar/pom.xml maven

${project.groupId}:disambiguation-author-logic ${project.version}
${project.groupId}:models ${project.version}
com.google.guava:guava 15.0
javax.servlet:javax.servlet-api 3.1.0
org.apache.spark:spark-core_2.10
org.apache.spark:spark-graphx_2.10

disambiguation-author/disambiguation-author-workflow/pom.xml maven

pl.edu.icm.coansys:disambiguation-author-spark-jar 1.11-SNAPSHOT

document-classification/document-classification-labeling-workflow/pom.xml maven

pl.edu.icm.coansys:document-classification-logic 1.11-SNAPSHOT

document-classification/document-classification-logic/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:disambiguation ${project.version}
${project.groupId}:disambiguation-author-logic ${project.version}

document-classification/document-classification-model-building-workflow/pom.xml maven

pl.edu.icm.coansys:document-classification-logic 1.11-SNAPSHOT
pl.edu.icm.coansys:document-similarity-workflow 1.11-SNAPSHOT

document-similarity/document-similarity-demonstrator-workflow/pom.xml maven

pl.edu.icm.coansys:document-similarity-enhanced-comac-facade 1.11-SNAPSHOT
pl.edu.icm.coansys:document-similarity-logic 1.11-SNAPSHOT

document-similarity/document-similarity-enhanced-comac-facade/pom.xml maven

pl.edu.icm.coansys:document-similarity-oap-uberworkflow 1.11-SNAPSHOT

document-similarity/document-similarity-logic/pom.xml maven

${project.groupId}:commons ${project.version}
commons-lang:commons-lang 2.6
org.antlr:antlr-runtime 3.4
org.apache.oozie:oozie-client 4.1.0-cdh5.9.0
org.apache.pig:pigunit test

document-similarity/document-similarity-oap-uberworkflow/pom.xml maven

pl.edu.icm.coansys:document-similarity-ranked-workflow 1.11-SNAPSHOT
pl.edu.icm.coansys:document-similarity-recalculate-sim-about-1 1.11-SNAPSHOT

document-similarity/document-similarity-ranked-two-sources-workflow/pom.xml maven

pl.edu.icm.coansys:document-similarity-logic 1.11-SNAPSHOT

document-similarity/document-similarity-ranked-workflow/pom.xml maven

pl.edu.icm.coansys:document-similarity-logic 1.11-SNAPSHOT

document-similarity/document-similarity-recalculate-sim-about-1/pom.xml maven

pl.edu.icm.coansys:document-similarity-logic 1.11-SNAPSHOT

document-similarity/document-similarity-workflow/pom.xml maven

pl.edu.icm.coansys:document-similarity-logic 1.11-SNAPSHOT

integration/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:disambiguation ${project.version}

keywords-extraction/keywords-extraction-impl/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:models ${project.version}
net.sf.jopt-simple:jopt-simple 4.4-beta-2
pl.edu.icm.ceon:ceon-commons 1.0.0
pl.edu.icm.cermine:cermine-impl 1.11

keywords-extraction/keywords-extraction-workflow/pom.xml maven

pl.edu.icm.coansys:keywords-extraction-impl 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

models/pom.xml maven

com.google.protobuf:protobuf-java 2.5.0

nlm-extraction/nlm-extraction-impl/pom.xml maven

${project.groupId}:commons ${project.version}
pl.edu.icm.cermine:cermine-impl 1.11
pl.edu.icm.coansys:models ${project.version}
org.apache.mrunit:mrunit 1.0.0 test

nlm-extraction/nlm-extraction-workflow/pom.xml maven

pl.edu.icm.coansys:nlm-extraction-impl 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

pom.xml maven

org.apache.spark:spark-core_2.10 1.6.0-cdh5.9.0 provided
org.apache.spark:spark-hive_2.10 1.6.0-cdh5.9.0 provided
org.apache.spark:spark-sql_2.10 1.6.0-cdh5.9.0 provided
com.beust:jcommander 1.48
com.databricks:spark-avro_2.10 1.0.0
com.google.protobuf:protobuf-java 2.5.0
org.apache.commons:commons-lang3 3.1
org.apache.hadoop:hadoop-client 2.6.0-cdh5.9.0
org.apache.hadoop:hadoop-mapreduce-client-app 2.6.0-cdh5.9.0
org.apache.hadoop:hadoop-mapreduce-client-common 2.6.0-cdh5.9.0
org.apache.hadoop:hadoop-mapreduce-client-core 2.6.0-cdh5.9.0
org.apache.hadoop:hadoop-yarn-api 2.6.0-cdh5.9.0
org.apache.hadoop:hadoop-yarn-client 2.6.0-cdh5.9.0
org.apache.hadoop:hadoop-yarn-common 2.6.0-cdh5.9.0
org.apache.hbase:hbase-client 1.2.0-cdh5.9.0
org.apache.pig:pig 0.12.0-cdh5.9.0
org.apache.spark:spark-graphx_2.10 1.6.0-cdh5.9.0
org.apache.spark:spark-mllib_2.10 1.6.0-cdh5.9.0
org.codehaus.jackson:jackson-mapper-asl 1.9.12
org.scala-lang:scala-library 2.10.6
org.slf4j:slf4j-api 1.6.4
org.slf4j:slf4j-simple 1.6.4
org.springframework.data:spring-data-hadoop 1.0.0.RELEASE
org.springframework:spring-aop 4.1.5.RELEASE
org.springframework:spring-aspects 4.1.5.RELEASE
org.springframework:spring-beans 4.1.5.RELEASE
org.springframework:spring-context 4.1.5.RELEASE
org.springframework:spring-core 4.1.5.RELEASE
org.springframework:spring-expression 4.1.5.RELEASE
org.springframework:spring-orm 4.1.5.RELEASE
org.springframework:spring-oxm 4.1.5.RELEASE
org.springframework:spring-test 4.1.5.RELEASE
org.springframework:spring-tx 4.1.5.RELEASE
pl.edu.icm.oozie:oozie-runner 1.5
pl.edu.icm.spark-utils:spark-utils 0.0.1
org.apache.pig:pigunit 0.12.0-cdh5.9.0 test
org.mockito:mockito-all 1.9.5 test
org.testng:testng 6.5.2 test

source-disambiguation/source-disambiguation-logic/pom.xml maven

${project.groupId}:commons ${project.version}
${project.groupId}:models ${project.version}
net.sf.jopt-simple:jopt-simple 4.4-beta-2
pl.edu.icm.ceon:ceon-commons 0.1.0

source-disambiguation/source-disambiguation-workflow/pom.xml maven

pl.edu.icm.coansys:source-disambiguation-logic 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

statistics-generator/statistics-generator-impl/pom.xml maven

com.fathzer:javaluator 2.0.0
joda-time:joda-time 2.3
pl.edu.icm.coansys:commons ${project.version}

statistics-generator/statistics-generator-workflow/pom.xml maven

pl.edu.icm.coansys:statistics-generator-impl 1.11-SNAPSHOT
pl.edu.icm.oozie:oozie-runner test

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science