https://github.com/aksw/lsq

Linked SPARQL Queries (LSQ): Framework for RDFizing triple store (web) logs and performing SPARQL query extraction, analysis and benchmarking in order to produce datasets of Linked SPARQL Queries

https://github.com/aksw/lsq

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    3 of 10 committers (30.0%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (14.2%) to scientific vocabulary

Keywords

analytics benchmarking queries rdf semantic-web sparql
Last synced: 5 months ago · JSON representation

Repository

Linked SPARQL Queries (LSQ): Framework for RDFizing triple store (web) logs and performing SPARQL query extraction, analysis and benchmarking in order to produce datasets of Linked SPARQL Queries

Basic Info
  • Host: GitHub
  • Owner: AKSW
  • License: apache-2.0
  • Language: Java
  • Default Branch: develop
  • Homepage: http://lsq.aksw.org
  • Size: 23.3 MB
Statistics
  • Stars: 28
  • Watchers: 4
  • Forks: 11
  • Open Issues: 17
  • Releases: 0
Topics
analytics benchmarking queries rdf semantic-web sparql
Created almost 11 years ago · Last pushed 6 months ago
Metadata Files
Readme License

README.md

Linked SPARQL Queries (LSQ) Framework

A framework for RDFizing query logs and benchmarking queries and graph patterns.

What's New in LSQ V2

2020-08-06 LSQ2 Pre-release

LSQ2 introduces significant improvements over the prior version in every aspect: Ease-of-use, flexibility, modularity, consintency in the data model and generated IDs.

  • Pretty CLI (thanks to on picocli)
  • Easier yet more flexible to use: RDFization, static analysis and benchmarking now decoupled
  • Named graph stream approach: Information for each query is grouped in its own named graph which allows easily selecting subsets with complete information for detailed analysis.

Documentation

Detailed Documentation

For detailed documentation about setup, use and concepts of the LSQ command line tool please refer to our LSQ Website.

Quick Reference

Setup

This is a typical maven project and can is thus built with mvn clean install.

For Ubuntu/Debian users: The build process creates a .deb package that can be conviently installed after build with

./reinstall-deb.sh (requires root access).

Quick Usage

A quick reference for the typical process is as follows:

lsq rx probe file.log lsq rx rdfize -e http://server.from/which/the/log/is/from file.log > file.log.trig lsq rx benchmark create -d myDatasetLabel -e http://localhost:8890/sparql -o > benchmark.conf.ttl lsq rx benchmark prepare -c benchmark.conf.ttl -o > benchmark.run.ttl lsq rx benchmark run -c benchmark.run.ttl *.log.trig

The -o option causes the settings to be written to the console. Omit -o to have LSQ auto-generate files.

Run with Docker

Run example running LSQ to RDFize SPARQL logs, input and output files in the current working directory (replace $(pwd) by ${PWD} for Windows PowerShell):

bash docker run -it -v $(pwd):/data ghcr.io/aksw/lsq rx rdfize --endpoint=http://dbpedia.org/sparql virtuoso.dbpedia.log

Build the Docker image from the source code:

bash docker build -t ghcr.io/aksw/lsq .

License

The source code of this repo is published under the Apache License Version 2.0.

Owner

  • Name: AKSW Research Group @ University of Leipzig
  • Login: AKSW
  • Kind: organization
  • Location: Leipzig

GitHub Events

Total
  • Issues event: 4
  • Watch event: 3
  • Issue comment event: 13
  • Push event: 11
  • Create event: 1
Last Year
  • Issues event: 4
  • Watch event: 3
  • Issue comment event: 13
  • Push event: 11
  • Create event: 1

Committers

Last synced: over 2 years ago

All Time
  • Total Commits: 645
  • Total Committers: 10
  • Avg Commits per committer: 64.5
  • Development Distribution Score (DDS): 0.51
Past Year
  • Commits: 14
  • Committers: 2
  • Avg Commits per committer: 7.0
  • Development Distribution Score (DDS): 0.071
Top Committers
Name Email Commits
Claus Stadler R****n@g****m 316
Claus Stadler c****r@i****e 206
Muhammad Saleem s****d@g****m 113
aidhog a****g@g****m 3
Claus Stadler C****r@g****e 2
Miguel Ceriani m****i@g****m 1
David Haller d****r@f****e 1
Gregory Todd Williams g****g@e****m 1
Simon Bin s****n@i****e 1
Vincent Emonet v****t@g****m 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 1
  • Total pull requests: 0
  • Average time to close issues: over 3 years
  • Average time to close pull requests: N/A
  • Total issue authors: 1
  • Total pull request authors: 0
  • Average comments per issue: 3.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • Aklakan (3)
  • vemonet (1)
  • hashimkhanwazir (1)
  • nck-mlcnv (1)
Pull Request Authors
  • miguel76 (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 2
  • Total downloads: unknown
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 0
    (may contain duplicates)
  • Total versions: 12
proxy.golang.org: github.com/aksw/lsq
  • Versions: 6
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 5.4%
Average: 5.6%
Dependent repos count: 5.8%
Last synced: 5 months ago
proxy.golang.org: github.com/AKSW/LSQ
  • Versions: 6
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 5.4%
Average: 5.6%
Dependent repos count: 5.8%
Last synced: 5 months ago

Dependencies

lsq-cli/pom.xml maven
  • info.picocli:picocli
  • org.aksw.commons:aksw-commons-picocli
  • org.aksw.jenax:jenax-rx-ops-syscall
  • org.aksw.simba.lsq:lsq-core
  • org.aksw.simba.lsq:lsq-enrichers
  • org.aksw.simba.lsq:lsq-spark-core
  • org.apache.logging.log4j:log4j-slf4j18-impl
lsq-core/pom.xml maven
  • org.aksw.commons:aksw-commons-beans
  • org.aksw.jenax:jenax-arq-connection-core
  • org.aksw.jenax:jenax-arq-rdfnode-in-dataset
  • org.aksw.jenax:jenax-arq-rx
  • org.aksw.jenax:jenax-conjure-core
  • org.aksw.jenax:jenax-reprogen-core
  • org.aksw.simba.lsq:lsq-model
  • org.aksw.simba.lsq:lsq-parser
  • org.apache.jena:jena-shacl
  • org.apache.jena:jena-tdb2
  • org.topbraid:spin
  • junit:junit test
  • org.apache.logging.log4j:log4j-slf4j18-impl test
lsq-debian-cli/pom.xml maven
  • org.aksw.simba.lsq:lsq-cli
lsq-enrichers/pom.xml maven
  • org.aksw.simba.lsq:lsq-core
  • junit:junit test
  • org.apache.logging.log4j:log4j-slf4j18-impl test
lsq-legacy/pom.xml maven
  • org.aksw.simba.lsq:lsq-cli
lsq-model/pom.xml maven
  • org.aksw.jenax:jenax-conjure-core
  • org.aksw.jenax:jenax-reprogen-core
  • org.aksw.simba.lsq:lsq-vocab-jena
  • org.topbraid:spin
  • junit:junit test
  • org.apache.logging.log4j:log4j-slf4j18-impl test
lsq-parser/pom.xml maven
  • org.aksw.jenax:jenax-arq-rx
  • org.aksw.jenax:jenax-arq-utils
  • org.aksw.simba.lsq:lsq-vocab-jena
  • junit:junit test
  • org.apache.logging.log4j:log4j-slf4j18-impl test
lsq-pkg-parent/lsq-pkg-deb-cli/pom.xml maven
  • org.aksw.simba.lsq:lsq-cli
lsq-pkg-parent/lsq-pkg-docker-cli/pom.xml maven
  • org.aksw.simba.lsq:lsq-cli
lsq-pkg-parent/lsq-pkg-dummy/pom.xml maven
  • org.aksw.simba.lsq:lsq-pkg-deb-cli provided
  • org.aksw.simba.lsq:lsq-pkg-docker-cli provided
  • org.aksw.simba.lsq:lsq-pkg-rpm-cli provided
  • org.aksw.simba.lsq:lsq-pkg-uberjar-cli provided
lsq-pkg-parent/lsq-pkg-rpm-cli/pom.xml maven
  • org.aksw.simba.lsq:lsq-cli
lsq-pkg-parent/lsq-pkg-uberjar-cli/pom.xml maven
  • org.aksw.simba.lsq:lsq-cli
lsq-spark-core/pom.xml maven
  • com.thoughtworks.paranamer:paranamer
  • net.sansa-stack:sansa-spark-jena-java${scala.version.suffix}
  • org.aksw.simba.lsq:lsq-core
  • org.apache.logging.log4j:log4j-slf4j18-impl
  • org.apache.spark:spark-sql_${scala.binary.version}
  • junit:junit test
lsq-vocab-jena/pom.xml maven
  • org.apache.commons:commons-lang3
  • org.apache.jena:jena-core
pom.xml maven
  • org.apache.spark:spark-sql_2.12 3.0.1 provided
  • com.thoughtworks.paranamer:paranamer 2.8
  • commons-codec:commons-codec 1.15
  • info.picocli:picocli 4.4.0
  • junit:junit 4.13.1
  • net.sansa-stack:sansa-spark-jena-java_2.12 0.8.0-RC3-SNAPSHOT
  • org.aksw.commons:aksw-commons-beans 0.9.3-SNAPSHOT
  • org.aksw.commons:aksw-commons-io-utils 0.9.3-SNAPSHOT
  • org.aksw.commons:aksw-commons-picocli 0.9.3-SNAPSHOT
  • org.aksw.jenax:jenax-arq-connection-core 4.5.0-1-SNAPSHOT
  • org.aksw.jenax:jenax-arq-rdfnode-in-dataset 4.5.0-1-SNAPSHOT
  • org.aksw.jenax:jenax-arq-rx 4.5.0-1-SNAPSHOT
  • org.aksw.jenax:jenax-arq-utils 4.5.0-1-SNAPSHOT
  • org.aksw.jenax:jenax-conjure-core 4.5.0-1-SNAPSHOT
  • org.aksw.jenax:jenax-reprogen-core 4.5.0-1-SNAPSHOT
  • org.aksw.jenax:jenax-rx-ops-syscall 4.5.0-1-SNAPSHOT
  • org.aksw.simba.lsq:lsq-cli 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-core 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-enrichers 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-model 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-parser 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-pkg-deb-cli 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-pkg-docker-cli 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-pkg-rpm-cli 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-pkg-uberjar-cli 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-spark-core 2.0.0-SNAPSHOT
  • org.aksw.simba.lsq:lsq-vocab-jena 2.0.0-SNAPSHOT
  • org.apache.commons:commons-lang3 3.12.0
  • org.apache.jena:jena-core 4.5.0
  • org.apache.jena:jena-shacl 4.5.0
  • org.apache.jena:jena-tdb2 4.5.0
  • org.apache.logging.log4j:log4j-slf4j18-impl 2.17.1
  • org.slf4j:slf4j-api 1.8.0-beta4
  • org.topbraid:spin 2.0.0
.github/workflows/publish-docker.yml actions
  • actions/checkout v2 composite
Dockerfile docker
  • maven 3-jdk-11 build
  • openjdk 11-jre-slim build
lsq-pkg-parent/pom.xml maven
docker-from-uberjar/Dockerfile docker
  • openjdk 11-jre-slim build