https://github.com/acdh-oeaw/vlo-curation

VLO curation

https://github.com/acdh-oeaw/vlo-curation

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (14.1%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

VLO curation

Basic Info
  • Host: GitHub
  • Owner: acdh-oeaw
  • License: gpl-3.0
  • Language: Java
  • Default Branch: master
  • Homepage:
  • Size: 5.7 MB
Statistics
  • Stars: 2
  • Watchers: 6
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Archived
Created over 10 years ago · Last pushed almost 9 years ago
Metadata Files
Readme License

README.md

Table of Contents

  • What is the VLO?
  • What should I read?
  • Setting up
    • Preparing for release
  • Using the VLO
    • Running an import

What is the VLO?

Using the VLO faceted browser, you can browse metadata by facet. It consists of three software components: a Solr server with VLO specific configuration, an importer and a web application front end.

For more information, see the wiki page.

What should I read?

  • README This file; a general introduction and development information
  • DEPLOY-README Instructions on how to deploy a fresh VLO installation
  • UPGRADE Instructions on how to upgrade an existing VLO installation
  • CHANGES A list of changes per release
  • LICENSE Licensing information

Licensing

All code unless otherwise noted is licensed under the terms of the GNU GENERAL PUBLIC LICENSE 3 (GPL3). Please refer to the file LICENSE in the root directory of this repository.

Development information

Some general development notes.

Setting up

Follow the instructions in DEPLOY-README to set up a development environment. You may deploy the Solr instance and the web app from your IDE. Make sure to set the required Java system property for the Solr data location (solr.data.dir)!

Preparing for release

These instructions apply to any kind of release, whether it's a stable version, or for beta or alpha deployment. Always increase the version number and keep the trunk in -SNAPSHOT but not the tags so that a deployed version can always be traced back to its sources!

  • Make a tag of the version to release:

    ` git checkout development git checkbout -b release-vlo-4.a.b

  • Change the version number in the poms to match the release (should match the directory name and be non-snapshot!!):

    mvn versions:set -DnewVersion=4.a.b

This will update the version numbers of the parent pom and all VLO modules in one go!

  • Build the tag and inspect the output of vlo-distribution

    mvn clean install #do not skip unit tests ;)

Unpack the tarball in vlo-distribution/target somehwere and check its contents on version numbers, config files etc.

You may also want to do a 'svn diff' to check the change of the version numbers.

  • Clean up and commit

    mvn versions:commit #cleans up POM backups mvn clean #cleans up build outpit svn commit -m "Created tag for VLO version 4.a.b" git commit

  • Merge into master and tag to finalise the release

    ``` git checkout master git merge release-vlo-4.a.b #maybe some conflicts needs to be resolved after this git push

    tag

    git tag -a 4.a.b git push --tags ```

  • Merge changes into development

    git checkout development git merge release-vlo-4.a.b #maybe some conflicts needs to be resolved after this mvn version:set -DnewVersion 4.c-SNAPSHOT mvn versions:commit git commit git push

  • Done!

After building the entire project, a deployment package will be present in the 'target' directory of vlo-distribution. This includes WARs for both the Solr and the web app front end as well as the importer script and default configuration files.

Running the VLO

After a successful deployment and configuration, you should be able to browse to the VLO web app and browse the imported records.

If the VLO is empty, you will need to run an import first.

Running an import

To run an import, go the 'bin' child directory of the VLO application directory and run

./vlo_solr_importer.sh

as the appropriate user (e.g. 'vlouser').

It's advisable to run this in a detached background process (for example using "screen") because an import can take quite a long time depending on the amount of records to be imported. Also make sure that enough memory is available. Some VM parameters are configured inside the script.

Some progress information is logged to a file 'log/vlo-importer.log'. It gets rotated automatically by the import process.

For a fresh import, even when the VLO is not configured to delete all documents from the index first, you can simply remove the contents of the Solr data directory (check server configuration documentation for the exact location).

Owner

  • Name: Austrian Centre for Digital Humanities & Cultural Heritage
  • Login: acdh-oeaw
  • Kind: organization
  • Email: acdh@oeaw.ac.at
  • Location: Vienna, Austria

GitHub Events

Total
Last Year

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Dependencies

pom.xml maven
  • org.slf4j:slf4j-api 1.7.20
  • junit:junit 4.12 test
vlo-commons/pom.xml maven
  • javax.servlet:servlet-api 2.5 provided
  • com.google.guava:guava 19.0
  • org.slf4j:slf4j-log4j12 ${slf4j.version} test
  • xmlunit:xmlunit 1.5 test
vlo-importer/pom.xml maven
  • javax.servlet:servlet-api 2.5 provided
  • com.ximpleware:vtd-xml 2.11
  • commons-cli:commons-cli 1.3
  • commons-lang:commons-lang 2.6
  • eu.clarin.cmdi:vlo-commons 4.0.1-CURATION
  • eu.clarin.cmdi:vlo-vocabularies 4.0.1-CURATION
  • net.handle:handle-client 7.0
  • net.sf.json-lib:json-lib 2.4
  • net.sf.saxon:Saxon-HE ${saxon.version}
  • org.apache.httpcomponents:httpclient 4.3.4
  • org.apache.solr:solr-solrj ${solr.version}
  • org.jgrapht:jgrapht-core 0.9.1
  • org.slf4j:slf4j-log4j12 ${slf4j.version}
vlo-sitemap/pom.xml maven
  • com.ximpleware:vtd-xml 2.11
  • commons-configuration:commons-configuration 1.6
  • org.slf4j:slf4j-api 1.7.12
  • org.slf4j:slf4j-log4j12 1.7.12
vlo-solr/pom.xml maven
  • org.apache.solr:solr-core ${solr.version}
  • org.apache.solr:solr-dataimporthandler ${solr.version}
  • org.apache.solr:solr-solrj ${solr.version}
  • org.slf4j:jcl-over-slf4j ${slf4j.version}
  • org.slf4j:slf4j-log4j12 ${slf4j.version}
vlo-statistics/pom.xml maven
  • com.timgroup:java-statsd-client 3.1.0
  • eu.clarin.cmdi:vlo-commons 4.0.1-CURATION
  • org.apache.solr:solr-solrj ${solr.version}
  • org.slf4j:jcl-over-slf4j ${slf4j.version}
  • org.slf4j:slf4j-simple ${slf4j.version}
vlo-vocabularies/pom.xml maven
  • org.apache.poi:poi 3.7
  • org.slf4j:jcl-over-slf4j 1.7.12
  • org.slf4j:slf4j-api 1.7.12
  • org.slf4j:slf4j-log4j12 1.7.12
  • junit:junit 4.12 test
vlo-web-app/pom.xml maven
  • org.eclipse.jetty.aggregate:jetty-all-server 8.1.17.v20150415 provided
  • com.sun.jersey:jersey-client 1.19
  • de.agilecoders.wicket:wicket-bootstrap-core 0.10.6
  • eu.clarin.cmdi:vlo-commons 4.0.1-CURATION
  • net.sf.saxon:Saxon-HE ${saxon.version}
  • nl.mpi.corpusstructure:corpus-structure-2-core 1.1.7
  • org.apache.solr:solr-solrj ${solr.version}
  • org.apache.wicket:wicket-extensions 7.3.0
  • org.apache.wicket:wicket-spring 7.3.0
  • org.slf4j:jcl-over-slf4j ${slf4j.version}
  • org.slf4j:slf4j-log4j12 ${slf4j.version}
  • org.springframework:spring-context 4.2.5.RELEASE
  • org.springframework:spring-web 4.2.5.RELEASE
  • eu.clarin.cmdi:vlo-importer 4.0.1-CURATION test
  • org.apache.commons:commons-lang3 3.4 test
  • org.apache.solr:solr-core ${solr.version} test
  • org.apache.solr:solr-test-framework ${solr.version} test
  • org.jmock:jmock-junit4 2.8.2 test
  • org.springframework:spring-test 4.2.5.RELEASE test