https://github.com/clowder-framework/extractors-core

Set of core extractors (image, video, audio, pdf) for clowder.

https://github.com/clowder-framework/extractors-core

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (7.6%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Set of core extractors (image, video, audio, pdf) for clowder.

Basic Info
  • Host: GitHub
  • Owner: clowder-framework
  • License: ncsa
  • Language: Python
  • Default Branch: main
  • Homepage:
  • Size: 39.5 MB
Statistics
  • Stars: 2
  • Watchers: 8
  • Forks: 1
  • Open Issues: 9
  • Releases: 0
Created almost 7 years ago · Last pushed over 1 year ago
Metadata Files
Readme Changelog License

README.md

Clowder Core Extractors

This repository contain the core extractors that most people would like to install:

  • image : creates image previews, thumbnails and extracts metadata
  • video : creates image previews, thumbnails and video previews
  • audio : creates image previews, thumbnails and audio previews
  • pdf : creates image previews, thumbnails and pdf previews
  • office : creates image previews, thumbnails and pdf previews

To test these extractors use the docker-compose file in clowder.

All code pull requests in this repo should be created against the main branch, and it's the default one. When making changes to the code, bump the version in the extractor_info.json as well as update the CHANGELOG.md

Support for Clowder V2

When running extractors against a Clowder V2 instance, pass the environment variable CLOWDER_VERSION=2 to the running Python program or Docker container.

Docker Build and Run Instructions for Clowder V2

CD into the directory containing the specific extractor:

shell docker build -t <extractor-docker-image-name> . docker run --rm -e CLOWDER_VERSION=2 -e "RABBITMQ_URI=amqp://guest:guest@rabbitmq:5672/%2f" --network <clowder_nework_name> <extractor-docker-image-name>

E.g., For image preview extractor, the build and run commands could be:

shell docker build -t clowder/extractors-image-preview . docker run --rm -e CLOWDER_VERSION=2 -e "RABBITMQ_URI=amqp://guest:guest@rabbitmq:5672/%2f" --network clowder2-dev_clowder2 clowder/extractors-image-preview

Owner

  • Name: Clowder
  • Login: clowder-framework
  • Kind: organization
  • Email: clowder@lists.illinois.edu

Research data management for long tail data.

GitHub Events

Total
  • Issues event: 1
  • Watch event: 1
  • Push event: 9
  • Create event: 1
Last Year
  • Issues event: 1
  • Watch event: 1
  • Push event: 9
  • Create event: 1

Dependencies

.github/workflows/docker.yml actions
  • actions/checkout v2 composite
  • docker/build-push-action v2 composite
  • docker/login-action v2 composite
  • docker/setup-buildx-action v2 composite
  • docker/setup-qemu-action v2 composite
  • peter-evans/dockerhub-description v2 composite
.github/workflows/pyclowder.yml actions
  • actions/checkout v2 composite
  • peter-evans/create-pull-request v3 composite
audio/preview/Dockerfile docker
  • python 3.7-alpine build
digest/Dockerfile docker
  • python 3.7 build
image/metadata/Dockerfile docker
  • python 3.7-alpine build
image/preview/Dockerfile docker
  • python 3.7 build
office/preview/Dockerfile docker
  • python 3.7-alpine build
pdf/preview/Dockerfile docker
  • python 3.7-alpine build
video/preview/Dockerfile docker
  • python 3.7 build
audio/preview/requirements.txt pypi
  • pyclowder ==2.6.0
digest/requirements.txt pypi
  • pyclowder ==2.6.0
  • pycurl ==7.43.0.6
image/metadata/requirements.txt pypi
  • pyclowder ==2.6.0
image/preview/requirements.txt pypi
  • pyclowder ==2.6.0
office/preview/requirements.txt pypi
  • pyclowder ==2.6.0
pdf/preview/requirements.txt pypi
  • pyclowder ==2.6.0
video/preview/requirements.txt pypi
  • pyclowder ==2.6.0
  • pycurl ==7.43.0.6