Data

Tools

Indexes

Applications

Experiments

Open Source Science

observatory-platform

Observatory Platform Package

https://github.com/the-academic-observatory/observatory-platform

Science Score: 64.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ✓
    Committers with academic emails
    2 of 14 committers (14.3%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (12.3%) to scientific vocabulary

Keywords

airflow data observatory-platform workflow

Keywords from Contributors

academic ebooks higher-education
Last synced: 6 months ago · JSON representation ·

Repository

Observatory Platform Package

Basic Info
  • Host: GitHub
  • Owner: The-Academic-Observatory
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Homepage: https://docs.observatory.academy
  • Size: 7.95 MB
Statistics
  • Stars: 19
  • Watchers: 3
  • Forks: 6
  • Open Issues: 1
  • Releases: 9
Topics
airflow data observatory-platform workflow
Created about 6 years ago · Last pushed 8 months ago
Metadata Files
Readme Contributing License Code of conduct Citation Zenodo

README.md

Observatory Platform

The Observatory Platform is a set of dependencies used by the Curtin Open Knowledge Initiative (COKI) for running its Airflow based workflows to fetch, process and analyse bibliometric datasets.

The workflows for the project can be seen in at: * Academic Observatory Workflows * OAeBU Workflows

License Python Version Code style: black Python package Documentation Status codecov DOI

Dependencies

Observatory Platform supports Python 3.10, Ubuntu Linux 22.04 and MacOS 10.14, on x86 architecture.

System dependencies: * Python 3.10 * Pip * virtualenv * Google Cloud SDK (optional): https://cloud.google.com/sdk/docs/install-sdk

Installation & Unit Tests

Enter observatory-platform folder: bash cd observatory-platform

Install dependencies: bash pip install -e .[tests] --constraint https://raw.githubusercontent.com/apache/airflow/constraints-2.10.5/constraints-no-providers-3.10.txt

Run unit tests: bash python3 -m unittest discover -v

Python Package Reference

See the Read the Docs website for documentation on the Python package https://observatory-platform.readthedocs.io

Dependent Repositories

The Observatory Platform is a dependency for other repositories developed and maintained by The Academic Observatory: * Academic Observatory Workflows * OAeBU Workflows

Owner

  • Name: The Academic Observatory
  • Login: The-Academic-Observatory
  • Kind: organization

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
title: "Observatory Platform"
url: "https://github.com/The-Academic-Observatory/observatory-platform"
doi: 10.5281/zenodo.6366700
authors:
  - given-names: "James P"
    family-names: "Diprose"
  - given-names: "Richard"
    family-names: "Hosking"
  - given-names: "Aniek"
    family-names: "Roelofs"
  - given-names: "Tuan-Yow"
    family-names: "Chien"
  - given-names: "Alex"
    family-names: "Massen-Hane"      
  - given-names: "Keegan R"
    family-names: "Smith"    
  - given-names: "Lucy"
    family-names: "Montgomery"
  - given-names: "Cameron"
    family-names: "Neylon"

GitHub Events

Total
  • Watch event: 1
  • Delete event: 5
  • Member event: 1
  • Push event: 31
  • Pull request review event: 2
  • Pull request review comment event: 5
  • Pull request event: 11
  • Fork event: 1
  • Create event: 5
Last Year
  • Watch event: 1
  • Delete event: 5
  • Member event: 1
  • Push event: 31
  • Pull request review event: 2
  • Pull request review comment event: 5
  • Pull request event: 11
  • Fork event: 1
  • Create event: 5

Committers

Last synced: almost 3 years ago

All Time
  • Total Commits: 282
  • Total Committers: 14
  • Avg Commits per committer: 20.143
  • Development Distribution Score (DDS): 0.66
Top Committers
Name Email Commits
Jamie Diprose j****e@g****m 96
aroelo a****s@c****u 64
tuanchien t****n@u****m 47
Bec Handcock 4****k@u****m 15
Bec Handcock 4****k@u****m 10
Keegan Smith 3****1@u****m 9
Richard Hosking r****g@c****u 9
Jamie Diprose 5****g@u****m 8
Richard Hosking r****d@h****m 8
Alex Massen-Hane 1****e@u****m 6
Cameron Neylon cn@c****t 5
aroelo a****3@l****l 3
kathrynnapier 4****r@u****m 1
Samuel Klein m****j@g****m 1
Committer Domains (Top 20 + Academic)
curtin.edu.au: 2 live.nl: 1 cameronneylon.net: 1 hoskingnz.com: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 3
  • Total pull requests: 161
  • Average time to close issues: about 1 year
  • Average time to close pull requests: about 1 month
  • Total issue authors: 2
  • Total pull request authors: 8
  • Average comments per issue: 3.0
  • Average comments per pull request: 1.03
  • Merged pull requests: 125
  • Bot issues: 0
  • Bot pull requests: 8
Past Year
  • Issues: 0
  • Pull requests: 11
  • Average time to close issues: N/A
  • Average time to close pull requests: 1 day
  • Issue authors: 0
  • Pull request authors: 2
  • Average comments per issue: 0
  • Average comments per pull request: 0.09
  • Merged pull requests: 11
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • aroelo (2)
  • bechandcock (1)
Pull Request Authors
  • jdddog (65)
  • keegansmith21 (39)
  • tuanchien (23)
  • alexmassen-hane (20)
  • aroelo (11)
  • dependabot[bot] (8)
  • kathrynnapier (5)
  • rhosking (2)
Top Labels
Issue Labels
Bug (1)
Pull Request Labels
Dependencies (8) Feature (3) Refactoring (1) Bug (1)

Packages

  • Total packages: 2
  • Total downloads:
    • pypi 35 last-month
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 2
    (may contain duplicates)
  • Total versions: 16
  • Total maintainers: 1
pypi.org: observatory-api
  • Versions: 8
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 19 Last month
Rankings
Dependent packages count: 10.1%
Stargazers count: 13.9%
Forks count: 14.2%
Average: 16.6%
Dependent repos count: 21.6%
Downloads: 23.1%
Maintainers (1)
jdddog
Last synced: 6 months ago
pypi.org: observatory-platform

The Observatory Platform is an environment for fetching, processing and analysing data to understand how well universities operate as Open Knowledge Institutions.

  • Versions: 8
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 16 Last month
Rankings
Dependent packages count: 10.1%
Stargazers count: 13.9%
Forks count: 14.2%
Average: 16.7%
Dependent repos count: 21.6%
Downloads: 23.5%
Maintainers (1)
jdddog
Last synced: 6 months ago

Dependencies

docs/requirements.txt pypi
  • Sphinx >=4,<5
  • docutils ==0.16.
  • mistune <2
  • pandas *
  • pbr ==5.5.
  • recommonmark ==0.7.
  • sphinx-autoapi ==1.8.
  • sphinx-rtd-theme ==0.5.
  • sphinxcontrib.openapi ==0.7.
observatory-api/requirements.cloudrun.txt pypi
  • Flask >=1.1.4,<2
  • SQLAlchemy >=1.3.18,<2
  • certifi >=2021.5.30
  • connexion >=2.7.0,<3
  • elasticsearch >=8.0.0,<9
  • gunicorn >=20.1.0,<21
  • markupsafe ==2.0.1
  • openapi-spec-validator >=0.3.1,<1
  • pendulum >=2.1.2,<3
  • psycopg2-binary >=2.9.1,<3
  • python-dateutil >=2.8.2,<3
  • pyyaml >=5.1,<6
  • urllib3 >=1.25.11,<2
observatory-api/requirements.txt pypi
  • Flask >=1.1.4,<2
  • Jinja2 >=2.10.1,<3
  • certifi >=2021.5.30
  • connexion >=2.7.0,<3
  • elasticsearch >=8.0.0,<9
  • gunicorn >=20.1.0,<21
  • markupsafe ==1.1.1
  • openapi-spec-validator >=0.3.1,<1
  • pendulum >=2.1.2,<3
  • psycopg2-binary >=2.9.1,<3
  • python-dateutil >=2.8.2,<3
  • pyyaml >=5.1,<6
  • urllib3 >=1.25.11,<2
observatory-platform/observatory/platform/cli/templates/generate_project/docs_requirements.txt pypi
  • Sphinx >=4,<5
  • docutils ==0.16.
  • pandas ==1.3.
  • pbr ==5.5.
  • recommonmark ==0.7.
  • sphinx-autoapi ==1.8.
  • sphinx-rtd-theme ==0.5.
  • sphinxcontrib.openapi ==0.7.
observatory-platform/requirements.txt pypi
  • Jinja2 >=2.10.1,<3
  • Markdown ==3.3.4
  • Sphinx >=4,<5
  • WTForms <3
  • aiohttp >=3.7.0,<4
  • apache-airflow ==2.2.1
  • apache-airflow-providers-celery ==2.1.0
  • apache-airflow-providers-http ==2.0.0
  • apache-airflow-providers-redis ==2.0.1
  • apache-airflow-providers-slack ==4.0.0
  • backoff >=1.11.0,<2
  • cerberus >=1.3.4,<2
  • click >=7.1.2,<8
  • docker-compose >=1.29.2,<2
  • elasticsearch >=8.0.0,<9
  • freezegun >=1.1.0,<2
  • google-api-python-client ==2.0.
  • google-auth-oauthlib >=0.4.5,<1
  • google-cloud-bigquery ==2.1.
  • google-cloud-secret-manager <2.0.0,>=0.2.0
  • google-cloud-storage ==1.35.
  • google-crc32c >=1.1.0,<2
  • httpretty >=1.0.0,<2
  • importlib-metadata ==3.7.3
  • json_lines >=0.5.0,<1
  • jsonlines >=2.0.0,<3
  • natsort >=7.1.1,<8
  • numpy >=1.20.3,<2
  • oauth2client ==4.1.
  • observatory-api *
  • pandas *
  • paramiko >=2.7.2,<3
  • pyhcl >=0.4.4,<1
  • pysftp >=0.2.9<1
  • pyyaml >=5.1,<6
  • requests >=2.25.0,<3
  • sftpserver >=0.3,<1
  • six >=1.16.0,<2
  • stringcase >=1.2.0,<2
  • timeout-decorator *
  • tldextract >=3.1.1
  • typing-extensions >=3.10.0.1,<4
  • validators *
  • xmltodict *
tests/fixtures/cli/my-workflows-project/requirements.txt pypi
  • oidsha256 * test
  • size12 * test
.github/workflows/build-observatory-api.yml actions
  • actions/checkout v3 composite
  • docker/build-push-action v3 composite
  • docker/login-action v1 composite
  • docker/metadata-action v3 composite
.github/workflows/publish-pypi.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
  • pypa/gh-action-pypi-publish master composite
.github/workflows/unit-tests.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
  • codecov/codecov-action v1 composite
observatory-api/Dockerfile docker
  • python 3.9-slim build