ogd-automation

A repository for automation scripts for moving OGD data around.

https://github.com/opengamedata/ogd-automation

Science Score: 52.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
✓
Institutional organization owner
Organization opengamedata has institutional domain (opengamedata.fielddaylab.wisc.edu)
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (7.2%) to scientific vocabulary

Last synced: 10 months ago · JSON representation ·

Repository

A repository for automation scripts for moving OGD data around.

Basic Info

Host: GitHub
Owner: opengamedata
License: mit
Language: Python
Default Branch: main
Size: 292 KB

Statistics

Stars: 1
Watchers: 3
Forks: 0
Open Issues: 3
Releases: 1

Created over 3 years ago · Last pushed 10 months ago

Metadata Files

Readme License Citation

opengamedata-automation

A repository for automation scripts to sync OGD logs from MySQL to BigQuery.

Setup:

Install python3 for your environment
Install python dependencies: "pip3 install -r requirements.txt"
Copy config.py.template to config.py set server/authentication data and the source & destination db tables
Download the authentication key needed for the BigQuery project. Save it as a .json file in the config directory and ensure the file path is defined in config.py

```bash usage: main.py --max-days

is your python command. is the game whose data you wish to move to BigQuery is the max number of days-worth of data you wish to move ```

These processes are also set up to run automatically in GitHub actions. Current workflows are configured to run at the following times:

| Time (UTC) | | --- | --- | 8:40 | 2:40 (AM) | 9:00 | 3:00 (AM) | 8:55 | 2:55 (AM) | 9:05 | 3:05 (AM) | 10:45 | 4:45 (AM) | 9:10 | 3:10 (AM) | 8:50 | 2:50 (AM) | 9:15 | 3:15 (AM) | 9:20 | 3:20 (AM) | 9:25 | 3:25 (AM) | 9:30 | 3:30 (AM) | 9:35 | 3:35 (AM) | 11:15 | 5:15 (AM) | 8:45 | 2:45 (AM) | 9:40 | 3:40 (AM) | 9:45 | 3:45 (AM) | 9:50 | 3:50 (AM) | 9:55 | 3:55 (AM) | 10:00 | 4:00 (AM) | 10:05 | 4:05 (AM) | 11:05 | 5:05 (AM) | 10:10 | 4:10 (AM) | 11:10 | 5:10 (AM) | 10:15 | 4:15 (AM) | 10:20 | 4:20 (AM) | 10:55 | 4:55 (AM) | 11:00 | 5:00 (AM) | 10:25 | 4:25 (AM) | 10:30 | 4:30 (AM) | 10:35 | 4:35 (AM) | 10:50 | 4:50 (AM) | 10:40 | 4:40 (AM) Time (Central) | Time (Central, Daylight) | Frequency | Game | Status | | --- | --- | --- | --- | | 3:40 (AM) | Daily | ANSWERCAMPUS | | | 4:00 (AM) | Daily | AQUALAB | | | 3:55 (AM) | Daily | AYCET | | | 4:05 (AM) | Daily | BACTERIA | | | 5:45 (AM) | Daily | BALLOON | | | 4:10 (AM) | Daily | BLOOM | | | 3:50 (AM) | Daily | CRUSHSTATIONS | | | 4:15 (AM) | Daily | CRYSTAL | | | 4:20 (AM) | Daily | CYCLECARBON | | | 4:25 (AM) | Daily | CYCLENITROGEN | | | 4:30 (AM) | Daily | CYCLEWATER | | | 4:35 (AM) | Daily | EARTHQUAKE | | | 6:15 (AM) | Daily | ASTRO | | | 3:45 (AM) | Daily | GWAKKAMOLE | | | 4:40 (AM) | Daily | ICECUBE | | | 4:45 (AM) | Daily | JOURNALISM | | | 4:50 (AM) | Daily | JOWILDER | | | 4:55 (AM) | Daily | LAKELAND | | | 5:00 (AM) | Daily | MAGNET | | | 5:05 (AM) | Daily | MASHOPOLIS | | | 6:05 (AM) | Weekly | MATCH | | | 5:10 (AM) | Daily | PENGUINS | | | 6:10 (AM) | Daily | PENNYCOOK | | | 5:15 (AM) | Daily | SHADOWSPECT | | | 5:20 (AM) | Daily | SHIPWRECKS | | | 5:55 (AM) | Weekly | SLIDE | | | 6:00 (AM) | Weekly | STACK | | | 5:25 (AM) | Daily | THERMOLAB | | | 5:30 (AM) | Daily | TRANSFORMATIONQUEST | | | 5:35 (AM) | Daily | WAVES | | | 5:50 (AM) | Daily | WEATHERSTATION | | | 5:40 (AM) | Daily | WIND | |

Current latest run: 11:15 UTC/5:15 CST

Last keep-alive on 09/01/25

Owner

Name: Open Game Data
Login: opengamedata
Kind: organization

Website: opengamedata.fielddaylab.wisc.edu
Repositories: 11
Profile: https://github.com/opengamedata

Open Game Data is a project out of the UW - Madison Field Day Lab to make datasets of anonymous play data public for science.

Citation (CITATION.cff)

# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: opengamedata-automation
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - name: Field Day Lab
    city: Madison
    country: US
    region: Wisconsin
    website: 'https://fielddaylab.wisc.edu/'
  - given-names: Luke
    family-names: Swanson
    email: lwswanson2@wisc.edu
    affiliation: Field Day Lab
    orcid: 'https://orcid.org/0000-0002-8455-7441'
  - given-names: David
    family-names: Gagnon
    email: djgagnon@wisc.edu
    affiliation: Field Day Lab
    orcid: 'https://orcid.org/0000-0001-5126-0476'
repository-code: 'https://github.com/opengamedata/opengamedata-automation'
license: MIT

GitHub Events

Total

Create event: 8
Release event: 1
Issues event: 20
Delete event: 3
Push event: 35
Pull request review comment event: 4
Pull request review event: 5
Pull request event: 9

Last Year

Create event: 8
Release event: 1
Issues event: 20
Delete event: 3
Push event: 35
Pull request review comment event: 4
Pull request review event: 5
Pull request event: 9

Issues and Pull Requests

Last synced: 10 months ago

All Time

Total issues: 13
Total pull requests: 6
Average time to close issues: 1 day
Average time to close pull requests: about 2 hours
Total issue authors: 1
Total pull request authors: 1
Average comments per issue: 0.0
Average comments per pull request: 0.0
Merged pull requests: 4
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 13
Pull requests: 6
Average time to close issues: 1 day
Average time to close pull requests: about 2 hours
Issue authors: 1
Pull request authors: 1
Average comments per issue: 0.0
Average comments per pull request: 0.0
Merged pull requests: 4
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

LswaN58 (13)

Pull Request Authors

LswaN58 (6)

Top Labels

Issue Labels

automation (13)

Pull Request Labels

automation (6)

Dependencies

.github/actions/OGD_automation_config/action.yml actions

.github/actions/OGD_automation_dependencies/action.yml actions

.github/workflows/aqualab.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/bacteria.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/balloon.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/crystal.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/cycle_carbon.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/cycle_nitrogen.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/cycle_water.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/earthquake.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/icecube.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/journalism.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/jowilder.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/lakeland.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/magnet.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/mashopolis.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/penguins.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/shadowspect.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/shipwrecks.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/thermovr.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/transformation_quest.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/verify_VPN.yml actions

actions/checkout v3 composite

.github/workflows/waves.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/wind.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

requirements.txt pypi

google-cloud-bigquery ==3.3.6
mysql-connector-python ==8.0.25
pyOpenSSL ==23.0.0
sshtunnel ==0.4.0

.github/workflows/bloom.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

.github/workflows/keep-alive.yml actions

actions/checkout v3 composite
actions/upload-artifact v3 composite

.github/workflows/weather_station.yml actions

./.github/actions/OGD_automation_config * composite
./.github/actions/OGD_automation_dependencies * composite
actions/checkout v3 composite
actions/upload-artifact v3 composite
google-github-actions/setup-gcloud v0 composite

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science