open-data-access-tools - v0.2.6

What's Changed?

• Added tracking the sun dataset 2024.

- Python
Published by jgu2 12 months ago

open-data-access-tools - v0.2.5

What's Changed

• Updated table prefixes for data lake automation.
• Upgrade package versions.
• Updated info related to year 2025.

- Python
Published by jgu2 about 1 year ago

open-data-access-tools - v0.2.4

What's New

• Added ATB Transportation datasets

What's Fixed

• Fixed unit tests by pinning moto version.

- Python
Published by jgu2 about 2 years ago

open-data-access-tools - v0.2.3

What's New

• Added NSO dataset, and Jupyter notebook example
• Added Tracking the Sun 2023 dataset

- Python
Published by jgu2 over 2 years ago

open-data-access-tools - v0.2.2

• Fix unit tests
• Bump version to v0.2.2

- Python
Published by jgu2 over 2 years ago

open-data-access-tools - v0.2.1

What's New?

• Add Tracking the Sun 2022
• Add ATB 2023

- Python
Published by jgu2 about 3 years ago

open-data-access-tools - v0.2.0

What's New?

• Migrate AWS CDK from version 1 to version 2.
• Fix test error after the migration.
• Upgrade docs and note the compatibility issue.

- Python
Published by jgu2 over 3 years ago

open-data-access-tools - v0.1.6

What's New

• Replace base image from python by node, and then install Python 3.9
• Node 16.x
• NPM 8.x
• CDK@1.x

- Python
Published by jgu2 over 3 years ago

open-data-access-tools - v0.1.5

What's New

1. Add Tacking the Sun 2021 Jupyter notebook
2. Bump version to 0.1.5

What're Changed

1. Update ATB Jupyter notebook.

What're Fixed

1. Fixed CDK to version 1 cdk@1.x
2. One unit test fix.

- Python
Published by jgu2 over 3 years ago

open-data-access-tools - v0.1.4

What's New?

Improvements

• Crawler tagging, add Tags to AWS Glue crawler in CDK stack.

Datasets

• Update Res/Com-stack data sources
• Add tracking the sun 2021

Example

• Add notebook example for ATB dataset.

- Python
Published by jgu2 almost 4 years ago

open-data-access-tools - v0.1.3

Change logs

1. Update CICD pipeline for auto-publishing docker images to DockerHub
2. Update documentation of GitHub pages.

- Python
Published by jgu2 almost 4 years ago

open-data-access-tools - v0.1.2

Change logs

1. Update database deployment, each dataset has its own database in data lake;
2. Change config.yaml schema to support multiple database deploy and update;
3. Added ATB Electricity 2019, 2020, and 2021 datasets;
4. Added Jupyter notebook example for Tracking the Sun 2020;
5. Update units, documentation, and according util functions to support the changes.
6. Publish image to DockerHub - https://hub.docker.com/r/openenergydatainitiative/oedi

- Python
Published by jgu2 over 4 years ago

open-data-access-tools - v0.1.1

Change logs

1. oedi CLI commands bug fix related to AWS region.
2. Datasets were migrated to one AWS S3 bucket oedi-data-lake.
3. Update Jupyter notebooks in examples due to the source change.
4. Other minor changes.
5. Docker image pushed to DockerHub - https://hub.docker.com/repository/docker/openenergydatainitiative/oedi

- Python
Published by jgu2 almost 5 years ago

open-data-access-tools - v0.1.0

New Features

1. Build OEDI data lake on AWS by using AWS CDK in either local or docker environment.
2. Integrate open datasets on Registry of Open Data on AWS published through OEDI.
   • PV Rooftop, Aspects
   • PV Rooftop, Buildings
   • PV Rooftop, Developable Planes
   • PV Rooftop, RASD
   • Tracking the Sun, 2018
   • Tracking the Sun, 2019
3. Custom your data lake through configuration ~/.oedi/config.yaml
4. Deploy, update, and test OEDI data lake through cdk and oedi commands.
5. Query metadata and data through OEDIGlue and OEDIAthena interfaces.
6. Add Jupyter notebooks as examples of data access.
7. Online documentation - https://openedi.github.io/open-data-access-tools/

- Python
Published by jgu2 over 5 years ago