clim-recal

Open repository of methods for recalibrating & bias correcting UKCP18 climate projections data

https://github.com/alan-turing-institute/clim-recal

Science Score: 57.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 6 DOI reference(s) in README
  • Academic publication links
  • Committers with academic emails
    7 of 12 committers (58.3%) from academic institutions
  • Institutional organization owner
    Organization alan-turing-institute has institutional domain (turing.ac.uk)
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (16.3%) to scientific vocabulary

Keywords

hut23 hut23-1077

Keywords from Contributors

mcmc
Last synced: 7 months ago · JSON representation

Repository

Open repository of methods for recalibrating & bias correcting UKCP18 climate projections data

Basic Info
Statistics
  • Stars: 10
  • Watchers: 7
  • Forks: 2
  • Open Issues: 52
  • Releases: 0
Topics
hut23 hut23-1077
Created about 3 years ago · Last pushed over 1 year ago
Metadata Files
Readme Contributing License

README.md

Welcome to the clim-recal repository!

mit-license coverage Code style: black CI

Welcome to clim-recal, a specialised resource which provides a data-processing pipeline for extracting parts of the UK Climate Projections 2018 Convection Permitting model (UKCP18-CPM) in order to apply and assess bias correction methods via adjustment to and comparison with the HadUK-Grid.

clim-recal:

  • Is a software library for pre-processing climate data to ready it for bias-correction
  • Was developed in partnership with the MetOffice to ensure the propriety, quality, and usability of our work
  • Provides a framework for open additions of new software libraries/bias correction methods (in planning)

Overview: Data-processing Pipeline

Regional climate models (RCMs) contain systematic errors, or biases in their output [^1]. Biases arise in RCMs for a number of reasons, such as the assumptions in the general circulation models (GCMs), and in the downscaling process from GCM to RCM.

Researchers, policy-makers and other stakeholders wishing to use publicly available RCMs need to consider a range of "bias correction” methods (sometimes referred to as "bias adjustment" or "recalibration"). Bias correction methods offer a means of adjusting the outputs of RCM in a manner that might better reflect future climate change signals whilst preserving the natural and internal variability of climate [^2].

However, in order to apply and assess these methods, the climate model of interest needs to be overlaid to corresponding observation data. This can be a time-consuming and laborious process where data is spatially and temporally very granular.

The clim-recal pipeline addresses this by providing preprocessed data, including the innovative UKCP18-CPM datasets, to facilitate the assessment of these methods on aligned, reprojected data, without requiring the whole (very large) dataset.

clim-recal is a data-processing pipeline, with the following steps:

  1. Set-up & data download We provide custom scripts to facilitate download of data
  2. Preprocessing This includes reprojecting, resampling & splitting the data prior to bias correction

For a quick start on installing and running the pipeline, refer to our pipeline guide.

Our work is however, just like climate data, intended to be dynamic, and we welcome collaboration from researchers who wish to further our aims!

Documentation

We are in the process of developing comprehensive documentation for our code base to supplement the guidance provided in this and other README.md files. In the interim, there is documentation available in the following forms:

User documentation

To use clim-recal programmatically

To contribute to clim-recal

The Datasets

UKCP18-CPM

The UK Climate Projections 2018 (UKCP18) dataset offers insights into the potential climate changes in the UK. UKCP18 is an advancement of the UKCP09 projections and delivers the latest evaluations of the UK's possible climate alterations in land and marine regions throughout the 21st century. This crucial information aids in future Climate Change Risk Assessments and supports the UK’s adaptation to climate change challenges and opportunities as per the National Adaptation Programme.

We make use of the Convection Permitting Model (CPM). This dataset represents a much finer spatial resolution of climate model (2.2km grid) than typical climate-models, representing a step forward in the ability to simulate small scale behavior (in particular 'atmospheric convection'), and the influence of mountains, coastlines and urban areas. As a result, the CPM provides access to credible climate information important for small-scale weather features and also on local (kilometre) scale; which is particularly important for improving our understanding of climate change in cities.

The UKCP18-CPM represents a high-emission scenario (RCP 8.5).

The UKCP18-CPM is comprised of 12 ensemble members (or runs), driven by the same 12km Regional Climate Model (Strand 3 12km RCM ensemble). In addition to run 1, we selected the following runs:

  • Run 05: Represents the ensemble member with the second lowest mean annual tasmax of all ensembles members
  • Run 06: Represents the ensemble member with the second highest mean annual tasmax of all ensembles members
  • Run 07 & Run 08: Represent the ensemble members with the average mean annual tasmax of all ensemble members

We believe that this combination will provide users with enough uncertainty in their estimates to appropriately assess bias correction methods.

HADS

HadUK-Grid is a comprehensive collection of climate data for the UK, compiled from various land surface observations across the country. This data is organized into a uniform grid to ensure consistent coverage throughout the UK at up to 1km x 1km resolution. The dataset, spanning from 1836 to the present, includes a variety of climate variables such as air temperature, precipitation, sunshine, and wind speed, available on daily, monthly, seasonal, and annual timescales.

Contributing

If you have suggestions on the repository, please: - raise an issue - get in touch - see our contributing section, which includes details on contributing to the documentation.

All are welcome and appreciated.

Acknowledgements

Prior to 12th September 2024 we included a reference to the python-cmethods library, written by Benjamin Thomas Schwertfeger.

This was via a git submodule which targeted https://github.com/alan-turing-institute/python-cmethods, itself a fork of the original library.

Inadvertently, we did not identify that the license for the python-cmethods library (GPL3) is not compatible with the license for this package (MIT). We apologise for this mistake and have taken the following actions to resolve it:

  • We have now removed the relevant submodule from this repository.
  • Added this note to the README.
  • Added a note to the python/README.md file.
  • Added the citation below.

Citations

[^1]: Senatore et al., 2022, https://doi.org/10.1016/j.ejrh.2022.101120 [^2]: Ayar et al., 2021, https://doi.org/10.1038/s41598-021-82715-1

python-cmethods: Benjamin T. Schwertfeger. (2024). btschwertfeger/python-cmethods: v2.3.0 (v2.3.0). Zenodo. https://doi.org/10.5281/zenodo.12168002

Owner

  • Name: The Alan Turing Institute
  • Login: alan-turing-institute
  • Kind: organization
  • Email: info@turing.ac.uk

The UK's national institute for data science and artificial intelligence.

GitHub Events

Total
  • Issues event: 3
  • Watch event: 1
  • Delete event: 5
  • Issue comment event: 19
  • Push event: 98
  • Pull request review event: 23
  • Pull request review comment event: 14
  • Pull request event: 16
  • Fork event: 1
  • Create event: 7
Last Year
  • Issues event: 3
  • Watch event: 1
  • Delete event: 5
  • Issue comment event: 19
  • Push event: 98
  • Pull request review event: 23
  • Pull request review comment event: 14
  • Pull request event: 16
  • Fork event: 1
  • Create event: 7

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 746
  • Total Committers: 12
  • Avg Commits per committer: 62.167
  • Development Distribution Score (DDS): 0.536
Past Year
  • Commits: 159
  • Committers: 5
  • Avg Commits per committer: 31.8
  • Development Distribution Score (DDS): 0.522
Top Committers
Name Email Commits
Dr Griffith Rees g****s@g****m 346
RuthBowyer r****r@t****k 128
crangelsmith c****h@t****k 66
Andy Smith a****h 46
Sophie Arana a****e@g****m 42
Grigorios Mingas g****s@t****k 39
Dr Griffith Rees g****s@t****k 28
Sam Greenbury s****y@t****k 24
AoifeHughes a****s@t****k 14
BZhang666 b****g@k****k 6
AoifeHughes a****s@g****m 5
Jennifer Ding j****2@g****m 2
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 134
  • Total pull requests: 51
  • Average time to close issues: about 2 months
  • Average time to close pull requests: 18 days
  • Total issue authors: 12
  • Total pull request authors: 9
  • Average comments per issue: 1.74
  • Average comments per pull request: 1.29
  • Merged pull requests: 41
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 14
  • Pull requests: 14
  • Average time to close issues: 18 days
  • Average time to close pull requests: 13 days
  • Issue authors: 4
  • Pull request authors: 4
  • Average comments per issue: 0.36
  • Average comments per pull request: 1.29
  • Merged pull requests: 12
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • dingaaling (43)
  • griff-rees (33)
  • crangelsmith (10)
  • RuthBowyer (9)
  • aranas (8)
  • gmingas (7)
  • andrewphilipsmith (5)
  • mvakil-dewar (3)
  • AoifeHughes (2)
  • BZ-BowenZhang (2)
  • btschwertfeger (1)
  • Mariya-11 (1)
Pull Request Authors
  • griff-rees (27)
  • andrewphilipsmith (14)
  • RuthBowyer (10)
  • crangelsmith (7)
  • sgreenbury (6)
  • gmingas (4)
  • aranas (2)
  • AoifeHughes (2)
  • BZ-BowenZhang (1)
Top Labels
Issue Labels
python (10) enhancement (9) documentation (9) bug (8) help wanted (1) invalid (1) R (1) planning (1) clime-recal and SPC data (1)
Pull Request Labels
documentation (13) bug (12) python (10) enhancement (7) R (4) clime-recal and SPC data (2)

Dependencies

environment.yml pypi
  • affine ==2.3.1
  • attrs ==22.1.0
  • certifi ==2022.9.24
  • cftime ==1.6.2
  • click ==8.1.3
  • click-plugins ==1.1.1
  • cligj ==0.7.2
  • matplotlib ==3.6.1
  • netcdf4 ==1.6.1
  • numpy ==1.23.4
  • packaging ==21.3
  • pandas ==1.5.1
  • pillow ==9.4.0
  • pyparsing ==3.0.9
  • pyproj ==3.4.0
  • python-dateutil ==2.8.2
  • pytz ==2022.5
  • rasterio ==1.3.3
  • rioxarray ==0.12.3
  • scipy ==1.10.0
  • six ==1.16.0
  • snuggs ==1.4.7
  • tqdm ==4.64.1
  • xarray ==2022.10.0