https://github.com/blutjens/e3sm-mmf_baseline
Science Score: 10.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
○codemeta.json file
-
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
✓Committers with academic emails
1 of 3 committers (33.3%) from academic institutions -
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (13.8%) to scientific vocabulary
Repository
Basic Info
- Host: GitHub
- Owner: blutjens
- Language: Jupyter Notebook
- Default Branch: main
- Size: 39 MB
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
E3SM-MMF_baseline
Dataset Information
Variable list can be found here: https://docs.google.com/spreadsheets/d/1ljRfHq6QB36u0TuoxQXcV4_DSQUR0X4UimZ4QHR8f9M/edit#gid=0
1: E3SM-MMF High-Resolution Real Geography - Two files (one for input; the other for output) are produced at each time step for a 10-year long simulation (with timestep = 20 min.), totaling 525,600 files (= 10 year * 365 days/year * 72 steps/day * 2 files/day) - Total data volume: 43 TB - File size: - Input: 102 MB/file - Output: 61 MB/file - File format: netcdf - Dimensions: - ncol (horizontal dimension of an unstructured grid): 21600 - lev (vertical dimension): 60
2: E3SM-MMF Low Resolution Real Geography - All same as above except for file sizes and dimension sizes. - Total data volume: 800GB - File size: - Input: 1.9 MB/file - Output: 1.1 MB/file - File format: netcdf - Dimensions: - ncol (horizontal dimension of an unstructured grid): 384 - lev (vertical dimension): 60
3: E3SM-MMF Low Resolution Aquaplanet - All same as above except for file sizes and dimension sizes. - Total data volume: 800GB - File size: - Input: 1.9 MB/file - Output: 1.1 MB/file - File format: netcdf - Dimensions: - ncol (horizontal dimension of an unstructured grid): 384 - lev (vertical dimension): 60
Installation
(local machine) in your conda base environment do the following to ensure proper channel management: ```
Prefer packages in conda-forge
conda config --system --prepend channels conda-forge
Packages in lower-priority channels not considered if a package with the same
name exists in a higher priority channel. Can dramatically speed up installations.
Conda recommends this as a default
https://docs.conda.io/projects/conda/en/latest/user-guide/tasks/manage-channels.html
conda config --set channelpriority strict conda config --system --set autoupdateconda false conda config --system --set showchannel_urls true ```
Install script
todo: move to clean environment.yml ```
conda deactivate # It's likely not necessary to deactivate base env.
module load anaconda3/2020.11 # Note my supercomputer loads a base env and this install has only been tested with that.
conda create -n e3sm python=3.8.5 conda activate e3sm conda install -c conda-forge numpy conda install -c conda-forge pandas conda install -c conda-forge xarray netCDF4 bottleneck conda install -c conda-forge scikit-learn statsmodels scipy conda install -c conda-forge matplotlib seaborn conda install -c conda-forge jupyterlab tqdm conda install -c conda-forge dask hdf5 h5py conda install -c conda-forge ipython yaml # All packages already installed conda install -c conda-forge cudatoolkit=11.2 cudnn=8.1.0 pip install --upgrade pip # Make sure this is run inside the conda env. pip install tensorflow pip install keras-tuner --upgrade pip install tensorflow-addons pip install qhoptim
Link conda environment to jupyter
python -m ipykernel install --user --name=e3sm ```
Owner
- Name: Björn Lütjens (he/him)
- Login: blutjens
- Kind: user
- Company: MIT
- Website: https://blutjens.github.io/
- Twitter: bjornlutjens
- Repositories: 31
- Profile: https://github.com/blutjens
Postdoctoral Associate in tackling climate change with AI @ MIT. Project overview at https://blutjens.github.io/
GitHub Events
Total
Last Year
Committers
Last synced: over 2 years ago
Top Committers
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: over 2 years ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels
Dependencies
- tensorflow-addons ==0.19.0
- typeguard ==3.0.2