Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of the-well

the-well - v1.1.0

The Well v1.1.0 (April 4, 2025)

Enhancements

Metrics (https://github.com/PolymathicAI/the_well/commit/944975ecb3f8803e8a43c4c54e6359e2eda3370d)

Added the following metrics: - Mean absolute error - Pearson Correlation

Updated the expected path structure for Well-formatted non-Well data to match Well data (https://github.com/PolymathicAI/the_well/commit/944975ecb3f8803e8a43c4c54e6359e2eda3370d)

Users can now pass paths pointing to non-Well data produced in the Well format to use in the existing pipeline.

Augmentations (https://github.com/PolymathicAI/the_well/commit/944975ecb3f8803e8a43c4c54e6359e2eda3370d)

Added the following augmentation options in a tensor-law consistent manner: - Rotations - Resize

Refactoring to allow for easier modification (https://github.com/PolymathicAI/the_well/commit/944975ecb3f8803e8a43c4c54e6359e2eda3370d)

Users can now more easily extend the Well dataset objects for their own purposes as the function of __get_item__ has now been split into a small number of sub-components. Extension now only requires users to replace the components needed in their workflow rather than the full object.

Plotting updates (https://github.com/PolymathicAI/the_well/commit/944975ecb3f8803e8a43c4c54e6359e2eda3370d)

  • Power spectrum now generated for last timestep rather than average
  • Bug fix in 3D (sliced) video
  • Update "padding" BC mode to handle nD padding masks

Download dataset statistics along data (https://github.com/PolymathicAI/the_well/pull/22)

Previously, the statistics were included in the Github repo but not the data itself. This update now automatically downloads the statistics yaml files if they do not already exist in the given path.

Hugging Face integration

  • Upload additional datasets (https://github.com/PolymathicAI/the_well/pull/31)
  • Upload model checkpoints (https://github.com/PolymathicAI/thewell/pull/34, https://github.com/PolymathicAI/thewell/pull/35)

Delta vs full training within (https://github.com/PolymathicAI/the_well/commit/18fcd05e43f1c8f2c1b27ae1cda38bbcea714914)

Now users can decide if they want to train models to predict the time step such that $x{t+1} = xt + f(xt)$ or the full reconstruction where $x{t+1} = f(x_t)$. Paper benchmarks are trained with full reconstruction, but predicting the delta/timestep is more effective in many applications.

Normalization changes also within (https://github.com/PolymathicAI/the_well/commit/18fcd05e43f1c8f2c1b27ae1cda38bbcea714914)

Dataset normalization has been extended to include new options for both full and delta prediction. These now use parameterizable normalization modules for easy extension.

RMS and delta statistics addition (https://github.com/PolymathicAI/the_well/commit/944975ecb3f8803e8a43c4c54e6359e2eda3370d)

Additionally, we've added new normalization options beyond what was in the paper including normalization by the root-mean-square of the field and applying normalization based on delta statistics.

Fixes

Bug fixes (https://github.com/PolymathicAI/the_well/commit/18fcd05e43f1c8f2c1b27ae1cda38bbcea714914)

  • Fix AFNO and AViT for non-square data

Data fixes

  • Added Rayleigh-Benard Uniform and fixed x dimension in existing data - Previously, the x dimension in Rayleigh-Benard was listed as being uniformly spaced. This data was actually sampled on Chebychev nodes so this spacing was not accurate. This has been addressed in two ways: 1. x dimension in the existing dataset has been updated to accurately reflect the spacing. 2. We have added a new rayleigh_benard_uniform that has been resampled onto a uniform grid from the underlying spectral representation of the solver. This is to ensure both backward compatibility while also enabled analysis of the uniformly spaced data.
  • Replaced outlier trajectory in acoustic_scattering_inclusions - acousticscatteringinclusions chunk 11, position 47 had a corrupted trajectory. This has been replaced with a newly simulated valid example.
  • Fix shear_flow documentation (https://github.com/PolymathicAI/the_well/pull/13)

- Jupyter Notebook
Published by LTMeyer 11 months ago

the-well - v1.0.1

The Well v1.0.1 (December 6, 2024)

Enhancements

  • Change original file locations for faster download (#5)

Documentation

  • Add badges to README (#1)
  • Add link to arXiv paper (#2)
  • Fix contact email address (#3)
  • Fix math rendering in dataset READMEs (#4)
  • Update shear_flow benchmark results

- Jupyter Notebook
Published by LTMeyer about 1 year ago

the-well - v1.0.0

The Well v1.0.0 (December 2, 2024)

🌊 Initial release of the Well.

- Jupyter Notebook
Published by LTMeyer about 1 year ago