https://github.com/chenliu-1996/cde-image
Extending Neural CDE to images!
Science Score: 10.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
○codemeta.json file
-
○.zenodo.json file
-
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (7.7%) to scientific vocabulary
Repository
Extending Neural CDE to images!
Basic Info
- Host: GitHub
- Owner: ChenLiu-1996
- Language: Python
- Default Branch: main
- Size: 39.1 KB
Statistics
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
CDE-image
Chen Liu (chen.liu.cl2482@yale.edu) at Krishnaswamy Lab
Background
In this work, we aim to extend Neural CDE to images!
Neural Controlled Differential Equations (Neural CDE) are a great extension on Neural Ordinary Differential Equations (Neural ODEs). While the solution of Neural ODEs are determined by its initial condition, the solution of Neural CDEs are adjusted based on subsequent observations. By modeling with Neural CDEs, we can predict the future observation at an arbitrary time $t$ based on the initial value as well as the intermediate observations that may be both partially observed and irregularly sampled.
Neural CDEs open a lot of doors to modeling the time-dependent dynamics in multivariate time series data. While the authors provided decent implementations, both for research prototype: torchcde as well as for production-level usage: diffrax, so far we found no implementation that allows us to apply Neural CDE on longitudinal image data. Hence we created this repo.
Usage
Dependencies
We developed the codebase in a miniconda environment. How we created the conda environment: ```
Optional: Update to libmamba solver.
conda update -n base conda conda install -n base conda-libmamba-solver conda config --set solver libmamba
conda create --name cde-image pytorch==1.12.1 torchvision==0.13.1 torchaudio==0.12.1 cudatoolkit=11.3 -c pytorch -c nvidia -c anaconda -c conda-forge conda activate cde-image conda install scikit-learn scikit-image pillow matplotlib seaborn tqdm -c pytorch -c anaconda -c conda-forge python -m pip install -U albumentations python -m pip install timm python -m pip install opencv-python python -m pip install torchdiffeq python -m pip install torch-ema python -m pip install torchcde ```
Owner
- Name: Chen Liu
- Login: ChenLiu-1996
- Kind: user
- Location: New Haven
- Company: Yale University
- Website: https://chenliu-1996.github.io/
- Twitter: ChenLiu_1996
- Repositories: 5
- Profile: https://github.com/ChenLiu-1996
CS PhD student at @KrishnaswamyLab, @YaleUniversity. Reviewing Committee member at NeurIPS, ICLR, ICML.
GitHub Events
Total
- Watch event: 1
Last Year
- Watch event: 1