Recent Releases of gradsflow-automl
gradsflow-automl - β¨ Enhancements and Bug fixes
What's Changed
- π format docs by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/170
- [Snyk] Fix for 3 vulnerabilities by @snyk-bot in https://github.com/gradsflow/gradsflow/pull/171
- Tensorboard callbacks by @arvindmuralie77 in https://github.com/gradsflow/gradsflow/pull/173
- update docs :memo: by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/175
- anti pattern fixes from deepsource by @skp-github in https://github.com/gradsflow/gradsflow/pull/176
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in https://github.com/gradsflow/gradsflow/pull/177
- Demo & fixes by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/180
- Upgrade deps by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/181
- π minor bug fixes and reformat by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/182
- fix examples and Flash trainer by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/183
- refactor apis by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/184
- Fix examples by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/185
New Contributors
- @snyk-bot made their first contribution in https://github.com/gradsflow/gradsflow/pull/171
- @arvindmuralie77 made their first contribution in https://github.com/gradsflow/gradsflow/pull/173
- @skp-github made their first contribution in https://github.com/gradsflow/gradsflow/pull/176
Full Changelog: https://github.com/gradsflow/gradsflow/compare/v0.0.8...v0.0.8.post1
- Python
Published by aniketmaurya almost 4 years ago
gradsflow-automl - v0.0.8
What's Changed
- π€© refactor core by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/136
- cleanup APIs by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/137
- added conda installation instruction by @sugatoray in https://github.com/gradsflow/gradsflow/pull/144
- recursively exclude tests folder and its contents by @sugatoray in https://github.com/gradsflow/gradsflow/pull/141
- add model.save test by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/147
- remove redundant to_item by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/152
- refactor Tracker by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/153
- Change methods not using its bound instance to staticmethods by @deepsource-autofix in https://github.com/gradsflow/gradsflow/pull/156
- refactor metrics by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/159
- add dataoader length by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/160
- fix model checkpoint folder not found by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/162
- Fix metrics update by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/163
- Replace multiple
==checks withinby @deepsource-autofix in https://github.com/gradsflow/gradsflow/pull/167 - increment current_epoch after each epoch by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/169
- Wandb Implementation by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/168
Full Changelog: https://github.com/gradsflow/gradsflow/compare/v0.0.7...v0.0.8
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - v0.0.8.dev1
What's Changed
- optional pl dependency by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/133
- minor fixes by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/134
- π update example by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/135
- π€© refactor core by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/136
- cleanup APIs by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/137
- remove dependencies by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/139
- added conda installation instruction by @sugatoray in https://github.com/gradsflow/gradsflow/pull/144
- recursively exclude tests folder and its contents by @sugatoray in https://github.com/gradsflow/gradsflow/pull/141
- pin flash version to 0.5.1 by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/143
- refactor backend by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/146
- Remove flit by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/148
- add model.save test by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/147
- Update main.yml by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/149
- remove redundant to_item by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/152
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in https://github.com/gradsflow/gradsflow/pull/155
- refactor Tracker by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/153
- Change methods not using its bound instance to staticmethods by @deepsource-autofix in https://github.com/gradsflow/gradsflow/pull/156
- π fix documentation & examples by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/158
- refactor metrics by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/159
- add dataoader length by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/160
- fix model checkpoint folder not found by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/162
- Fix metrics update by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/163
Full Changelog: https://github.com/gradsflow/gradsflow/compare/v0.0.7...v0.0.8.dev1
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - v0.0.7.post2
What's Changed
- optional pl dependency by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/133
- minor fixes by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/134
- π update example by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/135
- π€© refactor core by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/136
- cleanup APIs by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/137
Full Changelog: https://github.com/gradsflow/gradsflow/compare/v0.0.7...v0.0.7.post2
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - Improved Callback and Loggers
Highlights
- βοΈ comet integration #129
- add model checkpoint callback #121
- π add csv logger #116
- π add trainevalcallback #111
- πͺ add Average Meter #109
- fix device issue in metric calculation PR #106
What's Changed
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in https://github.com/gradsflow/gradsflow/pull/98
- clean docs by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/100
- fix optimizer by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/102
- fix device issue in metric calculation by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/106
- β¨ refactor tuner by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/107
- π add example & better intro by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/108
- πͺ add Average Meter by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/109
- Fixes metrics device handling by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/110
- π add trainevalcallback by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/111
- refactor training callback by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/112
- π₯Data refactor by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/113
- π Bump test coverage by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/114
- fix live display error on multiple runs by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/115
- π add csv logger by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/116
- β¨refactor base model by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/118
- βοΈ add codecarbon callback by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/119
- add model checkpoint callback by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/121
- fix loss compile by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/126
- add requirement decorator by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/128
- Refactor callback runner by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/130
- βοΈ comet integration by @aniketmaurya in https://github.com/gradsflow/gradsflow/pull/129
New Contributors
- @pre-commit-ci made their first contribution in https://github.com/gradsflow/gradsflow/pull/98
Full Changelog: https://github.com/gradsflow/gradsflow/compare/v0.0.6...v0.0.7
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - Model Training & Auto Tuner
0.0.6
- π Revamp Callbacks and Training #94
- β¨ refactor data handling π docs update. PR #91
- integrate torchmetrics. PR #80
- callbacks & π€ ProgressCallback. PR #76
- π₯ Add AutoModel Tuner. PR #74
- refactor APIs - Simplify API & add
model.compile(...). PR #73 - π€ integrate HF Accelerator. PR #71
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - 0.0.5
What is New?
- Keras style Model Training API π
- Remote Dataset Loader - create
dataloaderfrom any cloud Bucket βοΈ Datageneratorfor Image Classification (more to come soon...)
To install $ pip install -U gradsflow
Release Notes
- π₯ Add custom training loop with
model.fit. PR #63 Done by @aniketmaurya - βοΈ Add
ray.data- remote dataset loader. PR #61 Done by @aniketmaurya - π Add AutoDataset - Encapsulate datamodule and dataloaders. PR #59 Done by @aniketmaurya
- π Add Autotask feature. PR #54 Done by @gagan3012
- β¨ Add AutoTrainer to support plain torch training loop and other torch frameworks. PR #53
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - 0.0.5a0
Release Notes
π₯ Add custom training loop with model.fit. PR #63 Done by @aniketmaurya
βοΈ Add ray.data - remote dataset loader. PR #61 Done by @aniketmaurya
π Add AutoDataset - Encapsulate datamodule and dataloaders. PR #59 Done by @aniketmaurya
π Add Autotask feature. PR #54 Done by @gagan3012
β¨ Add AutoTrainer to support plain torch training loop and other torch frameworks. PR #53
$ pip install gradsflow==0.0.5a0
π Get started with Documentation
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - 0.0.4
Latest Changes
- fix best checkpoints model loading #52
- π feature/fix train arguments docs #44
- Publish Python π distributions π¦ to PyPI #42
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - Distributed HPO with Ray βΎ
0.0.3
Latest Changes
- add optuna visualizations π¨ . PR #27 by @aniketmaurya.
- add max_steps for HPO. PR #25 by @aniketmaurya.
- :memo: update docs & license. PR #23 by @aniketmaurya.
- fetch best trial model. PR #21 by @aniketmaurya.
- migrate to ray_tune π. Read more here. PR #36 by @aniketmaurya.
- render jupyter notebooks in documentation. PR #38 by @aniketmaurya.
- remove optuna #39
- Publish Python π distributions π¦ to PyPI #42
Get Started Now
π Documentation: docs.gradsflow.com
$ pip install -U gradsflow
Example
```python from gradsflow import AutoImageClassifier
from flash.core.data.utils import download_data from flash.image import ImageClassificationData
datadir = "/Users/aniket/personal/gradsflow/gradsflow/data/" downloaddata("https://pl-flash-data.s3.amazonaws.com/hymenopteradata.zip", datadir) datamodule = ImageClassificationData.fromfolders( trainfolder=f"{datadir}/hymenopteradata/train/", valfolder=f"{datadir}/hymenoptera_data/val/", )
model = AutoImageClassifier( datamodule, maxepochs=2, ntrials=4, optimizationmetric="valaccuracy", timeout=50, )
print("AutoImageClassifier initialised!") model.hp_tune(gpu=1) ```
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - Gradsflow + Ray Tune integration
- migrate to ray_tune π. Read more here. PR #36 by @aniketmaurya.
- render jupyter notebooks in documentation. PR #38 by @aniketmaurya.
$ pip install -U gradsflow==0.0.3a2
π Read more on documentation
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - 0.0.3a1
0.0.3a1
- add optuna visualizations π¨ . PR #27 by @aniketmaurya.
- add max_steps for HPO. PR #25 by @aniketmaurya.
- :memo: update docs & license. PR #23 by @aniketmaurya.
- fetch best trial model. PR #21 by @aniketmaurya.
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - 0.0.2
- fetch best trial model. PR #21 by @aniketmaurya.
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - First stable Release ππβ¨
Release Notes
0.0.1
- This changed: π update example and documentation. Done by aniketmaurya. Check the Pull Request 20 with the changes and stuff. now back to code. π€\n
- This changed: :tada::sparkles: First Release - v0.0.1 - Refactor API & tested Python 3.7+. Done by aniketmaurya. Check the Pull Request 18 with the changes and stuff. now back to code. π€
- This changed: Adding example notebook for AutoSummarization. Done by the GitHub user gagan3012. Check the Pull Request 19 with the changes and stuff. now back to code. π€
- This changed: Adding text summarisation. Done by the GitHub user gagan3012. Check the Pull Request 14 with the changes and stuff. now back to code. π€
- This changed: add codecov CI. Done by the GitHub user aniketmaurya. Check the Pull Request 15 with the changes and stuff. now back to code. π€
- This changed: π update documentation - added citation, acknowledgments, docstrings automation. Done by the GitHub user aniketmaurya. Check the Pull Request 13 with the changes and stuff. now back to code. π€
- Refactor API Design, CI & Docs PR #10 by @aniketmaurya.
- auto docstring. PR #7 by @aniketmaurya.
- Add AutoImageClassifier. PR #1 by @aniketmaurya.
What is Gradsflow?
Gradsflow is based on Optuna and PyTorch Lightning β‘οΈ. It leverages PyTorch Lightning Flash so that you don't have to write any PyTorch or Optuna code for model building or hyperparameter tuning π
Although you might want to train a custom model and search hyperparameters, You can easily integrate any PyTorch/Lightning Flash Model with Gradsflow AutoModel β¨
gradsflow.core: Core defines the building blocks of AutoML tasks.
gradsflow.taskauto: AutoTasks defines different ML/DL tasks which is provided by Gradsflow AutoML API.
Image classification example
```python from flash.core.data.utils import download_data from flash.image import ImageClassificationData
from gradsflow import AutoImageClassifier
# 1. Create the DataModule
download_data("https://pl-flash-data.s3.amazonaws.com/hymenoptera_data.zip", "./data")
datamodule = ImageClassificationData.from_folders(
train_folder="data/hymenoptera_data/train/",
val_folder="data/hymenoptera_data/val/",
)
suggested_conf = dict(
optimizers=["adam", "sgd"],
lr=(5e-4, 1e-3),
)
model = AutoImageClassifier(datamodule,
suggested_conf=suggested_conf,
max_epochs=10,
optimization_metric="val_accuracy",
timeout=300)
model.hp_tune()
```
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - An AutoML Library made with Optuna and PyTorch Lightning
Refactoring and bug fixes
- Python
Published by aniketmaurya over 4 years ago
gradsflow-automl - π AutoClassification
- Added AutoImageClassification
- Added AutoTextClassification
Example
```python model = AutoImageClassifier(datamodule, suggestedbackbones=['sslresnet18'], suggestedconf=suggestedconf, maxepochs=1, optimizationmetric="val_accuracy", timeout=30)
print("AutoImageClassifier initialised!") model.hp_tune() ```
- Python
Published by aniketmaurya over 4 years ago