Recent Releases of fastai
fastai - v2.8.4
Bugs Squashed
- set
weights_only=Falseforload_model_text, fixes LRFinder /lr_find(#4120), thanks to @austinvhuang - fix: Pass alpha and beta parameters to
rnn_cbs()in TextLearner constructor (#4119), thanks to @austinvhuang - Fixed SaveModelCallback (#4118), thanks to @FacuRoffet99
- Jupyter Notebook
Published by jph00 6 months ago
fastai - v2.8.1
New Features
- Use fasttransform (#4074), thanks to @RensDimmendaal
- Jupyter Notebook
Published by jph00 10 months ago
fastai - v2.7.19
New Features
- Add support for PyTorch 2.6 (#4078), thanks to @warner-benjamin
- Jupyter Notebook
Published by jph00 12 months ago
fastai - v2.7.15
New Features
- Support PyTorch 2.3 (#4026), thanks to @warner-benjamin
- Add
logandshow_epochstolog_ploss(#3964), thanks to @turbotimon
- Jupyter Notebook
Published by jph00 almost 2 years ago
fastai - v2.7.14
New Features
- PyTorch 2.2 support, thanks to @warner-benjamin
- Jupyter Notebook
Published by jph00 about 2 years ago
fastai - v2.7.13
New Features
- PyTorch 2.1 compatibility (#3970), thanks to @warner-benjamin
- Add
MutableMappingtotorch_core.applyto Support Moving Transformers Dicts (#3969), thanks to @warner-benjamin - Added Jaccard coefficient metric for multiclass target in segmentation (#3951), thanks to @Hazem-Ahmed-Abdelraouf
- Support TorchVision's Multi-Weight API (#3944), thanks to @warner-benjamin
- Fix the Deploy to GitHub Pages Action (#3942), thanks to @warner-benjamin
Bugs Squashed
- Fix Pandas Categorical FutureWarning (#3973), thanks to @warner-benjamin
- Fix torch.jit.script on TimmBody (#3948), thanks to @johan12345
- Resolve CutMix Deprecation Warning (#3937), thanks to @warner-benjamin
- Fixed format string (#3934), thanks to @bkowshik
- Fix casting types for mps (#3912), thanks to @MSciesiek
- Fix AccumMetric name.setter (#3621), thanks to @warner-benjamin
- Jupyter Notebook
Published by jph00 over 2 years ago
fastai - v2.7.12
New Features
- PyTorch 2.0 compatibility (#3890), thanks to @warner-benjamin
- Pytorch 2.0 compiler compatibility (#3899), thanks to @ggosline
- Better version support for
TensorBase.new_empty(#3887), thanks to @warner-benjamin - TensorBase deepcopy Compatibility (#3882), thanks to @warner-benjamin
- ChannelsLast Callback Improvements & Bug Fix (#3876), thanks to @warner-benjamin
- Add support for a batch transforms
tomethod (#3875), thanks to @warner-benjamin - Allow Pillow Image to be passed to PILBase.create (#3872), thanks to @warner-benjamin
Bugs Squashed
- Fix
Learn.predictErrors Out if Passed a PILImage (#3884), thanks to @nglillywhite - Set DataLoaders device if not None and to exists (#3873), thanks to @warner-benjamin
- Fix
default_deviceto correctly detect + use mps (Apple Silicon) (#3858), thanks to @wolever
- Jupyter Notebook
Published by jph00 almost 3 years ago
fastai - v2.7.11
New Features
- ChannelsLast Callback Improvements, Additional Documentation, & Bug Fix (#3876), thanks to @warner-benjamin
- Add support for a batch transforms
tomethod (#3875), thanks to @warner-benjamin - Allow Pillow Image to be passed to PILBase.create (#3872), thanks to @warner-benjamin
- Compat with latest numpy (#3871), thanks to @warner-benjamin
- Move training-only step to separate function in
Learner(#3857), thanks to @kunaltyagi - TabularPandas data transform reproducibility (#2826)
Bugs Squashed
- Set DataLoaders device if not None and to exists (#3873), thanks to @warner-benjamin
- Fix
default_deviceto correctly detect + use mps (Apple Silicon) (#3858), thanks to @wolever - Fix load hanging in distributed processes (#3839), thanks to @muellerzr
default_devicelogic is repeated twice, related tomps/ OSX support. (#3785)- revert auto-enable of mac mps due to pytorch limitations (#3769)
- Fix Classification Interpretation (#3563), thanks to @warner-benjamin
- vision tutorial failed at
learner.fine_tune(1)(#3283)
- Jupyter Notebook
Published by jph00 about 3 years ago
fastai - v2.7.10
New Features
- Add torch save and load kwargs (#3831), thanks to @JonathanGrant
- This lets us do nice things like set pickle_module to cloudpickle
- PyTorch 1.13 Compatibility (#3828), thanks to @warner-benjamin
- Recursive copying of attribute dictionaries for TensorImage subclass (#3822), thanks to @restlessronin
OptimWrappersets same param groups asOptimizer(#3821), thanks to @warner-benjamin- This PR harmonizes the default parameter group setting between
OptimWrapperandOptimizerby modifyingOptimWrapperto matchOptimizer's logic.
- This PR harmonizes the default parameter group setting between
- Support normalization of 1-channel images in unet (#3820), thanks to @marib00
- Add
img_clsparam toImageDataLoaders(#3808), thanks to @tcapelle- This is particularly useful for passing
PILImageBWfor MNIST.
- This is particularly useful for passing
- Add support for
kwargstotensor()when arg is anndarray(#3797), thanks to @SaadAhmedGit - Add latest TorchVision models on fastai (#3791), thanks to @datumbox
- Option to preserve filenames in
download_images(#2983), thanks to @mess-lelouch
Bugs Squashed
get_text_classifierfails with customAWS_LSTM(#3817)- revert auto-enable of mac mps due to pytorch limitations (#3769)
- Workaround for performance bug in PyTorch with subclassed tensors (#3683), thanks to @warner-benjamin
- Jupyter Notebook
Published by jph00 over 3 years ago
fastai - v2.7.8
New Features
- add split value argument to ColSplitter (#3737), thanks to @DanteOz
- deterministic repr for PIL images (#3762)
- option to skip default callbacks in
Learner(#3739) - update for nbdev2 (#3747)
Bugs Squashed
- IntToFloatTensor failing on Mac mps due to missing op (#3761)
- fix for pretrained in vision.learner (#3746), thanks to @peterdudfield
- fix same file error message when resizing image (#3743), thanks to @cvergnes
- Jupyter Notebook
Published by jph00 over 3 years ago
fastai - v2.7.0
Breaking changes
- Distributed training now uses Hugging Face Accelerate, rather than fastai's launcher. Distributed training is now supported in a notebook -- see this tutorial for details
New Features
resize_imagescreates folder structure atdestwhenrecurse=True(#3692)- Integrate nested callable and getcallable (#3691), thanks to @muellerzr
- workaround pytorch subclass performance bug (#3682)
- Torch 1.12.0 compatibility (#3659), thanks to @josiahls
- Integrate Accelerate into fastai (#3646), thanks to @muellerzr
- New Callback event, before and after backward (#3644), thanks to @muellerzr
- Let optimizer use built torch opt (#3642), thanks to @muellerzr
- Support PyTorch Dataloaders with
DistributedDL(#3637), thanks to @tmabraham - Add
channels_lastcb (#3634), thanks to @tcapelle - support all timm kwargs (#3631)
- send
self.loss_functo device if it is an instance on nn.Module (#3395), thanks to @arampacha
Bugs Squashed
- Solve hanging
load_modeland let LRFind be ran in a distributed setup (#3689), thanks to @muellerzr - pytorch subclass functions fail if no positional args (#3687)
- Workaround for performance bug in PyTorch with subclassed tensors (#3683), thanks to @warner-benjamin
- Fix
Tokenizer.get_lengths(#3667), thanks to @karotchykau load_learnerwithcpu=Falsedoesn't respect the current cuda device if model exported on another; fixes #3656 (#3657), thanks to @ohmeow- [Bugfix] Fix smoothloss on distributed (#3643), thanks to @muellerzr
- WandbCallback Error: "Tensors must be CUDA and dense" on distributed training (#3291)
- vision tutorial failed at
learner.fine_tune(1)(#3283)
- Jupyter Notebook
Published by jph00 over 3 years ago
fastai - v2.6.0
New Features
- add support for Ross Wightman's Pytorch Image Models (timm) library (#3624)
- rename
cnn_learnertovision_learnersince we now support models other than CNNs too (#3625)
Bugs Squashed
- Fix AccumMetric name.setter (#3621), thanks to @warner-benjamin
- Fix Classification Interpretation (#3563), thanks to @warner-benjamin
- Jupyter Notebook
Published by jph00 almost 4 years ago
fastai - v2.5.4
New Features
- Support py3.10 annotations (#3601)
Bugs Squashed
- Fix pin_memory=True breaking (batch) Transforms (#3606), thanks to @johan12345
- Add Python 3.9 to
setup.pyfor PyPI (#3604), thanks to @nzw0301 - removes addvert from getgrid calls (#3593), thanks to @kevinbird15
- Making
loss_not_reducedwork with DiceLoss (#3583), thanks to @hiromis - Fix bug in URLs.path() in 04_data.external (#3582), thanks to @malligaraj
- Custom name for metrics (#3573), thanks to @bdsaglam
- Update import for show_install (#3568), thanks to @fr1ll
- Fix Classification Interpretation (#3563), thanks to @warner-benjamin
- Updates Interpretation class to be memory efficient (#3558), thanks to @warner-benjamin
- Learner.showresults uses passed dataloader via dlidx or dl arguments (#3554), thanks to @warner-benjamin
- Fix learn.export pickle error with MixedPrecision Callback (#3544), thanks to @warner-benjamin
- Fix concurrent LRFinder instances overwriting each other by using tempfile (#3528), thanks to @warner-benjamin
- Fix getshapes to work with dictionaries (#3520), thanks to @ohmeow
- Fix torch version checks, remove clipgradnorm check (#3518), thanks to @warner-benjamin
- Fix nested tensors predictions compatibility with fp16 (#3516), thanks to @tcapelle
- Learning rate passed via OptimWrapper not updated in Learner (#3337)
- Different results after running
lr_find()at different times (#3295) - lr_find() may fail if run in parallel from the same directory (#3240)
- Jupyter Notebook
Published by jph00 almost 4 years ago
fastai - v2.5.3
New Features
- add
at_endfeature toSaveModelCallback(#3296), thanks to @tmabraham
Bugs Squashed
- fix fp16 test (#3284), thanks to @tmabraham
- Jupyter Notebook
Published by jph00 over 4 years ago
fastai - v2.5.0
Breaking changes
config.ymlhas been renamed toconfig.ini, and is now inConfigParserformat instead of YAML- THe
_pathsuffixes inconfig.inihave been removed
Bugs Squashed
- Training with
learn.to_fp16() fails with PyTorch 1.9 / Cuda 11.4 (#3438) - pandas 1.3.0 breaks
add_elapsed_times(#3431)
- Jupyter Notebook
Published by jph00 over 4 years ago
fastai - v2.4
Breaking changes
- QRNN module removed, due to incompatibility with PyTorch 1.9, and lack of utilization of QRNN in the deep learning community. QRNN was our only module that wasn't pure Python, so with this change fastai is now a pure Python package.
New Features
- Support for PyTorch 1.9
- Improved LR Suggestions (#3377), thanks to @muellerzr
- SaveModelCallback every nth epoch (#3375), thanks to @KeremTurgutlu
- Send self.loss_func to device if it is an instance of nn.Module (#3395), thanks to @arampacha
- Batch support for more than one image (#3339)
- Changable tfmdlists for TransformBlock, Datasets, DataBlock (#3327)
Bugs Squashed
- convert TensorBBox to TensorBase during compare (#3388), thanks to @kevinbird15
- Check if normalize exists on
_add_norm(#3371), thanks to @renato145
- Jupyter Notebook
Published by jph00 over 4 years ago
fastai - v2.3.2
New Features
- send self.loss_func to device if it is an instance of nn.Module (#3395), thanks to @arampacha
- Improved LR Suggestions (#3377), thanks to @muellerzr
- SaveModelCallback every nth epoch (#3375), thanks to @KeremTurgutlu
- Batch support for more than one image (#3339)
- Changable tfmdlists for TransformBlock, Datasets, DataBlock (#3327)
Bugs Squashed
- convert TensorBBox to TensorBase during compare (#3388), thanks to @kevinbird15
- Check if normalize exists on
_add_norm(#3371), thanks to @renato145
- Jupyter Notebook
Published by jph00 over 4 years ago
fastai - v2.3.1
New Features
- Add support for pytorch 1.8 (#3349)
- Add support for spacy3 (#3348)
- Add support for Windows. Big thanks to Microsoft for many contributions to get this working
- Timedistributed layer and Image Sequence Tutorial (#3124), thanks to @tcapelle
- Add interactive run logging to AzureMLCallback (#3341), thanks to @yijinlee
- Batch support for more than one image (#3339)
- Have interp use ds_idx, add tests (#3332), thanks to @muellerzr
- Automatically have fastai determine the right device, even with torch DataLoaders (#3330), thanks to @muellerzr
- Add
at_endfeature toSaveModelCallback(#3296), thanks to @tmabraham - Improve inplace params in Tabular's new and allow for new and test_dl to be in place (#3292), thanks to @muellerzr
- Update VSCode & Codespaces dev container (#3280), thanks to @bamurtaugh
- Add max_scale param to RandomResizedCrop(GPU) (#3252), thanks to @kai-tub
- Increase testing granularity for speedup (#3242), thanks to @ddobrinskiy
Bugs Squashed
- Make TTA turn shuffle and droplast off when using dsidx (#3347), thanks to @muellerzr
- Add order to TrackerCallback derived classes (#3346), thanks to @muellerzr
- Prevent schedule from crashing close to the end of training (#3335), thanks to @Lewington-pitsos
- Fix ability to use raw pytorch DataLoaders (#3328), thanks to @hamelsmu
- Fix PixelShuffle_icnr weight (#3322), thanks to @pratX
- Creation of new DataLoader in Learner.get_preds has wrong keyword (#3316), thanks to @tcapelle
- Correct layers order in tabular learner (#3314), thanks to @gradientsky
- Fix vmin parameter default (#3305), thanks to @tcapelle
- Ensure call to
one_batchplaces data on the right device (#3298), thanks to @tcapelle - Fix Cutmix Augmentation (#3259), thanks to @MrRobot2211
- Fix custom tokenizers for DataLoaders (#3256), thanks to @iskode
- fix error setting 'toktfm' parameter in TextDataloaders.fromfolder
- Fix lighting augmentation (#3255), thanks to @kai-tub
- Fix CUDA variable serialization (#3253), thanks to @mszhanyi
- change batch tfms to have the correct dimensionality (#3251), thanks to @trdvangraft
- Ensure add_datepart adds elapsed as numeric column (#3230), thanks to @aberres
- Jupyter Notebook
Published by jph00 almost 5 years ago
fastai - v2.3.0
Breaking Changes
- fix optimwrapper to work with
param_groups(#3241), thanks to @tmabraham- OptimWrapper now has a different constructor signature, which makes it easier to wrap PyTorch optimizers
New Features
- Support discriminative learning with OptimWrapper (#2829)
Bugs Squashed
- Updated to support adding transforms to multiple dataloaders (#3268), thanks to @marii-moe
- This fixes an issue in 2.2.7 which resulted in incorrect validation metrics when using Normalization
- Jupyter Notebook
Published by jph00 almost 5 years ago
fastai - v2.2.5
New Features
- Enhancement: Let TextDataLoaders take in a custom
tok_text_col(#3208), thanks to @muellerzr - Changed dataloaders arguments to have consistent overrides (#3178), thanks to @marii-moe
- Better support for iterable datasets (#3173), thanks to @jcaw
Bugs Squashed
- BrokenProcessPool in
download_images()on Windows (#3196) - error on predict() or using interp with resnet and MixUp (#3180)
- Fix 'cat' attribute with pandas dataframe:
AttributeError: Can only use .cat accessor with a 'category' dtype(#3165), thanks to @dreamflasher cont_cat_splitdoes not support pandas types (#3156)DataBlock.dataloadersdoes not support the advertised "shuffle" argument (#3133)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - v2.2.3
New Features
- Calculate correct
nfincreate_headbased onconcat_pool(#3115), thanks to @muellerzr
Bugs Squashed
- wandb integration failing with latest wandb library (#3066)
Learner.loadandLRFindernot functioning properly for the optimizer states (#2892)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - v2.2.0
Breaking Changes
- Promote
NativeMixedPrecisionto defaultMixedPrecision(and similar forLearner.to_fp16); oldMixedPrecisionis now calledNonNativeMixedPrecision(#3127)- Use the new
GradientClipcallback instead of theclipparameter to use gradient clipping
- Use the new
- Adding a
Callbackwhich has the same name as an attribute no longer raises an exception (#3109) - RNN training now requires
RNNCallback, but does not requireRNNRegularizer;outandraw_outhave moved toRNNRegularizer(#3108)- Call
rnn_cbsto get all callbacks needed for RNN training, optionally with regularization
- Call
- replace callback
run_afterwithorder; do not runaftercbs on exception (#3101)
New Features
- Add
GradientClipcallback (#3107) - Make
Flattencast toTensorBaseto simplify type compatibility (#3106) - make flattened metrics compatible with all tensor subclasses (#3105)
- New class method
TensorBase.register_functo register types for__torch_function__(#3097) - new
dynamicflag for controlling dynamic loss scaling inNativeMixedPrecision(#3096) - remove need to call
to_native_fp32beforepredict; setskippedin NativeMixedPrecision after NaN from dynamic loss scaling (#3095) - make native fp16 extensible with callbacks (#3094)
- Calculate correct
nfincreate_headbased onconcat_pool(#3115) thanks to @muellerzr
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - v2.1.10
New Features
- Small DICOM segmentation dataset (#3034), thanks to @moritzschwyzer
Bugs Squashed
NoneType object has no attribute appendin fastbook chapter 6 BIWI example (#3091)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - v2.1.9
New Features
- Refactor MixUp and CutMix into MixHandler (#3037), thanks to @muellerzr
- Refactors into a general MixHandler class, with MixUp and CutMix simply implementing a
before_batchto perform the data augmentation. Seefastai.callback.mixup
- Refactors into a general MixHandler class, with MixUp and CutMix simply implementing a
Bugs Squashed
- Gradient Accumulation + Mixed Precision shows artificially high training loss (#3048)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - v2.1.8
2.1.8
New Features
Bugs Squashed
- Update for fastcore
negate_func->not_ - LR too high for gradient accumulation (#3040), thanks to @marii-moe
- Torchscript transforms incompatibility with nn.Sequential (#2920)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - 2.1.7
2.1.7
New Features
- Pytorch 1.7 subclassing support (#2769)
Bugs Squashed
- unsupported operand type(s) for +=: 'TensorCategory' and 'TensorText' when using AWD_LSTM for text classification (#3027)
- UserWarning when using SaveModelCallback() on after_epoch (#3025)
- Segmentation error: no implementation found for 'torch.nn.functional.crossentropy' on types that implement torchfunction (#3022)
TextDataLoaders.from_df()returnsTypeError: 'float' object is not iterable(#2978)- Internal assert error in awd_qrnn (#2967)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - 2.1.6
2.1.6
New Features
- Option to preserve filenames in
download_images(#2983), thanks to @mess-lelouch - Deprecate
configincreate_cnnand instead pass kwargs directly (#2966), thanks to @borisdayma
Bugs Squashed
- Progress and Recorder callbacks serialize their data, resulting in large Learner export file sizes (#2981)
TextDataLoaders.from_df()returnsTypeError: 'float' object is not iterable(#2978)- "only one element tensors can be converted to Python scalars" exception in Siamese Tutorial (#2973)
- Learn.load and LRFinder not functioning properly for the optimizer states (#2892)
- Jupyter Notebook
Published by jph00 about 5 years ago
fastai - 2.1.5
2.1.5
Breaking Changes
- remove
log_args(#2954)
New Features
- Improve performance of
RandomSplitter(h/t @muellerzr) (#2957)
Bugs Squashed
- Exporting TabularLearner via learn.export() leads to huge file size (#2945)
TensorPointobject has no attributeimg_size(#2950)
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.1.4
2.1.4
Breaking Changes
- moved
has_childrenfromnn.Moduleto free function (#2931)
New Features
- Support persistent workers (#2768)
Bugs Squashed
unet_learnersegmentation fails (#2939)- In "Transfer learning in text" tutorial, the "dls.show_batch()" show wrong outputs (#2910)
Learn.loadandLRFindernot functioning properly for the optimizer states (#2892)- Documentation for
Show_Imagesbroken (#2876) - URL link for documentation for
torch_corelibrary from thedoc()method gives incorrect url (#2872)
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.1.0
2.1.0
New Features
- PyTorch 1.7 compatibility (#2917)
PyTorch 1.7 includes support for tensor subclassing, so we have replaced much of our custom subclassing code with PyTorch's. We have seen a few bugs in PyTorch's subclassing feature, however, so please file an issue if you see any code failing now which was working before.
There is one breaking change in this version of fastai, which is that custom metadata is now stored directly in tensors as standard python attributes, instead of in the special _meta attribute. Only advanced customization of fastai OO tensors would have used this functionality, so if you do not know what this all means, then it means you did not use it.
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.0.18
2.0.18
Forthcoming breaking changes
The next version of fastai will be 2.1. It will require PyTorch 1.7, which has significant foundational changes. It should not require any code changes except for people doing sophisticated tensor subclassing work, but nonetheless we recommend testing carefully. Therefore, we recommend pinning your fastai version to <2.1 if you are not able to fully test your fastai code when the new version comes out.
Dependencies
- pin pytorch (
<1.7) and torchvision (<0.8) requirements (#2915) - Add version pin for fastcore
- Remove version pin for sentencepiece
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.0.17
2.0.17
Forthcoming breaking changes
The next version of fastai will be 2.1. It will require PyTorch 1.7, which has significant foundational changes. It should not require any code changes except for people doing sophisticated tensor subclassing work, but nonetheless we recommend testing carefully. Therefore, we recommend pinning your fastai version to <2.1 if you are not able to fully test your fastai code when the new version comes out.
New Features
- pin pytorch (
<1.7) and torchvision (<0.8) requirements (#2915)
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.0.16
2.0.16
New Features
- added support for tb projector word embeddings (#2853), thanks to @floleuerer
- Added ability to have variable length draw (#2845), thanks to @marii-moe
- add pip upgrade cell to all notebooks, to ensure colab has current fastai version (#2843)
Bugs Squashed
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.0.14
2.0.14
New Features
new callback event:
after_create(#2842)- This event runs after a
Learneris constructed. It's useful for initial setup which isn't needed for everyfit, but just once for eachLearner(such as setting initial defaults).
- This event runs after a
Modified XResNet to support Conv1d / Conv3d (#2744), thanks to @floleuerer
- Supports different input dimensions, kernel sizes and stride (added parameters ndim, ks, stride). Tested with fastai_audio and fastai time series with promising results.
Bugs Squashed
- Jupyter Notebook
Published by jph00 over 5 years ago
fastai - 2.0.13
2.0.13
Bugs Squashed
- Undo breaking num_workers fix (#2804)
- Some users found the recent addition of
num_workersto inference functions was causing problems, particularly on Windows. This PR reverts that change, until we find a more reliable way to handlenum_workersfor inference.
- Some users found the recent addition of
- learn.tta() fails on a learner imported with load_learner() (#2764)
- learn.summary() crashes out on 2nd transfer learning (#2735)
- Jupyter Notebook
Published by jph00 over 5 years ago