Recent Releases of deepparse
deepparse - 0.9.10
- Fix and improve documentation.
- Remove fixed dependencies version.
- Fix app errors.
- Add data validation for 1) multiple consecutive whitespace and 2) newline.
- Fixes some errors in tests.
- Add an argument to the
DatasetContainerinterface to use a pre-processing data cleaning function before validation. - Hot-fix the issue with the BPEmb base URL download problem. See issue 221.
- Fix the NumPy version due to a major release with breaking changes.
- Fix the SciPy version due to breaking change with Gensim.
- Fix circular import in the API app.
- Fix deprecated
max_request_body_sizein Sentry.
- Python
Published by davebulaval over 1 year ago
deepparse - 0.9.9
- Add version to Seq2Seq and AddressParser.
- Add a Deepparse as an API using FastAPI.
- Add a Dockerfile and a
docker-compose.ymlto build a Docker container for the API. - Bug-fix the default pre-processors that were not all apply but only the last one.
- Python
Published by davebulaval over 2 years ago
deepparse - 0.9.8 and weights release
- Hot-Fix wheel install (See issue 196).
- Python
Published by davebulaval over 2 years ago
deepparse - 0.9.7
- New models release with more meta-data.
- Add a feature to use an AddressParser from a URI.
- Add a feature to upload the trained model to a URI.
- Add an example of how to use URI for parsing from and uploading to.
- Improve error handling of
path_to_retrain_model. - Bug-fix pre-processor error.
- Add verbose override and improve verbosity handling in retrain.
- Bug-fix the broken FastText installation using
fasttext-wheelinstead offasttext( see here and here).
- Python
Published by davebulaval almost 3 years ago
deepparse - 0.9.6
- Add Python 3.11.
- Add pre-processor when parsing addresses.
- Add pin_memory=True when using a CUDA device to increase performance as suggested
- by Torch documentation.
- Add torch.nograd() context manager in _call__() to increase performance.
- Reduce memory swap between CPU and GPU by instantiating Tensor directly on the GPU device.
- Improve some Warnings clarity (i.e. category and message).
- Bug-fix MacOS multiprocessing. It was impossible to use in multiprocess since we were not testing whether torch
- multiprocess was set properly. Now, we set it properly and raise a warning instead of an error.
- Drop Python 3.7 support since newer Python versions are faster
- and Torch 2.0 does not support Python 3.7.
- Improve error handling with wrong checkpoint loading in AddressParser retrain_path use.
- Add torch.compile integration to improve performance (Torch 1.x still supported) with mode="reduce-overhead" as
- suggested in the documentation. It
- increases the performance by about 1/100.
- Python
Published by davebulaval almost 3 years ago
deepparse - 0.9.2
- Improve Deepparse server error handling and error output
- Remove deprecated argument savingdir in downloadfasttextmagnitudeembeddings and downloadfasttextembeddings functions
- Add offline argument to remove verification of the latest version
- Bug-fix cache handling in download model
- Add download_models CLI function
- https://github.com/GRAAL-Research/deepparse/issues/156
- Python
Published by davebulaval over 3 years ago
deepparse - 0.9
- Add
save_model_weightsmethod toAddressParserto save model weights (PyTorch state dictionary) - Improve CI
- Added verbose flag for the test to activate or deactivate the test verbosity (it overrides the AddressParser verbosity)
- Add Docker image
- Add
val_datasetto retrain API to allow the use of a specific val dataset for training - Remove deprecated
download_from_urlfunction - Remove deprecated
dataset_containerargument - Fixed error and docs
- Added the UK retrain example
- Python
Published by davebulaval over 3 years ago
deepparse - 0.8.1
- Refactored function
download_from_urltodownload_from_public_repository. - Add error management when retrain a FastText like model on Windows with a number of workers (
num_workers) greater than 0. - Improve dev tooling
- Improve CI
- Improve code coverage and pylint
- Add Codacy
- Python
Published by davebulaval over 3 years ago
deepparse - 0.8
- Improve SEO.
- Add cache_dir arg in all CLI functions.
- Improve handling of HTTP error in models version verification.
- Improve doc.
- Add a note for parsing data cleaning (i.e. lowercase, commas removal, and hyphen replacing).
- Add hyphen parsing cleaning step (with a bool flag to activate or not) to improve some country address parsing (see issue 137).
- Add ListDatasetContainer for Python list dataset.
- Python
Published by davebulaval over 3 years ago
deepparse - 0.7.5
- Bug-fix Poutyne version handling that causes a print error when a version is 1.11 when retraining
- Add the option to create a named retrain parsing model using by default the architecture setting or using the user-given name
- Hot-fix missing raise for DataError validation of address to parse when address is tuple
- Bug-fix handling of string column name for CSVDatasetContainer that raised ValueError
- Improve parse CLI doc and fix error in doc stating JSON format is supported as input data
- Add batch_size to parse CLI
- Add minimum version to Gensim 4.0.0.
- Add a new CLI function, retrain, to retrain from the command line
- Improve doc
- Add
cache_dirto the BPEmb embedding model and toAddressParserto change the embeddings cache directory and models weights cache directory - Change the
saving_dirargument ofdownload_fastext_embeddingsanddownload_fasttext_magnitude_embeddingsfunction tocache_dir.saving_diris now deprecated and will be remove in version 0.8. - Add a new CLI function, test, to test from the command line
- Python
Published by davebulaval over 3 years ago
deepparse - 0.7.4
- Improve parsed address print
- Bug-fix #124: comma-separated list without whitespace in CSVDatasetContainer
- Add a report when addresses to parse and tags list len differ
- Add an example on how to fine-tune using our CSVDatasetContainer
- Improve data validation for data to parse
- Python
Published by davebulaval almost 4 years ago
deepparse - 0.6.5
- Improve error handling of empty data and whitespace-only data.
- Parsing now include two validation on the data quality (not empty and not whitespace only)
- DataContainer now includes data quality test (not empty, not whitespace only, tags not empty, tag the same len as an address, and data is a list of tuples)
- New CSVDatasetContainer
- DataContainer can now be used to predict using a flag.
- Add a CLI to parse addresses from the command line.
- Python
Published by davebulaval about 4 years ago
deepparse - 0.6.2
- Improved (slightly) code speed of data padding method as per PyTorch list or array to Tensor recommendation.
- Improved doc for RuntimeError due to retraining FastText and BPEmb model in the same directory.
- Added error handling RuntimeError when retraining.
- Python
Published by davebulaval about 4 years ago
deepparse - 0.4
- Added verbose flag to training and test base on the
__init__of address parser. - Added a feature to retrain our models with prediction tags dictionary different from the default one.
- Added in-doc code examples.
- Added code examples.
- Small improvement of our model implementation.
- Python
Published by davebulaval over 4 years ago
deepparse - 0.3.5
- Added verbose flag to training and test base on the init of address parser.
- Breaking change Since SciPy 1.6 is released on Python
3.7+, we don't support Python3.6. - Added management for Windows where the FastText model cannot be pickled. On Windows, we use Gensim fasttext model, which takes more RAM.
- Python
Published by davebulaval almost 5 years ago
deepparse - 0.3.4
- Fixed a bug when use batched address. Since we were sorting the address during the forward pass, the output prediction tags were not aligned with the supposed parsed address. We have removed the sorting, and now the results are more aligned with our research.
- Python
Published by davebulaval almost 5 years ago
deepparse - 0.3.3
- We have improved the loading of data during prediction. We now use a data loader.
- Updated the performance table of the model with the data loader approach.
- Fixed missing import in the parser module.
- Bug fix of the
max_lenfor the predictions.
- Python
Published by davebulaval almost 5 years ago
deepparse - 0.2
Added Fasttext light model using pymagnitude-light Added finetuning API to allow finetuning of our models (retrain) Added a method to test models (test) Added metric, loss and dataset container to facilitate finetuning training Added an example of finetuning Added way to load retrain model when instantiation of AddressParser
- Python
Published by davebulaval about 5 years ago
deepparse - 0.1.3
Added "contributing to"
Added fix for comma problem (#56)
Added content in Address Parser doc for tags definition
Fixed Pylint bug with PyTorch 1.6
Fixed pack_padded cpu error with PyTorch new release (https://github.com/pytorch/pytorch/issues/43227)
- Python
Published by davebulaval over 5 years ago
deepparse - Beta release
- Initial release of the pre-trained models
- Beta version of the API
We are working on a way to reduce the memory footprint for fastText model. We welcome comments and issues to improve the API.
- Python
Published by davebulaval over 5 years ago