v0.9.6 (2024-04-18)

Full Changelog

This is a minor release.

Changed

Removed explicit dependency on Pydantic (#1002)

Development

Bump tj-actions/changed-files from 1.1.2 to 41.0.0 in /.github/workflows (#992)
Update README.md (#996)
Update numba requirement from !=0.54.0,<0.59.0,>=0.50.0 to >=0.50.0,!=0.54.0,<0.60.0 (#999)
Update twine requirement from <5.0.0,>3.2.0 to >3.2.0,<6.0.0 (#1001)
build(ci): Migrate actions to later Node version (#1003)

- Python
Published by jesse-c almost 2 years ago

v0.9.5 (2024-01-22)

Full Changelog

This is a patch release fixing several bugs, updating dependencies and a change of license.

Fixed

Fix torch version bound in setup.py extras_require (#950)
Fix DistributedExplainer import errors that arise when ray absent(#951)
Fix memory limit issue in tox ci jobs (#956)
Fix E721 linting errors (#958)
Fix plot_pd function to work with matplotlib 3.8.0 changes (#965)
Fix typechecking with matplotlib 3.8.0 (#969)
fix typechecking for matplotlib 3.8.1 (#981)
Fix typechecking for mypy 1.7.0 (#983)
Fix test models to output logits and work with default loss functions (#975)
Fix dtype type in helper method for AnchorText samplers (#980)

Changed

Alibi License change from Apache to Business Source License 1.1 (#995)

Development

Update myst-parser requirement upper bound from 2.0 to 3.0 (#931)
Update pillow requirement upper bound from 10.0 to 11.0 (#939)
Add notebooks tests for python 3.11 (#948) & (#949)
Update sphinxcontrib-apidoc requirement upper bound from 0.4.0 to 0.5.0 (#962)
Update numba requirement upper bound from 0.58.0 to 0.59.0 (#967)
Update shap requirement upper bound from 0.43.0 to 0.44.0 (#974)
Update tensorflow requirement upper bound from 2.14.0 to 2.15.0 (#968)
Update AlibiExplainLogo_rgb image with white stroked letters (#979)
Remove macos from ci (#995)
Add security scans to CI (#995)

- Python
Published by mauicv about 2 years ago

v0.9.4 (2023-07-07)

Full Changelog

This is a patch release to support numpy >= 1.24 and scikit-learn >= 1.3.0, and drop official support for Python 3.7.

Development

Drop official support for Python 3.7 (#942).
Maximum supported version of shap bumped to 0.42.x, to give numpy >= 1.24 support (#944).
Fix handling of scikit-learn partial_dependence kwarg's in tests, for compatibility with scikit-learn 1.3.0 (#940).

- Python
Published by ascillitoe over 2 years ago

v0.9.3 (2023-06-21)

Full Changelog

This is a patch release to officially enable support for Python 3.11. This is the last release with official support for Python 3.7.

Development

Test library on Python 3.11 (#932).
Separate code quality into its own Github Action and only run against the main development version of Python, currently Python 3.10 (#925).
Check and remove stale mypy ignore commands (#874).
Bump torch version to 2.x (#893).
Bump scikit-image version to 0.21.x (#928).
Bump numba version to 0.57.x (#922).
Bump sphinx version to 7.x (#921).

- Python
Published by jklaise over 2 years ago

v0.9.2 (2023-04-28)

Full Changelog

This is a patch release fixing several bugs, updating dependencies and adding some small extensions.

Added

Allow IntegratedGradients layer selection to be specified with a custom callable (#894).
Implement reset_predictor method for PartialDependence explainer (#897).
Extend GradientSimilarity explainer to allow models of any input type (#912).

Fixed

AnchorText auto-regressive language model sampler updating input_ids tensor (#895).
AnchorTabular length discrepancy between feature and names fields (#902).
AnchorBaseBeam unintended coverage update during the multi-armed bandit run (#919, #914).

Changed

Maximum supported version of tensorflow bumped to 2.12.x (#896).
Supported version of pandas bumped to >1.0.0, <3.0.0 (#899).
Update notebooks to account for pandas version 2.x deprecations (#908, #910).
Maximum supported version of scikit-image bumped to 0.20.x (#882).
Maximum supported version of attrs bumped to 23.x (#905).

Development

Migrate codecov to use Github Actions and don't fail CI on coverage report upload failure due to rate limiting (#901, #913).
Bumpy mypy version to >=1.0, <2.0 (#886).
Bump sphinx version to 6.x (#852).
Bump sphinx-design version to 0.4.1 (#904).
Bump nbsphinx version to 0.9.x (#889).
Bump myst-parser version to >=1.0, <2.0 (#887).
Bump twine version to 4.x (#620).
Bump pre-commit version to 3.x and update the config (#866).

- Python
Published by jklaise almost 3 years ago

v0.9.1 (2023-03-13)

Full Changelog

This is a patch release fixing several bugs.

Fixed

Replace deprecated usage of np.object in the codebase which was causing errors with numpy>=1.24 (#872, #890).
Fix a bug/typo in cfrl_base.py of the tensorflow backend (#891).
Correctly handle calls to .reset_predictor for KernelShap and TreeShap explainers (#880).
Update saving of KernelShap to avoid saving the internal _explainer object (#881).

Development

Show text execution times (#849).
Replace Python 2 style type comments with type annotations (#870).
Bump the mypy version to ~1.0 (#871).
Bump the default development version of Python to 3.10 (#876, #877).

- Python
Published by jklaise almost 3 years ago

v0.9.0 (2023-01-11)

Full Changelog

Added

New feature PermutationImportance explainer implementing the permutation feature importance global explanations. Also included is a plot_permutation_importance utility function for flexible plotting of the resulting feature importance scores (docs, #798).
New feature PartialDependenceVariance explainer implementing partial dependence variance global explanations. Also included is a plot_pd_variance utility function for flexible plotting of the resulting PD variance plots (docs, #758).

Fixed

GradientSimilarity explainer now automatically handles sparse tensors in the model by converting the gradient tensors to dense ones before calculating similarity. This used to be a source of bugs when calculating similarity for models with embedding layers for which gradients tensors are sparse by default. Additionally, it now filters any non-trainable parameters and doesn't consider those in the calculation as no gradients exist. A warning is raised if any non-trainable layers or parameters are detected (#829).
Updated the discussion of the interpretation of ALE. The previous examples and documentation had some misleading claims; these have been removed and reworked with an emphasis on the mostly qualitative interpretation of ALE plots (#838, #846).

Changed

Deprecated the use of the legacy Boston housing dataset in examples and testing. The new examples now use the California housing dataset (#838, #834).
Modularized the computation of prototype importances and plotting for ProtoSelect, allowing greater flexibility to the end user (#826).
Roadmap documentation page removed due to going out of date (#842).

Development

Tests added for tensorflow models used in CounterfactualRL (#793).
Tests added for pytorch models used in CounterfactualRL (#799).
Tests added for ALE plotting functionality (#816).
Tests added for PartialDependence plotting functionality (#819).
Tests added for PartialDependenceVariance plotting functionality (#820).
Tests added for PermutationImportance plotting functionality (#824).
Tests addef for ProtoSelect plotting functionality (#841).
Tests added for the datasets subpackage (#814).
Fixed optional dependency installation during CI to make sure dependencies are consistent (#817).
Synchronize notebook CI workflow with the main CI workflow (#818).
Version of pytest-cov bumped to 4.x (#794).
Version of pytest-xdist bumped to 3.x (#808).
Version of tox bumped to 4.x (#832).

- Python
Published by jklaise about 3 years ago

v0.8.0 (2022-09-26)

Full Changelog

Added

New feature PartialDependence and TreePartialDependence explainers implementing partial dependence (PD) global explanations. Also included is a plot_pd utility function for flexible plotting of the resulting PD plots (docs, #721).
New exceptions.NotFittedError exception which is raised whenever a compulsory call to a fit method has not been carried out. Specifically, this is now raised in AnchorTabular.explain when AnchorTabular.fit has been skipped (#732).
Various improvements to docs and examples (#695, #701, #698, #703, #717, #711, #750, #784).

Fixed

Edge case in AnchorTabular where an error is raised during an explain call if the instance contains a categorical feature value not seen in the training data (#742).

Changed

Improved handling of custom grid_points for the ALE explainer (#731).
Renamed our custom exception classes to remove the verbose Alibi* prefix and standardised the *Error suffix. Concretely:
- exceptions.AlibiPredictorCallException is now exceptions.PredictorCallError
- exceptions.AlibiPredictorReturnTypeError is now exceptions.PredictorReturnTypeError. Backwards compatibility has been maintained by subclassing the new exception classes by the old ones, but these will likely be removed in a future version (#733).
Warn users when TreeShap is used with more than 100 samples in the background dataset which is due to a limitation in the upstream shap package (#710).
Minimum version of scikit-learn bumped to 1.0.0 mainly due to upcoming deprecations (#776).
Minimum version of scikit-image bumped to 0.17.2 to fix a possible bug when using the slic segmentation function with AnchorImage (#753).
Maximum supported version of attrs bumped to 22.x (#727).
Maximum supported version of tensorflow bumped to 2.10.x (#745).
Maximum supported version of ray bumped to 2.x (#740).
Maximum supported version of numba bumped to 0.56.x (#724).
Maximum supported version of shap bumped to 0.41.x (#702).
Updated shap example notebooks to recommend installing matplotlib==3.5.3 due to failure of shap plotting functions with matplotlib==3.6.0 (#776).

Development

Extend optional dependency checks to ensure the correct submodules are present (#714).
Introduce pytest-custom_exit_code to let notebook CI pass when no notebooks are selected for tests (#728).
Use UTF-8 encoding when loading README.md in setup.py to avoid a possible failure of installation for some users (#744).
Updated guidance for class docstrings (#743).
Reinstate ray tests (#756).
We now exclude test files from test coverage for a more accurate representation of coverage (#751). Note that this has led to a drop in code covered which will be addressed in due course (#760).
The Python 3.10.x version on CI has been pinned to 3.10.6 due to typechecking failures, pending a new release of mypy (#761).
The test_changed_notebooks workflow can now be triggered manually and is run on push/PR for any branch (#762).
Use codecov flags for more granular reporting of code coverage (#759).
Option to ssh into Github Actions runs for remote debugging of CI pipelines (#770).
Version of sphinx bumped to 5.x but capped at <5.1.0 to avoid CI failures (#722).
Version of myst-parser bumped to 0.18.x (#693).
Version of flake8 bumped to 5.x (#729).
Version of ipykernel bumped to 6.x (#431).
Version of ipython bumped to 8.x (#572).
Version of pytest bumped to 7.x (#591).
Version of sphinx-design bumped to 0.3.0 (#739).
Version of nbconvert bumped to 7.x (#738).

- Python
Published by jklaise over 3 years ago

v0.7.0 (2022-05-18)

Full Changelog

This release introduces two new methods, a GradientSimilarity explainer and a ProtoSelect data summarisation algorithm.

Added

New feature GradientSimilarity explainer for explaining predictions of gradient-based (PyTorch and TensorFlow) models by returning the most similar training data points from the point of view of the model (docs).
New feature We have introduced a new subpackage alibi.prototypes which contains the ProtoSelect algorithm for summarising datasets with a representative set of "prototypes" (docs).
ALE explainer now can take a custom grid-point per feature to evaluate the ALE on. This can help in certain situations when grid-points defined by quantiles might not be the best choice (docs).
Extended the IntegratedGradients method target selection to handle explaining any scalar dimension of tensors of any rank (previously only rank-1 and rank-2 were supported). See #635.
Python 3.10 support. Note that PyTorch at the time of writing doesn't support Python 3.10 on Windows.

Fixed

Fixed a bug which incorrectly handled multi-dimensional scaling in CounterfactualProto (#646).
Fixed a bug in the example using CounterfactualRLTabular (#651).

Changed

tensorflow is now an optional dependency. To use methods that require tensorflow you can install alibi using pip install alibi[tensorflow] which will pull in a supported version. For full instructions for the recommended way of installing optional dependencies please refer to Installation docs.
Updated sklearn version bounds to scikit-learn>=0.22.0, <2.0.0.
Updated tensorflow maximum allowed version to 2.9.x.

Development

This release introduces a way to manage the absence of optional dependencies. In short, the design is such that if an optional dependency is required for an algorithm but missing, at import time the corresponding public (or private in the case of the optional dependency being required for a subset of the functionality of a private class) algorithm class will be replaced by a MissingDependency object. For full details on developing alibi with optional dependencies see Contributing: Optional Dependencies.
The CONTRIBUTING.md has been updated with further instructions for managing optional dependencies (see point above) and more conventions around docstrings.
We have split the Explainer base class into Base and Explainer to facilitate reusability and better class hierarchy semantics with introducing methods that are not explainers (#649).
mypy has been updated to ~=0.900 which requires additional development dependencies for type stubs, currently only types-requests has been necessary to add to requirements/dev.txt.
Fron this release onwards we exclude the directories doc/ and examples/ from the source distribution (by adding prune directives in MANIFEST.in). This results in considerably smaller file sizes for the source distribution.

- Python
Published by jklaise almost 4 years ago

v0.6.5 (2022-03-18)

Full Changelog

This is a patch release to correct a regression in CounterfactualProto introduced in v0.6.3.

Added

Added a Frequently Asked Questions page to the docs.

Fixed

Fix a bug introduced in v0.6.3 which prevented CounterfactualProto working with categorical features (#612).
Fix an issue with the LanguageModelSampler where it would sometimes sample punctuation (#585).

Development

The maximum tensorflow version has been bumped from 2.7 to 2.8 (#588).

- Python
Published by jklaise almost 4 years ago

v0.6.4 (2022-01-28)

Full Changelog

This is a patch release to correct a regression in AnchorImage introduced in v0.6.3.

Fixed

Fix a bug introduced in v0.6.3 where AnchorImage would ignore user segmentation_kwargs (#581).

Development

The maximum versions of Pillow and scikit-image have been bumped to 9.x and 0.19.x respectively.

- Python
Published by jklaise about 4 years ago

v0.6.3 (2022-01-18)

Full Changelog

Added

New feature A callback can now be passed to IntegratedGradients via the target_fn argument, in order to calculate the scalar target dimension from the model output. This is to bypass the requirement of passing target directly to explain when the target of interest may depend on the prediction output. See the example in the docs. (#523).
A new comprehensive Introduction to explainability added to the documentation (#510).

Changed

Python 3.6 has been deprecated from the supported versions as it has reached end-of-life.

Fixed

Fix a bug with passing background images to AnchorImage leading to an error (#542).
Fix a bug with rounding errors being introduced in CounterfactualRLTabular (#550).

Development

Docstrings have been updated and consolidated (#548). For developers, docstring conventions have been documented in CONTRIBUTING.md.
numpy typing has been updated to be compatible with numpy 1.22 (#543). This is a prerequisite for upgrading to tensorflow 2.7.
To further improve reliability, strict Optional type-checking with mypy has been reinstated (#541).
The Alibi CI tests now include Windows and MacOS platforms (#575).
The maximum tensorflow version has been bumped from 2.6 to 2.7 (#377).

- Python
Published by ascillitoe about 4 years ago

v0.6.2 (2021-11-18)

Full Changelog

Added

Documentation on using black-box and white-box models in the context of alibi, see here.
AnchorTabular, AnchorImage and AnchorText now expose an additional dtype keyword argument with a default value of np.float32. This is to ensure that whenever a user predictor is called internally with dummy data a correct data type can be ensured (#506).
Custom exceptions. A new public module alibi.exceptions defining the alibi exception hierarchy. This introduces two exceptions, AlibiPredictorCallException and AlibiPredictorReturnTypeError. See #520 for more details.

Changed

For AnchorImage, coerce image_shape argument into a tuple to implicitly allow passing a list input which eases use of configuration files. In the future the typing will be improved to be more explicit about allowed types with runtime type checking.
Updated the minimum shap version to the latest 0.40.0 as this fixes an installation issue if alibi and shap are installed with the same command.

Fixed

Fix a bug with version saving being overwritten on subsequent saves (#481).
Fix a bug in the Integrated Gradients notebook with transformer models due to a regression in the upstream transformers library (#528).
Fix a bug in IntegratedGradients with forward_kwargs not always being correctly passed (#525).
Fix a bug resetting TreeShap predictor (#534).

Development

Now using readthedocs Docker image in our CI to replicate the doc building environment exactly. Also enabled readthedocs build on PR feature which allows browsing the built docs on every PR.
New notebook execution testing framework via Github Actions. There are two new GA workflows, testallnotebooks which is run once a week and can be triggered manually, and testchangednotebooks which detects if any notebooks have been modified in a PR and executes only those. Not all notebooks are amenable to be tested automatically due to long running times or complex software/hardware dependencies. We maintain a list of notebooks to be excluded in the testing script under testing/test_notebooks.py.
Now using myst (a markdown superset) for more flexible documentation (#482).
Added a CITATION.cff file.

- Python
Published by jklaise over 4 years ago

v0.6.1 (2021-09-02)

Full Changelog

Added

New feature An implementation of Model-agnostic and Scalable Counterfactual Explanations via Reinforcement Learning is now available via alibi.explainers.CounterfactualRL and alibi.explainers.CounterfactualRLTabular classes. The method is model-agnostic and the implementation is written in both PyTorch and TensorFlow. See docs for more information.

Changed

Future breaking change The names of CounterFactual and CounterFactualProto classes have been changed to Counterfactual and CounterfactualProto respectively for consistency and correctness. The old class names continue working for now but emit a deprecation warning message and will be removed in an upcoming version.
dill behaviour was changed to not extend the pickle protocol so that standard usage of pickle in a session with alibi does not change expected pickle behaviour. See discussion.
AnchorImage internals refactored to avoid persistent state between explain calls.

Development

A PR checklist is available under CONTRIBUTING.md. In the future many of these may be turned into automated checks.
pandoc version for docs building updated to 1.19.2 which is what is used on readthedocs.
Citation updated to the JMLR paper.

- Python
Published by jklaise over 4 years ago

v0.6.0 (2021-07-08)

Full Changelog

Added

New feature AnchorText now supports sampling according to masked language models via the transformers library. See docs and the example for using the new functionality.
Breaking change due to the new masked language model sampling for AnchorText the public API for the constructor has changed. See docs for a full description of the new API.
AnchorTabular now supports one-hot encoded categorical variables in addition to the default ordinal/label encoded representation of categorical variables.
IntegratedGradients changes to allow explaining a wider variety of models. In particular, a new forward_kwargs argument to explain allows passing additional arguments to the model and attribute_to_layer_inputs flag to allow calculating attributions with respect to layer input instead of output if set to True. The API and capabilities now track more closely to the captum.ai PyTorch implementation.
Example of using IntegratedGradients to explain transformer models.
Python 3.9 support.

Fixed

IntegratedGradients - fix the path definition for attributions calculated with respect to an internal layer. Previously the paths were defined in terms of the inputs and baselines, now they are correctly defined in terms of the corresponding layer input/output.

- Python
Published by jklaise over 4 years ago

v0.5.8 (2021-04-29)

Full Changelog

Added

Experimental explainer serialization support using dill. See docs for more details.

Fixed

Handle layers which are not part of model.layers for IntegratedGradients.

Development

Update type hints to be compatible with numpy 1.20.
Separate licence build step in CI, only check licences against latest Python version.

- Python
Published by jklaise almost 5 years ago

v0.5.7 (2021-03-31)

Full Changelog

Changed

Support for KernelShap and TreeShap now requires installing the shap dependency explicitly after installing alibi. This can be achieved by running pip install alibi && pip install alibi[shap]. The reason for this is that the build process for the upstream shap package is not well configured resulting in broken installations as detailed in https://github.com/SeldonIO/alibi/pull/376 and https://github.com/slundberg/shap/pull/1802. We expect this to be a temporary change until changes are made upstream.

Added

A reset_predictor method for black-box explainers. The intended use case for this is for deploying an already configured explainer to work with a remote predictor endpoint instead of the local predictor used in development.
alibi.datasets.load_cats function which loads a small sample of cat images shipped with the library to be used in examples.

Fixed

Deprecated the alibi.datasets.fetch_imagenet function as the Imagenet API is no longer available.
IntegratedGradients now works with subclassed TensorFlow models.
Removed support for calculating attributions wrt multiple layers in IntegratedGradients as this was not working properly and is difficult to do in the general case.

Development

Fixed an issue with AnchorTabular tests not being picked up due to a name change of test data fixtures.

- Python
Published by jklaise almost 5 years ago

v0.5.6 (2021-02-18)

Full Changelog

Added

Breaking change IntegratedGradients now supports models with multiple inputs. For each input of the model, attributions are calculated and returned in a list. Also extends the method allowing to calculate attributions for multiple internal layers. If a list of layers is passed, a list of attributions is returned. See https://github.com/SeldonIO/alibi/pull/321.
ALE now supports selecting a subset of features to explain. This can be useful to reduce runtime if only some features are of interest and also indirectly helps dealing with categorical variables by being able to exclude them (as ALE does not support categorical variables).

Fixed

AnchorTabular coverage calculation was incorrect which was caused by incorrectly indexing a list, this is now resolved.
ALE was causing an error when a constant feature was present. This is now handled explicitly and the user has control over how to handle these features. See https://docs.seldon.io/projects/alibi/en/latest/api/alibi.explainers.ale.html#alibi.explainers.ale.ALE for more details.
Release of Spacy 3.0 broke the AnchorText functionality as the way lexeme_prob tables are loaded was changed. This is now fixed by explicitly handling the loading depending on the spacy version.
Fixed documentation to refer to the Explanation object instead of the old dict object.
Added warning boxes to CounterFactual, CounterFactualProto and CEM docs to explain the necessity of clearing the TensorFlow graph if switching to a new model in the same session.

Development

Introduced lower and upper bounds for library and development dependencies to limit the potential for breaking functionality upon new releases of dependencies.
Added dependabot support to automatically monitor new releases of dependencies (both library and development).
Switched from Travis CI to Github Actions as the former limited their free tier.
Removed unused CI provider configs from the repo to reduce clutter.
Simplified development dependencies to just two files, requirements/dev.txt and requirements/docs.txt.
Split out the docs building stage as a separate step on CI as it doesn't need to run on every Python version thus saving time.
Added .readthedocs.yml to control how user-facing docs are built directly from the repo.
Removed testing related entries to setup.py as the workflow is both unused and outdated.
Avoid shap==0.38.1 as a dependency as it assumes IPython is installed and breaks the installation.

- Python
Published by jklaise about 5 years ago

v0.5.5 (2020-10-20)

Full Changelog

Added

New feature Distributed backend using ray. To use, install ray using pip install alibi[ray].
New feature KernelShap distributed version using the new distributed backend.
For anchor methods added an explanation field data['raw']['instances'] which is a batch-wise version of the existing data['raw']['instance']. This is in preparation for the eventual batch support for anchor methods.
Pre-commit hook for pyupgrade via nbqa for formatting example notebooks using Python 3.6+ syntax.

Fixed

Flaky test for distributed anchors (note: this is the old non-batchwise implementation) by dropping the precision treshold.
Notebook string formatting upgraded to Python 3.6+ f-strings.

Changed

Breaking change For anchor methods, the returned explanation field data['raw']['prediction'] is now batch-wise, i.e. for AnchorTabular and AnchorImage it is a 1-dimensional numpy array whilst for AnchorText it is a list of strings. This is in preparation for the eventual batch support for anchor methods.
Removed dependency on prettyprinter and substituted with a slightly modified standard library version of PrettyPrinter. This is to prepare for a conda release which requires all dependencies to also be published on conda.

- Python
Published by jklaise over 5 years ago

v0.5.4 (2020-09-03)

Full Changelog

Added

update_metadata method for any Explainer object to enable easy book-keeping for algorithm parameters

Fixed

Updated KernelShap wrapper to work with the newest shap>=0.36 library
Fix some missing metadata parameters in KernelShap and TreeShap

- Python
Published by jklaise over 5 years ago

v0.5.3 (2020-09-01)

Full Changelog

Changed

Updated roadmap

Fixed

Bug in integrated gradients where incorrect layer handling led to output shape mismatch when explaining layer outputs
Remove tf.logging calls in example notebooks as TF 2.x API no longer supports tf.logging
Pin shap to 0.35.0, pending shap 0.36.0 patch release to support shap API updates/library refactoring

- Python
Published by alexcoca over 5 years ago

v0.5.2 (2020-08-05)

Full Changelog

This release changes the required TensorFlow version from <2.0 to >=2.0. This means that alibi code depends on TenorFlow>=2.0, however the explainer algorithms are compatible for models trained with both TF1.x and TF2.x.

The alibi code that depends on TensorFlow itself has not been fully migrated in the sense that the code is still not idiomatic TF2.x code just that we now use the tf.compat.v1 package provided by TF2.x internally. This does mean that for the time being to run algorithms which depend on TensorFlow (CounterFactual, CEM and CounterFactualProto) require disabling TF2.x behaviour by running tf.compat.v1.disable_v2_behavior(). This is documented in the example notebooks. Work is underway to re-write the TensorFlow dependent components in idiomatic TF2.x code so that this will not be necessary in a future release.

The upgrade to TensorFlow 2.x also enables this to be the first release with Python 3.8 support.

Finally, white-box explainers are now tested with pre-trained models from both TF1.x and TF2.x. The binaries for the models along with loading functionality and datasets used to train these are available in the alibi-testing helper package which is now a requirement for running tests.

Changed

Minimum required TensorFlow version is now 2.0
Tests depending on trained models are now run using pre-trained models hosted under the alibi-testing helper package

Fixed

A bug in AnchorText resulting from missing string hash entries in some spacy models (https://github.com/SeldonIO/alibi/pull/276)
Explicitly import lazy_fixture in tests instead of relying on the deprecated usage of pytest namespace (https://github.com/SeldonIO/alibi/pull/281)
A few bugs in example notebooks

- Python
Published by jklaise over 5 years ago

alibi - v0.5.1

v0.5.1 (2020-07-10)

Full Changelog

This is a bug fix release.

Fixed

Fix an issue with AnchorText not working on text instances with commas due to not checking for empty synonym lists
Enable correct behaviour of AnchorText with spacy>=2.3.0, this now requires installing spacy[lookups] as an additional dependency which contains model probability tables
Update the expected_value attribute of TreeSHAP which is internally updated after a call to explain
Fix some links in Integrated Gradients examples
Coverage after running tests on Travis is now correctly reported as the reports are merged for different pytest runs
Old Keras tests now require Keras<2.4.0 as the new release requires tensorflow>=2.2
Bump typing_extensions>=3.7.2 which includes the type Literal

- Python
Published by jklaise over 5 years ago

alibi - v0.5.0

v0.5.0 (2020-06-10)

Full Changelog

This version supports Python 3.6 and 3.7 as support for Python 3.5 is dropped.

Added

New feature TreeSHAP explainer for white-box, tree based model SHAP value computation
New feature ALE explainer for computing feature effects for black-box, tabular data models
New feature IntegratedGradients explainer for computing feature attributions for TensorFlow and Keras models
Experimental utils.visualization module currently containing visualization functions for IntegratedGradients on image datasets.The location, implementation and content of the module and functions therein are subject to change.
Extend datasets.fetch_imagenet to work with any class
Extend utils.data.gen_category_map to take a list of strings of column names

Changed

Internal refactoring of KernelSHAP to reuse functionality for TreeSHAP. Both SHAP wrappers are now under explainers.shap_wrappers
Tests are now split into two runs, one with TensorFlow in eager mode which is necessary for using IntegratedGradients
Added typing-extensions library as a requirement to take advantage of more precise types
Pinned scikit-image<0.17 due to a regression upstream
Pinned Sphinx<3.0 for documentation builds due to some issues with the m2r plugin

Fixed

Various improvements to documentation
Some tests were importing old keras functions instead of tensorflow.keras

- Python
Published by jklaise over 5 years ago

alibi - v0.4.0

v0.4.0 (2020-03-20)

Full Changelog

NB: This is the last version supporting Python 3.5.

Added

New feature KernelSHAP explainer for black-box model SHAP scores
Documentation for the LinearityMeasure algorithm ### Changed
Breaking change New API for explainer and explanation objects. Explainer objects now inherit from Explainer base class as a minimum. When calling .explain method, an Explanation object is returned (previously a dictionary). This contains two dictionaries meta and data accessed as attributes of the object, detailing the metadata and the data of the returned explanation. The common interfaces are under api.interfaces and default return metadata and data for each explainer are under api.defaults.
Complete refactoring of the Anchors algorithms, many code improvements
Explainer tests are now more modular, utilizing scoped fixtures defined in explainers.tests.conftest and various utility functions
Tests are now run sequentially insted of in parallel due to overhead of launching new processes

- Python
Published by jklaise almost 6 years ago

alibi - v0.3.2