Recent Releases of pytest

pytest 8.4.1 (2025-06-17)

Bug fixes

#13461: Corrected _pytest.terminal.TerminalReporter.isatty to support being called as a method. Before it was just a boolean which could break correct code when using -o log_cli=true).
#13477: Reintroduced pytest.PytestReturnNotNoneWarning{.interpreted-text role="class"} which was removed by accident in pytest [8.4]{.title-ref}.

This warning is raised when a test functions returns a value other than None, which is often a mistake made by beginners.

See return-not-none{.interpreted-text role="ref"} for more information.
#13497: Fixed compatibility with Twisted 25+.

Improved documentation

#13492: Fixed outdated warning about faulthandler not working on Windows.

- Python
Published by github-actions[bot] 8 months ago

pytest 8.4.0 (2025-06-02)

Removals and backward incompatible breaking changes

#11372: Async tests will now fail, instead of warning+skipping, if you don\'t have any suitable plugin installed.
#12346: Tests will now fail, instead of raising a warning, if they return any value other than None.
#12874: We dropped support for Python 3.8 following its end of life (2024-10-07).
#12960: Test functions containing a yield now cause an explicit error. They have not been run since pytest 4.0, and were previously marked as an expected failure and deprecation warning.

See the docs <yield tests deprecated>{.interpreted-text role="ref"} for more information.

Deprecations (removal in next major release)

#10839: Requesting an asynchronous fixture without a [pytestfixturesetup]{.title-ref} hook that resolves it will now give a DeprecationWarning. This most commonly happens if a sync test requests an async fixture. This should have no effect on a majority of users with async tests or fixtures using async pytest plugins, but may affect non-standard hook setups or autouse=True. For guidance on how to work around this warning see sync-test-async-fixture{.interpreted-text role="ref"}.

New features

#11538: Added pytest.RaisesGroup{.interpreted-text role="class"} as an equivalent to pytest.raises{.interpreted-text role="func"} for expecting ExceptionGroup{.interpreted-text role="exc"}. Also adds pytest.RaisesExc{.interpreted-text role="class"} which is now the logic behind pytest.raises{.interpreted-text role="func"} and used as parameter to pytest.RaisesGroup{.interpreted-text role="class"}. RaisesGroup includes the ability to specify multiple different expected exceptions, the structure of nested exception groups, and flags for emulating except* <except_star>{.interpreted-text role="ref"}. See assert-matching-exception-groups{.interpreted-text role="ref"} and docstrings for more information.
#12081: Added capteesys{.interpreted-text role="fixture"} to capture AND pass output to next handler set by --capture=.
#12504: pytest.mark.xfail{.interpreted-text role="func"} now accepts pytest.RaisesGroup{.interpreted-text role="class"} for the raises parameter when you expect an exception group. You can also pass a pytest.RaisesExc{.interpreted-text role="class"} if you e.g. want to make use of the check parameter.
#12713: New [--force-short-summary]{.title-ref} option to force condensed summary output regardless of verbosity level.

This lets users still see condensed summary output of failures for quick reference in log files from job outputs, being especially useful if non-condensed output is very verbose.
#12749: pytest traditionally collects classes/functions in the test module namespace even if they are imported from another file.

For example:

``` python

contents of src/domain.py

class Testament: ...

contents of tests/test_testament.py

from domain import Testament

def test_testament(): ... ```

In this scenario with the default options, pytest will collect the class [Testament]{.title-ref} from [tests/test_testament.py]{.title-ref} because it starts with [Test]{.title-ref}, even though in this case it is a production class being imported in the test module namespace.

This behavior can now be prevented by setting the new collect_imported_tests{.interpreted-text role="confval"} configuration option to false, which will make pytest collect classes/functions from test files only if they are defined in that file.

-- by FreerGit{.interpreted-text role="user"}
#12765: Thresholds to trigger snippet truncation can now be set with truncation_limit_lines{.interpreted-text role="confval"} and truncation_limit_chars{.interpreted-text role="confval"}.

See truncation-params{.interpreted-text role="ref"} for more information.
#13125: console_output_style{.interpreted-text role="confval"} now supports times to show execution time of each test.
#13192: pytest.raises{.interpreted-text role="func"} will now raise a warning when passing an empty string to match, as this will match against any value. Use match="^$" if you want to check that an exception has no message.
#13192: pytest.raises{.interpreted-text role="func"} will now print a helpful string diff if matching fails and the match parameter has ^ and $ and is otherwise escaped.
#13192: You can now pass with pytest.raises(check=fn): <pytest.raises>{.interpreted-text role="func"}, where fn is a function which takes a raised exception and returns a boolean. The raises fails if no exception was raised (as usual), passes if an exception is raised and fn returns True (as well as match and the type matching, if specified, which are checked before), and propagates the exception if fn returns False (which likely also fails the test).
#13228: hidden-param{.interpreted-text role="ref"} can now be used in id of pytest.param{.interpreted-text role="func"} or in ids of Metafunc.parametrize <pytest.Metafunc.parametrize>{.interpreted-text role="py:func"}. It hides the parameter set from the test name.
#13253: New flag: --disable-plugin-autoload <disable_plugin_autoload>{.interpreted-text role="ref"} which works as an alternative to PYTEST_DISABLE_PLUGIN_AUTOLOAD{.interpreted-text role="envvar"} when setting environment variables is inconvenient; and allows setting it in config files with addopts{.interpreted-text role="confval"}.

Improvements in existing functionality

#10224: pytest\'s short and long traceback styles (how-to-modifying-python-tb-printing{.interpreted-text role="ref"}) now have partial 657{.interpreted-text role="pep"} support and will show specific code segments in the traceback.

``` pytest ================================= FAILURES ================================= _______________________ testgetscorrecttracebacks ______________________

testtracebacks.py:12: in testgetscorrecttracebacks assert manhattandistance(p1, p2) == 1 ^^^^^^^^^^^^^^^^^^^^^^^^^^ testtracebacks.py:6: in manhattandistance return abs(point1.x - point2.x) + abs(point1.y - point_2.y) ^^^^^^^^^ E AttributeError: 'NoneType' object has no attribute 'x' ```

-- by ammaraskar{.interpreted-text role="user"}
#11118: Now pythonpath{.interpreted-text role="confval"} configures [\$PYTHONPATH]{.title-ref} earlier than before during the initialization process, which now also affects plugins loaded via the [-p]{.title-ref} command-line option.

-- by millerdev{.interpreted-text role="user"}
#11381: The type parameter of the parser.addini method now accepts [\"int\"]{.title-ref} and "float" parameters, facilitating the parsing of configuration values in the configuration file.

Example:

python def pytest_addoption(parser): parser.addini("int_value", type="int", default=2, help="my int value") parser.addini("float_value", type="float", default=4.2, help="my float value")

The [pytest.ini]{.title-ref} file:

ini [pytest] int_value = 3 float_value = 5.4
#11525: Fixtures are now clearly represented in the output as a \"fixture object\", not as a normal function as before, making it easy for beginners to catch mistakes such as referencing a fixture declared in the same module but not requested in the test function.

-- by the-compiler{.interpreted-text role="user"} and glyphack{.interpreted-text role="user"}
#12426: A warning is now issued when pytest.mark.usefixtures ref{.interpreted-text role="ref"} is used without specifying any fixtures. Previously, empty usefixtures markers were silently ignored.
#12707: Exception chains can be navigated when dropped into Pdb in Python 3.13+.
#12736: Added a new attribute [name]{.title-ref} with the fixed value [\"pytest tests\"]{.title-ref} to the root tag [testsuites]{.title-ref} of the junit-xml generated by pytest.

This attribute is part of many junit-xml specifications and is even part of the [junit-10.xsd]{.title-ref} specification that pytest\'s implementation is based on.
#12943: If a test fails with an exceptiongroup with a single exception, the contained exception will now be displayed in the short test summary info.
#12958: A number of unraisable <unraisable>{.interpreted-text role="ref"} enhancements:
- Set the unraisable hook as early as possible and unset it as late as possible, to collect the most possible number of unraisable exceptions.
- Call the garbage collector just before unsetting the unraisable hook, to collect any straggling exceptions.
- Collect multiple unraisable exceptions per test phase.
- Report the tracemalloc{.interpreted-text role="mod"} allocation traceback (if available).
- Avoid using a generator based hook to allow handling StopIteration{.interpreted-text role="class"} in test failures.
- Report the unraisable exception as the cause of the pytest.PytestUnraisableExceptionWarning{.interpreted-text role="class"} exception if raised.
- Compute the repr of the unraisable object in the unraisable hook so you get the latest information if available, and should help with resurrection of the object.
#13010: pytest.approx{.interpreted-text role="func"} now can compare collections that contain numbers and non-numbers mixed.
#13016: A number of threadexception <unraisable>{.interpreted-text role="ref"} enhancements:
- Set the excepthook as early as possible and unset it as late as possible, to collect the most possible number of unhandled exceptions from threads.
- Collect multiple thread exceptions per test phase.
- Report the tracemalloc{.interpreted-text role="mod"} allocation traceback (if available).
- Avoid using a generator based hook to allow handling StopIteration{.interpreted-text role="class"} in test failures.
- Report the thread exception as the cause of the pytest.PytestUnhandledThreadExceptionWarning{.interpreted-text role="class"} exception if raised.
- Extract the name of the thread object in the excepthook which should help with resurrection of the thread.
#13031: An empty parameter set as in pytest.mark.parametrize([], ids=idfunc) will no longer trigger a call to idfunc with internal objects.
#13115: Allows supplying ExceptionGroup[Exception] and BaseExceptionGroup[BaseException] to pytest.raises to keep full typing on ExceptionInfo <pytest.ExceptionInfo>{.interpreted-text role="class"}:

python with pytest.raises(ExceptionGroup[Exception]) as exc_info: some_function()

Parametrizing with other exception types remains an error - we do not check the types of child exceptions and thus do not permit code that might look like we do.

#13122: The --stepwise mode received a number of improvements:

It no longer forgets the last failed test in case pytest is executed later without the flag.

This enables the following workflow:

1.  Execute pytest with `--stepwise`, pytest then stops at the first failing test;
2.  Iteratively update the code and run the test in isolation, without the `--stepwise` flag (for example in an IDE), until it is fixed.
3.  Execute pytest with `--stepwise` again and pytest will continue from the previously failed test, and if it passes, continue on to the next tests.

Previously, at step 3, pytest would start from the beginning, forgetting the previously failed test.

This change however might cause issues if the `--stepwise` mode is used far apart in time, as the state might get stale, so the internal state will be reset automatically in case the test suite changes (for now only the number of tests are considered for this, we might change/improve this on the future).

New --stepwise-reset/--sw-reset flag, allowing the user to explicitly reset the stepwise state and restart the workflow from the beginning.

#13308: Added official support for Python 3.14.
#13380: Fix ExceptionGroup{.interpreted-text role="class"} traceback filtering to exclude pytest internals.
#13415: The author metadata of the BibTex example is now correctly formatted with last names following first names. An example of BibLaTex has been added. BibTex and BibLaTex examples now clearly indicate that what is cited is software.

-- by willynilly{.interpreted-text role="user"}
#13420: Improved test collection performance by optimizing path resolution used in FSCollector.
#13457: The error message about duplicate parametrization no longer displays an internal stack trace.
#4112: Using pytest.mark.usefixtures <pytest.mark.usefixtures ref>{.interpreted-text role="ref"} on pytest.param{.interpreted-text role="func"} now produces an error instead of silently doing nothing.
#5473: Replace [:]{.title-ref} with [;]{.title-ref} in the assertion rewrite warning message so it can be filtered using standard Python warning filters before calling pytest.main{.interpreted-text role="func"}.

#6985: Improved pytest.approx{.interpreted-text role="func"} to enhance the readability of value ranges and tolerances between 0.001 and 1000.

: - The [repr]{.title-ref} method now provides clearer output for values within those ranges, making it easier to interpret the results.

-   Previously, the output for those ranges of values and tolerances was displayed in scientific notation (e.g., [42 ± 1.0e+00]{.title-ref}). The updated method now presents the tolerance as a decimal for better readability (e.g., [42 ± 1]{.title-ref}).

    Example:

    **Previous Output:**

    ``` console
    >>> pytest.approx(42, abs=1)
    42 ± 1.0e+00
    ```

    **Current Output:**

    ``` console
    >>> pytest.approx(42, abs=1)
    42 ± 1
    ```

\-- by `fazeelghafoor`{.interpreted-text role="user"}

#7683: The formerly optional pygments dependency is now required, causing output always to be source-highlighted (unless disabled via the --code-highlight=no CLI option).

Bug fixes

#10404: Apply filterwarnings from config/cli as soon as possible, and revert them as late as possible so that warnings as errors are collected throughout the pytest run and before the unraisable and threadexcept hooks are removed.

This allows very late warnings and unraisable/threadexcept exceptions to fail the test suite.

This also changes the warning that the lsof plugin issues from PytestWarning to the new warning PytestFDWarning so it can be more easily filtered.
#11067: The test report is now consistent regardless if the test xfailed via pytest.mark.xfail <pytest.mark.xfail ref>{.interpreted-text role="ref"} or pytest.fail{.interpreted-text role="func"}.

Previously, xfailed tests via the marker would have the string "reason: " prefixed to the message, while those xfailed via the function did not. The prefix has been removed.
#12008: In 11220{.interpreted-text role="pr"}, an unintended change in reordering was introduced by changing the way indices were assigned to direct params. More specifically, before that change, the indices of direct params to metafunc\'s callspecs were assigned after all parametrizations took place. Now, that change is reverted.
#12863: Fix applying markers, including pytest.mark.parametrize <pytest.mark.parametrize ref>{.interpreted-text role="ref"} when placed above [\@staticmethod]{.title-ref} or [\@classmethod]{.title-ref}.
#12929: Handle StopIteration from test cases, setup and teardown correctly.
#12938: Fixed --durations-min argument not respected if -vv is used.
#12946: Fixed missing help for pdb{.interpreted-text role="mod"} commands wrapped by pytest -- by adamchainz{.interpreted-text role="user"}.
#12981: Prevent exceptions in pytest.Config.add_cleanup{.interpreted-text role="func"} callbacks preventing further cleanups.
#13047: Restore pytest.approx{.interpreted-text role="func"} handling of equality checks between [bool]{.title-ref} and [numpy.bool_]{.title-ref} types.

Comparing [bool]{.title-ref} and [numpy.bool_]{.title-ref} using pytest.approx{.interpreted-text role="func"} accidentally changed in version [8.3.4]{.title-ref} and [8.3.5]{.title-ref} to no longer match:

``` pycon

import numpy as np from pytest import approx [np.True, np.True] == pytest.approx([True, True]) False ```

This has now been fixed:

``` pycon

[np.True, np.True] == pytest.approx([True, True]) True ```
#13119: Improved handling of invalid regex patterns for filter warnings by providing a clear error message.
#13175: The diff is now also highlighted correctly when comparing two strings.
#13248: Fixed an issue where passing a scope in Metafunc.parametrize <pytest.Metafunc.parametrize>{.interpreted-text role="py:func"} with indirect=True could result in other fixtures being unable to depend on the parametrized fixture.
#13291: Fixed repr of attrs objects in assertion failure messages when using attrs>=25.2.
#13312: Fixed a possible KeyError crash on PyPy during collection of tests involving higher-scoped parameters.
#13345: Fix type hints for pytest.TestReport.when{.interpreted-text role="attr"} and pytest.TestReport.location{.interpreted-text role="attr"}.
#13377: Fixed handling of test methods with positional-only parameter syntax.

Now, methods are supported that formally define self as positional-only and/or fixture parameters as keyword-only, e.g.:

``` python class TestClass:
```
def test_method(self, /, *, fixture): ...
```
```

Before, this caused an internal error in pytest.
#13384: Fixed an issue where pytest could report negative durations.
#13420: Added lru_cache to nodes._check_initialpaths_for_relpath.
#9037: Honor disable_test_id_escaping_and_forfeit_all_rights_to_community_support{.interpreted-text role="confval"} when escaping ids in parametrized tests.

Improved documentation

#12535: [This example]{.title-ref}<https://docs.pytest.org/en/latest/example/simple.html#making-test-result-information-available-in-fixtures> showed print statements that do not exactly reflect what the different branches actually do. The fix makes the example more precise.
#13218: Pointed out in the pytest.approx{.interpreted-text role="func"} documentation that it considers booleans unequal to numeric zero or one.
#13221: Improved grouping of CLI options in the --help output.
#6649: Added ~pytest.TerminalReporter{.interpreted-text role="class"} to the api-reference{.interpreted-text role="ref"} documentation page.
#8612: Add a recipe for handling abstract test classes in the documentation.

A new example has been added to the documentation to demonstrate how to use a mixin class to handle abstract test classes without manually setting the __test__ attribute for subclasses. This ensures that subclasses of abstract test classes are automatically collected by pytest.

Packaging updates and notes for downstreams

#13317: Specified minimum allowed versions of colorama, iniconfig, and packaging; and bumped the minimum allowed version of exceptiongroup for python_version<'3.11' from a release candidate to a full release.

Contributor-facing changes

#12017: Mixed internal improvements:
- Migrate formatting to f-strings in some tests.
- Use type-safe constructs in JUnitXML tests.
- MovedMockTiming into _pytest.timing.
-- by RonnyPfannschmidt{.interpreted-text role="user"}
#12647: Fixed running the test suite with the hypothesis pytest plugin.

Miscellaneous internal changes

#6649: Added ~pytest.TerminalReporter{.interpreted-text role="class"} to the public pytest API, as it is part of the signature of the pytest_terminal_summary{.interpreted-text role="hook"} hook.

- Python
Published by github-actions[bot] 9 months ago

pytest 8.3.5 (2025-03-02)

Bug fixes

#11777: Fixed issue where sequences were still being shortened even with -vv verbosity.
#12888: Fixed broken input when using Python 3.13+ and a libedit build of Python, such as on macOS or with uv-managed Python binaries from the python-build-standalone project. This could manifest e.g. by a broken prompt when using Pdb, or seeing empty inputs with manual usage of input() and suspended capturing.
#13026: Fixed AttributeError{.interpreted-text role="class"} crash when using --import-mode=importlib when top-level directory same name as another module of the standard library.
#13053: Fixed a regression in pytest 8.3.4 where, when using --import-mode=importlib, a directory containing py file with the same name would cause an ImportError
#13083: Fixed issue where pytest could crash if one of the collected directories got removed during collection.

Improved documentation

#12842: Added dedicated page about using types with pytest.

See types{.interpreted-text role="ref"} for detailed usage.

Contributor-facing changes

#13112: Fixed selftest failures in test_terminal.py with Pygments >= 2.19.0
#13256: Support for Towncier versions released in 2024 has been re-enabled when building Sphinx docs -- by webknjaz{.interpreted-text role="user"}.

- Python
Published by github-actions[bot] 12 months ago

pytest 8.3.4 (2024-12-01)

Bug fixes

#12592: Fixed KeyError{.interpreted-text role="class"} crash when using --import-mode=importlib in a directory layout where a directory contains a child directory with the same name.
#12818: Assertion rewriting now preserves the source ranges of the original instructions, making it play well with tools that deal with the AST, like executing.
#12849: ANSI escape codes for colored output now handled correctly in pytest.fail{.interpreted-text role="func"} with [pytrace=False]{.title-ref}.
#9353: pytest.approx{.interpreted-text role="func"} now uses strict equality when given booleans.

Improved documentation

#10558: Fix ambiguous docstring of pytest.Config.getoption{.interpreted-text role="func"}.
#10829: Improve documentation on the current handling of the --basetemp option and its lack of retention functionality (temporary directory location and retention{.interpreted-text role="ref"}).
#12866: Improved cross-references concerning the recwarn{.interpreted-text role="fixture"} fixture.
#12966: Clarify filterwarnings{.interpreted-text role="ref"} docs on filter precedence/order when using multiple @pytest.mark.filterwarnings <pytest.mark.filterwarnings ref>{.interpreted-text role="ref"} marks.

Contributor-facing changes

#12497: Fixed two failing pdb-related tests on Python 3.13.

- Python
Published by nicoddemus about 1 year ago

pytest 8.3.3 (2024-09-09)

Bug fixes

#12446: Avoid calling @property (and other instance descriptors) during fixture discovery -- by asottile{.interpreted-text role="user"}
#12659: Fixed the issue of not displaying assertion failure differences when using the parameter --import-mode=importlib in pytest>=8.1.
#12667: Fixed a regression where type change in [ExceptionInfo.errisinstance]{.title-ref} caused [mypy]{.title-ref} to fail.
#12744: Fixed typing compatibility with Python 3.9 or less -- replaced [typing.Self]{.title-ref} with [typing_extensions.Self]{.title-ref} -- by Avasam{.interpreted-text role="user"}
#12745: Fixed an issue with backslashes being incorrectly converted in nodeid paths on Windows, ensuring consistent path handling across environments.
#6682: Fixed bug where the verbosity levels where not being respected when printing the \"msg\" part of failed assertion (as in assert condition, msg).
#9422: Fix bug where disabling the terminal plugin via -p no:terminal would cause crashes related to missing the verbose option.

-- by GTowers1{.interpreted-text role="user"}

Improved documentation

#12663: Clarify that the [pytest_deselected]{.title-ref} hook should be called from [pytest_collection_modifyitems]{.title-ref} hook implementations when items are deselected.
#12678: Remove erroneous quotes from [tmp_path_retention_policy]{.title-ref} example in docs.

Miscellaneous internal changes

#12769: Fix typos discovered by codespell and add codespell to pre-commit hooks.

- Python
Published by github-actions[bot] over 1 year ago

pytest 8.3.2 (2024-07-24)

Bug fixes

#12652: Resolve regression [conda]{.title-ref} environments where no longer being automatically detected.

-- by RonnyPfannschmidt{.interpreted-text role="user"}

- Python
Published by github-actions[bot] over 1 year ago

pytest 8.3.1 (2024-07-20)

The 8.3.0 release failed to include the change notes and docs for the release. This patch release remedies this. There are no other changes.

- Python
Published by github-actions[bot] over 1 year ago

pytest 8.3.0 (2024-07-20)

New features

#12231: Added [--xfail-tb]{.title-ref} flag, which turns on traceback output for XFAIL results.
- If the [--xfail-tb]{.title-ref} flag is not given, tracebacks for XFAIL results are NOT shown.
- The style of traceback for XFAIL is set with [--tb]{.title-ref}, and can be [auto|long|short|line|native|no]{.title-ref}.
- Note: Even if you have [--xfail-tb]{.title-ref} set, you won\'t see them if [--tb=no]{.title-ref}.
Some history:

With pytest 8.0, [-rx]{.title-ref} or [-ra]{.title-ref} would not only turn on summary reports for xfail, but also report the tracebacks for xfail results. This caused issues with some projects that utilize xfail, but don\'t want to see all of the xfail tracebacks.

This change detaches xfail tracebacks from [-rx]{.title-ref}, and now we turn on xfail tracebacks with [--xfail-tb]{.title-ref}. With this, the default [-rx]{.title-ref}/ [-ra]{.title-ref} behavior is identical to pre-8.0 with respect to xfail tracebacks. While this is a behavior change, it brings default behavior back to pre-8.0.0 behavior, which ultimately was considered the better course of action.
#12281: Added support for keyword matching in marker expressions.

Now tests can be selected by marker keyword arguments. Supported values are int{.interpreted-text role="class"}, (unescaped) str{.interpreted-text role="class"}, bool{.interpreted-text role="class"} & None{.interpreted-text role="data"}.

See marker examples <marker_keyword_expression_example>{.interpreted-text role="ref"} for more information.

-- by lovetheguitar{.interpreted-text role="user"}
#12567: Added --no-fold-skipped command line option.

If this option is set, then skipped tests in short summary are no longer grouped by reason but all tests are printed individually with their nodeid in the same way as other statuses.

-- by pbrezina{.interpreted-text role="user"}

Improvements in existing functionality

#12469: The console output now uses the \"third-party plugins\" terminology, replacing the previously established but confusing and outdated reference to setuptools <setuptools:index>{.interpreted-text role="std:doc"} -- by webknjaz{.interpreted-text role="user"}.
#12544, #12545: Python virtual environment detection was improved by checking for a pyvenv.cfg{.interpreted-text role="file"} file, ensuring reliable detection on various platforms -- by zachsnickers{.interpreted-text role="user"}.
#2871: Do not truncate arguments to functions in output when running with [-vvv]{.title-ref}.
#389: The readability of assertion introspection of bound methods has been enhanced -- by farbodahm{.interpreted-text role="user"}, webknjaz{.interpreted-text role="user"}, obestwalter{.interpreted-text role="user"}, flub{.interpreted-text role="user"} and glyphack{.interpreted-text role="user"}.

Earlier, it was like:

``` console =================================== FAILURES =================================== _____________________________________ test _____________________________________
```
def test():
```
```
  assert Help().fun() == 2
```
E assert 1 == 2 E + where 1 = >() E + where > = .fun E + where = Help()
example.py:7: AssertionError =========================== 1 failed in 0.03 seconds =========================== ```

And now it\'s like:

``` console =================================== FAILURES =================================== _____________________________________ test _____________________________________
```
def test():
```
```
  assert Help().fun() == 2
```
E assert 1 == 2 E + where 1 = fun() E + where fun = .fun E + where = Help()
test_local.py:13: AssertionError =========================== 1 failed in 0.03 seconds =========================== ```
#7662: Added timezone information to the testsuite timestamp in the JUnit XML report.

Bug fixes

#11706: Fixed reporting of teardown errors in higher-scoped fixtures when using [--maxfail]{.title-ref} or [--stepwise]{.title-ref}.

Originally added in pytest 8.0.0, but reverted in 8.0.2 due to a regression in pytest-xdist. This regression was fixed in pytest-xdist 3.6.1.
#11797: pytest.approx{.interpreted-text role="func"} now correctly handles Sequence <collections.abc.Sequence>{.interpreted-text role="class"}-like objects.
#12204, #12264: Fixed a regression in pytest 8.0 where tracebacks get longer and longer when multiple tests fail due to a shared higher-scope fixture which raised -- by bluetech{.interpreted-text role="user"}.

Also fixed a similar regression in pytest 5.4 for collectors which raise during setup.

The fix necessitated internal changes which may affect some plugins:
- FixtureDef.cached_result[2] is now a tuple (exc, tb) instead of exc.
- SetupState.stack failures are now a tuple (exc, tb) instead of exc.
#12275: Fixed collection error upon encountering an abstract <abc>{.interpreted-text role="mod"} class, including abstract [unittest.TestCase]{.title-ref} subclasses.
#12328: Fixed a regression in pytest 8.0.0 where package-scoped parameterized items were not correctly reordered to minimize setups/teardowns in some cases.
#12424: Fixed crash with [assert testcase is not None]{.title-ref} assertion failure when re-running unittest tests using plugins like pytest-rerunfailures. Regressed in 8.2.2.
#12472: Fixed a crash when returning category "error" or "failed" with a custom test status from pytest_report_teststatus{.interpreted-text role="hook"} hook -- pbrezina{.interpreted-text role="user"}.
#12505: Improved handling of invalid regex patterns in pytest.raises(match=r'...') <pytest.raises>{.interpreted-text role="func"} by providing a clear error message.
#12580: Fixed a crash when using the cache class on Windows and the cache directory was created concurrently.
#6962: Parametrization parameters are now compared using [==]{.title-ref} instead of [is]{.title-ref} ([is]{.title-ref} is still used as a fallback if the parameter does not support [==]{.title-ref}). This fixes use of parameters such as lists, which have a different [id]{.title-ref} but compare equal, causing fixtures to be re-computed instead of being cached.
#7166: Fixed progress percentages (the [ 87%] at the edge of the screen) sometimes not aligning correctly when running with pytest-xdist -n.

Improved documentation

#12153: Documented using PYTEST_VERSION{.interpreted-text role="envvar"} to detect if code is running from within a pytest run.
#12469: The external plugin mentions in the documentation now avoid mentioning setuptools entry-points <setuptools:index>{.interpreted-text role="std:doc"} as the concept is much more generic nowadays. Instead, the terminology of \"external\", \"installed\", or \"third-party\" plugins (or packages) replaces that.

-- by webknjaz{.interpreted-text role="user"}
#12577: [CI]{.title-ref} and [BUILD_NUMBER]{.title-ref} environment variables role is discribed in the reference doc. They now also appear when doing [pytest -h]{.title-ref} -- by MarcBresson{.interpreted-text role="user"}.

Contributor-facing changes

#12467: Migrated all internal type-annotations to the python3.10+ style by using the [annotations]{.title-ref} future import.

-- by RonnyPfannschmidt{.interpreted-text role="user"}
#11771, #12557: The PyPy runtime version has been updated to 3.9 from 3.8 that introduced a flaky bug at the garbage collector which was not expected to fix there as the 3.8 is EoL.

-- by x612skm{.interpreted-text role="user"}
#12493: The change log draft preview integration has been refactored to use a third party extension sphinxcontib-towncrier. The previous in-repo script was putting the change log preview file at doc/en/_changelog_towncrier_draft.rst{.interpreted-text role="file"}. Said file is no longer ignored in Git and might show up among untracked files in the development environments of the contributors. To address that, the contributors can run the following command that will clean it up:

console $ git clean -x -i -- doc/en/_changelog_towncrier_draft.rst

-- by webknjaz{.interpreted-text role="user"}
#12498: All the undocumented tox environments now have descriptions. They can be listed in one\'s development environment by invoking tox -av in a terminal.

-- by webknjaz{.interpreted-text role="user"}
#12501: The changelog configuration has been updated to introduce more accurate audience-tailored categories. Previously, there was a trivial change log fragment type with an unclear and broad meaning. It was removed and we now have contrib, misc and packaging in place of it.

The new change note types target the readers who are downstream packagers and project contributors. Additionally, the miscellaneous section is kept for unspecified updates that do not fit anywhere else.

-- by webknjaz{.interpreted-text role="user"}
#12502: The UX of the GitHub automation making pull requests to update the plugin list has been updated. Previously, the maintainers had to close the automatically created pull requests and re-open them to trigger the CI runs. From now on, they only need to click the [Ready for review]{.title-ref} button instead.

-- by webknjaz{.interpreted-text role="user"}
#12522: The :pull: RST role has been replaced with a shorter :pr: due to starting to use the implementation from the third-party sphinx-issues{.interpreted-text role="pypi"} Sphinx extension -- by webknjaz{.interpreted-text role="user"}.
#12531: The coverage reporting configuration has been updated to exclude pytest\'s own tests marked as expected to fail from the coverage report. This has an effect of reducing the influence of flaky tests on the resulting number.

-- by webknjaz{.interpreted-text role="user"}
#12533: The extlinks Sphinx extension is no longer enabled. The :bpo: role it used to declare has been removed with that. BPO itself has migrated to GitHub some years ago and it is possible to link the respective issues by using their GitHub issue numbers and the :issue: role that the sphinx-issues extension implements.

-- by webknjaz{.interpreted-text role="user"}
#12562: Possible typos in using the :user: RST role is now being linted through the pre-commit tool integration -- by webknjaz{.interpreted-text role="user"}.

- Python
Published by github-actions[bot] over 1 year ago

pytest 8.2.2 (2024-06-04)

Bug Fixes

#12355: Fix possible catastrophic performance slowdown on a certain parametrization pattern involving many higher-scoped parameters.
#12367: Fix a regression in pytest 8.2.0 where unittest class instances (a fresh one is created for each test) were not released promptly on test teardown but only on session teardown.
#12381: Fix possible \"Directory not empty\" crashes arising from concurent cache dir (.pytest_cache) creation. Regressed in pytest 8.2.0.

Improved Documentation

#12290: Updated Sphinx theme to use Furo instead of Flask, enabling Dark mode theme.
#12356: Added a subsection to the documentation for debugging flaky tests to mention lack of thread safety in pytest as a possible source of flakyness.
#12363: The documentation webpages now links to a canonical version to reduce outdated documentation in search engine results.

- Python
Published by github-actions[bot] over 1 year ago

pytest 8.2.1 (2024-05-19)

Improvements

#12334: Support for Python 3.13 (beta1 at the time of writing).

Bug Fixes

#12120: Fix [PermissionError]{.title-ref} crashes arising from directories which are not selected on the command-line.
#12191: Keyboard interrupts and system exits are now properly handled during the test collection.
#12300: Fixed handling of \'Function not implemented\' error under squashfuse_ll, which is a different way to say that the mountpoint is read-only.
#12308: Fix a regression in pytest 8.2.0 where the permissions of automatically-created .pytest_cache directories became rwx------ instead of the expected rwxr-xr-x.

Trivial/Internal Changes

#12333: pytest releases are now attested using the recent Artifact Attestation support from GitHub, allowing users to verify the provenance of pytest\'s sdist and wheel artifacts.

- Python
Published by github-actions[bot] almost 2 years ago

pytest 8.2.0 (2024-04-27)

Deprecations

#12069: A deprecation warning is now raised when implementations of one of the following hooks request a deprecated py.path.local parameter instead of the pathlib.Path parameter which replaced it:
- pytest_ignore_collect{.interpreted-text role="hook"} - the path parameter - use collection_path instead.
- pytest_collect_file{.interpreted-text role="hook"} - the path parameter - use file_path instead.
- pytest_pycollect_makemodule{.interpreted-text role="hook"} - the path parameter - use module_path instead.
- pytest_report_header{.interpreted-text role="hook"} - the startdir parameter - use start_path instead.
- pytest_report_collectionfinish{.interpreted-text role="hook"} - the startdir parameter - use start_path instead.
The replacement parameters are available since pytest 7.0.0. The old parameters will be removed in pytest 9.0.0.

See legacy-path-hooks-deprecated{.interpreted-text role="ref"} for more details.

Features

#11871: Added support for reading command line arguments from a file using the prefix character @, like e.g.: pytest @tests.txt. The file must have one argument per line.

See Read arguments from file <args-from-file>{.interpreted-text role="ref"} for details.

Improvements

#11523: pytest.importorskip{.interpreted-text role="func"} will now issue a warning if the module could be found, but raised ImportError{.interpreted-text role="class"} instead of ModuleNotFoundError{.interpreted-text role="class"}.

The warning can be suppressed by passing exc_type=ImportError to pytest.importorskip{.interpreted-text role="func"}.

See import-or-skip-import-error{.interpreted-text role="ref"} for details.
#11728: For unittest-based tests, exceptions during class cleanup (as raised by functions registered with TestCase.addClassCleanup <unittest.TestCase.addClassCleanup>{.interpreted-text role="meth"}) are now reported instead of silently failing.
#11777: Text is no longer truncated in the short test summary info section when -vv is given.
#12112: Improved namespace packages detection when consider_namespace_packages{.interpreted-text role="confval"} is enabled, covering more situations (like editable installs).
#9502: Added PYTEST_VERSION{.interpreted-text role="envvar"} environment variable which is defined at the start of the pytest session and undefined afterwards. It contains the value of pytest.__version__, and among other things can be used to easily check if code is running from within a pytest run.

Bug Fixes

#12065: Fixed a regression in pytest 8.0.0 where test classes containing setup_method and tests using @staticmethod or @classmethod would crash with AttributeError: 'NoneType' object has no attribute 'setup_method'.

Now the request.instance <pytest.FixtureRequest.instance>{.interpreted-text role="attr"} attribute of tests using @staticmethod and @classmethod is no longer None, but a fresh instance of the class, like in non-static methods. Previously it was None, and all fixtures of such tests would share a single self.
#12135: Fixed issue where fixtures adding their finalizer multiple times to fixtures they request would cause unreliable and non-intuitive teardown ordering in some instances.
#12194: Fixed a bug with --importmode=importlib and --doctest-modules where child modules did not appear as attributes in parent modules.
#1489: Fixed some instances where teardown of higher-scoped fixtures was not happening in the reverse order they were initialized in.

Trivial/Internal Changes

#12069: pluggy>=1.5.0 is now required.
#12167: cache <cache>{.interpreted-text role="ref"}: create supporting files (CACHEDIR.TAG, .gitignore, etc.) in a temporary directory to provide atomic semantics.

- Python
Published by github-actions[bot] almost 2 years ago

pytest 8.1.2 (2024-04-26)

Bug Fixes

#12114: Fixed error in pytest.approx{.interpreted-text role="func"} when used with [numpy]{.title-ref} arrays and comparing with other types.

- Python
Published by github-actions[bot] almost 2 years ago

pytest 8.1.1 (2024-03-08)

::: {.note} ::: {.title} Note :::

This release is not a usual bug fix release -- it contains features and improvements, being a follow up to 8.1.0, which has been yanked from PyPI. :::

Features

#11475: Added the new consider_namespace_packages{.interpreted-text role="confval"} configuration option, defaulting to False.

If set to True, pytest will attempt to identify modules that are part of namespace packages when importing modules.
#11653: Added the new verbosity_test_cases{.interpreted-text role="confval"} configuration option for fine-grained control of test execution verbosity. See Fine-grained verbosity <pytest.fine_grained_verbosity>{.interpreted-text role="ref"} for more details.

Improvements

#10865: pytest.warns{.interpreted-text role="func"} now validates that warnings.warn{.interpreted-text role="func"} was called with a [str]{.title-ref} or a [Warning]{.title-ref}. Currently in Python it is possible to use other types, however this causes an exception when warnings.filterwarnings{.interpreted-text role="func"} is used to filter those warnings (see CPython #103577 for a discussion). While this can be considered a bug in CPython, we decided to put guards in pytest as the error message produced without this check in place is confusing.
#11311: When using --override-ini for paths in invocations without a configuration file defined, the current working directory is used as the relative directory.

Previoulsy this would raise an AssertionError{.interpreted-text role="class"}.
#11475: --import-mode=importlib <import-mode-importlib>{.interpreted-text role="ref"} now tries to import modules using the standard import mechanism (but still without changing :pysys.path{.interpreted-text role="data"}), falling back to importing modules directly only if that fails.

This means that installed packages will be imported under their canonical name if possible first, for example app.core.models, instead of having the module name always be derived from their path (for example .env310.lib.site_packages.app.core.models).
#11801: Added the iter_parents() <_pytest.nodes.Node.iter_parents>{.interpreted-text role="func"} helper method on nodes. It is similar to listchain <_pytest.nodes.Node.listchain>{.interpreted-text role="func"}, but goes from bottom to top, and returns an iterator, not a list.
#11850: Added support for sys.last_exc{.interpreted-text role="data"} for post-mortem debugging on Python>=3.12.
#11962: In case no other suitable candidates for configuration file are found, a pyproject.toml (even without a [tool.pytest.ini_options] table) will be considered as the configuration file and define the rootdir.
#11978: Add --log-file-mode option to the logging plugin, enabling appending to log-files. This option accepts either "w" or "a" and defaults to "w".

Previously, the mode was hard-coded to be "w" which truncates the file before logging.
#12047: When multiple finalizers of a fixture raise an exception, now all exceptions are reported as an exception group. Previously, only the first exception was reported.

Bug Fixes

#11475: Fixed regression where --importmode=importlib would import non-test modules more than once.
#11904: Fixed a regression in pytest 8.0.0 that would cause test collection to fail due to permission errors when using --pyargs.

This change improves the collection tree for tests specified using --pyargs, see 12043{.interpreted-text role="pull"} for a comparison with pytest 8.0 and <8.
#12011: Fixed a regression in 8.0.1 whereby setup_module xunit-style fixtures are not executed when --doctest-modules is passed.
#12014: Fix the stacklevel used when warning about marks used on fixtures.
#12039: Fixed a regression in 8.0.2 where tests created using tmp_path{.interpreted-text role="fixture"} have been collected multiple times in CI under Windows.

Improved Documentation

#11790: Documented the retention of temporary directories created using the tmp_path fixture in more detail.

Trivial/Internal Changes

#11785: Some changes were made to private functions which may affect plugins which access them:
- FixtureManager._getautousenames() now takes a Node itself instead of the nodeid.
- FixtureManager.getfixturedefs() now takes the Node itself instead of the nodeid.
- The _pytest.nodes.iterparentnodeids() function is removed without replacement. Prefer to traverse the node hierarchy itself instead. If you really need to, copy the function from the previous pytest release.
#12069: Delayed the deprecation of the following features to 9.0.0:
- node-ctor-fspath-deprecation{.interpreted-text role="ref"}.
- legacy-path-hooks-deprecated{.interpreted-text role="ref"}.
It was discovered after 8.1.0 was released that the warnings about the impeding removal were not being displayed, so the team decided to revert the removal.

This is the reason for 8.1.0 being yanked.

pytest 8.1.0 (YANKED)

::: {.note} ::: {.title} Note :::

This release has been yanked: it broke some plugins without the proper warning period, due to some warnings not showing up as expected.

See #12069. :::

- Python
Published by github-actions[bot] almost 2 years ago

pytest 8.1.0 (YANKED)

[!IMPORTANT]
This release has been yanked: it broke some plugins without the proper warning period, due to some warnings not showing up as expected. See #12069.

Features

#11475: Added the new consider_namespace_packages{.interpreted-text role="confval"} configuration option, defaulting to False.

If set to True, pytest will attempt to identify modules that are part of namespace packages when importing modules.
#11653: Added the new verbosity_test_cases{.interpreted-text role="confval"} configuration option for fine-grained control of test execution verbosity. See Fine-grained verbosity <pytest.fine_grained_verbosity>{.interpreted-text role="ref"} for more details.

Improvements

#10865: pytest.warns{.interpreted-text role="func"} now validates that warnings.warn{.interpreted-text role="func"} was called with a [str]{.title-ref} or a [Warning]{.title-ref}. Currently in Python it is possible to use other types, however this causes an exception when warnings.filterwarnings{.interpreted-text role="func"} is used to filter those warnings (see CPython #103577 for a discussion). While this can be considered a bug in CPython, we decided to put guards in pytest as the error message produced without this check in place is confusing.
#11311: When using --override-ini for paths in invocations without a configuration file defined, the current working directory is used as the relative directory.

Previoulsy this would raise an AssertionError{.interpreted-text role="class"}.
#11475: --import-mode=importlib <import-mode-importlib>{.interpreted-text role="ref"} now tries to import modules using the standard import mechanism (but still without changing :pysys.path{.interpreted-text role="data"}), falling back to importing modules directly only if that fails.

This means that installed packages will be imported under their canonical name if possible first, for example app.core.models, instead of having the module name always be derived from their path (for example .env310.lib.site_packages.app.core.models).
#11801: Added the iter_parents() <_pytest.nodes.Node.iter_parents>{.interpreted-text role="func"} helper method on nodes. It is similar to listchain <_pytest.nodes.Node.listchain>{.interpreted-text role="func"}, but goes from bottom to top, and returns an iterator, not a list.
#11850: Added support for sys.last_exc{.interpreted-text role="data"} for post-mortem debugging on Python>=3.12.
#11962: In case no other suitable candidates for configuration file are found, a pyproject.toml (even without a [tool.pytest.ini_options] table) will be considered as the configuration file and define the rootdir.
#11978: Add --log-file-mode option to the logging plugin, enabling appending to log-files. This option accepts either "w" or "a" and defaults to "w".

Previously, the mode was hard-coded to be "w" which truncates the file before logging.
#12047: When multiple finalizers of a fixture raise an exception, now all exceptions are reported as an exception group. Previously, only the first exception was reported.

Bug Fixes

#11904: Fixed a regression in pytest 8.0.0 that would cause test collection to fail due to permission errors when using --pyargs.

This change improves the collection tree for tests specified using --pyargs, see 12043{.interpreted-text role="pull"} for a comparison with pytest 8.0 and <8.
#12011: Fixed a regression in 8.0.1 whereby setup_module xunit-style fixtures are not executed when --doctest-modules is passed.
#12014: Fix the stacklevel used when warning about marks used on fixtures.
#12039: Fixed a regression in 8.0.2 where tests created using tmp_path{.interpreted-text role="fixture"} have been collected multiple times in CI under Windows.

Improved Documentation

#11790: Documented the retention of temporary directories created using the tmp_path fixture in more detail.

Trivial/Internal Changes

#11785: Some changes were made to private functions which may affect plugins which access them:
- FixtureManager._getautousenames() now takes a Node itself instead of the nodeid.
- FixtureManager.getfixturedefs() now takes the Node itself instead of the nodeid.
- The _pytest.nodes.iterparentnodeids() function is removed without replacement. Prefer to traverse the node hierarchy itself instead. If you really need to, copy the function from the previous pytest release.

- Python
Published by github-actions[bot] almost 2 years ago

pytest 8.0.2 (2024-02-24)

Bug Fixes

#11895: Fix collection on Windows where initial paths contain the short version of a path (for example c:\PROGRA~1\tests).
#11953: Fix an IndexError crash raising from getstatementrange_ast.
#12021: Reverted a fix to [--maxfail]{.title-ref} handling in pytest 8.0.0 because it caused a regression in pytest-xdist whereby session fixture teardowns may get executed multiple times when the max-fails is reached.

- Python
Published by github-actions[bot] about 2 years ago

pytest 8.0.1 (2024-02-16)

Bug Fixes

#11875: Correctly handle errors from getpass.getuser{.interpreted-text role="func"} in Python 3.13.
#11879: Fix an edge case where ExceptionInfo._stringify_exception could crash pytest.raises{.interpreted-text role="func"}.
#11906: Fix regression with pytest.warns{.interpreted-text role="func"} using custom warning subclasses which have more than one parameter in their [__init__]{.title-ref}.
#11907: Fix a regression in pytest 8.0.0 whereby calling pytest.skip{.interpreted-text role="func"} and similar control-flow exceptions within a pytest.warns(){.interpreted-text role="func"} block would get suppressed instead of propagating.
#11929: Fix a regression in pytest 8.0.0 whereby autouse fixtures defined in a module get ignored by the doctests in the module.
#11937: Fix a regression in pytest 8.0.0 whereby items would be collected in reverse order in some circumstances.

- Python
Published by github-actions[bot] about 2 years ago

pytest - pytest 8.0.0 (2024-01-27)

See 8.0.0rc1 and 8.0.0rc2 for the full changes since pytest 7.4!

Bug Fixes

#11842: Properly escape the reason of a skip <pytest.mark.skip ref>{.interpreted-text role="ref"} mark when writing JUnit XML files.
#11861: Avoid microsecond exceeds 1_000_000 when using log-date-format with %f specifier, which might cause the test suite to crash.

- Python
Published by bluetech about 2 years ago

pytest 8.0.0rc2 (2024-01-17)

Improvements

#11233: Improvements to -r for xfailures and xpasses:
- Report tracebacks for xfailures when -rx is set.
- Report captured output for xpasses when -rX is set.
- For xpasses, add - in summary between test name and reason, to match how xfail is displayed.
#11825: The pytest_plugin_registered{.interpreted-text role="hook"} hook has a new plugin_name parameter containing the name by which plugin is registered.

Bug Fixes

#11706: Fix reporting of teardown errors in higher-scoped fixtures when using [--maxfail]{.title-ref} or [--stepwise]{.title-ref}.
#11758: Fixed IndexError: string index out of range crash in if highlighted[-1] == "\n" and source[-1] != "\n". This bug was introduced in pytest 8.0.0rc1.
#9765, #11816: Fixed a frustrating bug that afflicted some users with the only error being assert mod not in mods. The issue was caused by the fact that str(Path(mod)) and mod.__file__ don\'t necessarily produce the same string, and was being erroneously used interchangably in some places in the code.

This fix also broke the internal API of PytestPluginManager.consider_conftest by introducing a new parameter -- we mention this in case it is being used by external code, even if marked as private.

- Python
Published by github-actions[bot] about 2 years ago

pytest - pytest 8.0.0rc1 (2023-12-30)

See https://docs.pytest.org/en/latest/changelog.html#pytest-8-0-0rc1-2023-12-30 for the rendered changelog.

Breaking Changes

Old Deprecations Are Now Errors

#7363: PytestRemovedIn8Warning deprecation warnings are now errors by default.

Following our plan to remove deprecated features with as little disruption as possible, all warnings of type PytestRemovedIn8Warning now generate errors instead of warning messages by default.

The affected features will be effectively removed in pytest 8.1, so please consult the deprecations{.interpreted-text role="ref"} section in the docs for directions on how to update existing code.

In the pytest 8.0.X series, it is possible to change the errors back into warnings as a stopgap measure by adding this to your pytest.ini file:

ini [pytest] filterwarnings = ignore::pytest.PytestRemovedIn8Warning

But this will stop working when pytest 8.1 is released.

If you have concerns about the removal of a specific feature, please add a comment to 7363{.interpreted-text role="issue"}.

Version Compatibility

#11151: Dropped support for Python 3.7, which reached end-of-life on 2023-06-27.
pluggy>=1.3.0 is now required.

Collection Changes

In this version we\'ve made several breaking changes to pytest\'s collection phase, particularly around how filesystem directories and Python packages are collected, fixing deficiencies and allowing for cleanups and improvements to pytest\'s internals. A deprecation period for these changes was not possible.

#7777: Files and directories are now collected in alphabetical order jointly, unless changed by a plugin. Previously, files were collected before directories. See below for an example.
#8976: Running [pytest pkg/__init__.py]{.title-ref} now collects the [pkg/__init__.py]{.title-ref} file (module) only. Previously, it collected the entire [pkg]{.title-ref} package, including other test files in the directory, but excluding tests in the [__init__.py]{.title-ref} file itself (unless python_files{.interpreted-text role="confval"} was changed to allow [__init__.py]{.title-ref} file).

To collect the entire package, specify just the directory: [pytest pkg]{.title-ref}.
#11137: pytest.Package{.interpreted-text role="class"} is no longer a pytest.Module{.interpreted-text role="class"} or pytest.File{.interpreted-text role="class"}.

The Package collector node designates a Python package, that is, a directory with an [__init__.py]{.title-ref} file. Previously Package was a subtype of pytest.Module (which represents a single Python module), the module being the [__init__.py]{.title-ref} file. This has been deemed a design mistake (see 11137{.interpreted-text role="issue"} and 7777{.interpreted-text role="issue"} for details).

The path property of Package nodes now points to the package directory instead of the __init__.py file.

Note that a Module node for __init__.py (which is not a Package) may still exist, if it is picked up during collection (e.g. if you configured python_files{.interpreted-text role="confval"} to include __init__.py files).
#7777: Added a new pytest.Directory{.interpreted-text role="class"} base collection node, which all collector nodes for filesystem directories are expected to subclass. This is analogous to the existing pytest.File{.interpreted-text role="class"} for file nodes.

Changed pytest.Package{.interpreted-text role="class"} to be a subclass of pytest.Directory{.interpreted-text role="class"}. A Package represents a filesystem directory which is a Python package, i.e. contains an __init__.py file.

pytest.Package{.interpreted-text role="class"} now only collects files in its own directory; previously it collected recursively. Sub-directories are collected as their own collector nodes, which then collect themselves, thus creating a collection tree which mirrors the filesystem hierarchy.

Added a new pytest.Dir{.interpreted-text role="class"} concrete collection node, a subclass of pytest.Directory{.interpreted-text role="class"}. This node represents a filesystem directory, which is not a pytest.Package{.interpreted-text role="class"}, that is, does not contain an __init__.py file. Similarly to Package, it only collects the files in its own directory.

pytest.Session{.interpreted-text role="class"} now only collects the initial arguments, without recursing into directories. This work is now done by the recursive expansion process <pytest.Collector.collect>{.interpreted-text role="func"} of directory collector nodes.

session.name <pytest.Session.name>{.interpreted-text role="attr"} is now ""; previously it was the rootdir directory name. This matches session.nodeid <_pytest.nodes.Node.nodeid>{.interpreted-text role="attr"} which has always been [\"\"]{.title-ref}.

The collection tree now contains directories/packages up to the rootdir <rootdir>{.interpreted-text role="ref"}, for initial arguments that are found within the rootdir. For files outside the rootdir, only the immediate directory/package is collected --note however that collecting from outside the rootdir is discouraged.

As an example, given the following filesystem tree:
```
myroot/
    pytest.ini
    top/
    ├── aaa
    │   └── test_aaa.py
    ├── test_a.py
    ├── test_b
    │   ├── __init__.py
    │   └── test_b.py
    ├── test_c.py
    └── zzz
        ├── __init__.py
        └── test_zzz.py
```
the collection tree, as shown by [pytest --collect-only top/]{.title-ref} but with the otherwise-hidden ~pytest.Session{.interpreted-text role="class"} node added for clarity, is now the following:
```
<Session>
  <Dir myroot>
    <Dir top>
      <Dir aaa>
        <Module test_aaa.py>
          <Function test_it>
      <Module test_a.py>
        <Function test_it>
      <Package test_b>
        <Module test_b.py>
          <Function test_it>
      <Module test_c.py>
        <Function test_it>
      <Package zzz>
        <Module test_zzz.py>
          <Function test_it>
```
Previously, it was:
```
<Session>
  <Module top/test_a.py>
    <Function test_it>
  <Module top/test_c.py>
    <Function test_it>
  <Module top/aaa/test_aaa.py>
    <Function test_it>
  <Package test_b>
    <Module test_b.py>
      <Function test_it>
  <Package zzz>
    <Module test_zzz.py>
      <Function test_it>
```
Code/plugins which rely on a specific shape of the collection tree might need to update.
#11676: The classes ~_pytest.nodes.Node{.interpreted-text role="class"}, ~pytest.Collector{.interpreted-text role="class"}, ~pytest.Item{.interpreted-text role="class"}, ~pytest.File{.interpreted-text role="class"}, ~_pytest.nodes.FSCollector{.interpreted-text role="class"} are now marked abstract (see abc{.interpreted-text role="mod"}).

We do not expect this change to affect users and plugin authors, it will only cause errors when the code is already wrong or problematic.

Other breaking changes

These are breaking changes where deprecation was not possible.

#11282: Sanitized the handling of the default parameter when defining configuration options.

Previously if default was not supplied for parser.addini <pytest.Parser.addini>{.interpreted-text role="meth"} and the configuration option value was not defined in a test session, then calls to config.getini <pytest.Config.getini>{.interpreted-text role="func"} returned an empty list or an empty string depending on whether type was supplied or not respectively, which is clearly incorrect. Also, None was not honored even if default=None was used explicitly while defining the option.

Now the behavior of parser.addini <pytest.Parser.addini>{.interpreted-text role="meth"} is as follows:
- If default is NOT passed but type is provided, then a type-specific default will be returned. For example type=bool will return False, type=str will return "", etc.
- If default=None is passed and the option is not defined in a test session, then None will be returned, regardless of the type.
- If neither default nor type are provided, assume type=str and return "" as default (this is as per previous behavior).
The team decided to not introduce a deprecation period for this change, as doing so would be complicated both in terms of communicating this to the community as well as implementing it, and also because the team believes this change should not break existing plugins except in rare cases.
#11667: pytest\'s setup.py file is removed. If you relied on this file, e.g. to install pytest using setup.py install, please see Why you shouldn\'t invoke setup.py directly for alternatives.
#9288: ~pytest.warns{.interpreted-text role="func"} now re-emits unmatched warnings when the context closes -- previously it would consume all warnings, hiding those that were not matched by the function.

While this is a new feature, we announce it as a breaking change because many test suites are configured to error-out on warnings, and will therefore fail on the newly-re-emitted warnings.

Deprecations

#10465: Test functions returning a value other than None will now issue a pytest.PytestWarning{.interpreted-text role="class"} instead of pytest.PytestRemovedIn8Warning{.interpreted-text role="class"}, meaning this will stay a warning instead of becoming an error in the future.
#3664: Applying a mark to a fixture function now issues a warning: marks in fixtures never had any effect, but it is a common user error to apply a mark to a fixture (for example usefixtures) and expect it to work.

This will become an error in pytest 9.0.

Features and Improvements

Improved Diffs

These changes improve the diffs that pytest prints when an assertion fails. Note that syntax highlighting requires the pygments package.

#11520: The very verbose (-vv) diff output is now colored as a diff instead of a big chunk of red.

Python code in error reports is now syntax-highlighted as Python.

The sections in the error reports are now better separated.
#1531: The very verbose diff (-vv) for every standard library container type is improved. The indentation is now consistent and the markers are on their own separate lines, which should reduce the diffs shown to users.

Previously, the standard Python pretty printer was used to generate the output, which puts opening and closing markers on the same line as the first/last entry, in addition to not having consistent indentation.
#10617: Added more comprehensive set assertion rewrites for comparisons other than equality ==, with the following operations now providing better failure messages: !=, <=, >=, <, and >.

Separate Control For Assertion Verbosity

#11387: Added the new verbosity_assertions{.interpreted-text role="confval"} configuration option for fine-grained control of failed assertions verbosity.

If you\'ve ever wished that pytest always show you full diffs, but without making everything else verbose, this is for you.

See Fine-grained verbosity <pytest.fine_grained_verbosity>{.interpreted-text role="ref"} for more details.

For plugin authors, config.get_verbosity <pytest.Config.get_verbosity>{.interpreted-text role="attr"} can be used to retrieve the verbosity level for a specific verbosity type.

Additional Support For Exception Groups and `notes`

These changes improve pytest\'s support for exception groups.

#10441: Added ExceptionInfo.group_contains() <pytest.ExceptionInfo.group_contains>{.interpreted-text role="func"}, an assertion helper that tests if an ExceptionGroup{.interpreted-text role="class"} contains a matching exception.

See assert-matching-exception-groups{.interpreted-text role="ref"} for an example.
#11227: Allow pytest.raises{.interpreted-text role="func"} match argument to match against [PEP-678 <https://peps.python.org/pep-0678/>]{.title-ref} __notes__.

Custom Directory collectors

#7777: Added a new hook pytest_collect_directory{.interpreted-text role="hook"}, which is called by filesystem-traversing collector nodes, such as pytest.Session{.interpreted-text role="class"}, pytest.Dir{.interpreted-text role="class"} and pytest.Package{.interpreted-text role="class"}, to create a collector node for a sub-directory. It is expected to return a subclass of pytest.Directory{.interpreted-text role="class"}. This hook allows plugins to customize the collection of directories <custom directory collectors>{.interpreted-text role="ref"}.

\"New-style\" Hook Wrappers

#11122: pytest now uses \"new-style\" hook wrappers internally, available since pluggy 1.2.0. See pluggy\'s 1.2.0 changelog and the updated docs <hookwrapper>{.interpreted-text role="ref"} for details.

Plugins which want to use new-style wrappers can do so if they require pytest>=8.

Other Improvements

#11216: If a test is skipped from inside an xunit setup fixture <classic xunit>{.interpreted-text role="ref"}, the test summary now shows the test location instead of the fixture location.
#11314: Logging to a file using the --log-file option will use --log-level, --log-format and --log-date-format as fallback if --log-file-level, --log-file-format and --log-file-date-format are not provided respectively.
#11610: Added the LogCaptureFixture.filtering() <pytest.LogCaptureFixture.filtering>{.interpreted-text role="func"} context manager which adds a given logging.Filter{.interpreted-text role="class"} object to the caplog{.interpreted-text role="fixture"} fixture.
#11447: pytest.deprecated_call{.interpreted-text role="func"} now also considers warnings of type FutureWarning{.interpreted-text role="class"}.
#11600: Improved the documentation and type signature for pytest.mark.xfail <pytest.mark.xfail>{.interpreted-text role="func"}\'s condition param to use False as the default value.
#7469: ~pytest.FixtureDef{.interpreted-text role="class"} is now exported as pytest.FixtureDef for typing purposes.
#11353: Added typing to ~pytest.PytestPluginManager{.interpreted-text role="class"}.

Bug Fixes

#10701: pytest.WarningsRecorder.pop{.interpreted-text role="meth"} will return the most-closely-matched warning in the list, rather than the first warning which is an instance of the requested type.
#11255: Fixed crash on [parametrize(..., scope=\"package\")]{.title-ref} without a package present.
#11277: Fixed a bug that when there are multiple fixtures for an indirect parameter, the scope of the highest-scope fixture is picked for the parameter set, instead of that of the one with the narrowest scope.
#11456: Parametrized tests now really do ensure that the ids given to each input are unique - for example, a, a, a0 now results in a1, a2, a0 instead of the previous (buggy) a0, a1, a0. This necessarily means changing nodeids where these were previously colliding, and for readability adds an underscore when non-unique ids end in a number.
#11563: Fixed a crash when using an empty string for the same parametrized value more than once.
#11712: Fixed handling NO_COLOR and FORCE_COLOR to ignore an empty value.
#9036: pytest.warns and similar functions now capture warnings when an exception is raised inside a with block.

Improved Documentation

#11011: Added a warning about modifying the root logger during tests when using caplog.
#11065: Use pytestconfig instead of request.config in cache example to be consistent with the API documentation.

Trivial/Internal Changes

#11208: The (internal) FixtureDef.cached_result type has changed. Now the third item cached_result[2], when set, is an exception instance instead of an exception triplet.
#11218: (This entry is meant to assist plugins which access private pytest internals to instantiate FixtureRequest objects.)

~pytest.FixtureRequest{.interpreted-text role="class"} is now an abstract class which can\'t be instantiated directly. A new concrete TopRequest subclass of FixtureRequest has been added for the request fixture in test functions, as counterpart to the existing SubRequest subclass for the request fixture in fixture functions.
#11315: The pytester{.interpreted-text role="fixture"} fixture now uses the monkeypatch{.interpreted-text role="fixture"} fixture to manage the current working directory. If you use pytester in combination with monkeypatch.undo() <pytest.MonkeyPatch.undo>{.interpreted-text role="func"}, the CWD might get restored. Use monkeypatch.context() <pytest.MonkeyPatch.context>{.interpreted-text role="func"} instead.
#11333: Corrected the spelling of Config.ArgsSource.INVOCATION_DIR. The previous spelling INCOVATION_DIR remains as an alias.
#11638: Fixed the selftests to pass correctly if FORCE_COLOR, NO_COLOR or PY_COLORS is set in the calling environment.

- Python
Published by bluetech about 2 years ago

pytest - pytest 7.4.4 (2023-12-31)

Bug Fixes

#11140: Fix non-string constants at the top of file being detected as docstrings on Python>=3.8.
#11572: Handle an edge case where sys.stderr{.interpreted-text role="data"} and sys.__stderr__{.interpreted-text role="data"} might already be closed when faulthandler{.interpreted-text role="ref"} is tearing down.
#11710: Fixed tracebacks from collection errors not getting pruned.
#7966: Removed unhelpful error message from assertion rewrite mechanism when exceptions are raised in __iter__ methods. Now they are treated un-iterable instead.

Improved Documentation

#11091: Updated documentation to refer to hyphenated options: replaced --junitxml with --junit-xml and --collectonly with --collect-only.

- Python
Published by bluetech about 2 years ago

pytest - pytest 7.4.3 (2023-10-24)

Bug Fixes

#10447: Markers are now considered in the reverse mro order to ensure base class markers are considered first -- this resolves a regression.
#11239: Fixed := in asserts impacting unrelated test cases.
#11439: Handled an edge case where :data:sys.stderr might already be closed when :ref:faulthandler is tearing down.

- Python
Published by nicoddemus over 2 years ago

pytest - pytest 7.4.2 (2023-09-07)

Bug Fixes

#11237: Fix doctest collection of functools.cached_property objects.
#11306: Fixed bug using --importmode=importlib which would cause package __init__.py files to be imported more than once in some cases.
#11367: Fixed bug where user_properties where not being saved in the JUnit XML file if a fixture failed during teardown.
#11394: Fixed crash when parsing long command line arguments that might be interpreted as files.

Improved Documentation

#11391: Improved disclaimer on pytest plugin reference page to better indicate this is an automated, non-curated listing.

- Python
Published by nicoddemus over 2 years ago

pytest - pytest 7.4.1 (2023-09-02)

Bug Fixes

#10337: Fixed bug where fake intermediate modules generated by --import-mode=importlib would not include the child modules as attributes of the parent modules.
#10702: Fixed error assertion handling in pytest.approx when None is an expected or received value when comparing dictionaries.
#10811: Fixed issue when using --import-mode=importlib together with --doctest-modules that caused modules to be imported more than once, causing problems with modules that have import side effects.

- Python
Published by nicoddemus over 2 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.4.0

pytest 7.4.0 (2023-06-23)

Features

#10901: Added ExceptionInfo.from_exception() <pytest.ExceptionInfo.from_exception>{.interpreted-text role="func"}, a simpler way to create an ~pytest.ExceptionInfo{.interpreted-text role="class"} from an exception. This can replace ExceptionInfo.from_exc_info() <pytest.ExceptionInfo.from_exc_info()>{.interpreted-text role="func"} for most uses.

Improvements

#10872: Update test log report annotation to named tuple and fixed inconsistency in docs for pytest_report_teststatus{.interpreted-text role="hook"} hook.
#10907: When an exception traceback to be displayed is completely filtered out (by mechanisms such as __tracebackhide__, internal frames, and similar), now only the exception string and the following message are shown:

\"All traceback entries are hidden. Pass [--full-trace]{.title-ref} to see hidden and internal frames.\".

Previously, the last frame of the traceback was shown, even though it was hidden.
#10940: Improved verbose output (-vv) of skip and xfail reasons by performing text wrapping while leaving a clear margin for progress output.

Added TerminalReporter.wrap_write() as a helper for that.
#10991: Added handling of %f directive to print microseconds in log format options, such as log-date-format.
#11005: Added the underlying exception to the cache provider\'s path creation and write warning messages.
#11013: Added warning when testpaths{.interpreted-text role="confval"} is set, but paths are not found by glob. In this case, pytest will fall back to searching from the current directory.
#11043: When [--confcutdir]{.title-ref} is not specified, and there is no config file present, the conftest cutoff directory ([--confcutdir]{.title-ref}) is now set to the rootdir <rootdir>{.interpreted-text role="ref"}. Previously in such cases, [conftest.py]{.title-ref} files would be probed all the way to the root directory of the filesystem. If you are badly affected by this change, consider adding an empty config file to your desired cutoff directory, or explicitly set [--confcutdir]{.title-ref}.
#11081: The norecursedirs{.interpreted-text role="confval"} check is now performed in a pytest_ignore_collect{.interpreted-text role="hook"} implementation, so plugins can affect it.

If after updating to this version you see that your [norecursedirs]{.title-ref} setting is not being respected, it means that a conftest or a plugin you use has a bad [pytest_ignore_collect]{.title-ref} implementation. Most likely, your hook returns [False]{.title-ref} for paths it does not want to ignore, which ends the processing and doesn\'t allow other plugins, including pytest itself, to ignore the path. The fix is to return [None]{.title-ref} instead of [False]{.title-ref} for paths your hook doesn\'t want to ignore.
#8711: caplog.set_level() <pytest.LogCaptureFixture.set_level>{.interpreted-text role="func"} and caplog.at_level() <pytest.LogCaptureFixture.at_level>{.interpreted-text role="func"} will temporarily enable the requested level if level was disabled globally via logging.disable(LEVEL).

Bug Fixes

#10831: Terminal Reporting: Fixed bug when running in --tb=line mode where pytest.fail(pytrace=False) tests report None.
#11068: Fixed the --last-failed whole-file skipping functionality (\"skipped N files\") for non-python test files <non-python tests>{.interpreted-text role="ref"}.
#11104: Fixed a regression in pytest 7.3.2 which caused to testpaths{.interpreted-text role="confval"} to be considered for loading initial conftests, even when it was not utilized (e.g. when explicit paths were given on the command line). Now the testpaths are only considered when they are in use.
#1904: Fixed traceback entries hidden with __tracebackhide__ = True still being shown for chained exceptions (parts after \"... the above exception ...\" message).
#7781: Fix writing non-encodable text to log file when using --debug.

Improved Documentation

#9146: Improved documentation for caplog.set_level() <pytest.LogCaptureFixture.set_level>{.interpreted-text role="func"}.

Trivial/Internal Changes

#11031: Enhanced the CLI flag for -c to now include --config-file to make it clear that this flag applies to the usage of a custom config file.

- Python
Published by github-actions[bot] over 2 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.3.2

pytest 7.3.2 (2023-06-10)

Bug Fixes

#10169: Fix bug where very long option names could cause pytest to break with OSError: [Errno 36] File name too long on some systems.
#10894: Support for Python 3.12 (beta at the time of writing).
#10987: testpaths{.interpreted-text role="confval"} is now honored to load root conftests.
#10999: The [monkeypatch]{.title-ref} [setitem]{.title-ref}/[delitem]{.title-ref} type annotations now allow [TypedDict]{.title-ref} arguments.
#11028: Fixed bug in assertion rewriting where a variable assigned with the walrus operator could not be used later in a function call.
#11054: Fixed --last-failed\'s \"(skipped N files)\" functionality for files inside of packages (directories with [__init__.py]{.title-ref} files).

- Python
Published by github-actions[bot] over 2 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.3.1

pytest 7.3.1 (2023-04-14)

Improvements

#10875: Python 3.12 support: fixed RuntimeError: TestResult has no addDuration method when running unittest tests.
#10890: Python 3.12 support: fixed shutil.rmtree(onerror=...) deprecation warning when using tmp_path{.interpreted-text role="fixture"}.

Bug Fixes

#10896: Fixed performance regression related to tmp_path{.interpreted-text role="fixture"} and the new tmp_path_retention_policy{.interpreted-text role="confval"} option.
#10903: Fix crash INTERNALERROR IndexError: list index out of range which happens when displaying an exception where all entries are hidden. This reverts the change \"Correctly handle __tracebackhide__ for chained exceptions.\" introduced in version 7.3.0.

- Python
Published by github-actions[bot] almost 3 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.3.0

pytest 7.3.0 (2023-04-08)

Features

#10525: Test methods decorated with @classmethod can now be discovered as tests, following the same rules as normal methods. This fills the gap that static methods were discoverable as tests but not class methods.
#10755: console_output_style{.interpreted-text role="confval"} now supports progress-even-when-capture-no to force the use of the progress output even when capture is disabled. This is useful in large test suites where capture may have significant performance impact.
#7431: --log-disable CLI option added to disable individual loggers.
#8141: Added tmp_path_retention_count{.interpreted-text role="confval"} and tmp_path_retention_policy{.interpreted-text role="confval"} configuration options to control how directories created by the tmp_path{.interpreted-text role="fixture"} fixture are kept.

Improvements

#10226: If multiple errors are raised in teardown, we now re-raise an ExceptionGroup of them instead of discarding all but the last.
#10658: Allow -p arguments to include spaces (eg: -p no:logging instead of -pno:logging). Mostly useful in the addopts section of the configuration file.
#10710: Added start and stop timestamps to TestReport objects.
#10727: Split the report header for rootdir, config file and testpaths so each has its own line.
#10840: pytest should no longer crash on AST with pathological position attributes, for example testing AST produced by [Hylang <https://github.com/hylang/hy>__]{.title-ref}.
#6267: The full output of a test is no longer truncated if the truncation message would be longer than the hidden text. The line number shown has also been fixed.

Bug Fixes

#10743: The assertion rewriting mechanism now works correctly when assertion expressions contain the walrus operator.
#10765: Fixed tmp_path{.interpreted-text role="fixture"} fixture always raising OSError{.interpreted-text role="class"} on emscripten platform due to missing os.getuid{.interpreted-text role="func"}.
#1904: Correctly handle __tracebackhide__ for chained exceptions.

Improved Documentation

#10782: Fixed the minimal example in goodpractices{.interpreted-text role="ref"}: pip install -e . requires a version entry in pyproject.toml to run successfully.

Trivial/Internal Changes

#10669: pytest no longer depends on the [attrs]{.title-ref} package (don\'t worry, nice diffs for attrs classes are still supported).

- Python
Published by github-actions[bot] almost 3 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.2.2

pytest 7.2.2 (2023-03-03)

Bug Fixes

#10533: Fixed pytest.approx{.interpreted-text role="func"} handling of dictionaries containing one or more values of [0.0]{.title-ref}.
#10592: Fixed crash if [--cache-show]{.title-ref} and [--help]{.title-ref} are passed at the same time.
#10597: Fixed bug where a fixture method named teardown would be called as part of nose teardown stage.
#10626: Fixed crash if --fixtures and --help are passed at the same time.
#10660: Fixed :pypytest.raises{.interpreted-text role="func"} to return a \'ContextManager\' so that type-checkers could narrow pytest.raises(...) if ... else nullcontext() down to \'ContextManager\' rather than \'object\'.

Improved Documentation

#10690: Added [CI]{.title-ref} and [BUILD_NUMBER]{.title-ref} environment variables to the documentation.
#10721: Fixed entry-points declaration in the documentation example using Hatch.
#10753: Changed wording of the module level skip to be very explicit about not collecting tests and not executing the rest of the module.

- Python
Published by github-actions[bot] almost 3 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.2.1

pytest 7.2.1 (2023-01-13)

Bug Fixes

#10452: Fix \'importlib.abc.TraversableResources\' deprecation warning in Python 3.12.
#10457: If a test is skipped from inside a fixture, the test summary now shows the test location instead of the fixture location.
#10506: Fix bug where sometimes pytest would use the file system root directory as rootdir <rootdir>{.interpreted-text role="ref"} on Windows.
#10607: Fix a race condition when creating junitxml reports, which could occur when multiple instances of pytest execute in parallel.
#10641: Fix a race condition when creating or updating the stepwise plugin\'s cache, which could occur when multiple xdist worker nodes try to simultaneously update the stepwise plugin\'s cache.

- Python
Published by github-actions[bot] about 3 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.2.0

pytest 7.2.0 (2022-10-23)

Deprecations

#10012: Update pytest.PytestUnhandledCoroutineWarning{.interpreted-text role="class"} to a deprecation; it will raise an error in pytest 8.
#10396: pytest no longer depends on the py library. pytest provides a vendored copy of py.error and py.path modules but will use the py library if it is installed. If you need other py.* modules, continue to install the deprecated py library separately, otherwise it can usually be removed as a dependency.
#4562: Deprecate configuring hook specs/impls using attributes/marks.

Instead use :pypytest.hookimpl{.interpreted-text role="func"} and :pypytest.hookspec{.interpreted-text role="func"}. For more details, see the docs <legacy-path-hooks-deprecated>{.interpreted-text role="ref"}.
#9886: The functionality for running tests written for nose has been officially deprecated.

This includes:
- Plain setup and teardown functions and methods: this might catch users by surprise, as setup() and teardown() are not pytest idioms, but part of the nose support.
- Setup/teardown using the \@with_setup decorator.
For more details, consult the deprecation docs <nose-deprecation>{.interpreted-text role="ref"}.

Features

#9897: Added shell-style wildcard support to testpaths.

Improvements

#10218: @pytest.mark.parametrize() (and similar functions) now accepts any Sequence[str] for the argument names, instead of just list[str] and tuple[str, ...].

(Note that str, which is itself a Sequence[str], is still treated as a comma-delimited name list, as before).
#10381: The --no-showlocals flag has been added. This can be passed directly to tests to override --showlocals declared through addopts.
#3426: Assertion failures with strings in NFC and NFD forms that normalize to the same string now have a dedicated error message detailing the issue, and their utf-8 representation is expresed instead.
#7337: A warning is now emitted if a test function returns something other than [None]{.title-ref}. This prevents a common mistake among beginners that expect that returning a [bool]{.title-ref} (for example [return foo(a, b) == result]{.title-ref}) would cause a test to pass or fail, instead of using [assert]{.title-ref}.
#8508: Introduce multiline display for warning matching via :pypytest.warns{.interpreted-text role="func"} and enhance match comparison for :py_pytest._code.ExceptionInfo.match{.interpreted-text role="func"} as returned by :pypytest.raises{.interpreted-text role="func"}.
#8646: Improve :pypytest.raises{.interpreted-text role="func"}. Previously passing an empty tuple would give a confusing error. We now raise immediately with a more helpful message.
#9741: On Python 3.11, use the standard library\'s tomllib{.interpreted-text role="mod"} to parse TOML.

tomli{.interpreted-text role="mod"}` is no longer a dependency on Python 3.11.
#9742: Display assertion message without escaped newline characters with -vv.
#9823: Improved error message that is shown when no collector is found for a given file.
#9873: Some coloring has been added to the short test summary.
#9883: Normalize the help description of all command-line options.
#9920: Display full crash messages in short test summary info, when runng in a CI environment.
#9987: Added support for hidden configuration file by allowing .pytest.ini as an alternative to pytest.ini.

Bug Fixes

#10150: sys.stdin{.interpreted-text role="data"} now contains all expected methods of a file-like object when capture is enabled.
#10382: Do not break into pdb when raise unittest.SkipTest() appears top-level in a file.
#7792: Marks are now inherited according to the full MRO in test classes. Previously, if a test class inherited from two or more classes, only marks from the first super-class would apply.

When inheriting marks from super-classes, marks from the sub-classes are now ordered before marks from the super-classes, in MRO order. Previously it was the reverse.

When inheriting marks from super-classes, the [pytestmark]{.title-ref} attribute of the sub-class now only contains the marks directly applied to it. Previously, it also contained marks from its super-classes. Please note that this attribute should not normally be accessed directly; use pytest.Node.iter_markers{.interpreted-text role="func"} instead.
#9159: Showing inner exceptions by forcing native display in ExceptionGroups even when using display options other than --tb=native. A temporary step before full implementation of pytest-native display for inner exceptions in ExceptionGroups.
#9877: Ensure caplog.get_records(when) returns current/correct data after invoking caplog.clear().

Improved Documentation

#10344: Update information on writing plugins to use pyproject.toml instead of setup.py.
#9248: The documentation is now built using Sphinx 5.x (up from 3.x previously).
#9291: Update documentation on how pytest.warns{.interpreted-text role="func"} affects DeprecationWarning{.interpreted-text role="class"}.

Trivial/Internal Changes

#10196: ~pytest.PytestReturnNotNoneWarning{.interpreted-text role="class"} is now a subclass of ~pytest.PytestRemovedIn8Warning{.interpreted-text role="class"}: the plan is to make returning non-None from tests an error in the future.
#10313: Made _pytest.doctest.DoctestItem export pytest.DoctestItem for type check and runtime purposes. Made [_pytest.doctest]{.title-ref} use internal APIs to avoid circular imports.
#9906: Made _pytest.compat re-export importlib_metadata in the eyes of type checkers.
#9910: Fix default encoding warning (EncodingWarning) in cacheprovider
#9984: Improve the error message when we attempt to access a fixture that has been torn down. Add an additional sentence to the docstring explaining when it\'s not a good idea to call getfixturevalue.

- Python
Published by github-actions[bot] over 3 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.1.3

pytest 7.1.3 (2022-08-31)

Bug Fixes

#10060: When running with --pdb, TestCase.tearDown is no longer called for tests when the class has been skipped via unittest.skip or pytest.mark.skip.
#10190: Invalid XML characters in setup or teardown error messages are now properly escaped for JUnit XML reports.
#10230: Ignore .py files created by pyproject.toml-based editable builds introduced in pip 21.3.
#3396: Doctests now respect the --import-mode flag.
#9514: Type-annotate FixtureRequest.param as Any as a stop gap measure until 8073{.interpreted-text role="issue"} is fixed.
#9791: Fixed a path handling code in rewrite.py that seems to work fine, but was incorrect and fails in some systems.
#9917: Fixed string representation for pytest.approx{.interpreted-text role="func"} when used to compare tuples.

Improved Documentation

#9937: Explicit note that tmpdir{.interpreted-text role="fixture"} fixture is discouraged in favour of tmp_path{.interpreted-text role="fixture"}.

Trivial/Internal Changes

#10114: Replace atomicwrites dependency on windows with [os.replace]{.title-ref}.

- Python
Published by github-actions[bot] over 3 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.1.2

pytest 7.1.2 (2022-04-23)

Bug Fixes

#9726: An unnecessary numpy import inside pytest.approx{.interpreted-text role="func"} was removed.
#9820: Fix comparison of dataclasses with InitVar.
#9869: Increase stacklevel for the NODE_CTOR_FSPATH_ARG deprecation to point to the user\'s code, not pytest.
#9871: Fix a bizarre (and fortunately rare) bug where the [temp_path]{.title-ref} fixture could raise an internal error while attempting to get the current user\'s username.

- Python
Published by github-actions[bot] almost 4 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.1.1

pytest 7.1.1 (2022-03-17)

Bug Fixes

#9767: Fixed a regression in pytest 7.1.0 where some conftest.py files outside of the source tree (e.g. in the [site-packages]{.title-ref} directory) were not picked up.

- Python
Published by github-actions[bot] almost 4 years ago

pytest - 7.1.0

pytest 7.1.0 (2022-03-13)

Breaking Changes

#8838: As per our policy, the following features have been deprecated in the 6.X series and are now removed:
- pytest._fillfuncargs function.
- pytest_warning_captured hook - use pytest_warning_recorded instead.
- -k -foobar syntax - use -k 'not foobar' instead.
- -k foobar: syntax.
- pytest.collect module - import from pytest directly.
For more information consult Deprecations and Removals in the docs.
#9437: Dropped support for Python 3.6, which reached end-of-life at 2021-12-23.

Improvements

#5192: Fixed test output for some data types where -v would show less information.

Also, when showing diffs for sequences, -q would produce full diffs instead of the expected diff.
#9362: pytest now avoids specialized assert formatting when it is detected that the default __eq__ is overridden in attrs or dataclasses.
#9536: When -vv is given on command line, show skipping and xfail reasons in full instead of truncating them to fit the terminal width.
#9644: More information about the location of resources that led Python to raise ResourceWarning{.interpreted-text role="class"} can now be obtained by enabling tracemalloc{.interpreted-text role="mod"}.

See resource-warnings{.interpreted-text role="ref"} for more information.
#9678: More types are now accepted in the ids argument to @pytest.mark.parametrize. Previously only [str]{.title-ref}, [float]{.title-ref}, [int]{.title-ref} and [bool]{.title-ref} were accepted; now [bytes]{.title-ref}, [complex]{.title-ref}, [re.Pattern]{.title-ref}, [Enum]{.title-ref} and anything with a [__name__]{.title-ref} are also accepted.
#9692: pytest.approx{.interpreted-text role="func"} now raises a TypeError{.interpreted-text role="class"} when given an unordered sequence (such as set{.interpreted-text role="class"}).

Note that this implies that custom classes which only implement __iter__ and __len__ are no longer supported as they don\'t guarantee order.

Bug Fixes

#8242: The deprecation of raising unittest.SkipTest{.interpreted-text role="class"} to skip collection of tests during the pytest collection phase is reverted - this is now a supported feature again.
#9493: Symbolic link components are no longer resolved in conftest paths. This means that if a conftest appears twice in collection tree, using symlinks, it will be executed twice. For example, given

tests/real/conftest.py tests/real/test_it.py tests/link -> tests/real

running pytest tests now imports the conftest twice, once as tests/real/conftest.py and once as tests/link/conftest.py. This is a fix to match a similar change made to test collection itself in pytest 6.0 (see 6523{.interpreted-text role="pull"} for details).
#9626: Fixed count of selected tests on terminal collection summary when there were errors or skipped modules.

If there were errors or skipped modules on collection, pytest would mistakenly subtract those from the selected count.
#9645: Fixed regression where --import-mode=importlib used together with PYTHONPATH{.interpreted-text role="envvar"} or pythonpath{.interpreted-text role="confval"} would cause import errors in test suites.
#9708: pytester{.interpreted-text role="fixture"} now requests a monkeypatch{.interpreted-text role="fixture"} fixture instead of creating one internally. This solves some issues with tests that involve pytest environment variables.
#9730: Malformed pyproject.toml files now produce a clearer error message.

- Python
Published by github-actions[bot] almost 4 years ago

pytest - 7.0.1

pytest 7.0.1 (2022-02-11)

Bug Fixes

#9608: Fix invalid importing of importlib.readers in Python 3.9.
#9610: Restore [UnitTestFunction.obj]{.title-ref} to return unbound rather than bound method. Fixes a crash during a failed teardown in unittest TestCases with non-default [__init__]{.title-ref}. Regressed in pytest 7.0.0.
#9636: The pythonpath plugin was renamed to python_path. This avoids a conflict with the pytest-pythonpath plugin.
#9642: Fix running tests by id with :: in the parametrize portion.
#9643: Delay issuing a ~pytest.PytestWarning{.interpreted-text role="class"} about diamond inheritance involving ~pytest.Item{.interpreted-text role="class"} and ~pytest.Collector{.interpreted-text role="class"} so it can be filtered using standard warning filters <warnings>{.interpreted-text role="ref"}.

- Python
Published by github-actions[bot] about 4 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.0.0

pytest 7.0.0 (2022-02-03)

(Please see the full set of changes for this release also in the 7.0.0rc1 notes below)

Deprecations

#9488: If custom subclasses of nodes like pytest.Item{.interpreted-text role="class"} override the __init__ method, they should take **kwargs. See uncooperative-constructors-deprecated{.interpreted-text role="ref"} for details.

Note that a deprection warning is only emitted when there is a conflict in the arguments pytest expected to pass. This deprecation was already part of pytest 7.0.0rc1 but wasn\'t documented.

Bug Fixes

#9355: Fixed error message prints function decorators when using assert in Python 3.8 and above.
#9396: Ensure pytest.Config.inifile{.interpreted-text role="attr"} is available during the pytest_cmdline_main <_pytest.hookspec.pytest_cmdline_main>{.interpreted-text role="func"} hook (regression during 7.0.0rc1).

Improved Documentation

#9404: Added extra documentation on alternatives to common misuses of [pytest.warns(None)]{.title-ref} ahead of its deprecation.
#9505: Clarify where the configuration files are located. To avoid confusions documentation mentions that configuration file is located in the root of the repository.

Trivial/Internal Changes

#9521: Add test coverage to assertion rewrite path.

pytest 7.0.0rc1 (2021-12-06)

Breaking Changes

#7259: The Node.reportinfo() <non-python tests>{.interpreted-text role="ref"} function first return value type has been expanded from [py.path.local | str]{.title-ref} to [os.PathLike[str] | str]{.title-ref}.

Most plugins which refer to [reportinfo()]{.title-ref} only define it as part of a custom pytest.Item{.interpreted-text role="class"} implementation. Since [py.path.local]{.title-ref} is a [os.PathLike[str]]{.title-ref}, these plugins are unaffacted.

Plugins and users which call [reportinfo()]{.title-ref}, use the first return value and interact with it as a [py.path.local]{.title-ref}, would need to adjust by calling [py.path.local(fspath)]{.title-ref}. Although preferably, avoid the legacy [py.path.local]{.title-ref} and use [pathlib.Path]{.title-ref}, or use [item.location]{.title-ref} or [item.path]{.title-ref}, instead.

Note: pytest was not able to provide a deprecation period for this change.
#8246: --version now writes version information to stdout rather than stderr.
#8733: Drop a workaround for pyreadline that made it work with --pdb.

The workaround was introduced in #1281 in 2015, however since then pyreadline seems to have gone unmaintained, is generating warnings, and will stop working on Python 3.10.
#9061: Using pytest.approx{.interpreted-text role="func"} in a boolean context now raises an error hinting at the proper usage.

It is apparently common for users to mistakenly use pytest.approx like this:

{.sourceCode .python} assert pytest.approx(actual, expected)

While the correct usage is:

{.sourceCode .python} assert actual == pytest.approx(expected)

The new error message helps catch those mistakes.
#9277: The pytest.Instance collector type has been removed. Importing pytest.Instance or _pytest.python.Instance returns a dummy type and emits a deprecation warning. See instance-collector-deprecation{.interpreted-text role="ref"} for details.
#9308: PytestRemovedIn7Warning deprecation warnings are now errors by default.

Following our plan to remove deprecated features with as little disruption as possible, all warnings of type PytestRemovedIn7Warning now generate errors instead of warning messages by default.

The affected features will be effectively removed in pytest 7.1, so please consult the deprecations{.interpreted-text role="ref"} section in the docs for directions on how to update existing code.

In the pytest 7.0.X series, it is possible to change the errors back into warnings as a stopgap measure by adding this to your pytest.ini file:

{.sourceCode .ini} [pytest] filterwarnings = ignore::pytest.PytestRemovedIn7Warning

But this will stop working when pytest 7.1 is released.

If you have concerns about the removal of a specific feature, please add a comment to 9308{.interpreted-text role="issue"}.

Deprecations

#7259: py.path.local arguments for hooks have been deprecated. See the deprecation note <legacy-path-hooks-deprecated>{.interpreted-text role="ref"} for full details.

py.path.local arguments to Node constructors have been deprecated. See the deprecation note <node-ctor-fspath-deprecation>{.interpreted-text role="ref"} for full details.

::: {.note} ::: {.admonition-title} Note :::

The name of the ~_pytest.nodes.Node{.interpreted-text role="class"} arguments and attributes (the new attribute being path) is the opposite of the situation for hooks (the old argument being path).

This is an unfortunate artifact due to historical reasons, which should be resolved in future versions as we slowly get rid of the py{.interpreted-text role="pypi"} dependency (see 9283{.interpreted-text role="issue"} for a longer discussion). :::
#7469: Directly constructing the following classes is now deprecated:
- _pytest.mark.structures.Mark
- _pytest.mark.structures.MarkDecorator
- _pytest.mark.structures.MarkGenerator
- _pytest.python.Metafunc
- _pytest.runner.CallInfo
- _pytest._code.ExceptionInfo
- _pytest.config.argparsing.Parser
- _pytest.config.argparsing.OptionGroup
- _pytest.pytester.HookRecorder
These constructors have always been considered private, but now issue a deprecation warning, which may become a hard error in pytest 8.
#8242: Raising unittest.SkipTest{.interpreted-text role="class"} to skip collection of tests during the pytest collection phase is deprecated. Use pytest.skip{.interpreted-text role="func"} instead.

Note: This deprecation only relates to using unittest.SkipTest{.interpreted-text role="class"} during test collection. You are probably not doing that. Ordinary usage of unittest.SkipTest{.interpreted-text role="class"} / unittest.TestCase.skipTest{.interpreted-text role="meth"} / unittest.skip{.interpreted-text role="func"} in unittest test cases is fully supported.
#8315: Several behaviors of Parser.addoption <pytest.Parser.addoption>{.interpreted-text role="meth"} are now scheduled for removal in pytest 8 (deprecated since pytest 2.4.0):
- parser.addoption(..., help=".. %default ..") - use %(default)s instead.
- parser.addoption(..., type="int/string/float/complex") - use type=int etc. instead.
#8447: Defining a custom pytest node type which is both an pytest.Item <Item>{.interpreted-text role="class"} and a pytest.Collector <Collector>{.interpreted-text role="class"} (e.g. pytest.File <File>{.interpreted-text role="class"}) now issues a warning. It was never sanely supported and triggers hard to debug errors.

See the deprecation note <diamond-inheritance-deprecated>{.interpreted-text role="ref"} for full details.
#8592: pytest_cmdline_preparse{.interpreted-text role="hook"} has been officially deprecated. It will be removed in a future release. Use pytest_load_initial_conftests{.interpreted-text role="hook"} instead.

See the deprecation note <cmdline-preparse-deprecated>{.interpreted-text role="ref"} for full details.
#8645: pytest.warns(None) <pytest.warns>{.interpreted-text role="func"} is now deprecated because many people used it to mean \"this code does not emit warnings\", but it actually had the effect of checking that the code emits at least one warning of any type - like pytest.warns() or pytest.warns(Warning).
#8948: pytest.skip(msg=...) <pytest.skip>{.interpreted-text role="func"}, pytest.fail(msg=...) <pytest.fail>{.interpreted-text role="func"} and pytest.exit(msg=...) <pytest.exit>{.interpreted-text role="func"} signatures now accept a reason argument instead of msg. Using msg still works, but is deprecated and will be removed in a future release.

This was changed for consistency with pytest.mark.skip <pytest.mark.skip>{.interpreted-text role="func"} and pytest.mark.xfail <pytest.mark.xfail>{.interpreted-text role="func"} which both accept reason as an argument.
#8174: The following changes have been made to types reachable through pytest.ExceptionInfo.traceback{.interpreted-text role="attr"}:
- The path property of _pytest.code.Code returns Path instead of py.path.local.
- The path property of _pytest.code.TracebackEntry returns Path instead of py.path.local.
There was no deprecation period for this change (sorry!).

Features

#5196: Tests are now ordered by definition order in more cases.

In a class hierarchy, tests from base classes are now consistently ordered before tests defined on their subclasses (reverse MRO order).
#7132: Added two environment variables PYTEST_THEME{.interpreted-text role="envvar"} and PYTEST_THEME_MODE{.interpreted-text role="envvar"} to let the users customize the pygments theme used.
#7259: Added cache.mkdir() <pytest.Cache.mkdir>{.interpreted-text role="meth"}, which is similar to the existing cache.makedir() <pytest.Cache.makedir>{.interpreted-text role="meth"}, but returns a pathlib.Path{.interpreted-text role="class"} instead of a legacy py.path.local.

Added a paths type to parser.addini() <pytest.Parser.addini>{.interpreted-text role="meth"}, as in parser.addini("mypaths", "my paths", type="paths"), which is similar to the existing pathlist, but returns a list of pathlib.Path{.interpreted-text role="class"} instead of legacy py.path.local.
#7469: The types of objects used in pytest\'s API are now exported so they may be used in type annotations.

The newly-exported types are:
- pytest.Config for Config <pytest.Config>{.interpreted-text role="class"}.
- pytest.Mark for marks <pytest.Mark>{.interpreted-text role="class"}.
- pytest.MarkDecorator for mark decorators <pytest.MarkDecorator>{.interpreted-text role="class"}.
- pytest.MarkGenerator for the pytest.mark <pytest.MarkGenerator>{.interpreted-text role="class"} singleton.
- pytest.Metafunc for the metafunc <pytest.MarkGenerator>{.interpreted-text role="class"} argument to the pytest_generate_tests{.interpreted-text role="hook"} hook.
- pytest.CallInfo for the CallInfo <pytest.CallInfo>{.interpreted-text role="class"} type passed to various hooks.
- pytest.PytestPluginManager for PytestPluginManager <pytest.PytestPluginManager>{.interpreted-text role="class"}.
- pytest.ExceptionInfo for the ExceptionInfo <pytest.ExceptionInfo>{.interpreted-text role="class"} type returned from pytest.raises{.interpreted-text role="func"} and passed to various hooks.
- pytest.Parser for the Parser <pytest.Parser>{.interpreted-text role="class"} type passed to the pytest_addoption{.interpreted-text role="hook"} hook.
- pytest.OptionGroup for the OptionGroup <pytest.OptionGroup>{.interpreted-text role="class"} type returned from the parser.addgroup <pytest.Parser.getgroup>{.interpreted-text role="func"} method.
- pytest.HookRecorder for the HookRecorder <pytest.HookRecorder>{.interpreted-text role="class"} type returned from ~pytest.Pytester{.interpreted-text role="class"}.
- pytest.RecordedHookCall for the RecordedHookCall <pytest.HookRecorder>{.interpreted-text role="class"} type returned from ~pytest.HookRecorder{.interpreted-text role="class"}.
- pytest.RunResult for the RunResult <pytest.RunResult>{.interpreted-text role="class"} type returned from ~pytest.Pytester{.interpreted-text role="class"}.
- pytest.LineMatcher for the LineMatcher <pytest.RunResult>{.interpreted-text role="class"} type used in ~pytest.RunResult{.interpreted-text role="class"} and others.
- pytest.TestReport for the TestReport <pytest.TestReport>{.interpreted-text role="class"} type used in various hooks.
- pytest.CollectReport for the CollectReport <pytest.CollectReport>{.interpreted-text role="class"} type used in various hooks.
Constructing most of them directly is not supported; they are only meant for use in type annotations. Doing so will emit a deprecation warning, and may become a hard-error in pytest 8.0.

Subclassing them is also not supported. This is not currently enforced at runtime, but is detected by type-checkers such as mypy.
#7856: --import-mode=importlib <import-modes>{.interpreted-text role="ref"} now works with features that depend on modules being on :pysys.modules{.interpreted-text role="data"}, such as pickle{.interpreted-text role="mod"} and dataclasses{.interpreted-text role="mod"}.
#8144: The following hooks now receive an additional pathlib.Path argument, equivalent to an existing py.path.local argument:
- pytest_ignore_collect{.interpreted-text role="hook"} - The collection_path parameter (equivalent to existing path parameter).
- pytest_collect_file{.interpreted-text role="hook"} - The file_path parameter (equivalent to existing path parameter).
- pytest_pycollect_makemodule{.interpreted-text role="hook"} - The module_path parameter (equivalent to existing path parameter).
- pytest_report_header{.interpreted-text role="hook"} - The start_path parameter (equivalent to existing startdir parameter).
- pytest_report_collectionfinish{.interpreted-text role="hook"} - The start_path parameter (equivalent to existing startdir parameter).
::: {.note} ::: {.admonition-title} Note :::

The name of the ~_pytest.nodes.Node{.interpreted-text role="class"} arguments and attributes (the new attribute being path) is the opposite of the situation for hooks (the old argument being path).

This is an unfortunate artifact due to historical reasons, which should be resolved in future versions as we slowly get rid of the py{.interpreted-text role="pypi"} dependency (see 9283{.interpreted-text role="issue"} for a longer discussion). :::
#8251: Implement Node.path as a pathlib.Path. Both the old fspath and this new attribute gets set no matter whether path or fspath (deprecated) is passed to the constructor. It is a replacement for the fspath attribute (which represents the same path as py.path.local). While fspath is not deprecated yet due to the ongoing migration of methods like ~_pytest.Item.reportinfo{.interpreted-text role="meth"}, we expect to deprecate it in a future release.

::: {.note} ::: {.admonition-title} Note :::

The name of the ~_pytest.nodes.Node{.interpreted-text role="class"} arguments and attributes (the new attribute being path) is the opposite of the situation for hooks (the old argument being path).

This is an unfortunate artifact due to historical reasons, which should be resolved in future versions as we slowly get rid of the py{.interpreted-text role="pypi"} dependency (see 9283{.interpreted-text role="issue"} for a longer discussion). :::
#8421: pytest.approx{.interpreted-text role="func"} now works on ~decimal.Decimal{.interpreted-text role="class"} within mappings/dicts and sequences/lists.
#8606: pytest invocations with --fixtures-per-test and --fixtures have been enriched with:
- Fixture location path printed with the fixture name.
- First section of the fixture\'s docstring printed under the fixture name.
- Whole of fixture\'s docstring printed under the fixture name using --verbose option.
#8761: New version-tuple{.interpreted-text role="ref"} attribute, which makes it simpler for users to do something depending on the pytest version (such as declaring hooks which are introduced in later versions).
#8789: Switch TOML parser from toml to tomli for TOML v1.0.0 support in pyproject.toml.
#8920: Added pytest.Stash{.interpreted-text role="class"}, a facility for plugins to store their data on ~pytest.Config{.interpreted-text role="class"} and ~_pytest.nodes.Node{.interpreted-text role="class"}s in a type-safe and conflict-free manner. See plugin-stash{.interpreted-text role="ref"} for details.
#8953: RunResult <_pytest.pytester.RunResult>{.interpreted-text role="class"} method assert_outcomes <_pytest.pytester.RunResult.assert_outcomes>{.interpreted-text role="meth"} now accepts a warnings argument to assert the total number of warnings captured.
#8954: --debug flag now accepts a str{.interpreted-text role="class"} file to route debug logs into, remains defaulted to [pytestdebug.log]{.title-ref}.
#9023: Full diffs are now always shown for equality assertions of iterables when [CI]{.title-ref} or BUILD_NUMBER is found in the environment, even when -v isn\'t used.
#9113: RunResult <_pytest.pytester.RunResult>{.interpreted-text role="class"} method assert_outcomes <_pytest.pytester.RunResult.assert_outcomes>{.interpreted-text role="meth"} now accepts a deselected argument to assert the total number of deselected tests.
#9114: Added pythonpath{.interpreted-text role="confval"} setting that adds listed paths to sys.path{.interpreted-text role="data"} for the duration of the test session. If you currently use the pytest-pythonpath or pytest-srcpaths plugins, you should be able to replace them with built-in [pythonpath]{.title-ref} setting.

Improvements

#7480: A deprecation scheduled to be removed in a major version X (e.g. pytest 7, 8, 9, ...) now uses warning category [PytestRemovedInXWarning]{.title-ref}, a subclass of ~pytest.PytestDeprecationWarning{.interpreted-text role="class"}, instead of PytestDeprecationWarning{.interpreted-text role="class"} directly.

See backwards-compatibility{.interpreted-text role="ref"} for more details.
#7864: Improved error messages when parsing warning filters.

Previously pytest would show an internal traceback, which besides being ugly sometimes would hide the cause of the problem (for example an ImportError while importing a specific warning type).

#8335: Improved pytest.approx{.interpreted-text role="func"} assertion messages for sequences of numbers.

The assertion messages now dumps a table with the index and the error of each diff. Example:

>       assert [1, 2, 3, 4] == pytest.approx([1, 3, 3, 5])
E       assert comparison failed for 2 values:
E         Index | Obtained | Expected
E         1     | 2        | 3 +- 3.0e-06
E         3     | 4        | 5 +- 5.0e-06

#8403: By default, pytest will truncate long strings in assert errors so they don\'t clutter the output too much, currently at 240 characters by default.

However, in some cases the longer output helps, or is even crucial, to diagnose a failure. Using -v will now increase the truncation threshold to 2400 characters, and -vv or higher will disable truncation entirely.
#8509: Fixed issue where unittest.TestCase.setUpClass{.interpreted-text role="meth"} is not called when a test has [/]{.title-ref} in its name since pytest 6.2.0.

This refers to the path part in pytest node IDs, e.g. TestClass::test_it in the node ID tests/test_file.py::TestClass::test_it.

Now, instead of assuming that the test name does not contain /, it is assumed that test path does not contain ::. We plan to hopefully make both of these work in the future.
#8803: It is now possible to add colors to custom log levels on cli log.

By using add_color_level <_pytest.logging.add_color_level>{.interpreted-text role="func"} from a pytest_configure hook, colors can be added:
```
logging_plugin = config.pluginmanager.get_plugin('logging-plugin')
logging_plugin.log_cli_handler.formatter.add_color_level(logging.INFO, 'cyan')
logging_plugin.log_cli_handler.formatter.add_color_level(logging.SPAM, 'blue')
```
See log_colors{.interpreted-text role="ref"} for more information.
#8822: When showing fixture paths in [--fixtures]{.title-ref} or [--fixtures-by-test]{.title-ref}, fixtures coming from pytest itself now display an elided path, rather than the full path to the file in the [site-packages]{.title-ref} directory.
#8898: Complex numbers are now treated like floats and integers when generating parameterization IDs.
#9062: --stepwise-skip now implicitly enables --stepwise and can be used on its own.
#9205: pytest.Cache.set{.interpreted-text role="meth"} now preserves key order when saving dicts.

Bug Fixes

#7124: Fixed an issue where __main__.py would raise an ImportError when --doctest-modules was provided.
#8061: Fixed failing staticmethod test cases if they are inherited from a parent test class.
#8192: testdir.makefile now silently accepts values which don\'t start with . to maintain backward compatibility with older pytest versions.

pytester.makefile now issues a clearer error if the . is missing in the ext argument.
#8258: Fixed issue where pytest\'s faulthandler support would not dump traceback on crashes if the faulthandler{.interpreted-text role="mod"} module was already enabled during pytest startup (using python -X dev -m pytest for example).
#8317: Fixed an issue where illegal directory characters derived from getpass.getuser() raised an OSError.
#8367: Fix Class.from_parent so it forwards extra keyword arguments to the constructor.
#8377: The test selection options pytest -k and pytest -m now support matching names containing forward slash (/) characters.
#8384: The @pytest.mark.skip decorator now correctly handles its arguments. When the reason argument is accidentally given both positional and as a keyword (e.g. because it was confused with skipif), a TypeError now occurs. Before, such tests were silently skipped, and the positional argument ignored. Additionally, reason is now documented correctly as positional or keyword (rather than keyword-only).
#8394: Use private names for internal fixtures that handle classic setup/teardown so that they don\'t show up with the default --fixtures invocation (but they still show up with --fixtures -v).
#8456: The required_plugins{.interpreted-text role="confval"} config option now works correctly when pre-releases of plugins are installed, rather than falsely claiming that those plugins aren\'t installed at all.
#8464: -c <config file> now also properly defines rootdir as the directory that contains <config file>.
#8503: pytest.MonkeyPatch.syspath_prepend{.interpreted-text role="meth"} no longer fails when setuptools is not installed. It now only calls pkg_resources.fixup_namespace_packages{.interpreted-text role="func"} if pkg_resources was previously imported, because it is not needed otherwise.
#8548: Introduce fix to handle precision width in log-cli-format in turn to fix output coloring for certain formats.
#8796: Fixed internal error when skipping doctests.
#8983: The test selection options pytest -k and pytest -m now support matching names containing backslash ([\]{.title-ref}) characters. Backslashes are treated literally, not as escape characters (the values being matched against are already escaped).
#8990: Fix [pytest -vv]{.title-ref} crashing with an internal exception [AttributeError: \'str\' object has no attribute \'relative_to\']{.title-ref} in some cases.
#9077: Fixed confusing error message when request.fspath / request.path was accessed from a session-scoped fixture.
#9131: Fixed the URL used by --pastebin to use bpa.st.
#9163: The end line number and end column offset are now properly set for rewritten assert statements.
#9169: Support for the files API from importlib.resources within rewritten files.
#9272: The nose compatibility module-level fixtures [setup()]{.title-ref} and [teardown()]{.title-ref} are now only called once per module, instead of for each test function. They are now called even if object-level [setup]{.title-ref}/[teardown]{.title-ref} is defined.

Improved Documentation

#4320: Improved docs for [pytester.copy_example]{.title-ref}.
#5105: Add automatically generated plugin-list{.interpreted-text role="ref"}. The list is updated on a periodic schedule.
#8337: Recommend numpy.testing module on pytest.approx{.interpreted-text role="func"} documentation.
#8655: Help text for --pdbcls more accurately reflects the option\'s behavior.
#9210: Remove incorrect docs about confcutdir being a configuration option: it can only be set through the --confcutdir command-line option.
#9242: Upgrade readthedocs configuration to use a newer Ubuntu version` with better unicode support for PDF docs.
#9341: Various methods commonly used for non-python tests{.interpreted-text role="ref"} are now correctly documented in the reference docs. They were undocumented previously.

Trivial/Internal Changes

#8133: Migrate to setuptools_scm 6.x to use SETUPTOOLS_SCM_PRETEND_VERSION_FOR_PYTEST for more robust release tooling.
#8174: The following changes have been made to internal pytest types/functions:
- The _pytest.code.getfslineno() function returns Path instead of py.path.local.
- The _pytest.python.path_matches_patterns() function takes Path instead of py.path.local.
- The _pytest._code.Traceback.cut() function accepts any os.PathLike[str], not just py.path.local.
#8248: Internal Restructure: let python.PyObjMixin inherit from nodes.Node to carry over typing information.
#8432: Improve error message when pytest.skip{.interpreted-text role="func"} is used at module level without passing [allow_module_level=True]{.title-ref}.
#8818: Ensure regendoc opts out of TOX_ENV cachedir selection to ensure independent example test runs.
#8913: The private CallSpec2._arg2scopenum attribute has been removed after an internal refactoring.
#8967: pytest_assertion_pass{.interpreted-text role="hook"} is no longer considered experimental and future changes to it will be considered more carefully.
#9202: Add github action to upload coverage report to codecov instead of bash uploader.
#9225: Changed the command used to create sdist and wheel artifacts: using the build package instead of setup.py.
#9351: Correct minor typos in doc/en/example/special.rst.

- Python
Published by github-actions[bot] about 4 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/7.0.0rc1

- Python
Published by github-actions[bot] about 4 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.2.5

pytest 6.2.5 (2021-08-29)

Trivial/Internal Changes

#8494: Python 3.10 is now supported.
#9040: Enable compatibility with pluggy 1.0 or later.

- Python
Published by github-actions[bot] over 4 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.2.4

pytest 6.2.4 (2021-05-04)

Bug Fixes

#8539: Fixed assertion rewriting on Python 3.10.

- Python
Published by nicoddemus almost 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.2.3

pytest 6.2.3 (2021-04-03)

Bug Fixes

#8414: pytest used to create directories under /tmp with world-readable permissions. This means that any user in the system was able to read information written by tests in temporary directories (such as those created by the tmp_path/tmpdir fixture). Now the directories are created with private permissions.

pytest used silenty use a pre-existing /tmp/pytest-of-<username> directory, even if owned by another user. This means another user could pre-create such a directory and gain control of another user\'s temporary directory. Now such a condition results in an error.

- Python
Published by nicoddemus almost 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.2.2

pytest 6.2.2 (2021-01-25)

Bug Fixes

#8152: Fixed "(<Skipped instance>)" being shown as a skip reason in the verbose test summary line when the reason is empty.
#8249: Fix the faulthandler plugin for occasions when running with twisted.logger and using pytest --capture=no.

- Python
Published by nicoddemus about 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.2.1

pytest 6.2.1 (2020-12-15)

Bug Fixes

#7678: Fixed bug where ImportPathMismatchError would be raised for files compiled in the host and loaded later from an UNC mounted path (Windows).
#8132: Fixed regression in approx: in 6.2.0 approx no longer raises TypeError when dealing with non-numeric types, falling back to normal comparison. Before 6.2.0, array types like tf.DeviceArray fell through to the scalar case, and happened to compare correctly to a scalar if they had only one element. After 6.2.0, these types began failing, because they inherited neither from standard Python number hierarchy nor from numpy.ndarray.

approx now converts arguments to numpy.ndarray if they expose the array protocol and are not scalars. This treats array-like objects like numpy arrays, regardless of size.

- Python
Published by nicoddemus about 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.2.0

pytest 6.2.0 (2020-12-12)

Breaking Changes

#7808: pytest now supports python3.6+ only.

Deprecations

#7469: Directly constructing/calling the following classes/functions is now deprecated:
- _pytest.cacheprovider.Cache
- _pytest.cacheprovider.Cache.for_config()
- _pytest.cacheprovider.Cache.clear_cache()
- _pytest.cacheprovider.Cache.cache_dir_from_config()
- _pytest.capture.CaptureFixture
- _pytest.fixtures.FixtureRequest
- _pytest.fixtures.SubRequest
- _pytest.logging.LogCaptureFixture
- _pytest.pytester.Pytester
- _pytest.pytester.Testdir
- _pytest.recwarn.WarningsRecorder
- _pytest.recwarn.WarningsChecker
- _pytest.tmpdir.TempPathFactory
- _pytest.tmpdir.TempdirFactory
These have always been considered private, but now issue a deprecation warning, which may become a hard error in pytest 7.0.0.
#7530: The --strict command-line option has been deprecated, use --strict-markers instead.

We have plans to maybe in the future to reintroduce --strict and make it an encompassing flag for all strictness related options (--strict-markers and --strict-config at the moment, more might be introduced in the future).
#7988: The @pytest.yield_fixture decorator/function is now deprecated. Use pytest.fixture instead.

yield_fixture has been an alias for fixture for a very long time, so can be search/replaced safely.

Features

#5299: pytest now warns about unraisable exceptions and unhandled thread exceptions that occur in tests on Python>=3.8. See unraisable for more information.
#7425: New pytester fixture, which is identical to testdir but its methods return pathlib.Path when appropriate instead of py.path.local.

This is part of the movement to use pathlib.Path objects internally, in order to remove the dependency to py in the future.

Internally, the old Testdir <_pytest.pytester.Testdir> is now a thin wrapper around Pytester <_pytest.pytester.Pytester>, preserving the old interface.
#7695: A new hook was added, pytest_markeval_namespace which should return a dictionary. This dictionary will be used to augment the "global" variables available to evaluate skipif/xfail/xpass markers.

Pseudo example

conftest.py:

{.sourceCode .python} def pytest_markeval_namespace(): return {"color": "red"}

test_func.py:

{.sourceCode .python} @pytest.mark.skipif("color == 'blue'", reason="Color is not red") def test_func(): assert False
#8006: It is now possible to construct a ~pytest.MonkeyPatch object directly as pytest.MonkeyPatch(), in cases when the monkeypatch fixture cannot be used. Previously some users imported it from the private _pytest.monkeypatch.MonkeyPatch namespace.

Additionally, MonkeyPatch.context <pytest.MonkeyPatch.context> is now a classmethod, and can be used as with MonkeyPatch.context() as mp: .... This is the recommended way to use MonkeyPatch directly, since unlike the monkeypatch fixture, an instance created directly is not undo()-ed automatically.

Improvements

#1265: Added an __str__ implementation to the ~pytest.pytester.LineMatcher class which is returned from pytester.run_pytest().stdout and similar. It returns the entire output, like the existing str() method.
#2044: Verbose mode now shows the reason that a test was skipped in the test's terminal line after the "SKIPPED", "XFAIL" or "XPASS".
#7469 The types of builtin pytest fixtures are now exported so they may be used in type annotations of test functions. The newly-exported types are:
- pytest.FixtureRequest for the request fixture.
- pytest.Cache for the cache fixture.
- pytest.CaptureFixture[str] for the capfd and capsys fixtures.
- pytest.CaptureFixture[bytes] for the capfdbinary and capsysbinary fixtures.
- pytest.LogCaptureFixture for the caplog fixture.
- pytest.Pytester for the pytester fixture.
- pytest.Testdir for the testdir fixture.
- pytest.TempdirFactory for the tmpdir_factory fixture.
- pytest.TempPathFactory for the tmp_path_factory fixture.
- pytest.MonkeyPatch for the monkeypatch fixture.
- pytest.WarningsRecorder for the recwarn fixture.
Constructing them is not supported (except for MonkeyPatch); they are only meant for use in type annotations. Doing so will emit a deprecation warning, and may become a hard-error in pytest 7.0.

Subclassing them is also not supported. This is not currently enforced at runtime, but is detected by type-checkers such as mypy.
#7527: When a comparison between namedtuple <collections.namedtuple> instances of the same type fails, pytest now shows the differing field names (possibly nested) instead of their indexes.
#7615: Node.warn <_pytest.nodes.Node.warn> now permits any subclass of Warning, not just PytestWarning <pytest.PytestWarning>.
#7701: Improved reporting when using --collected-only. It will now show the number of collected tests in the summary stats.
#7710: Use strict equality comparison for non-numeric types in pytest.approx instead of raising TypeError.

This was the undocumented behavior before 3.7, but is now officially a supported feature.
#7938: New --sw-skip argument which is a shorthand for --stepwise-skip.
#8023: Added 'node_modules' to default value for norecursedirs.
#8032: doClassCleanups <unittest.TestCase.doClassCleanups> (introduced in unittest in Python and 3.8) is now called appropriately.

Bug Fixes

#4824: Fixed quadratic behavior and improved performance of collection of items using autouse fixtures and xunit fixtures.
#7758: Fixed an issue where some files in packages are getting lost from --lf even though they contain tests that failed. Regressed in pytest 5.4.0.
#7911: Directories created by by tmp_path and tmpdir are now considered stale after 3 days without modification (previous value was 3 hours) to avoid deleting directories still in use in long running test suites.
#7913: Fixed a crash or hang in pytester.spawn <_pytest.pytester.Pytester.spawn> when the readline module is involved.
#7951: Fixed handling of recursive symlinks when collecting tests.
#7981: Fixed symlinked directories not being followed during collection. Regressed in pytest 6.1.0.
#8016: Fixed only one doctest being collected when using pytest --doctest-modules path/to/an/__init__.py.

Improved Documentation

#7429: Add more information and use cases about skipping doctests.
#7780: Classes which should not be inherited from are now marked final class in the API reference.
#7872: _pytest.config.argparsing.Parser.addini() accepts explicit None and "string".
#7878: In pull request section, ask to commit after editing changelog and authors file.

Trivial/Internal Changes

#7802: The attrs dependency requirement is now >=19.2.0 instead of >=17.4.0.
#8014: .pyc files created by pytest's assertion rewriting now conform to the newer PEP-552 format on Python>=3.7. (These files are internal and only interpreted by pytest itself.)

- Python
Published by nicoddemus about 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.1.2

pytest 6.1.2 (2020-10-28)

Bug Fixes

#7758: Fixed an issue where some files in packages are getting lost from --lf even though they contain tests that failed. Regressed in pytest 5.4.0.
#7911: Directories created by tmpdir are now considered stale after 3 days without modification (previous value was 3 hours) to avoid deleting directories still in use in long running test suites.

Improved Documentation

#7815: Improve deprecation warning message for pytest._fillfuncargs().

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.1.1

pytest 6.1.1 (2020-10-03)

Bug Fixes

#7807: Fixed regression in pytest 6.1.0 causing incorrect rootdir to be determined in some non-trivial cases where parent directories have config files as well.
#7814: Fixed crash in header reporting when testpaths is used and contains absolute paths (regression in 6.1.0).

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.1.0

pytest 6.1.0 (2020-09-26)

Breaking Changes

#5585: As per our policy, the following features which have been deprecated in the 5.X series are now removed:
- The funcargnames read-only property of FixtureRequest, Metafunc, and Function classes. Use fixturenames attribute.
- @pytest.fixture no longer supports positional arguments, pass all arguments by keyword instead.
- Direct construction of Node subclasses now raise an error, use from_parent instead.
- The default value for junit_family has changed to xunit2. If you require the old format, add junit_family=xunit1 to your configuration file.
- The TerminalReporter no longer has a writer attribute. Plugin authors may use the public functions of the TerminalReporter instead of accessing the TerminalWriter object directly.
- The --result-log option has been removed. Users are recommended to use the pytest-reportlog plugin instead.
For more information consult Deprecations and Removals in the docs.

Deprecations

#6981: The pytest.collect module is deprecated: all its names can be imported from pytest directly.
#7097: The pytest._fillfuncargs function is deprecated. This function was kept for backward compatibility with an older plugin.

It's functionality is not meant to be used directly, but if you must replace it, use function._request._fillfixtures() instead, though note this is not a public API and may break in the future.
#7210: The special -k '-expr' syntax to -k is deprecated. Use -k 'not expr' instead.

The special -k 'expr:' syntax to -k is deprecated. Please open an issue if you use this and want a replacement.
#7255: The pytest_warning_captured <_pytest.hookspec.pytest_warning_captured> hook is deprecated in favor of pytest_warning_recorded <_pytest.hookspec.pytest_warning_recorded>, and will be removed in a future version.
#7648: The gethookproxy() and isinitpath() methods of FSCollector and Package are deprecated; use self.session.gethookproxy() and self.session.isinitpath() instead. This should work on all pytest versions.

Features

#7667: New --durations-min command-line flag controls the minimal duration for inclusion in the slowest list of tests shown by --durations. Previously this was hard-coded to 0.005s.

Improvements

#6681: Internal pytest warnings issued during the early stages of initialization are now properly handled and can filtered through filterwarnings or --pythonwarnings/-W.

This also fixes a number of long standing issues: #2891, #7620, #7426.
#7572: When a plugin listed in required_plugins is missing or an unknown config key is used with --strict-config, a simple error message is now shown instead of a stacktrace.
#7685: Added two new attributes rootpath <_pytest.config.Config.rootpath> and inipath <_pytest.config.Config.inipath> to Config <_pytest.config.Config>. These attributes are pathlib.Path versions of the existing rootdir <_pytest.config.Config.rootdir> and inifile <_pytest.config.Config.inifile> attributes, and should be preferred over them when possible.
#7780: Public classes which are not designed to be inherited from are now marked @final. Code which inherits from these classes will trigger a type-checking (e.g. mypy) error, but will still work in runtime. Currently the final designation does not appear in the API Reference but hopefully will in the future.

Bug Fixes

#1953: Fixed error when overwriting a parametrized fixture, while also reusing the super fixture value.

``` {.sourceCode .python}

conftest.py

import pytest

@pytest.fixture(params=[1, 2]) def foo(request): return request.param

test_foo.py

import pytest

@pytest.fixture def foo(foo): return foo * 2 ```
#4984: Fixed an internal error crash with IndexError: list index out of range when collecting a module which starts with a decorated function, the decorator raises, and assertion rewriting is enabled.
#7591: pylint shouldn't complain anymore about unimplemented abstract methods when inheriting from File <non-python tests>.
#7628: Fixed test collection when a full path without a drive letter was passed to pytest on Windows (for example \projects\tests\test.py instead of c:\projects\tests\pytest.py).
#7638: Fix handling of command-line options that appear as paths but trigger an OS-level syntax error on Windows, such as the options used internally by pytest-xdist.
#7742: Fixed INTERNALERROR when accessing locals / globals with faulty exec.

Improved Documentation

#1477: Removed faq.rst and its reference in contents.rst.

Trivial/Internal Changes

#7536: The internal junitxml plugin has rewritten to use xml.etree.ElementTree. The order of attributes in XML elements might differ. Some unneeded escaping is no longer performed.
#7587: The dependency on the more-itertools package has been removed.
#7631: The result type of capfd.readouterr() <_pytest.capture.CaptureFixture.readouterr> (and similar) is no longer a namedtuple, but should behave like one in all respects. This was done for technical reasons.
#7671: When collecting tests, pytest finds test classes and functions by examining the attributes of python objects (modules, classes and instances). To speed up this process, pytest now ignores builtin attributes (like __class__, __delattr__ and __new__) without consulting the python_classes and python_functions configuration options and without passing them to plugins using the pytest_pycollect_makeitem <_pytest.hookspec.pytest_pycollect_makeitem> hook.

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.0.2

pytest 6.0.2 (2020-09-04)

Bug Fixes

#7148: Fixed --log-cli potentially causing unrelated print output to be swallowed.
#7672: Fixed log-capturing level restored incorrectly if caplog.set_level is called more than once.
#7686: Fixed NotSetType.token being used as the parameter ID when the parametrization list is empty. Regressed in pytest 6.0.0.
#7707: Fix internal error when handling some exceptions that contain multiple lines or the style uses multiple lines (--tb=line for example).

- Python
Published by nicoddemus over 5 years ago

pytest - 6.0.0rc1

pytest 6.0.0rc1 (2020-07-08)

Breaking Changes

#1316: TestReport.longrepr is now always an instance of ReprExceptionInfo. Previously it was a str when a test failed with pytest.fail(..., pytrace=False).
#5965: symlinks are no longer resolved during collection and matching conftest.py files with test file paths.

Resolving symlinks for the current directory and during collection was introduced as a bugfix in 3.9.0, but it actually is a new feature which had unfortunate consequences in Windows and surprising results in other platforms.

The team decided to step back on resolving symlinks at all, planning to review this in the future with a more solid solution (see discussion in #6523 for details).

This might break test suites which made use of this feature; the fix is to create a symlink for the entire test tree, and not only to partial files/tress as it was possible previously.
#6505: Testdir.run().parseoutcomes() now always returns the parsed nouns in plural form.

Originally parseoutcomes() would always returns the nouns in plural form, but a change meant to improve the terminal summary by using singular form single items (1 warning or 1 error) caused an unintended regression by changing the keys returned by parseoutcomes().

Now the API guarantees to always return the plural form, so calls like this:

{.sourceCode .python} result = testdir.runpytest() result.assert_outcomes(error=1)

Need to be changed to:

{.sourceCode .python} result = testdir.runpytest() result.assert_outcomes(errors=1)
#6903: The os.dup() function is now assumed to exist. We are not aware of any supported Python 3 implementations which do not provide it.
#7040: -k no longer matches against the names of the directories outside the test session root.

Also, pytest.Package.name is now just the name of the directory containing the package's __init__.py file, instead of the full path. This is consistent with how the other nodes are named, and also one of the reasons why -k would match against any directory containing the test suite.
#7122: Expressions given to the -m and -k options are no longer evaluated using Python's eval. The format supports or, and, not, parenthesis and general identifiers to match against. Python constants, keywords or other operators are no longer evaluated differently.
#7135: Pytest now uses its own TerminalWriter class instead of using the one from the py library. Plugins generally access this class through TerminalReporter.writer, TerminalReporter.write() (and similar methods), or _pytest.config.create_terminal_writer().

The following breaking changes were made:
- Output (write() method and others) no longer flush implicitly; the flushing behavior of the underlying file is respected. To flush explicitly (for example, if you want output to be shown before an end-of-line is printed), use write(flush=True) or terminal_writer.flush().
- Explicit Windows console support was removed, delegated to the colorama library.
- Support for writing bytes was removed.
- The reline method and chars_on_current_line property were removed.
- The stringio and encoding arguments was removed.
- Support for passing a callable instead of a file was removed.
#7224: The item.catch_log_handler and item.catch_log_handlers attributes, set by the logging plugin and never meant to be public , are no longer available.

The deprecated --no-print-logs option is removed. Use --show-capture instead.
#7226: Removed the unused args parameter from pytest.Function.__init__.
#7418: Removed the pytest_doctest_prepare_content hook specification. This hook hasn't been triggered by pytest for at least 10 years.
#7438: Some changes were made to the internal _pytest._code.source, listed here for the benefit of plugin authors who may be using it:
- The deindent argument to Source() has been removed, now it is always true.
- Support for zero or multiple arguments to Source() has been removed.
- Support for comparing Source with an str has been removed.
- The methods Source.isparseable() and Source.putaround() have been removed.
- The method Source.compile() and function _pytest._code.compile() have been removed; use plain compile() instead.
- The function _pytest._code.source.getsource() has been removed; use Source() directly instead.

Deprecations

#7210: The special -k '-expr' syntax to -k is deprecated. Use -k 'not expr' instead.

The special -k 'expr:' syntax to -k is deprecated. Please open an issue if you use this and want a replacement.
#4049: pytest_warning_captured is deprecated in favor of the pytest_warning_recorded hook.

Features

#1556: pytest now supports pyproject.toml files for configuration.

The configuration options is similar to the one available in other formats, but must be defined in a [tool.pytest.ini_options] table to be picked up by pytest:

``` {.sourceCode .toml}

pyproject.toml

[tool.pytest.ini_options] minversion = "6.0" addopts = "-ra -q" testpaths = [ "tests", "integration", ] ```

More information can be found in the docs.
#3342: pytest now includes inline type annotations and exposes them to user programs. Most of the user-facing API is covered, as well as internal code.

If you are running a type checker such as mypy on your tests, you may start noticing type errors indicating incorrect usage. If you run into an error that you believe to be incorrect, please let us know in an issue.

The types were developed against mypy version 0.780. Versions before 0.750 are known not to work. We recommend using the latest version. Other type checkers may work as well, but they are not officially verified to work by pytest yet.
#4049: Introduced a new hook named pytest_warning_recorded to convey information about warnings captured by the internal pytest warnings plugin.

This hook is meant to replace pytest_warning_captured, which is deprecated and will be removed in a future release.
#6471: New command-line flags:
- `--no-header`: disables the initial header, including platform, version, and plugins.
- `--no-summary`: disables the final test summary, including warnings.
#6856: A warning is now shown when an unknown key is read from a config INI file.

The --strict-config flag has been added to treat these warnings as errors.
#6906: Added --code-highlight command line option to enable/disable code highlighting in terminal output.
#7245: New --import-mode=importlib option that uses importlib to import test modules.

Traditionally pytest used __import__ while changing sys.path to import test modules (which also changes sys.modules as a side-effect), which works but has a number of drawbacks, like requiring test modules that don't live in packages to have unique names (as they need to reside under a unique name in sys.modules).

--import-mode=importlib uses more fine grained import mechanisms from importlib which don't require pytest to change sys.path or sys.modules at all, eliminating much of the drawbacks of the previous mode.

We intend to make --import-mode=importlib the default in future versions, so users are encouraged to try the new mode and provide feedback (both positive or negative) in issue #7245.

You can read more about this option in the documentation.
#7305: New required_plugins configuration option allows the user to specify a list of plugins, including version information, that are required for pytest to run. An error is raised if any required plugins are not found when running pytest.

Improvements

#4375: The pytest command now suppresses the BrokenPipeError error message that is printed to stderr when the output of pytest is piped and and the pipe is closed by the piped-to program (common examples are less and head).
#4391: Improved precision of test durations measurement. CallInfo items now have a new <CallInfo>.duration attribute, created using time.perf_counter(). This attribute is used to fill the <TestReport>.duration attribute, which is more accurate than the previous <CallInfo>.stop - <CallInfo>.start (as these are based on time.time()).
#4675: Rich comparison for dataclasses and attrs-classes is now recursive.
#6285: Exposed the pytest.FixtureLookupError exception which is raised by request.getfixturevalue() (where request is a FixtureRequest fixture) when a fixture with the given name cannot be returned.
#6433: If an error is encountered while formatting the message in a logging call, for example logging.warning("oh no!: %s: %s", "first") (a second argument is missing), pytest now propagates the error, likely causing the test to fail.

Previously, such a mistake would cause an error to be printed to stderr, which is not displayed by default for passing tests. This change makes the mistake visible during testing.

You may supress this behavior temporarily or permanently by setting logging.raiseExceptions = False.
#6817: Explicit new-lines in help texts of command-line options are preserved, allowing plugins better control of the help displayed to users.
#6940: When using the --duration option, the terminal message output is now more precise about the number and duration of hidden items.
#6991: Collected files are displayed after any reports from hooks, e.g. the status from --lf.
#7091: When fd capturing is used, through --capture=fd or the capfd and capfdbinary fixtures, and the file descriptor (0, 1, 2) cannot be duplicated, FD capturing is still performed. Previously, direct writes to the file descriptors would fail or be lost in this case.
#7119: Exit with an error if the --basetemp argument is empty, is the current working directory or is one of the parent directories. This is done to protect against accidental data loss, as any directory passed to this argument is cleared.
#7128: pytest --version now displays just the pytest version, while pytest --version --version displays more verbose information including plugins. This is more consistent with how other tools show --version.
#7133: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> will now override any log_level set via the CLI or configuration file.
#7159: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> and caplog.at_level() <_pytest.logging.LogCaptureFixture.at_level> no longer affect the level of logs that are shown in the Captured log report report section.
#7348: Improve recursive diff report for comparison asserts on dataclasses / attrs.
#7385: --junitxml now includes the exception cause in the message XML attribute for failures during setup and teardown.

Previously:

{.sourceCode .xml} <error message="test setup failure">

Now:

{.sourceCode .xml} <error message="failed on setup with "ValueError: Some error during setup"">

Bug Fixes

#1120: Fix issue where directories from tmpdir are not removed properly when multiple instances of pytest are running in parallel.
#4583: Prevent crashing and provide a user-friendly error when a marker expression (-m) invoking of eval raises any exception.
#4677: The path shown in the summary report for SKIPPED tests is now always relative. Previously it was sometimes absolute.
#5456: Fix a possible race condition when trying to remove lock files used to control access to folders created by tmp_path and tmpdir.
#6240: Fixes an issue where logging during collection step caused duplication of log messages to stderr.
#6428: Paths appearing in error messages are now correct in case the current working directory has changed since the start of the session.
#6755: Support deleting paths longer than 260 characters on windows created inside tmpdir.
#6871: Fix crash with captured output when using capsysbinary.
#6909: Revert the change introduced by #6330, which required all arguments to @pytest.mark.parametrize to be explicitly defined in the function signature.

The intention of the original change was to remove what was expected to be an unintended/surprising behavior, but it turns out many people relied on it, so the restriction has been reverted.
#6910: Fix crash when plugins return an unknown stats while using the --reportlog option.
#6924: Ensure a unittest.IsolatedAsyncioTestCase is actually awaited.
#6925: Fix TerminalRepr instances to be hashable again.
#6947: Fix regression where functions registered with unittest.TestCase.addCleanup were not being called on test failures.
#6951: Allow users to still set the deprecated TerminalReporter.writer attribute.
#6956: Prevent pytest from printing ConftestImportFailure traceback to stdout.
#6991: Fix regressions with --lf filtering too much since pytest 5.4.
#6992: Revert "tmpdir: clean up indirection via config for factories" #6767 as it breaks pytest-xdist.
#7061: When a yielding fixture fails to yield a value, report a test setup error instead of crashing.
#7076: The path of file skipped by @pytest.mark.skip in the SKIPPED report is now relative to invocation directory. Previously it was relative to root directory.
#7110: Fixed regression: asyncbase.TestCase tests are executed correctly again.
#7126: --setup-show now doesn't raise an error when a bytes value is used as a parametrize parameter when Python is called with the -bb flag.
#7143: Fix pytest.File.from_parent so it forwards extra keyword arguments to the constructor.
#7145: Classes with broken __getattribute__ methods are displayed correctly during failures.
#7150: Prevent hiding the underlying exception when ConfTestImportFailure is raised.
#7180: Fix _is_setup_py for files encoded differently than locale.
#7215: Fix regression where running with --pdb would call unittest.TestCase.tearDown for skipped tests.
#7253: When using pytest.fixture on a function directly, as in pytest.fixture(func), if the autouse or params arguments are also passed, the function is no longer ignored, but is marked as a fixture.
#7360: Fix possibly incorrect evaluation of string expressions passed to pytest.mark.skipif and pytest.mark.xfail, in rare circumstances where the exact same string is used but refers to different global values.
#7383: Fixed exception causes all over the codebase, i.e. use raise new_exception from old_exception when wrapping an exception.

Improved Documentation

#7202: The development guide now links to the contributing section of the docs and RELEASING.rst on GitHub.
#7233: Add a note about --strict and --strict-markers and the preference for the latter one.
#7345: Explain indirect parametrization and markers for fixtures.

Trivial/Internal Changes

#7035: The originalname attribute of _pytest.python.Function now defaults to name if not provided explicitly, and is always set.
#7264: The dependency on the wcwidth package has been removed.
#7291: Replaced py.iniconfig with iniconfig.
#7295: src/_pytest/config/__init__.py now uses the warnings module to report warnings instead of sys.stderr.write.
#7356: Remove last internal uses of deprecated slave term from old pytest-xdist.
#7357: py>=1.8.2 is now required.

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.0.1

pytest 6.0.1 (2020-07-30)

Bug Fixes

#7394: Passing an empty help value to Parser.add_option is now accepted instead of crashing when running pytest --help. Passing None raises a more informative TypeError.
#7558: Fix pylint not-callable lint on pytest.mark.parametrize() and the other builtin marks: skip, skipif, xfail, usefixtures, filterwarnings.
#7559: Fix regression in plugins using TestReport.longreprtext (such as pytest-html) when TestReport.longrepr is not a string.
#7569: Fix logging capture handler's level not reset on teardown after a call to caplog.set_level().

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/6.0.0

pytest 6.0.0 (2020-07-28)

(Please see the full set of changes for this release also in the 6.0.0rc1 notes below)

Breaking Changes

#5584: PytestDeprecationWarning are now errors by default.

Following our plan to remove deprecated features with as little disruption as possible, all warnings of type PytestDeprecationWarning now generate errors instead of warning messages.

The affected features will be effectively removed in pytest 6.1, so please consult the Deprecations and Removals section in the docs for directions on how to update existing code.

In the pytest 6.0.X series, it is possible to change the errors back into warnings as a stopgap measure by adding this to your pytest.ini file:

{.sourceCode .ini} [pytest] filterwarnings = ignore::pytest.PytestDeprecationWarning

But this will stop working when pytest 6.1 is released.

If you have concerns about the removal of a specific feature, please add a comment to #5584.
#7472: The exec_() and is_true() methods of _pytest._code.Frame have been removed.

Features

#7464: Added support for NO_COLOR and FORCE_COLOR environment variables to control colored output.

Improvements

#7467: --log-file CLI option and log_file ini marker now create subdirectories if needed.
#7489: The pytest.raises function has a clearer error message when match equals the obtained string but is not a regex match. In this case it is suggested to escape the regex.

Bug Fixes

#7392: Fix the reported location of tests skipped with @pytest.mark.skip when --runxfail is used.
#7491: tmpdir and tmp_path no longer raise an error if the lock to check for stale temporary directories is not accessible.
#7517: Preserve line endings when captured via capfd.
#7534: Restored the previous formatting of TracebackEntry.__str__ which was changed by accident.

Improved Documentation

#7422: Clarified when the usefixtures mark can apply fixtures to test.
#7441: Add a note about -q option used in getting started guide.

Trivial/Internal Changes

#7389: Fixture scope package is no longer considered experimental.

pytest 6.0.0rc1 (2020-07-08)

Breaking Changes

#1316: TestReport.longrepr is now always an instance of ReprExceptionInfo. Previously it was a str when a test failed with pytest.fail(..., pytrace=False).
#5965: symlinks are no longer resolved during collection and matching conftest.py files with test file paths.

Resolving symlinks for the current directory and during collection was introduced as a bugfix in 3.9.0, but it actually is a new feature which had unfortunate consequences in Windows and surprising results in other platforms.

The team decided to step back on resolving symlinks at all, planning to review this in the future with a more solid solution (see discussion in #6523 for details).

This might break test suites which made use of this feature; the fix is to create a symlink for the entire test tree, and not only to partial files/tress as it was possible previously.
#6505: Testdir.run().parseoutcomes() now always returns the parsed nouns in plural form.

Originally parseoutcomes() would always returns the nouns in plural form, but a change meant to improve the terminal summary by using singular form single items (1 warning or 1 error) caused an unintended regression by changing the keys returned by parseoutcomes().

Now the API guarantees to always return the plural form, so calls like this:

{.sourceCode .python} result = testdir.runpytest() result.assert_outcomes(error=1)

Need to be changed to:

{.sourceCode .python} result = testdir.runpytest() result.assert_outcomes(errors=1)
#6903: The os.dup() function is now assumed to exist. We are not aware of any supported Python 3 implementations which do not provide it.
#7040: -k no longer matches against the names of the directories outside the test session root.

Also, pytest.Package.name is now just the name of the directory containing the package's __init__.py file, instead of the full path. This is consistent with how the other nodes are named, and also one of the reasons why -k would match against any directory containing the test suite.
#7122: Expressions given to the -m and -k options are no longer evaluated using Python's eval. The format supports or, and, not, parenthesis and general identifiers to match against. Python constants, keywords or other operators are no longer evaluated differently.
#7135: Pytest now uses its own TerminalWriter class instead of using the one from the py library. Plugins generally access this class through TerminalReporter.writer, TerminalReporter.write() (and similar methods), or _pytest.config.create_terminal_writer().

The following breaking changes were made:
- Output (write() method and others) no longer flush implicitly; the flushing behavior of the underlying file is respected. To flush explicitly (for example, if you want output to be shown before an end-of-line is printed), use write(flush=True) or terminal_writer.flush().
- Explicit Windows console support was removed, delegated to the colorama library.
- Support for writing bytes was removed.
- The reline method and chars_on_current_line property were removed.
- The stringio and encoding arguments was removed.
- Support for passing a callable instead of a file was removed.
#7224: The item.catch_log_handler and item.catch_log_handlers attributes, set by the logging plugin and never meant to be public , are no longer available.

The deprecated --no-print-logs option is removed. Use --show-capture instead.
#7226: Removed the unused args parameter from pytest.Function.__init__.
#7418: Removed the pytest_doctest_prepare_content hook specification. This hook hasn't been triggered by pytest for at least 10 years.
#7438: Some changes were made to the internal _pytest._code.source, listed here for the benefit of plugin authors who may be using it:
- The deindent argument to Source() has been removed, now it is always true.
- Support for zero or multiple arguments to Source() has been removed.
- Support for comparing Source with an str has been removed.
- The methods Source.isparseable() and Source.putaround() have been removed.
- The method Source.compile() and function _pytest._code.compile() have been removed; use plain compile() instead.
- The function _pytest._code.source.getsource() has been removed; use Source() directly instead.

Deprecations

#7210: The special -k '-expr' syntax to -k is deprecated. Use -k 'not expr' instead.

The special -k 'expr:' syntax to -k is deprecated. Please open an issue if you use this and want a replacement.
#4049: pytest_warning_captured is deprecated in favor of the pytest_warning_recorded hook.

Features

#1556: pytest now supports pyproject.toml files for configuration.

The configuration options is similar to the one available in other formats, but must be defined in a [tool.pytest.ini_options] table to be picked up by pytest:

``` {.sourceCode .toml}

pyproject.toml

[tool.pytest.ini_options] minversion = "6.0" addopts = "-ra -q" testpaths = [ "tests", "integration", ] ```

More information can be found in the docs.
#3342: pytest now includes inline type annotations and exposes them to user programs. Most of the user-facing API is covered, as well as internal code.

If you are running a type checker such as mypy on your tests, you may start noticing type errors indicating incorrect usage. If you run into an error that you believe to be incorrect, please let us know in an issue.

The types were developed against mypy version 0.780. Versions before 0.750 are known not to work. We recommend using the latest version. Other type checkers may work as well, but they are not officially verified to work by pytest yet.
#4049: Introduced a new hook named pytest_warning_recorded to convey information about warnings captured by the internal pytest warnings plugin.

This hook is meant to replace pytest_warning_captured, which is deprecated and will be removed in a future release.
#6471: New command-line flags:
- `--no-header`: disables the initial header, including platform, version, and plugins.
- `--no-summary`: disables the final test summary, including warnings.
#6856: A warning is now shown when an unknown key is read from a config INI file.

The --strict-config flag has been added to treat these warnings as errors.
#6906: Added --code-highlight command line option to enable/disable code highlighting in terminal output.
#7245: New --import-mode=importlib option that uses importlib to import test modules.

Traditionally pytest used __import__ while changing sys.path to import test modules (which also changes sys.modules as a side-effect), which works but has a number of drawbacks, like requiring test modules that don't live in packages to have unique names (as they need to reside under a unique name in sys.modules).

--import-mode=importlib uses more fine grained import mechanisms from importlib which don't require pytest to change sys.path or sys.modules at all, eliminating much of the drawbacks of the previous mode.

We intend to make --import-mode=importlib the default in future versions, so users are encouraged to try the new mode and provide feedback (both positive or negative) in issue #7245.

You can read more about this option in the documentation.
#7305: New required_plugins configuration option allows the user to specify a list of plugins, including version information, that are required for pytest to run. An error is raised if any required plugins are not found when running pytest.

Improvements

#4375: The pytest command now suppresses the BrokenPipeError error message that is printed to stderr when the output of pytest is piped and and the pipe is closed by the piped-to program (common examples are less and head).
#4391: Improved precision of test durations measurement. CallInfo items now have a new <CallInfo>.duration attribute, created using time.perf_counter(). This attribute is used to fill the <TestReport>.duration attribute, which is more accurate than the previous <CallInfo>.stop - <CallInfo>.start (as these are based on time.time()).
#4675: Rich comparison for dataclasses and attrs-classes is now recursive.
#6285: Exposed the pytest.FixtureLookupError exception which is raised by request.getfixturevalue() (where request is a FixtureRequest fixture) when a fixture with the given name cannot be returned.
#6433: If an error is encountered while formatting the message in a logging call, for example logging.warning("oh no!: %s: %s", "first") (a second argument is missing), pytest now propagates the error, likely causing the test to fail.

Previously, such a mistake would cause an error to be printed to stderr, which is not displayed by default for passing tests. This change makes the mistake visible during testing.

You may supress this behavior temporarily or permanently by setting logging.raiseExceptions = False.
#6817: Explicit new-lines in help texts of command-line options are preserved, allowing plugins better control of the help displayed to users.
#6940: When using the --duration option, the terminal message output is now more precise about the number and duration of hidden items.
#6991: Collected files are displayed after any reports from hooks, e.g. the status from --lf.
#7091: When fd capturing is used, through --capture=fd or the capfd and capfdbinary fixtures, and the file descriptor (0, 1, 2) cannot be duplicated, FD capturing is still performed. Previously, direct writes to the file descriptors would fail or be lost in this case.
#7119: Exit with an error if the --basetemp argument is empty, is the current working directory or is one of the parent directories. This is done to protect against accidental data loss, as any directory passed to this argument is cleared.
#7128: pytest --version now displays just the pytest version, while pytest --version --version displays more verbose information including plugins. This is more consistent with how other tools show --version.
#7133: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> will now override any log_level set via the CLI or configuration file.
#7159: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> and caplog.at_level() <_pytest.logging.LogCaptureFixture.at_level> no longer affect the level of logs that are shown in the Captured log report report section.
#7348: Improve recursive diff report for comparison asserts on dataclasses / attrs.
#7385: --junitxml now includes the exception cause in the message XML attribute for failures during setup and teardown.

Previously:

{.sourceCode .xml} <error message="test setup failure">

Now:

{.sourceCode .xml} <error message="failed on setup with "ValueError: Some error during setup"">

Bug Fixes

#1120: Fix issue where directories from tmpdir are not removed properly when multiple instances of pytest are running in parallel.
#4583: Prevent crashing and provide a user-friendly error when a marker expression (-m) invoking of eval raises any exception.
#4677: The path shown in the summary report for SKIPPED tests is now always relative. Previously it was sometimes absolute.
#5456: Fix a possible race condition when trying to remove lock files used to control access to folders created by tmp_path and tmpdir.
#6240: Fixes an issue where logging during collection step caused duplication of log messages to stderr.
#6428: Paths appearing in error messages are now correct in case the current working directory has changed since the start of the session.
#6755: Support deleting paths longer than 260 characters on windows created inside tmpdir.
#6871: Fix crash with captured output when using capsysbinary.
#6909: Revert the change introduced by #6330, which required all arguments to @pytest.mark.parametrize to be explicitly defined in the function signature.

The intention of the original change was to remove what was expected to be an unintended/surprising behavior, but it turns out many people relied on it, so the restriction has been reverted.
#6910: Fix crash when plugins return an unknown stats while using the --reportlog option.
#6924: Ensure a unittest.IsolatedAsyncioTestCase is actually awaited.
#6925: Fix TerminalRepr instances to be hashable again.
#6947: Fix regression where functions registered with unittest.TestCase.addCleanup were not being called on test failures.
#6951: Allow users to still set the deprecated TerminalReporter.writer attribute.
#6956: Prevent pytest from printing ConftestImportFailure traceback to stdout.
#6991: Fix regressions with --lf filtering too much since pytest 5.4.
#6992: Revert "tmpdir: clean up indirection via config for factories" #6767 as it breaks pytest-xdist.
#7061: When a yielding fixture fails to yield a value, report a test setup error instead of crashing.
#7076: The path of file skipped by @pytest.mark.skip in the SKIPPED report is now relative to invocation directory. Previously it was relative to root directory.
#7110: Fixed regression: asyncbase.TestCase tests are executed correctly again.
#7126: --setup-show now doesn't raise an error when a bytes value is used as a parametrize parameter when Python is called with the -bb flag.
#7143: Fix pytest.File.from_parent so it forwards extra keyword arguments to the constructor.
#7145: Classes with broken __getattribute__ methods are displayed correctly during failures.
#7150: Prevent hiding the underlying exception when ConfTestImportFailure is raised.
#7180: Fix _is_setup_py for files encoded differently than locale.
#7215: Fix regression where running with --pdb would call unittest.TestCase.tearDown for skipped tests.
#7253: When using pytest.fixture on a function directly, as in pytest.fixture(func), if the autouse or params arguments are also passed, the function is no longer ignored, but is marked as a fixture.
#7360: Fix possibly incorrect evaluation of string expressions passed to pytest.mark.skipif and pytest.mark.xfail, in rare circumstances where the exact same string is used but refers to different global values.
#7383: Fixed exception causes all over the codebase, i.e. use raise new_exception from old_exception when wrapping an exception.

Improved Documentation

#7202: The development guide now links to the contributing section of the docs and RELEASING.rst on GitHub.
#7233: Add a note about --strict and --strict-markers and the preference for the latter one.
#7345: Explain indirect parametrization and markers for fixtures.

Trivial/Internal Changes

#7035: The originalname attribute of _pytest.python.Function now defaults to name if not provided explicitly, and is always set.
#7264: The dependency on the wcwidth package has been removed.
#7291: Replaced py.iniconfig with iniconfig.
#7295: src/_pytest/config/__init__.py now uses the warnings module to report warnings instead of sys.stderr.write.
#7356: Remove last internal uses of deprecated slave term from old pytest-xdist.
#7357: py>=1.8.2 is now required.

- Python
Published by nicoddemus over 5 years ago

pytest - pytest 4.6.11 (2020-06-04)

Bug Fixes

#6334: Fix summary entries appearing twice when f/F and s/S report chars were used at the same time in the -r command-line option (for example -rFf).

The upper case variants were never documented and the preferred form should be the lower case.

#7310: Fix UnboundLocalError: local variable 'letter' referenced before assignment in _pytest.terminal.pytest_report_teststatus() when plugins return report objects in an unconventional state.

This was making pytest_report_teststatus() skip entering if-block branches that declare the letter variable.

The fix was to set the initial value of the letter before the if-block cascade so that it always has a value.

- Python
Published by nicoddemus over 5 years ago

pytest - pytest 4.6.10 (2020-05-08)

6870: New Config.invocation_args attribute containing the unchanged arguments passed to pytest.main().

Remark: while this is technically a new feature and according to our policy it should not have been backported, we have opened an exception in this particular case because it fixes a serious interaction with pytest-xdist, so it can also be considered a bugfix.

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.4.3

pytest 5.4.3 (2020-06-02)

Bug Fixes

#6428: Paths appearing in error messages are now correct in case the current working directory has changed since the start of the session.
#6755: Support deleting paths longer than 260 characters on windows created inside tmpdir.
#6956: Prevent pytest from printing ConftestImportFailure traceback to stdout.
#7150: Prevent hiding the underlying exception when ConfTestImportFailure is raised.
#7215: Fix regression where running with --pdb would call the tearDown methods of unittest.TestCase subclasses for skipped tests.

- Python
Published by nicoddemus over 5 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.4.2

pytest 5.4.2 (2020-05-08)

Bug Fixes

#6871: Fix crash with captured output when using the capsysbinary fixture <capsysbinary>.
#6924: Ensure a unittest.IsolatedAsyncioTestCase is actually awaited.
#6925: Fix TerminalRepr instances to be hashable again.
#6947: Fix regression where functions registered with TestCase.addCleanup were not being called on test failures.
#6951: Allow users to still set the deprecated TerminalReporter.writer attribute.
#6992: Revert "tmpdir: clean up indirection via config for factories" #6767 as it breaks pytest-xdist.
#7110: Fixed regression: asyncbase.TestCase tests are executed correctly again.
#7143: Fix File.from_constructor so it forwards extra keyword arguments to the constructor.
#7145: Classes with broken __getattribute__ methods are displayed correctly during failures.
#7180: Fix _is_setup_py for files encoded differently than locale.

- Python
Published by nicoddemus almost 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.4.1

pytest 5.4.1 (2020-03-13)

Bug Fixes

#6909: Revert the change introduced by #6330, which required all arguments to @pytest.mark.parametrize to be explicitly defined in the function signature.

The intention of the original change was to remove what was expected to be an unintended/surprising behavior, but it turns out many people relied on it, so the restriction has been reverted.
#6910: Fix crash when plugins return an unknown stats while using the --reportlog option.

- Python
Published by nicoddemus almost 6 years ago

pytest - pytest 5.4.0 (2020-03-12)

Breaking Changes

#6316: Matching of -k EXPRESSION to test names is now case-insensitive.
#6443: Plugins specified with -p are now loaded after internal plugins, which results in their hooks being called before the internal ones.

This makes the -p behavior consistent with PYTEST_PLUGINS.
#6637: Removed the long-deprecated pytest_itemstart hook.

This hook has been marked as deprecated and not been even called by pytest for over 10 years now.
#6673: Reversed / fix meaning of \"+/-\" in error diffs. \"-\" means that sth. expected is missing in the result and \"+\" means that there are unexpected extras in the result.
#6737: The cached_result attribute of FixtureDef is now set to None when the result is unavailable, instead of being deleted.

If your plugin performs checks like hasattr(fixturedef, 'cached_result'), for example in a pytest_fixture_post_finalizer hook implementation, replace it with fixturedef.cached_result is not None. If you del the attribute, set it to None instead.

Deprecations

#3238: Option --no-print-logs is deprecated and meant to be removed in a future release. If you use --no-print-logs, please try out --show-capture and provide feedback.

--show-capture command-line option was added in pytest 3.5.0 and allows to specify how to display captured output when tests fail: no, stdout, stderr, log or all (the default).
#571: Deprecate the unused/broken [pytest_collect_directory]{.title-ref} hook. It was misaligned since the removal of the Directory collector in 2010 and incorrect/unusable as soon as collection was split from test execution.
#5975: Deprecate using direct constructors for Nodes.

Instead they are new constructed via Node.from_parent.

This transitional mechanism enables us to detangle the very intensely entangled Node relationships by enforcing more controlled creation/configruation patterns.

As part of that session/config are already disallowed parameters and as we work on the details we might need disallow a few more as well.

Subclasses are expected to use [super().from_parent]{.title-ref} if they intend to expand the creation of [Nodes]{.title-ref}.
#6779: The TerminalReporter.writer attribute has been deprecated and should no longer be used. This was inadvertently exposed as part of the public API of that plugin and ties it too much with py.io.TerminalWriter.

Features

#4597: New --capture=tee-sys <capture-method>{.interpreted-text role="ref"} option to allow both live printing and capturing of test output.
#5712: Now all arguments to @pytest.mark.parametrize need to be explicitly declared in the function signature or via indirect. Previously it was possible to omit an argument if a fixture with the same name existed, which was just an accident of implementation and was not meant to be a part of the API.
#6454: Changed default for [-r]{.title-ref} to [fE]{.title-ref}, which displays failures and errors in the short test summary <pytest.detailed_failed_tests_usage>{.interpreted-text role="ref"}. [-rN]{.title-ref} can be used to disable it (the old behavior).
#6469: New options have been added to the junit_logging{.interpreted-text role="confval"} option: log, out-err, and all.
#6834: Excess warning summaries are now collapsed per file to ensure readable display of warning summaries.

Improvements

#1857: pytest.mark.parametrize accepts integers for ids again, converting it to strings.
#449: Use \"yellow\" main color with any XPASSED tests.
#4639: Revert \"A warning is now issued when assertions are made for None\".

The warning proved to be less useful than initially expected and had quite a few false positive cases.
#5686: tmpdir_factory.mktemp now fails when given absolute and non-normalized paths.
#5984: The pytest_warning_captured hook now receives a location parameter with the code location that generated the warning.
#6213: pytester: the testdir fixture respects environment settings from the monkeypatch fixture for inner runs.
#6247: --fulltrace is honored with collection errors.
#6384: Make [--showlocals]{.title-ref} work also with [--tb=short]{.title-ref}.
#6653: Add support for matching lines consecutively with LineMatcher <_pytest.pytester.LineMatcher>{.interpreted-text role="attr"}\'s ~_pytest.pytester.LineMatcher.fnmatch_lines{.interpreted-text role="func"} and ~_pytest.pytester.LineMatcher.re_match_lines{.interpreted-text role="func"}.
#6658: Code is now highlighted in tracebacks when pygments is installed.

Users are encouraged to install pygments into their environment and provide feedback, because the plan is to make pygments a regular dependency in the future.
#6795: Import usage error message with invalid [-o]{.title-ref} option.
#759: pytest.mark.parametrize supports iterators and generators for ids.

Bug Fixes

#310: Add support for calling [pytest.xfail()]{.title-ref} and [pytest.importorskip()]{.title-ref} with doctests.
#3823: --trace now works with unittests.
#4445: Fixed some warning reports produced by pytest to point to the correct location of the warning in the user\'s code.
#5301: Fix --last-failed to collect new tests from files with known failures.
#5928: Report PytestUnknownMarkWarning at the level of the user\'s code, not pytest\'s.
#5991: Fix interaction with --pdb and unittests: do not use unittest\'s TestCase.debug().
#6334: Fix summary entries appearing twice when f/F and s/S report chars were used at the same time in the -r command-line option (for example -rFf).

The upper case variants were never documented and the preferred form should be the lower case.
#6409: Fallback to green (instead of yellow) for non-last items without previous passes with colored terminal progress indicator.
#6454: [--disable-warnings]{.title-ref} is honored with [-ra]{.title-ref} and [-rA]{.title-ref}.
#6497: Fix bug in the comparison of request key with cached key in fixture.

A construct if key == cached_key: can fail either because == is explicitly disallowed, or for, e.g., NumPy arrays, where the result of a == b cannot generally be converted to [bool]{.title-ref}. The implemented fix replaces [==]{.title-ref} with is.
#6557: Make capture output streams .write() method return the same return value from original streams.
#6566: Fix EncodedFile.writelines to call the underlying buffer\'s writelines method.
#6575: Fix internal crash when faulthandler starts initialized (for example with PYTHONFAULTHANDLER=1 environment variable set) and faulthandler_timeout defined in the configuration file.
#6597: Fix node ids which contain a parametrized empty-string variable.
#6646: Assertion rewriting hooks are (re)stored for the current item, which fixes them being still used after e.g. pytester\'s testdir.runpytest <_pytest.pytester.Testdir.runpytest>{.interpreted-text role="func"} etc.
#6660: pytest.exit() <_pytest.outcomes.exit>{.interpreted-text role="func"} is handled when emitted from the pytest_sessionfinish <_pytest.hookspec.pytest_sessionfinish>{.interpreted-text role="func"} hook. This includes quitting from a debugger.
#6752: When :pypytest.raises{.interpreted-text role="func"} is used as a function (as opposed to a context manager), a [match]{.title-ref} keyword argument is now passed through to the tested function. Previously it was swallowed and ignored (regression in pytest 5.1.0).
#6801: Do not display empty lines inbetween traceback for unexpected exceptions with doctests.
#6802: The testdir fixture <testdir>{.interpreted-text role="fixture"} works within doctests now.

Improved Documentation

#6696: Add list of fixtures to start of fixture chapter.
#6742: Expand first sentence on fixtures into a paragraph.

Trivial/Internal Changes

#6404: Remove usage of parser module, deprecated in Python 3.9.

- Python
Published by RonnyPfannschmidt almost 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.3.5

pytest 5.3.5 (2020-01-29)

Bug Fixes

#6517: Fix regression in pytest 5.3.4 causing an INTERNALERROR due to a wrong assertion.

- Python
Published by nicoddemus about 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.3.4

pytest 5.3.4 (2020-01-20)

Bug Fixes

#6496: Revert #6436: unfortunately this change has caused a number of regressions in many suites, so the team decided to revert this change and make a new release while we continue to look for a solution.

- Python
Published by nicoddemus about 6 years ago

pytest - 5.3.3

pytest 5.3.3 (2020-01-16)

Bug Fixes

#2780: Captured output during teardown is shown with -rP.
#5971: Fix a pytest-xdist crash when dealing with exceptions raised in subprocesses created by the multiprocessing module.
#6436: FixtureDef <_pytest.fixtures.FixtureDef> objects now properly register their finalizers with autouse and parameterized fixtures that execute before them in the fixture stack so they are torn down at the right times, and in the right order.
#6532: Fix parsing of outcomes containing multiple errors with testdir results (regression in 5.3.0).

Trivial/Internal Changes

#6350: Optimized automatic renaming of test parameter IDs.

- Python
Published by nicoddemus about 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/4.6.9

pytest 4.6.9 (2020-01-04)

Bug Fixes

#6301: Fix assertion rewriting for egg-based distributions and editable installs (pip install --editable).

- Python
Published by nicoddemus about 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/4.6.8

pytest 4.6.8 (2019-12-19)

Features

#5471: JUnit XML now includes a timestamp and hostname in the testsuite tag.

Bug Fixes

#5430: junitxml: Logs for failed test are now passed to junit report in case the test fails during call phase.

Trivial/Internal Changes

#6345: Pin colorama to 0.4.1 only for Python 3.4 so newer Python versions can still receive colorama updates.

- Python
Published by nicoddemus about 6 years ago

pytest -

pytest 5.3.2 (2019-12-13)

Improvements

#4639: Revert \"A warning is now issued when assertions are made for None\".

The warning proved to be less useful than initially expected and had quite a few false positive cases.

Bug Fixes

#5430: junitxml: Logs for failed test are now passed to junit report in case the test fails during call phase.
#6290: The supporting files in the .pytest_cache directory are kept with --cache-clear, which only clears cached values now.
#6301: Fix assertion rewriting for egg-based distributions and editable installs (pip install --editable).

- Python
Published by nicoddemus about 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/4.6.7

pytest 4.6.7 (2019-12-05)

Bug Fixes

#5477: The XML file produced by --junitxml now correctly contain a <testsuites> root element.
#6044: Properly ignore FileNotFoundError (OSError.errno == NOENT in Python 2) exceptions when trying to remove old temporary directories, for instance when multiple processes try to remove the same directory (common with pytest-xdist for example).

- Python
Published by nicoddemus about 6 years ago

pytest -

pytest 5.3.1 (2019-11-25)

Improvements

#6231: Improve check for misspelling of pytest.mark.parametrize.
#6257: Handle exit.Exception raised in notify_exception (via pytest_internalerror), e.g. when quitting pdb from post mortem.

Bug Fixes

#5914: pytester: fix no_fnmatch_line when used after positive matching.
#6082: Fix line detection for doctest samples inside property docstrings, as a workaround to bpo-17446.
#6254: Fix compatibility with pytest-parallel (regression in pytest 5.3.0).
#6255: Clear the sys.last_traceback, sys.last_type and sys.last_value attributes by deleting them instead of setting them to None. This better matches the behaviour of the Python standard library.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.3.0

pytest 5.3.0 (2019-11-19)

Deprecations

#6179: The default value of junit_family option will change to xunit2 in pytest 6.0, given that this is the version supported by default in modern tools that manipulate this type of file.

In order to smooth the transition, pytest will issue a warning in case the --junitxml option is given in the command line but junit_family is not explicitly configured in pytest.ini.

For more information, see the docs.

Features

#4488: The pytest team has created the pytest-reportlog plugin, which provides a new --report-log=FILE option that writes report logs into a file as the test session executes.

Each line of the report log contains a self contained JSON object corresponding to a testing event, such as a collection or a test result report. The file is guaranteed to be flushed after writing each line, so systems can read and process events in real-time.

The plugin is meant to replace the --resultlog option, which is deprecated and meant to be removed in a future release. If you use --resultlog, please try out pytest-reportlog and provide feedback.
#4730: When sys.pycache_prefix (Python 3.8+) is set, it will be used by pytest to cache test files changed by the assertion rewriting mechanism.

This makes it easier to benefit of cached .pyc files even on file systems without permissions.
#5515: Allow selective auto-indentation of multiline log messages.

Adds command line option --log-auto-indent, config option log_auto_indent and support for per-entry configuration of indentation behavior on calls to logging.log().

Alters the default for auto-indention from on to off. This restores the older behavior that existed prior to v4.6.0. This reversion to earlier behavior was done because it is better to activate new features that may lead to broken tests explicitly rather than implicitly.
#5914: pytester learned two new functions, no_fnmatch_line and no_re_match_line.

The functions are used to ensure the captured text does not match the given pattern.

The previous idiom was to use re.match:

{.sourceCode .python} assert re.match(pat, result.stdout.str()) is None

Or the in operator:

{.sourceCode .python} assert text in result.stdout.str()

But the new functions produce best output on failure.
#6057: Added tolerances to complex values when printing pytest.approx.

For example, repr(pytest.approx(3+4j)) returns (3+4j) ± 5e-06 ∠ ±180°. This is polar notation indicating a circle around the expected value, with a radius of 5e-06. For approx comparisons to return True, the actual value should fall within this circle.
#6061: Added the pluginmanager as an argument to pytest_addoption so that hooks can be invoked when setting up command line options. This is useful for having one plugin communicate things to another plugin, such as default values or which set of command line options to add.

Improvements

#5061: Use multiple colors with terminal summary statistics.
#5630: Quitting from debuggers is now properly handled in doctest items.
#5924: Improved verbose diff output with sequences.

Before:

{.sourceCode .} E AssertionError: assert ['version', '...version_info'] == ['version', '...version', ...] E Right contains 3 more items, first extra item: ' ' E Full diff: E - ['version', 'version_info', 'sys.version', 'sys.version_info'] E + ['version', E + 'version_info', E + 'sys.version', E + 'sys.version_info', E + ' ', E + 'sys.version', E + 'sys.version_info']

After:

{.sourceCode .} E AssertionError: assert ['version', '...version_info'] == ['version', '...version', ...] E Right contains 3 more items, first extra item: ' ' E Full diff: E [ E 'version', E 'version_info', E 'sys.version', E 'sys.version_info', E + ' ', E + 'sys.version', E + 'sys.version_info', E ]
#5936: Display untruncated assertion message with -vv.
#5990: Fixed plurality mismatch in test summary (e.g. display "1 error" instead of "1 errors").
#6008: Config.InvocationParams.args is now always a tuple to better convey that it should be immutable and avoid accidental modifications.
#6023: pytest.main now returns a pytest.ExitCode instance now, except for when custom exit codes are used (where it returns int then still).
#6026: Align prefixes in output of pytester's LineMatcher.
#6059: Collection errors are reported as errors (and not failures like before) in the terminal's short test summary.
#6069: pytester.spawn does not skip/xfail tests on FreeBSD anymore unconditionally.
#6097: The "[XXX%]" indicator in the test summary is now colored according to the final (new) multi-colored line's main color.
#6116: Added --co as a synonym to --collect-only.
#6148: atomicwrites is now only used on Windows, fixing a performance regression with assertion rewriting on Unix.
#6152: Now parametrization will use the __name__ attribute of any object for the id, if present. Previously it would only use __name__ for functions and classes.
#6176: Improved failure reporting with pytester's Hookrecorder.assertoutcome.
#6181: The reason for a stopped session, e.g. with --maxfail / -x, now gets reported in the test summary.
#6206: Improved cache.set robustness and performance.

Bug Fixes

#2049: Fixed --setup-plan showing inaccurate information about fixture lifetimes.
#2548: Fixed line offset mismatch of skipped tests in terminal summary.
#6039: The PytestDoctestRunner is now properly invalidated when unconfiguring the doctest plugin.

This is important when used with pytester's runpytest_inprocess.
#6047: BaseExceptions are now handled in saferepr, which includes pytest.fail.Exception etc.
#6074: pytester: fixed order of arguments in rm_rf warning when cleaning up temporary directories, and do not emit warnings for errors with os.open.
#6189: Fixed result of getmodpath method.

Trivial/Internal Changes

#4901: RunResult from pytester now displays the mnemonic of the ret attribute when it is a valid pytest.ExitCode value.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.2.4

pytest 5.2.4 (2019-11-15)

Bug Fixes

#6194: Fix incorrect discovery of non-test __init__.py files.
#6197: Revert "The first test in a package (__init__.py) marked with @pytest.mark.skip is now correctly skipped.".

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.2.3

pytest 5.2.3 (2019-11-14)

Bug Fixes

#5830: The first test in a package (__init__.py) marked with @pytest.mark.skip is now correctly skipped.
#6099: Fix --trace when used with parametrized functions.
#6183: Using request as a parameter name in @pytest.mark.parametrize now produces a more user-friendly error.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.2.2

pytest 5.2.2 (2019-10-24)

Bug Fixes

#5206: Fix --nf to not forget about known nodeids with partial test selection.
#5906: Fix crash with KeyboardInterrupt during --setup-show.
#5946: Fixed issue when parametrizing fixtures with numpy arrays (and possibly other sequence-like types).
#6044: Properly ignore FileNotFoundError exceptions when trying to remove old temporary directories, for instance when multiple processes try to remove the same directory (common with pytest-xdist for example).

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/4.6.6

pytest 4.6.6 (2019-10-11)

Bug Fixes

#5523: Fixed using multiple short options together in the command-line (for example -vs) in Python 3.8+.
#5537: Replace importlib_metadata backport with importlib.metadata from the standard library on Python 3.8+.
#5806: Fix "lexer" being used when uploading to bpaste.net from --pastebin to "text".
#5902: Fix warnings about deprecated cmp attribute in attrs>=19.2.

Trivial/Internal Changes

#5801: Fixes python version checks (detected by flake8-2020) in case python4 becomes a thing.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.2.1

pytest 5.2.1 (2019-10-06)

Bug Fixes

#5902: Fix warnings about deprecated cmp attribute in attrs>=19.2.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.2.0

pytest 5.2.0 (2019-09-28)

Deprecations

#1682: Passing arguments to pytest.fixture() as positional arguments is deprecated - pass them as a keyword argument instead.

Features

#1682: The scope parameter of @pytest.fixture can now be a callable that receives the fixture name and the config object as keyword-only parameters. See the docs for more information.
#5764: New behavior of the --pastebin option: failures to connect to the pastebin server are reported, without failing the pytest run

Bug Fixes

#5806: Fix "lexer" being used when uploading to bpaste.net from --pastebin to "text".
#5884: Fix --setup-only and --setup-show for custom pytest items.

Trivial/Internal Changes

#5056: The HelpFormatter uses py.io.get_terminal_width for better width detection.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.1.3

pytest 5.1.3 (2019-09-18)

Bug Fixes

#5807: Fix pypy3.6 (nightly) on windows.
#5811: Handle --fulltrace correctly with pytest.raises.
#5819: Windows: Fix regression with conftest whose qualified name contains uppercase characters (introduced by #5792).

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.1.2

pytest 5.1.2 (2019-08-30)

Bug Fixes

#2270: Fixed self reference in function-scoped fixtures defined plugin classes: previously self would be a reference to a test class, not the plugin class.
#570: Fixed long standing issue where fixture scope was not respected when indirect fixtures were used during parametrization.
#5782: Fix decoding error when printing an error response from --pastebin.
#5786: Chained exceptions in test and collection reports are now correctly serialized, allowing plugins like pytest-xdist to display them properly.
#5792: Windows: Fix error that occurs in certain circumstances when loading conftest.py from a working directory that has casing other than the one stored in the filesystem (e.g., c:\test instead of C:\test).

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.1.1

pytest 5.1.1 (2019-08-20)

Bug Fixes

#5751: Fixed TypeError when importing pytest on Python 3.5.0 and 3.5.1.

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.1.0

pytest 5.1.0 (2019-08-15)

Removals

#5180: As per our policy, the following features have been deprecated in the 4.X series and are now removed:
- Request.getfuncargvalue: use Request.getfixturevalue instead.
- pytest.raises and pytest.warns no longer support strings as the second argument.
- message parameter of pytest.raises.
- pytest.raises, pytest.warns and ParameterSet.param now use native keyword-only syntax. This might change the exception message from previous versions, but they still raise TypeError on unknown keyword arguments as before.
- pytest.config global variable.
- tmpdir_factory.ensuretemp method.
- pytest_logwarning hook.
- RemovedInPytest4Warning warning type.
- request is now a reserved name for fixtures.
For more information consult Deprecations and Removals in the docs.
#5565: Removed unused support code for unittest2.

The unittest2 backport module is no longer necessary since Python 3.3+, and the small amount of code in pytest to support it also doesn\'t seem to be used: after removed, all tests still pass unchanged.

Although our policy is to introduce a deprecation period before removing any features or support for third party libraries, because this code is apparently not used at all (even if unittest2 is used by a test suite executed by pytest), it was decided to remove it in this release.

If you experience a regression because of this, please file an issue.
#5615: pytest.fail, pytest.xfail and pytest.skip no longer support bytes for the message argument.

This was supported for Python 2 where it was tempting to use "message" instead of u"message".

Python 3 code is unlikely to pass bytes to these functions. If you do, please decode it to an str beforehand.

Features

#5564: New Config.invocation_args attribute containing the unchanged arguments passed to pytest.main().
#5576: New NUMBER option for doctests to ignore irrelevant differences in floating-point numbers. Inspired by Sébastien Boisgérault\'s numtest extension for doctest.

Improvements

#5471: JUnit XML now includes a timestamp and hostname in the testsuite tag.
#5707: Time taken to run the test suite now includes a human-readable representation when it takes over 60 seconds, for example:
```
===== 2 failed in 102.70s (0:01:42) =====
```

Bug Fixes

#4344: Fix RuntimeError/StopIteration when trying to collect package with \"__init__.py\" only.
#5115: Warnings issued during pytest_configure are explicitly not treated as errors, even if configured as such, because it otherwise completely breaks pytest.
#5477: The XML file produced by --junitxml now correctly contain a <testsuites> root element.
#5523: Fixed using multiple short options together in the command-line (for example -vs) in Python 3.8+.
#5524: Fix issue where tmp_path and tmpdir would not remove directories containing files marked as read-only, which could lead to pytest crashing when executed a second time with the --basetemp option.
#5537: Replace importlib_metadata backport with importlib.metadata from the standard library on Python 3.8+.
#5578: Improve type checking for some exception-raising functions (pytest.xfail, pytest.skip, etc) so they provide better error messages when users meant to use marks (for example @pytest.xfail instead of @pytest.mark.xfail).
#5606: Fixed internal error when test functions were patched with objects that cannot be compared for truth values against others, like numpy arrays.
#5634: pytest.exit is now correctly handled in unittest cases. This makes unittest cases handle quit from pytest\'s pdb correctly.
#5650: Improved output when parsing an ini configuration file fails.
#5701: Fix collection of staticmethod objects defined with functools.partial.
#5734: Skip async generator test functions, and update the warning message to refer to async def functions.

Improved Documentation

#5669: Add docstring for Testdir.copy_example.

Trivial/Internal Changes

#5095: XML files of the xunit2 family are now validated against the schema by pytest\'s own test suite to avoid future regressions.
#5516: Cache node splitting function which can improve collection performance in very large test suites.
#5603: Simplified internal SafeRepr class and removed some dead code.
#5664: When invoking pytest\'s own testsuite with PYTHONDONTWRITEBYTECODE=1, the test_xfail_handling test no longer fails.
#5684: Replace manual handling of OSError.errno in the codebase by new OSError subclasses (PermissionError, FileNotFoundError, etc.).

- Python
Published by nicoddemus over 6 years ago

pytest - https://github.com/pytest-dev/pytest/releases/tag/5.0.1

pytest 5.0.1 (2019-07-04)

Bug Fixes

#5479: Improve quoting in raises match failure message.
#5523: Fixed using multiple short options together in the command-line (for example -vs) in Python 3.8+.
#5547: --step-wise now handles xfail(strict=True) markers properly.

Improved Documentation

#5517: Improve \"Declaring new hooks\" section in chapter \"Writing Plugins\"

- Python
Published by nicoddemus over 6 years ago

pytest -

Bug Fixes

#4344: Fix RuntimeError/StopIteration when trying to collect package with "init.py" only.
#5478: Fix encode error when using unicode strings in exceptions with pytest.raises.
#5524: Fix issue where tmp_path and tmpdir would not remove directories containing files marked as read-only, which could lead to pytest crashing when executed a second time with the --basetemp option.
#5547: --step-wise now handles xfail(strict=True) markers properly.
#5650: Improved output when parsing an ini configuration file fails.

- Python
Published by nicoddemus over 6 years ago

Recent Releases of pytest

pytest - 8.4.1

pytest 8.4.1 (2025-06-17)

Bug fixes

Improved documentation

pytest - 8.4.0

pytest 8.4.0 (2025-06-02)

Removals and backward incompatible breaking changes

Deprecations (removal in next major release)

New features

contents of src/domain.py

contents of tests/test_testament.py

Improvements in existing functionality

Bug fixes

Improved documentation

Packaging updates and notes for downstreams

Contributor-facing changes

Miscellaneous internal changes

pytest - 8.3.5

pytest 8.3.5 (2025-03-02)

Bug fixes

Improved documentation

Contributor-facing changes

pytest - 8.3.4

pytest 8.3.4 (2024-12-01)

Bug fixes

Improved documentation

Contributor-facing changes

pytest - 8.3.3

pytest 8.3.3 (2024-09-09)

Bug fixes

Improved documentation

Miscellaneous internal changes

pytest - 8.3.2

pytest 8.3.2 (2024-07-24)

Bug fixes

pytest - 8.3.1

pytest 8.3.1 (2024-07-20)

pytest - 8.3.0

pytest 8.3.0 (2024-07-20)

New features

Improvements in existing functionality

Bug fixes

Improved documentation

Contributor-facing changes

pytest - 8.2.2

pytest 8.2.2 (2024-06-04)

Bug Fixes

Improved Documentation

pytest - 8.2.1

pytest 8.2.1 (2024-05-19)

Improvements

Bug Fixes

Trivial/Internal Changes

pytest - 8.2.0

pytest 8.2.0 (2024-04-27)

Deprecations

Features

Improvements

Bug Fixes

Trivial/Internal Changes

pytest - 8.1.2

pytest 8.1.2 (2024-04-26)

Bug Fixes

pytest - 8.1.1

pytest 8.1.1 (2024-03-08)

Features

Improvements

Bug Fixes

Improved Documentation

Trivial/Internal Changes

pytest 8.1.0 (YANKED)

pytest - 8.1.0

pytest 8.1.0 (YANKED)

Features

Improvements

Bug Fixes

Improved Documentation

Trivial/Internal Changes

pytest - 8.0.2

Additional Support For Exception Groups and `notes`