Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of cargo-mutants

cargo-mutants - v25.3.1

  • Fixed: cargo-mutants' own tests were failing on nightly due to a change in the format of messages emitted by tests.

- Rust
Published by github-actions[bot] 10 months ago

cargo-mutants - v25.3.0

  • New: A specific clearer error if a valid non-empty diff changes no Rust source files, and so matches no mutants. Thanks to @brunoerg.

  • New: cargo-mutants can emit GitHub Actions structured annotations for missed mutants, which appear as warnings outside of the log text. This behavior is on by default when the GITHUB_ACTION environment variable is set, can be forced on with --annotations=github and forced off with --annotations=none.

- Rust
Published by github-actions[bot] 10 months ago

cargo-mutants - v25.2.2

  • Changed: The mutant name of "replace match guard" mutations now includes the original match guard, for example replace match guard path.path.is_ident("str") with true in type_replacements. Similarly, the "delete match arm" mutation includes the pattern of the arm, for example delete match arm BinOp::BitOr(_) in ....

  • Internal: Automatically publish cargo-mutants to crates.io from GitHub Actions.

- Rust
Published by github-actions[bot] 11 months ago

cargo-mutants - v25.2.2-pre2

  • Release packages from a github environment for added security.

- Rust
Published by github-actions[bot] 11 months ago

cargo-mutants - v25.2.2-pre0

  • Changed: The mutant name of "replace match guard" mutations now includes the original match guard, for example replace match guard path.path.is_ident("str") with true in type_replacements. Similarly, the "delete match arm" mutation includes the pattern of the arm, for example delete match arm BinOp::BitOr(_) in ....

- Rust
Published by github-actions[bot] 11 months ago

cargo-mutants - v25.2.1

  • Fixed: Updated to syn 2.0.104, which understands new Rust syntax including impl trait precise capturing.

- Rust
Published by github-actions[bot] 11 months ago

cargo-mutants - v25.2.0

  • New: gitignore config key in .cargo/mutants.toml to control whether .gitignore patterns are respected when copying source trees, corresponding to --gitignore.

  • Changed: The mutant name for mutations of match statements and guard expressions now includes the enclosing function name, for example replace match guard with true in find_path_attribute.

- Rust
Published by github-actions[bot] 11 months ago

cargo-mutants - v25.1.0

  • Changed: The --gitignore option now defaults to false, meaning .gitignore patterns are no longer respected when copying source trees by default. The /target directory is still excluded by default through explicit filtering. To restore the previous behavior, use --gitignore=true.

  • New: Mutate > to >= and < to <=.

  • Changed: Mutate &T to Box::leak(Box::new(...)), instead of a reference to a value, so that mutants aren't unviable due to returning references to temporary values.

  • New: --copy-target option allows copying the /target directory to build directories. By default, the target directory is excluded to avoid copying large build artifacts, but --copy-target=true can be used if tests depend on existing build artifacts.

  • New: Feature-related options can now be configured in .cargo/mutants.toml: features, all_features, and no_default_features. Command line arguments take precedence over config file settings for boolean options, while features from both sources are combined.

  • New: Produce a json schema for the config file with --emit-schema=config to support schema-guided editing. The schema has been proposed to SchemaStore so many editors should in future support it automatically.

  • New: The config file path can be specified with the --config option, overriding the default of .cargo/mutants.toml. (The pre-existing --no-config option turns it off.)

- Rust
Published by github-actions[bot] 12 months ago

cargo-mutants - v25.0.1

  • New: Additional mutation patterns: delete match arms if there is a default arm, and replace if guards from match arms with true and false.

  • Changed: Show more type parameters in mutant names, like impl From<&str> for Foo rather than impl From for Foo.

  • Fixed: Support crates that use a non-default Cargo registry. Previously, cargo metadata failed with "registry index was not found."

  • Improved: Warn if --jobs is set higher than 8, which is likely to be too high.

  • Improved: Don't warn about expected/harmless exit codes from Nextest.

- Rust
Published by github-actions[bot] over 1 year ago

cargo-mutants - v25.0.1-pre3

  • Fixed: Build arm64 binaries for macOS.

- Rust
Published by github-actions[bot] over 1 year ago

cargo-mutants - v25.0.1-pre2

  • Fixed: Build binaries into releases.

- Rust
Published by github-actions[bot] over 1 year ago

cargo-mutants - cargo-mutants 25.0.0

  • Better estimation of time remaining, based on the time taken to test mutants so far, excluding the time for the baseline.

  • New: --copy-vcs option and config option will copy .git and other VCS directories, to accommodate trees whose tests depend on the contents or presence of the VCS directory.

  • New: Add .jj to the list of known VCS directories. These are excluded by default when copying the tree, but can be included using --copy-vcs=true.

  • Fixed: cargo --package options now include the version number of the targeted package, like foo@0.1.2. This avoids cargo failing with an error that the package name is ambiguous in trees whose dependencies include multiple versions of one of the packages being tested.

- Rust
Published by sourcefrog over 1 year ago

cargo-mutants - cargo-mutants 24.11.2

  • Changed: .gitignore (and other git ignore files) are only consulted when copying the tree if it is contained within a directory with a .git directory.

  • Fixed: .gitignore files above the git root directory are no longer read. In particular this fixes the problem where .gitignore * in the home directory would prevent copying any source trees.

- Rust
Published by sourcefrog over 1 year ago

cargo-mutants - v24.11.1

  • Changed: The arguments of calls to functions or methods named with_capacity are not mutated by default. This can be turned off with --skip-calls-defaults=false on the command line or skip_calls_defaults = false in .cargo/mutants.toml.

  • New: --skip-calls=NAME,NAME on the command line or skip_calls = [NAMES..] in .cargo/mutants.toml allows configuring other functions whose calls should never be mutated.

Download cargo-mutants 24.11.1

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

cargo-mutants - v24.11.0

24.11.0

  • New: --test-workspace and --test-package arguments and config options support projects whose tests live in a different package.

  • New: Mutate proc_macro targets and functions.

  • New: Write diffs to dedicated files under mutants.out/diff/. The filename is included in the mutant json output.

  • New: The package tarball on crates.io now includes all the test data, so that the tests can be run on the unpacked tarball. This may be helpful for people packaging cargo-mutants for distributions, and keeps an accurate record of the whole tree separate from the git history.

- Rust
Published by github-actions[bot] over 1 year ago

cargo-mutants - v24.9.0

24.9.0

  • Fixed: Avoid generating empty string elements in ENCODED_RUSTFLAGS when --cap-lints is set. In some situations these could cause a compiler error complaining about the empty argument.

  • New: --profile option allows selecting a Cargo profile. In particular, it's recommended that you can use --profile=mutants and configure a custom profile in your Cargo.toml to optimize the build for mutants, by turning off debug symbols.

  • New: --iterate option skips mutants that were previously caught or unviable.

  • New: cargo-mutants starts a GNU jobserver, shared across all children, so that running multiple --jobs does not spawn an excessive number of compiler processes. The jobserver is on by default and can be turned off with --jobserver false.

  • Fixed: Don't error on diffs containing a "Binary files differ" message.

- Rust
Published by github-actions[bot] over 1 year ago

cargo-mutants - v24.7.1

  • Changed: No build timeouts by default. Previously, cargo-mutants set a default build timeout based on the baseline build, but experience showed that this would sometimes make builds flaky, because build times can be quite variable. If mutants cause builds to hang, then you can still set a timeout using --build-timeout or --build-timeout-multiplier.

  • Fixed: Don't error if the --in-diff file is empty.

  • Changed: cargo-mutants no longer passes --cap-lints=allow to rustc. This was previously done so that mutants would not unnecessarily be unviable due to triggering compiler warnings in trees configured to deny some lints, but it had the undesirable effect of disabling rustc's detection of long running const evaluations. If your tree treats some lints as errors then the previous behavior can be restored with --cap-lints=true (or the equivalent config option), or you can use cfg_attr and a feature flag to accept those warnings when testing under cargo-mutants.

Download cargo-mutants 24.7.1

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] almost 2 years ago

cargo-mutants - v24.7.0

Download cargo-mutants 24.7.0

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] almost 2 years ago

cargo-mutants - v24.5.0

Download cargo-mutants 24.5.0

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] about 2 years ago

cargo-mutants - v24.4.0

  • New: Generate mutations that delete the ! and - unary operators.

  • Changed: Baselines and mutants are now built with cargo test --no-run rather than cargo build --tests as previously. This avoids wasted build effort if the dev and test Cargo profiles are not the same, and may better distinguish build failures from test failures. With --test-tool=nextest, the corresponding cargo nextest run --no-run is used.

  • Fixed: .ignore files can no longer affect source tree copying, so test files listed in a .ignore (e.g. *.snap for Insta snapshots) are now correctly copied into temporary build directories.

  • Fixed: Don't visit files marked with #![cfg(test)] (or other inner attributes that generally cause code to be skipped.)

  • Fixed: Paths to module files nested within mod blocks are now correctly resolved.

  • Added: Document stability policy in the manual.

- Rust
Published by github-actions[bot] about 2 years ago

cargo-mutants - v24.3.0

Download cargo-mutants 24.3.0

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] about 2 years ago

cargo-mutants - v24.2.1

  • New: --features, --no-default-features and --all-features options are passed through to Cargo.

  • Changed: Minimum Rust version (to build cargo-mutants, not to use it) increased to 1.73.

  • New: Warn if nextest returns an exit code indicating some failure other than test failure, such as an internal error in nextest.

  • New: json output includes the exit code of subprocesses, and the signal if it was killed by a signal.

  • Changed: Set INSTA_FORCE_PASS=0 (in addition to previously INSTA_UPDATE=no) when running tests, so that tests that use the Insta library don't write updates back into the source directory, and so don't falsely pass.

  • New: --timeout-multiplier option allows setting the timeout for mutants to be a multiple of the baseline timeout, rather than a fixed time.

Install cargo-mutants 24.2.1

Install prebuilt binaries via shell script

sh curl --proto '=https' --tlsv1.2 -LsSf https://github.com/sourcefrog/cargo-mutants/releases/download/v24.2.1/cargo-mutants-installer.sh | sh

Install prebuilt binaries via powershell script

sh irm https://github.com/sourcefrog/cargo-mutants/releases/download/v24.2.1/cargo-mutants-installer.ps1 | iex

Download cargo-mutants 24.2.1

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 2 years ago

cargo-mutants - v24.2.0

  • New: Colored output can be enabled in CI or other noninteractive situations by passing --colors=always, or setting CARGO_TERM_COLOR=always, or CLICOLOR_FORCE=1. Colors can similarly be forced off with --colors=never, CARGO_TERM_COLOR=never, or NO_COLOR=1.

Install cargo-mutants 24.2.0

Install prebuilt binaries via shell script

sh curl --proto '=https' --tlsv1.2 -LsSf https://github.com/sourcefrog/cargo-mutants/releases/download/v24.2.0/cargo-mutants-installer.sh | sh

Install prebuilt binaries via powershell script

sh irm https://github.com/sourcefrog/cargo-mutants/releases/download/v24.2.0/cargo-mutants-installer.ps1 | iex

Download cargo-mutants 24.2.0

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 2 years ago

cargo-mutants - v24.1.2

  • New: --in-place option tests mutations in the original source tree, without copying the tree. This is faster and uses less disk space, but it's incompatible with --jobs, and you must be careful not to edit or commit the source tree while tests are running.

Install cargo-mutants 24.1.2

Install prebuilt binaries via shell script

sh curl --proto '=https' --tlsv1.2 -LsSf https://github.com/sourcefrog/cargo-mutants/releases/download/v24.1.2/cargo-mutants-installer.sh | sh

Install prebuilt binaries via powershell script

sh irm https://github.com/sourcefrog/cargo-mutants/releases/download/v24.1.2/cargo-mutants-installer.ps1 | iex

Download cargo-mutants 24.1.2

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] over 2 years ago

cargo-mutants - v24.1.1

cargo-mutants 24.1.1

  • New: Mutate +, -, *, /, %, &, ^, |, <<, >> binary ops, and their corresponding assignment ops like +=.

  • New: --baseline=skip option to skip running tests in an unmutated tree, when they're already been checked externally.

  • Changed: Stop generating mutations of || and && to != and ||, because it seems to raise too many low-value false positives that may be hard to test.

  • Fixed: Colors in command-line help and error messages.

Install cargo-mutants 24.1.1

Install prebuilt binaries via shell script

sh curl --proto '=https' --tlsv1.2 -LsSf https://github.com/sourcefrog/cargo-mutants/releases/download/v24.1.1/cargo-mutants-installer.sh | sh

Install prebuilt binaries via powershell script

sh irm https://github.com/sourcefrog/cargo-mutants/releases/download/v24.1.1/cargo-mutants-installer.ps1 | iex

Download cargo-mutants 24.1.1

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] over 2 years ago

cargo-mutants - v24.1.0

Install cargo-mutants 24.1.0

Install prebuilt binaries via shell script

sh curl --proto '=https' --tlsv1.2 -LsSf https://github.com/sourcefrog/cargo-mutants/releases/download/v24.1.0/cargo-mutants-installer.sh | sh

Install prebuilt binaries via powershell script

sh irm https://github.com/sourcefrog/cargo-mutants/releases/download/v24.1.0/cargo-mutants-installer.ps1 | iex

Download cargo-mutants 24.1.0

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] over 2 years ago

cargo-mutants - v23.12.2

Install cargo-mutants 23.12.2

Install prebuilt binaries via shell script

sh curl --proto '=https' --tlsv1.2 -LsSf https://github.com/sourcefrog/cargo-mutants/releases/download/v23.12.2/cargo-mutants-installer.sh | sh

Install prebuilt binaries via powershell script

sh irm https://github.com/sourcefrog/cargo-mutants/releases/download/v23.12.2/cargo-mutants-installer.ps1 | iex

Download cargo-mutants 23.12.2

| File | Platform | Checksum | |--------|----------|----------| | cargo-mutants-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | cargo-mutants-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | cargo-mutants-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | cargo-mutants-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] over 2 years ago

cargo-mutants - 23.12.1 tropical mutants

  • Improved progress bars and console output, including putting the outcome of each mutant on the left, and the overall progress bar at the bottom. Improved display of estimated remaining time, and other times.

  • Fixed: Correctly traverse mod statements within package top source files that are not named lib.rs or main.rs, by following the path setting of each target within the manifest.

  • Improved: Don't generate function mutants that have the same AST as the code they're replacing.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - cargo-mutants 23.12.0

An exciting step forward: cargo-mutants can now generate mutations smaller than a whole function. To start with, several binary operators are mutated.

Also, --in-diff will no longer error out if no mutants are generated in the diff, making it much more reasonable for a CI check.

  • New: Mutate == to != and vice versa.

  • New: Mutate && to || and vice versa, and mutate both of them to == and !=.

  • New: Mutate <, <=, >, >=.

  • Changed: If no mutants are generated then cargo mutants now exits successfully, showing a warning. (Previously it would exit with an error.) This works better with --in-diff in CI, where it's normal that some changes may not have any mutants.

  • Changed: Include column numbers in text listings of mutants and output to disambiguate smaller-than-function mutants, for example if there are several operators that can be changed on one line. This also applies to the names used for regex matching, so may break some regexps that match the entire line (sorry). The new option --line-col=false turns them both off in --list output.

  • Changed: In the mutants.json format, replaced the function, line, and return_type fields with a function submessage (including the name and return type) and a span indicating the entire replaced region, to better handle smaller-than-function mutants. Also, the function includes the line-column span of the entire function.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - v23.11.2

  • Changed: If --file or --exclude are set on the command line, then they replace the corresponding config file options. Similarly, if --re is given then the examine_re config key is ignored, and if --exclude-re is given then exclude_regex is ignored. (Previously the values were combined.) This makes it easier to use the command line to test files or mutants that are normally not tested.

  • Improved: By default, files matching gitignore patterns (including in parent directories, per-user configuration, and info/exclude) are excluded from copying to temporary build directories. This should improve performance in some large trees with many files that are not part of the build. This behavior can be turned off with --gitignore=false.

  • Improved: Run cargo metadata with --no-deps, so that it doesn't download and compute dependency information, which can save time in some situations.

  • Added: Alternative aliases for command line options, so you don't need to remember if it's "regex" or "re": --regex, --examine-re, --examine-regex (all for names to include) and --exclude-regex.

  • Added: Accept --manifest-path as an alternative to -d, for consistency with other cargo commands.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - v23.11.1

  • New --in-diff FILE option tests only mutants that are in the diff from the given file. This is useful to avoid testing mutants from code that has not changed, either locally or in CI.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants -

  • Changed: cargo mutants now tries to match the behavior of cargo test when run within a workspace. If run in a package directory, it tests only that package. If run in a workspace that is not a package (a "virtual workspace"), it tests the configured default packages, or otherwise all packages. This can all be overridden with the --package or --workspace options.

  • New: generate key-value map values from types like BTreeMap<String, Vec<u8>>.

  • Changed: Send trace messages to stderr rather stdout, in part so that it won't pollute json output.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - v23.10.0

  • The baseline test (with no mutants) now tests only the packages in which mutants will be generated, subject to any file or regex filters. This should both make baseline tests faster, and allow testing workspaces in which some packages have non-hermetic tests.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - cargo-mutants 23.9.1

Lots more mutation patterns!

  • Mutate the known collection types BinaryHeap, BTreeSet, HashSet, LinkedList, and VecDeque to generate empty and one-element collections using T::new() and T::from_iter(..).

  • Mutate known container types like Arc, Box, Cell, Mutex, Rc, RefCell into T::new(a).

  • Mutate unknown types that look like containers or collections T<A> or T<'a, A>' and try to construct them from an A with T::from_iter, T::new, and T::from.

  • Minimum Rust version updated to 1.70.

  • Mutate Cow<'_, T> into Owned and Borrowed variants.

  • Mutate functions returning &[T] and &mut [T] to return leaked vecs of values.

  • Mutate (A, B, C, ...) into the product of all replacements for a, b, c, ...

  • The combination of options --list --diff --json is now supported, and emits a diff key in the JSON.

  • Mutate -> impl Iterator<Item = A> to produce empty and one-element iterators of the item type.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - cargo-mutants 23.9.0

Live from http://rustconf.com/

  • Fixed a bug causing an assertion failure when cargo-mutants was run from a subdirectory of a workspace. Thanks to @adamchalmers!
  • Generate HttpResponse::Ok().finish() as a mutation of an Actix HttpResponse.

- Rust
Published by sourcefrog over 2 years ago

cargo-mutants - cargo-mutants 23.6.0

An exciting release that adds a lot more power to generate viable mutations of functions returning more complex types.

  • Generate Box::leak(Box::new(...)) as a mutation of functions returning &mut.

  • Add a concept of mutant "genre", which is included in the json listing of mutants. The only genre today is FnValue, in which a function body is replaced by a value. This will in future allow filtering by genre.

  • Recurse into return types, so that for example Result<bool> can generate Ok(true) and Ok(false), and Some<T> generates None and every generated value of T. Similarly for Box<T>, and Vec<T>.

  • Generate specific values for integers: [0, 1] for unsigned integers, [0, 1, -1] for signed integers; [1] for NonZero unsigned integers and [1, -1] for NonZero signed integers.

  • Generate specific values for floats: [0.0, 1.0, -1.0].

  • Generate (fixed-length) array values, like [0; 256], [1; 256] using every recursively generated value for the element type.

- Rust
Published by sourcefrog almost 3 years ago

cargo-mutants - cargo-mutants 23.5.0

"Pickled crab"

  • cargo mutants can now successfully test packages that transitively depend on a different version of themselves, such as itertools. Previously, cargo-mutants used the cargo --package option, which is ambiguous in this case, and now it uses --manifest-path instead. #117

  • Mutate functions returning &'_ str (whether a lifetime is named or not) to return "xyzzy" and "".

  • Switch to CalVer numbering.

- Rust
Published by sourcefrog about 3 years ago

cargo-mutants - cargo-mutants 1.2.3

  • New --error option, to cause functions returning Result to be mutated to return the specified error.

  • New --no-config option, to disable reading .cargo/mutants.toml.

  • Mutate functions returning String to String::new() rather than "".into(): same result but a bit more idiomatic.

  • New --leak-dirs option, for debugging cargo-mutants.

  • Update to syn 2.0, adding support for new Rust syntax.

  • Minimum supported Rust version increased to 1.65 due to changes in dependencies.

- Rust
Published by sourcefrog about 3 years ago

cargo-mutants - cargo-mutants-1.2.2

  • Don't mutate unsafe fns.

  • Don't mutate functions that never return (i.e. -> !).

  • Minimum supported Rust version increased to 1.64 due to changes in dependencies.

  • Some command-line options can now also be configured through environment variables: CARGO_MUTANTS_JOBS, CARGO_MUTANTS_TRACE_LEVEL.

  • New command line option --minimum-test-timeout and config file variable minimum_test_timeout join existing environment variable CARGO_MUTANTS_MINIMUM_TEST_TIMEOUT, to allow boosting the minimum, especially for test environments with poor or uneven throughput.

  • Changed: Renamed fields in outcomes.json from cargo_result to process_status and from command to argv.

  • Warn if no mutants were generated or if all mutants were unviable.

- Rust
Published by sourcefrog about 3 years ago

cargo-mutants -

  • Converted most of the docs to a book available at https://mutants.rs/.

  • Fixed: Correctly find submodules that don't use mod.rs naming, e.g. when descending from src/foo.rs to src/foo/bar.rs. Also handle module names that are raw identifiers using r#. (Thanks to @kpreid for the report.)

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - cargo-mutants 1.2.0

Thankful mutants!

  • Fixed: Files that are excluded by filters are also excluded from --list-files.

  • Fixed: --exclude-re and --re can match against the return type as shown in --list.

  • New: A .cargo/mutants.toml file can be used to configure standard filters and cargo args for a project.

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - cargo-mutants 1.1.1

Spooky mutants!

  • Fixed support for the Mold linker, or for other options passed via RUSTFLAGS or CARGO_ENCODED_RUSTFLAGS. (See the instructions in README.md).

  • Source trees are walked by following mod statements rather than globbing the directory. This is more correct if there are files that are not referenced by mod statements. Once attributes on modules are stable in Rust (https://github.com/rust-lang/rust/issues/54727) this opens a path to skip mods using attributes.

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - cargo-mutants-1.1.0

Fearless concurrency!

  • cargo-mutants can now run multiple cargo build and test tasks in parallel, to make better use of machine resources and find mutants faster, controlled by --jobs.

  • The minimum Rust version to build cargo-mutants is now 1.63.0. It can still be used to test code under older toolchains.

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - https://github.com/sourcefrog/cargo-mutants/releases/tag/cargo-mutants-1.0.3

  • cargo-mutants is now finds no uncaught mutants in itself! Various tests were added and improved, particularly around handling timeouts.

  • New: --re and --exclude-re options to filter by mutant name, including the path. The regexps match against the strings printed by --list.

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - https://github.com/sourcefrog/cargo-mutants/releases/tag/cargo-mutants-1.0.2

  • New: cargo mutants --completions to generate shell completions using clap_complete.

  • Changed: carg-mutants no longer builds in the source directory, and no longer copies the target/ directory to the scratch directory. Since cargo-mutants now sets RUSTFLAGS to avoid false failures from warnings, it is unlikely to match the existing build products in the source directory target/, and in fact building there is just likely to cause rebuilds in the source. The behavior now is as if --no-copy-target was always passed. That option is still accepted, but it has no effect.

  • Changed: cargo-mutants finds all possible mutations before doing the baseline test, so that you can see earlier how many there will be.

  • New: Set INSTA_UPDATE=no so that tests that use the Insta library don't write updates back into the source directory, and so don't falsely pass.

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - cargo-mutants 1.0.1

  • Fixed: Don't try to mutate functions within test targets, e.g. within tests/**/*.rs.

  • New: missed.txt, caught.txt, timeout.txt and unviable.txt files are written in to the output directory to make results easier to review later.

  • New: --output creates the specified directory if it does not exist.

  • Internal: Switched from Argh to Clap for command-line parsing. There may be some small changes in CLI behavior and help formatting.

- Rust
Published by sourcefrog over 3 years ago

cargo-mutants - cargo-mutants 1.0.0

A 1.0 release to celebrate that with the addition of workspace handling, cargo-mutants gives useful results on many Rust projects.

  • New: Supports workspaces containing multiple packages. Mutants are generated for all relevant targets in all packages, and mutants are subject to the tests of their own package. cargo mutants --list-files --json and cargo mutants --list --json now includes package names for each file or mutant.

  • Improved: Generate mutations in cdylib, rlib, and ever other *lib target. For example, this correctly exercises Wasm projects.

  • Improved: Write mutants.out/outcomes.json after the source-tree build and baseline tests so that it can be observed earlier on.

  • Improved: mutants.out/outcomes.json includes the commands run.

- Rust
Published by sourcefrog almost 4 years ago

cargo-mutants - cargo-mutants 0.2.11

  • New --exclude command line option to exclude source files from mutants generation, matching a glob.

  • New: CARGO_MUTANTS_MINIMUM_TEST_TIMEOUT sets a minimum timeout for cargo tests, in seconds. This can be used to allow more time on slow CI builders. If unset the default is still 20s.

  • Added: A new mutants.out/debug.log with internal debugging information.

  • Improved: The time for check, build, and test is now shown separately in progress bars and output, to give a better indication of which is taking more time in the tree under test. Also, times are show in seconds with one decimal place, and they are styled more consistently.

  • Improved: More consistent use of 'unviable' and other terms for outcomes in the UI.

- Rust
Published by sourcefrog almost 4 years ago

cargo-mutants - cargo-mutants 0.2.10

cargo-mutants 0.2.10 comes with improved docs, and the new -C option can be used to pass options like --release or --all-features to cargo.

  • Added: --cargo-arg (or -C for short) allows passing arguments to cargo commands (check, build, and test), for example to set --release or --features.

  • Improved: Works properly if run from a subdirectory of a crate, or if -d points to a subdirectory of a crate.

  • Improved: Various docs.

  • Improved: Relative dependencies within the source tree are left as relative paths, and will be built within the scratch directory. Relative dependencies outside the source tree are still rewritten as absolute paths.

- Rust
Published by sourcefrog almost 4 years ago

cargo-mutants - cargo-mutants 0.2.9

  • Faster: cargo mutants no longer runs cargo check before building, in cases where the build products are wanted or tests will be run. This saves a significant amount of work in build phases; in some trees cargo mutants is now 30% faster. (In trees where most of the time is spent running tests the effect will be less.)

  • Fixed: Open log files in append mode to fix messages from other processes occasionally being partly overwritten.

  • Improved: cargo mutants should now give useful results in packages that use #![deny(unused)] or other mechanisms to reject warnings. Mutated functions often ignore some parameters, which would previously be rejected by this configuration without proving anything interesting about test coverage. Now, --cap-lints=allow is passed in RUSTFLAGS while building mutants, so that they're not falsely rejected and the tests can be exercised.

  • Improved: The build dir name includes the root package name.

  • Improved: The progress bar shows more information.

  • Improved: The final message shows how many mutants were tested and how long it took.

- Rust
Published by sourcefrog almost 4 years ago

cargo-mutants - cargo-mutants 0.2.8

  • New: Summarize the overall number of mutants generated, caught, missed, etc, at the end.

  • Fixed: Works properly with crates that have relative path dependencies in Cargo.toml or .cargo/config.toml, by rewriting them to absolute paths in the scratch directory.

- Rust
Published by sourcefrog almost 4 years ago

cargo-mutants - cargo-mutants-0.2.7

  • New: You can skip functions by adding #[cfg_attr(test, mutants::skip), in which case the mutants crate can be only a dev-dependency.

  • Improved: Don't generate pointless mutations of functions with an empty body (ignoring comments.)

  • Improved: Remove extra whitespace from the display of function names and return types: the new formatting is closer to the spacing used in idiomatic Rust.

  • Improved: Show the last line of compiler/test output while running builds, so that it's more clear where time is being spent.

  • Docs: Instructions on how to check for missed mutants from CI.

- Rust
Published by sourcefrog almost 4 years ago

cargo-mutants -

  • Improved: Find source files by looking at cargo metadata output, rather than assuming they're in src/**/*.rs. This makes cargo mutants work properly on trees where it previously failed to find the source.

  • New --version option.

  • New: Write a lock.json into the mutants.out directory including the start timestamp, cargo-mutants version, hostname and username. Take a lock on this file while cargo mutants is running, so that it doesn't crash or get confused if two tasks try to write to the same directory at the same time.

  • New: Restored a --list-files option.

  • Changed: Error if no mutants are generated, which probably indicates a bug or configuration error(?)

- Rust
Published by sourcefrog about 4 years ago

cargo-mutants -

  • New --file command line option to mutate only functions in source files matching a glob.

  • Improved: Don't attempt to mutate functions called new or implementations of Default. cargo-mutants can not yet generate good mutations for these so they are generally false positives.

  • Improved: Better display of <impl Foo for Bar>::foo and similar type paths.

  • New: --output directory to write mutants.out somewhere other than the source directory.

- Rust
Published by sourcefrog about 4 years ago

cargo-mutants -

  • Fix: Ignore errors setting file mtimes during copies, which can cause failures on Windows if some files are readonly.

  • Fix: Log file names now include only the source file relative path, the line number, and a counter, so they are shorter, and shouldn't cause problems on filesystems with length limits.

  • Change: version-control directories like .git are not copied with the source tree: they should have no effect on the build, so copying them is just a waste.

  • Changed/improved json logs in mutants.out:

    • Show durations as fractional seconds.
    • Outcomes include a "summary" field.

- Rust
Published by sourcefrog about 4 years ago

cargo-mutants - cargo-mutants 0.2.3

  • Switch from Indicatif to Nutmeg to draw progress bars and output. This fixes a bug where terminal output line-wraps badly, and adds a projection for the total estimated time to completion.

  • Change: Mutants are now tested in random order by default, so that repeated runs are more likely to surface interesting new findings early, rather than repeating previous results. The previous behavior of testing mutants in the deterministic order they're encountered in the tree can be restored with --no-shuffle.

- Rust
Published by sourcefrog about 4 years ago

cargo-mutants - cargo-mutants 0.2.2

  • The progress bar now shows which mutant is being tested out of how many total.

  • The automatic timeout is now set to the minimum of 20 seconds, or 5x the time of the tests in a baseline tree, to reduce the incidence of false timeouts on machines with variable throughput.

  • Ctrl-c (or SIGINT) interrupts the program during copying the tree. Previously it was not handled until the copy was complete.

  • New --no-copy-target option.

- Rust
Published by sourcefrog over 4 years ago

cargo-mutants - cargo-mutants 0.2.1

- Rust
Published by sourcefrog over 4 years ago

cargo-mutants - cargo-mutants 0.2.0

0.2.0

Released 2022-02-06

  • A new --timeout SECS option to limit the runtime of any cargo test invocation, so that mutations that cause tests to hang don't cause cargo mutants to hang.

A default timeout is set based on the time to run tests in an unmutated tree. There is no timeout by default on the unmutated tree.

On Unix, the cargo subprocesses run in a new process group. As a consequence ctrl-c is explicitly caught and propagated to the child processes.

  • Show a progress bar while looking for mutation opportunities, and show the total number found.

  • Show how many mutation opportunities were found, before testing begins.

  • New --shuffle option tests mutants in random order.

  • By default, the output now only lists mutants that were missed or that timed out. Mutants that were caught, and mutants that did not build, can be printed with --caught and --unviable respectively.

- Rust
Published by sourcefrog over 4 years ago