Recent Releases of BenchmarkPlots

BenchmarkPlots - v1.6.0

BenchmarkTools v1.6.0

Diff since v1.5.0

Merged pull requests: - Bump codecov/codecov-action from 3 to 4 (#355) (@dependabot[bot]) - Bump julia-actions/setup-julia from 1 to 2 (#361) (@dependabot[bot]) - Add buildkite configuration stub. (#363) (@fredrikekre) - Raise minimum Julia version to 1.6 (#366) (@Zentrik) - Run gcscrub after warmup and remove unnecessary gc run for first sample (#367) (@Zentrik) - no empty varargs (#373) (@KlausC) - add docstring to judge (#378) (@bclrk) - "evaluations" -> "evaluations each" when printing Trial (#380) (@asinghvi17) - Update Profile output test for v1.12 (#381) (@vtjnash) - Add @btimed and @ballocations macros (#383) (@singularitti) - rename default branch to main (#384) (@willow-ahrens) - Fix compilation and interpolation memory leaks (#385) (@willow-ahrens) - deprecate @benchmarkset (#386) (@willow-ahrens)

Closed issues: - Pass setup/interpolated variables through as run arguments instead of closing over them in the harness (#127) - @benchmarkset breaks on ^C (#279) - Feature for just running the code without benchmarking (#300) - Memory leak when repeatedly benchmarking (#339) - is @benchmarkset usable ? (#343) - judge lacks a docstring (#356) - timeout measures warmup (eliminating many of the reasons to use timeout) (#368) - @Benchmarkset fails silently, returns null (#369)

- Julia
Published by github-actions[bot] about 1 year ago

BenchmarkPlots - v1.5.0

BenchmarkTools v1.5.0

Diff since v1.4.0

Main changes

  • Warm up is now systematic in every individual benchmark and suite (#330)

Merged pull requests: - warm up at the beginning of every measurement (#330) (@willow-ahrens) - Update BenchmarkTools version constant (#349) (@Zentrik) - Only run GC 3 times instead of 4 to scrub (#350) (@Zentrik) - Allow loading saved benchmark results from version <= 1.3.2 (#351) (@Zentrik) - Bump actions/cache from 3 to 4 (#352) (@dependabot[bot]) - Deserialize Inf correctly in some cases (#354) (@Zentrik) - Bump to 1.5.0 (#357) (@gdalle) - Add 1.10 to CI (#358) (@gdalle) - Allow nightly to fail (#359) (@gdalle)

Closed issues: - Warmups are skipped when running a benchmark suite (#291) - Should hardcoded version number be updated? (#348) - cannot read benchmark JSON if run & written with seconds=Inf (#353)

- Julia
Published by github-actions[bot] almost 2 years ago

BenchmarkPlots - v1.4.0

BenchmarkTools v1.4.0

Diff since v1.3.2

Merged pull requests: - Make @benchmarkset work with for loop (#284) (@skleinbo) - Add Example Code to Common Workflow (#290) (@FelixBenning) - Use nameof instead of Type.name.name (#296) (@jishnub) - Create dependabot.yml (#302) (@ranocha) - Bump actions/checkout from 2 to 3 (#303) (@dependabot[bot]) - Bump codecov/codecov-action from 1 to 3 (#304) (@dependabot[bot]) - Bump actions/cache from 1 to 3 (#305) (@dependabot[bot]) - Automatically create nested BenchmarkGroup on access (#309) (@MilesCranmer) - Fix a few typos (#310) (@pitmonticone) - Clarify multiple setup values (#312) (@gdalle) - Add CI on Julia 1.9 and fix Ubuntu builds for unsupported versions (#313) (@gdalle) - Semicolons instead of tuple in multiple setup docs (#317) (@gdalle) - Don't tune manually set evals parameter (#318) (@gdalle) - Add logo (#320) (@gdalle) - Fix logo (#321) (@gdalle) - Fix logo path (#322) (@gdalle) - Logo img was in docs/build (#323) (@gdalle) - Add Aqua to tests (#326) (@gdalle) - Apply JuliaFormatter with BlueStyle and add it to tests (#327) (@gdalle) - Bump actions/checkout from 3 to 4 (#331) (@dependabot[bot]) - don't export leaves (#333) (@lucaferranti) - Add compat lower bound Statistics >= 1 (#334) (@gdalle) - Reexport std and var from Statistics (#336) (@milesfrain) - Update attribution in readme (#341) (@LilithHafner) - Revert "Update attribution in readme" (#342) (@vchuravy) - Bump version to 1.4.0 (#346) (@gdalle)

Closed issues: - tune! overrides evals=1, causing errors in destructive benchmarks (#24) - judge working with memory (#70) - Replace markdown manual/reference documentation with actual docstrings + Documenter.jl (#133) - Change median and mean export, or update documentation (#146) - Request: @bprofile macro for profiling (#169) - Change return or print units (#170) - @btime not printing as expected in a loop in Atom (#184) - No stable documentation (only dev) (#219) - @benchmarkset seems to be missing cases (#221) - Incorrect(?) bar heights and plot labels from @benchmark (#246) - Spurious performance penalty for single-element Union (#262) - @btime errors because tune! does not execute setup (#264) - tune! ignores evals=1 of @benchmarkable (#266) - Number of significant digits in @btime seems to be an overkill (#288) - How do you save benchmark results? (#289) - Silence warnings when using @benchmark (#295) - Tuning ignores explicit evals parameter (#297) - Compiler optimization example outdated? (#298) - Unexpected Behaviour of @btime - cubic splines evaluation (#299) - @btime has constant runtime whereas @time is dependent on input (#301) - Automatically create keys in BenchmarkGroup (#308) - Re-edit docs for multiple setup (#315) - Add logo? (#316) - tune! on benchmarkable with evals set. (#328) - Removing leaves export (#332) - Remember keyword parameters for tune! (#337) - [Feature Request] Comparing two functions (#338) - Feature request: asynchronously build a benchmark group (#345)

- Julia
Published by github-actions[bot] about 2 years ago

BenchmarkPlots - v1.3.2

BenchmarkTools v1.3.2

Diff since v1.3.1

Closed issues: - Display fails with only one sample (#261) - std and var broken (#293)

Merged pull requests: - Fix name in comment (#278) (@LilithHafner) - Fix a few typos in the documentation (#282) (@pitmonticone) - Fix few broken links (#286) (@Whojo) - Fix std and var on trials and groups. (#294) (@maleadt)

- Julia
Published by github-actions[bot] over 3 years ago

BenchmarkPlots - v1.3.1

BenchmarkTools v1.3.1

Diff since v1.3.0

Merged pull requests: - Make @btime correctly return the value of the expression in v1.8 (#276) (@giordano)

- Julia
Published by github-actions[bot] about 4 years ago

BenchmarkPlots - v1.3.0

BenchmarkTools v1.3.0

Diff since v1.2.2

Closed issues: - Local variable defined in testset not visible in benchmark macro (#269) - BenchmarkTools test fails on Windows (#273)

Merged pull requests: - Update ExecutionTests.jl to work with Windows path (#274) (@strickek) - Make use of Base.donotdelete if available (#275) (@Keno)

- Julia
Published by github-actions[bot] about 4 years ago

BenchmarkPlots - v1.2.2

BenchmarkTools v1.2.2

Diff since v1.2.1

Closed issues: - Interpolating variables does not work anymore in v1.2.1 (#270)

Merged pull requests: - Use Expr(:tuple) instead of Expr(:vect) to avoid vect semantics (#271) (@vchuravy)

- Julia
Published by github-actions[bot] about 4 years ago

BenchmarkPlots - v1.2.1

BenchmarkTools v1.2.1

Diff since v1.2.0

Closed issues: - Weird precompilation errors (#252)

Merged pull requests: - Support manual range for hist display (#255) (@timholy) - Simplify control logic for :logbins (#257) (@timholy) - bprofile: disable gcscrub by default (#259) (@timholy) - Ensure interpolated variables are garbage-collectable (#265) (@ettersi) - Exclude internals from reference (#267) (@tkf) - fix dead links in README (#268) (@Moelf)

- Julia
Published by github-actions[bot] about 4 years ago

BenchmarkPlots - v1.2.0

BenchmarkTools v1.2.0

Diff since v1.1.4

Merged pull requests: - Add @bprofile (#254) (@timholy)

- Julia
Published by github-actions[bot] over 4 years ago

BenchmarkPlots - v1.1.4

BenchmarkTools v1.1.4

Diff since v1.1.3

Closed issues: - Confusing numbers in histogram (#249)

Merged pull requests: - Make sure times are sorted in the at-benchmark histogram (#250) (@giordano)

- Julia
Published by github-actions[bot] over 4 years ago

BenchmarkPlots - v1.1.3

BenchmarkTools v1.1.3

Diff since v1.1.2

- Julia
Published by github-actions[bot] over 4 years ago

BenchmarkPlots - v1.1.2

BenchmarkTools v1.1.2

Diff since v1.1.1

Closed issues: - Wrong numbers in @benchmark histogram (#235)

- Julia
Published by github-actions[bot] over 4 years ago

BenchmarkPlots - v1.1.1

BenchmarkTools v1.1.1

Diff since v1.1.0

Closed issues: - BenchmarkTools v1.1.0: BoundsError when displaying BenchmarkTools.Trial (#228) - Spelling errors: "BechmarkTools" instead of "BenchmarkTools" (#229) - Link to Manual in Description is Broken (#231)

Merged pull requests: - Add plot capability (#194) (@gustaphe) - Update README.md (#227) (@Moelf) - Fix spelling errors (BechmarkTools -> BenchmarkTools) (#230) (@louie-github) - Highlight the correct bins in histograms (#232) (@cmcaine) - Show trials with 1 sample without error (#234) (@tecosaur)

- Julia
Published by github-actions[bot] over 4 years ago

BenchmarkPlots - v1.1.0

BenchmarkTools v1.1.0

Diff since v1.0.0

Closed issues: - @benchmark error when try using local variables in 'for' statement (UndefVarError) (#206) - Invalid links to documentation (#213) - A more compact, colourful, output style. (#215) - Link to tips and tricks in README.jl is broken. (#223)

Merged pull requests: - set up Documenter (#209) (@Roger-luo) - Polish Readme (#210) (@Roger-luo) - add docstrings for benchmarkset (#211) (@Roger-luo) - Fix link to manual and reference.md (#216) (@ihnorton) - Overhaul display of a Trial (#217) (@tecosaur) - Update README.md (#224) (@vchuravy) - Revise print bound for BenchmarkGroup (#225) (@schillic) - Bump version for release (#226) (@ericphanson)

- Julia
Published by github-actions[bot] over 4 years ago

BenchmarkPlots - v1.0.0

BenchmarkTools v1.0.0

Diff since v0.7.0

Closed issues: - Add docstring for @benchmark (#63) - MethodError if variable fld defined before using BenchmarkTools (#190)

Merged pull requests: - add @benchmarkset & @case for defining benchmark suite (#147) (@Roger-luo) - Explicitely call Base.fld (#191) (@jaakkor2) - Fix documentation of @benchmark (#203) (@FedericoStra) - Document judge argument order more explicitly (#204) (@nalimilan)

- Julia
Published by github-actions[bot] almost 5 years ago

BenchmarkPlots - v0.7.0

BenchmarkTools v0.7.0

Diff since v0.6.0

Closed issues: - crash in @btime call (#199)

Merged pull requests: - add doc string for @benchmark etc. (#188) (@Roger-luo) - Fix badext error message (#198) (@Seelengrab) - improve load performance (#200) (@vtjnash) - Tag 0.7.0 (#202) (@vtjnash)

- Julia
Published by github-actions[bot] almost 5 years ago

BenchmarkPlots - v0.6.0

BenchmarkTools v0.6.0

Diff since v0.5.0

Closed issues: - overheadsample(evals) and estimateoverhead() gives lower values, the higher "evals" is (#163) - BenchmarkTools punning Base.time? (#165) - Avoiding invalidations of min/max (#168) - @btime returns different memory allocs than @time when used with Threads.@threads (#175) - wrong output from @btime, @benchmark etc. when benchmarking inplace broadcast operations (#181) - Behind the scenes of @btime (#185)

Merged pull requests: - Document the practice of referencing and dereferencing variables to stop constant prop (#140) (@MasonProtter) - update travis (#159) (@vchuravy) - Fixed broken link to Julia @time (#161) (@one-more-fix) - make sure that nullfunc is not ellided (#164) (@vchuravy) - Added a tip (#172) (@pauljurczak) - Fixing small typo (#178) (@tkralphs) - fix dead links (#183) (@fonsp) - switch to GitHub actions (#189) (@Roger-luo) - fix CI (#192) (@vtjnash) - Early-convert BenchmarkGroup names to JSON-safe (#193) (@vtjnash) - Tag v0.6.0 (#196) (@vtjnash)

- Julia
Published by github-actions[bot] almost 5 years ago

BenchmarkPlots - v0.5.0

BenchmarkTools v0.5.0

Diff since v0.4.3

Closed issues: - Strange results with StaticArrays (#152) - please tag a release (#158)

Merged pull requests: - Remove overly-specific RNG source in doc example (#148) (@milesfrain) - reexport mean and median (#149) (@milesfrain) - Add b to method name in doc (#151) (@randyzwitch) - Add progress logging based on ProgressLogging.jl spec (#153) (@tkf) - Fix how IOContext :limit is handled (#155) (@tkf) - Install TagBot as a GitHub Action (#156) (@JuliaTagBot) - Add ballocated macro (#157) (@oxinabox)

- Julia
Published by github-actions[bot] almost 6 years ago

BenchmarkPlots - v0.4.3

v0.4.3 (2019-09-03)

Diff since v0.4.2

Closed issues:

  • Export minimum, median, mean, and maximum (#143)
  • Variable interpolation resulting in differing results in function (#141)
  • @btime crashes with unsafe_wrap when own=true (#138)
  • Referencing BenchmarkTools.jl from a publication (#137)
  • First example in README is invalid (#134)
  • Tag a release please! (#131)
  • Interpolating a type causes spurious slowdown in benchmarks. (#50)

Merged pull requests:

  • RFC: Bump version number from 0.4.2 to 0.4.3 and create Project.toml file (#144) (DilumAluthge)
  • Add more granular functions for time and memory judgements (#142) (DilumAluthge)
  • Add CITATION.bib (#139) (giordano)
  • change intro example benchmark to thwart constant propagation (#136) (jrevels)
  • fix link to manual (#132) (JeffFessler)

- Julia
Published by julia-tagbot[bot] over 6 years ago

BenchmarkPlots - v0.4.2

- Julia
Published by ararslan about 7 years ago

BenchmarkPlots - v0.4.1

- Julia
Published by ararslan over 7 years ago

BenchmarkPlots - v0.4.0

1.0 compatibility

- Julia
Published by ararslan over 7 years ago

BenchmarkPlots - v0.3.2

- Julia
Published by ararslan over 7 years ago

BenchmarkPlots - v0.3.1

- Julia
Published by ararslan over 7 years ago

BenchmarkPlots - v0.3.0

- Julia
Published by ararslan almost 8 years ago

BenchmarkPlots - v0.2.5

- Julia
Published by ararslan about 8 years ago

BenchmarkPlots - v0.2.4

- Julia
Published by ararslan about 8 years ago

BenchmarkPlots - v0.2.3

- Julia
Published by ararslan about 8 years ago

BenchmarkPlots -

- Julia
Published by jrevels over 8 years ago

BenchmarkPlots -

- Julia
Published by ararslan over 8 years ago

BenchmarkPlots -

- Julia
Published by ararslan over 8 years ago

BenchmarkPlots -

- Julia
Published by jrevels over 8 years ago

BenchmarkPlots -

- Julia
Published by jrevels almost 9 years ago