Recent Releases of Zygote
Zygote - v0.6.77
Zygote v0.6.77
This release has been identified as a backport.
Automated changelogs for backports tend to be wildly incorrect.
Therefore, the list of issues and pull requests is hidden.
<!--
Merged pull requests:
- Import typesof from Base instead of InteractiveUtils (#1569) (@serenity4)
- Backport typesof fix for 0.6 (#1571) (@serenity4)
-->
- Julia
Published by github-actions[bot] 10 months ago
Zygote - v0.6.76
Zygote v0.6.76
This release has been identified as a backport. Automated changelogs for backports tend to be wildly incorrect. Therefore, the list of issues and pull requests is hidden. <!-- Merged pull requests: - Utilize ChainRulesCore thunks (#966) (@oschulz) - Remove redundant sum() rules (#1453) (@ToucheSir) - Improve the limitations page (#1548) (@mcabbott) - Drop support for Julia 1.6 (#1549) (@mcabbott) - Unthunk tangents (if any) before returning gradient (#1551) (@pxl-th) - Improve catch block identification (#1552) (@Pangoraw) - Remove Molly.jl from Downstream.yml CI (#1554) (@ToucheSir) - Don't create nested thunks when accumulating (#1555) (@ToucheSir) - Distribute tests across workers (#1559) (@pxl-th) - Cleanup & remove some deps (#1560) (@pxl-th) - CompatHelper: bump compat for ForwardDiff to 1, (keep existing compat) (#1563) (@github-actions[bot]) - chore: add unthunk_tangent rule for Ref (#1564) (@DhairyaLGandhi) - Remove DynamicPPL integration test (#1565) (@penelopeysm) - support ForwardDiff@1.0 for v0.6 (#1566) (@oscardssmith)
Closed issues:
- Seems to be #265ing (#22)
- Use ReTest for parallel testing (#1289)
- nested AD on CUDA array (#1450)
- try/catch error message regression (#1546)
- How to match performance of Zygote with Tracker.jl? With Issues in Tracker.jl itself. (#1550)
- Zygote is not compiling (#1553)
- sum with a function where that function returns a tuple (#1556)
- Wrong gradient return for a function that is a double getindex of jagged arrays (#1557)
-->
- Julia
Published by github-actions[bot] 11 months ago
Zygote - v0.7.5
Zygote v0.7.5
Merged pull requests: - Drop support for Julia 1.6 (#1549) (@mcabbott) - Distribute tests across workers (#1559) (@pxl-th) - Cleanup & remove some deps (#1560) (@pxl-th) - CompatHelper: bump compat for ForwardDiff to 1, (keep existing compat) (#1563) (@github-actions[bot])
Closed issues:
- Seems to be #265ing (#22)
- Use ReTest for parallel testing (#1289)
- sum with a function where that function returns a tuple (#1556)
- Wrong gradient return for a function that is a double getindex of jagged arrays (#1557)
- Julia
Published by github-actions[bot] 11 months ago
Zygote - v0.7.2
Zygote v0.7.2
Merged pull requests: - Improve catch block identification (#1552) (@Pangoraw)
Closed issues: - try/catch error message regression (#1546) - How to match performance of Zygote with Tracker.jl? With Issues in Tracker.jl itself. (#1550)
- Julia
Published by github-actions[bot] about 1 year ago
Zygote - v0.7.0
Zygote v0.7.0
Breaking changes:
- Now Zygote doesn't always unthunk ChainRulesCore's thunks, saving computation and memory in some situations. This may break some ChainRules' rules that are not correctly written, but no changes are usually required. (#966)
Merged pull requests: - Utilize ChainRulesCore thunks (#966) (@oschulz)
- Julia
Published by github-actions[bot] about 1 year ago
Zygote - v0.6.75
Zygote v0.6.75
Merged pull requests: - CompatHelper: bump compat for Colors in [weakdeps] to 0.13, (keep existing compat) (#1536) (@github-actions[bot]) - Eager parameter updating (#1541) (@murrellb) - set CollapsedDocStrings=true (#1543) (@CarloLucibello) - mark some tests as broken (#1545) (@CarloLucibello)
Closed issues: - Support try/catch by assuming try branch (#1516)
- Julia
Published by github-actions[bot] about 1 year ago
Zygote - v0.6.74
Zygote v0.6.74
Merged pull requests: - fix precompilation on 1.12 (#1542) (@simeonschaub)
Closed issues: - UnitRange calculations change types when using Zygote (#557) - Fails to precompile on PkgEval run (#1539) - An unknown error occurs raised by Zygote.jl when using eachslice and NamedTuple (#1540)
- Julia
Published by github-actions[bot] about 1 year ago
Zygote - v0.6.73
Zygote v0.6.73
Merged pull requests: - CompatHelper: bump compat for GPUArraysCore to 0.2, (keep existing compat) (#1534) (@github-actions[bot]) - CompatHelper: bump compat for GPUArrays to 11, (keep existing compat) (#1535) (@github-actions[bot])
Closed issues:
- Why nested gradient is so slow? (#1239)
- Unsupported operation when using CUDA (#1532)
- Incorrect nothing gradient (#1538)
- Julia
Published by github-actions[bot] over 1 year ago
Zygote - v0.6.71
Zygote v0.6.71
Merged pull requests:
- Fix dead link (#1518) (@NAThompson)
- Prefer numeric zero over ZeroTangent for numeric arrays (#1524) (@BioTurboNick)
- Support enumerate in conditional generators/comprehensions (#1525) (@BioTurboNick)
Closed issues: - "Zygote.Buffer copyto!" error when using "CartesianIndex" (#1364) - Default presentation of gradients confusing? (#1519) - BitVector failure (#1523)
- Julia
Published by github-actions[bot] over 1 year ago
Zygote - v0.6.70
Zygote v0.6.70
Merged pull requests: - Adjust to upcoming julia#54341 (#1511) (@Keno)
Closed issues: - error in summation of product iterator (#1490) - OOM when computing the gradient in an embarrassingly parallel problem (#1504) - Pullback over jacobian (#1505)
- Julia
Published by github-actions[bot] almost 2 years ago
Zygote - v0.6.69
Zygote v0.6.69
Important Changes
gradientis now guaranteed to return a tuple with one gradient per argument, even if the gradients arenothing.- Tuples of
nothingreturned from a now will now be consistently collapsed into a singlenothing.
Merged pull requests:
- Handle Expr(:boundscheck) (#1462) (@ToucheSir)
- Swap PyCall to PythonCall (#1485) (@ToucheSir)
- Improve adjoint for product and zip (#1489) (@lxvm)
- Preserve 0d arrays in Zygote.accum (#1491) (@lxvm)
- Remove @adjoints for sort and filter (#1493) (@lkdvos)
- Un-collapse nothings in gradient (#1495) (@ToucheSir)
Closed issues:
- Adjoint of Adjoint with NamedTuples (#1438)
- Pullback on mean() gives illegal memory access code 700 (#1473)
- sort(x; rev=true) is not supported (#1492)
- Incorrect gradients for plan_rfft(x) * x (#1496)
- Julia
Published by github-actions[bot] about 2 years ago
Zygote - v0.6.68
Zygote v0.6.68
Merged pull requests: - Fix tests (#1467) (@devmotion) - CompatHelper: add new compat entry for Statistics at version 1, (keep existing compat) (#1469) (@github-actions[bot]) - CompatHelper: bump compat for GPUArrays to 10, (keep existing compat) (#1480) (@github-actions[bot])
Closed issues: - Failing to precompile Flux and Zygote (#1456) - Assignment to multiple arrays is not differentiable on GPU since Zygote.jl 0.6.67 (#1470) - Spurious "Output is complex, so the gradient is not defined" error (#1471) - NaN in gradient of abs() on complex 0 (#1472) - test (#1475) - Type unstable gradients (@code_warntype) (#1476) - Type unstable gradients (#1477)
- Julia
Published by github-actions[bot] about 2 years ago
Zygote - v0.6.66
Zygote v0.6.66
Merged pull requests: - Handle unreachable blocks in the adjoint CFG (#1465) (@Pangoraw)
Closed issues:
- return within at-inbounds yields invalid IR (#1118)
- Zygote.withgradient crashes Julia REPL (#1380)
- repeat(X; outer, inner) triggers scalar indexing error with CUDA (#1459)
- Julia
Published by github-actions[bot] over 2 years ago
Zygote - v0.6.65
Zygote v0.6.65
Merged pull requests: - Mark AbstractFFT test broken (#1452) (@ToucheSir) - Extend kron support (#1458) (@willtebbutt)
Closed issues: - Failed to precompile Zygote (#1455) - Zygote-0.6.64 precompile error with julia-1.9.3 (#1457)
- Julia
Published by github-actions[bot] over 2 years ago
Zygote - v0.6.63
Zygote v0.6.63
Closed issues:
- Unable to precompile Zygote (#1435)
- gradient very slow when function call involves indexing (#1436)
- Silent failure differentiating ClassicalOrthogonalPolynomials.jl (#1440)
Merged pull requests:
- Replace "may" with "might" to avoid ambiguity (#1412) (@jeffreyesun)
- Allow f to return a Tuple in withgradient(f, args...) (#1419) (@mcabbott)
- Fix broken example in documentation (#1434) (@LilithHafner)
- Adjoint for parent for LowerTriangular and UpperTriangular (#1444) (@torfjelde)
- Julia
Published by github-actions[bot] over 2 years ago
Zygote - v0.6.62
Zygote v0.6.62
Closed issues:
- Jacobian returns (nothing,) on a Lux Network. Gradient works. (#1422)
- Mutating arrays is not supported when trying to calculate the derivative of a function (#1425)
- ZygoteColorsExt interference with startup packages that load Colors.jl (#1427)
- @adjoint for logabsdet duplicates ChainRules rrule (#1431)
Merged pull requests: - Remove @adjoint for logabsdet (#1432) (@ElOceanografo) - bump version (#1433) (@oxinabox)
- Julia
Published by github-actions[bot] over 2 years ago
Zygote - v0.6.60
Zygote v0.6.60
Closed issues:
- Broadcasted exp(-tr5) is not differentiable (#1399)
- Gradients of functions that use Buffer don't pass the inferred test (#1402)
- GPU compilation of kernel #broadcast_kernel Error when differentiating a Flux model on GPU (#1404)
- Regression in Zygote gradient accuracy in recent versions (#1405)
- differentiating rfft on CuArray leads to error (#1406)
Merged pull requests:
- Fix broadcasted 3-arg * (#1401) (@mcabbott)
- Fix some typos (#1407) (@goggle)
- CompatHelper: bump compat for FillArrays to 1, (keep existing compat) (#1409) (@github-actions[bot])
- Julia
Published by github-actions[bot] almost 3 years ago
Zygote - v0.6.58
Zygote v0.6.58
Closed issues: - ERROR: LoadError: ArgumentError: Package Colors [5ae59095-9a9b-59fe-a467-6f913c188581] is required but does not seem to be installed (#1395)
Merged pull requests:
- Fix reverse failure (#1396) (@simsurace)
- New bugfix release (#1397) (@devmotion)
- Julia
Published by github-actions[bot] almost 3 years ago
Zygote - v0.6.57
Zygote v0.6.57
Closed issues:
- Different jacobian than FiniteDiff for rfft (#1158)
- Incorrect pullback of AbstractFFTs.[i]rfft? (#1377)
Merged pull requests: - move require usage to extensions on 1.9+ (#1390) (@KristofferC) - Fix duplicate import (#1391) (@devmotion)
- Julia
Published by github-actions[bot] almost 3 years ago
Zygote - v0.6.56
Zygote v0.6.56
Closed issues:
- Issue with comparison operator and cuarrays (#678)
- Custom @adjoint doesn't work with PyCall.jl (#789)
- Not able to @optout rules with RuleConfig (#1342)
- [docs] missing reference for `hessianreverse(#1361)
- Binding Flux.setup does not exist (#1366)
- Type instability in Flux.gradient with immutable structs (#1368)
- Type instability onpromote_type` (#1372)
- Incorrect gradient with comprehensions (#1374)
Merged pull requests:
- Remove show for Type{<:Pullback} (#1356) (@devmotion)
- MethodError if configured rrule is ambiguous (#1358) (@oxinabox)
- test pycall adjoint (#1363) (@CarloLucibello)
- update: actions node 12 => node 16 (#1367) (@skyleaworlder)
- Un-revert SnoopCompile changes (#1370) (@ToucheSir)
- Don't differentiate getproperty on const module fields (#1371) (@ToucheSir)
- Update to latest TagBot config (#1373) (@ToucheSir)
- Always call reverse in map (#1376) (@mcabbott)
- Simple fix for kron(::AbstractVector) on nightly (#1378) (@ToucheSir)
- Forward mode: don't use zerolike fallback for GlobalRefs (#1379) (@ToucheSir)
- Add hessian_reverse to docs (#1382) (@ToucheSir)
- Use _pullback inside rules instead of pullback (#1385) (@ToucheSir)
- drop adjoints for [i,r,b]fft() (#1386) (@trahflow)
- Make sure conda env dir is set on Buildkite CI (#1387) (@ToucheSir)
- Julia
Published by github-actions[bot] almost 3 years ago
Zygote - v0.6.53
Zygote v0.6.53
Closed issues:
- abs2 of complex CUDA array fails with Zygote.gradient (#961)
- gradient returns nothing for sum(abs2, x) with a complex CuArray (#1121)
- Complex broadcasting AD gives nothing when using CUDA (#1215)
- cispi has poor performance (#1276)
Merged pull requests: - Adding complex broadcasting for gradients on the GPU (#1324) (@ptiede)
- Julia
Published by github-actions[bot] about 3 years ago
Zygote - v0.6.52
Zygote v0.6.52
Closed issues:
- Wrong gradient through hypergeometric function pFq (#796)
- gradient() fails on array mutation for mean(f, x; dims) (#1128)
- Training Neural SDEs with Mutating Arrays (#1341)
- Cannot specify type of list comprehension (#1343)
- regularization of Flux.params leads to increasing runtime and memory usage (#1347)
- Zygote.Buffer can fail for higher order AD (#1349)
Merged pull requests: - Test/while (#1337) (@bertschi) - Update index.html to the Documenter.jl standard (#1338) (@ChrisRackauckas) - Delete bors.toml (#1339) (@CarloLucibello) - fix forward-over-reverse with Buffer in some cases (#1350) (@marius311)
- Julia
Published by github-actions[bot] about 3 years ago
Zygote - v0.6.50
Zygote v0.6.50
Closed issues:
- Slow code and excessive allocations when backpropagating broadcasting (#592)
- Dictionary indexing failure inside closure and structs (#717)
- bug in comprehension over dictionaries (#725)
- BUG: getindex(::Dict) (#760)
- Document "adjoint" more clearly (#869)
- Memory leak on worker process (#930)
- broken iteration over dictionary (#1065)
- Gradient fails for sum of dictionary values (#1309)
- hessian does not like AbstractVectors (#1315)
- ERROR: MethodError: no method matching +(::Base.RefValue{Any}, ::NamedTuple{(:contents,), (#1317)
- No rule for mean(f, x; dims) (#1318)
Merged pull requests:
- Allow accumulating distinct Dicts (#1237) (@ToucheSir)
- Add precompilation via SnoopPrecompile (#1281) (@ToucheSir)
- Expand limitations page of docs (#1298) (@mcabbott)
- Dynamic README logo (#1311) (@Saransh-cpp)
- Fix and update CompatHelper CI (#1316) (@Saransh-cpp)
- Add an implicit example for withgradient (#1322) (@mcabbott)
- tests for dictionaries (#1330) (@CarloLucibello)
- fix collect and comprehension for NamedTuple and Dict (#1331) (@CarloLucibello)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.48
Zygote v0.6.48
Closed issues: - getproperty MethodError with StructArrays (#602) - zygote broadcast type stability (#1301) - Mutating array error when array isn't mutated (#1308)
Merged pull requests: - preserve type over broadcast (#1302) (@maartenvd) - Wct/fix repeats euclidean (#1307) (@willtebbutt)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.47
Zygote v0.6.47
Merged pull requests:
- Add rule for Dict iteration (#1285) (@ToucheSir)
- Add css + logo to docs (#1299) (@mcabbott)
- Turn on previews, move and render assets, add gradient's API to docs (#1300) (@Saransh-cpp)
- Bump minimum Juila support note in readme (#1303) (@ToucheSir)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.45
Zygote v0.6.45
Closed issues:
- Remove @adjoints for [hv]cat in favour of ChainRules (#1217)
- Wrong gradient involving splatting of kwargs (#1284)
- v0.13.5 of Flux breaks Flux.train! on a custom type with Zygote gradients (#1291)
- extremely slow compilation of gradient AND compilation error (two bugs, really) (#1292)
Merged pull requests:
- remove @adjoint for hv/h/v/cat (#1277) (@mzgubic)
- Treat pairs(NamedTuple) as NamedTuple for indexing (#1286) (@ToucheSir)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.44
Zygote v0.6.44
Closed issues:
- Error from has_chain_rrule on an array of Bool (#1234)
Merged pull requests:
- Propagate ambiguities from rrule lookup instead of failing inexplicably (#1278) (@ToucheSir)
- Passthrough safe ccalls in threading code (#1280) (@ToucheSir)
- @adjoint broadcasted for unary minus (#1287) (@mcabbott)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.42
Zygote v0.6.42
Closed issues:
- Flux.train error when using reduce hcat in loss (#626)
- Broadcasting fails for functions with adjoint 'nothing' (#642)
- Incorrect Wirtinger for prod operation (#744)
- Surprising error when constructing diagonal matrix (#771)
- dropdims gives MethodError in v0.5.6 when training with Flux.jl (#784)
- accum NamedTuple sometimes silently drops derivatives (#861)
- Dot product differentiation (#982)
- unique() error in pullback (#1053)
- Adjoint of cholesky is hard-coded for the CPU (#1210)
- Deprecate @nograd and dropgrad in favour of ChainRulesCore.@non_differentiable and ChainRulesCore.ignore_derivatives (#1235)
- Remove @adjoint for adjoint/Adjoint in favor of ChainRules (#1257)
- Error message link 404 error (#1260)
Merged pull requests:
- deprecate Zygote.@nograd (#1249) (@mzgubic)
- rm rules for Statistics.var, std, mean (#1252) (@mcabbott)
- rm adjoint & transpose adjoints (#1259) (@mcabbott)
- Fix link in error message (#1265) (@ziyiyin97)
- Replace @require CUDA with using GPUArraysCore (#1272) (@mcabbott)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.41
Zygote v0.6.41
Closed issues:
- Limitations Docs (#1077)
- DiffRules warning (#1155)
- Doctests running twice (#1199)
- vcat(::Vector, ::Pair) gradient bug (#1223)
- Zygote.gradient returns nothing instead of `NotImplemented (#1227)
- Rules for mutating functions, @adjoint! and its documentation (#1228)
- Possible mistake in complex tests (#1229)
- Possible mistake in complex tests (#1230)
- Gradient missing when using Params within Dicts (#1241)
- nested gradient fails with "Mutating arrays is not supported" (#1244)
- Incorrect gradient when using Flux.params (#1251)
- Gradients for nested struct fields are super slow (#1256)
Merged pull requests:
- remove @adjoint function cholesky (#1114) (@st--)
- Fix deprecations in DiffRules 1.4, add forward-mode rules for LogExpFunctions (#1172) (@devmotion)
- Make LogExpFunctions a proper dependency and clean adjoints (#1221) (@devmotion)
- Add warnings to ForwardDiff functions (#1224) (@mcabbott)
- Use CR adjoint for logdet(::Cholesky) (#1226) (@devmotion)
- Fix non-holomorphic tests (#1231) (@DomCRose)
- Fix #1241 (#1242) (@bogiebro)
- deprecate dropgrad and ignore (#1245) (@mzgubic)
- Make errors for array mutation, try/catch, and foreign call nicer (+ docs) (#1246) (@darsnack)
- rm rules for maximum, minimum, dropdims (#1250) (@mcabbott)
- rm rules for eachslice, cumsum (#1253) (@mcabbott)
- Run doctests only once (#1255) (@Saransh-cpp)
- Julia
Published by github-actions[bot] over 3 years ago
Zygote - v0.6.40
Zygote v0.6.40
Closed issues:
- Function mod2pi + list of implemented functions (#118)
- Unexpected error with using the normalize from LinearAlgebra (#1190)
- Gradient Dimension Mismatch (#1192)
Merged pull requests:
- Make chunk threshold configurable (#1213) (@lassepe)
- Use setglobal! on nightly (#1219) (@ToucheSir)
- Remove unnecessary generated functions (#1220) (@MasonProtter)
- Julia
Published by github-actions[bot] almost 4 years ago
Zygote - v0.6.38
Zygote v0.6.38
Closed issues:
- non-differentiable error for code that needn't be differentiable (#175)
- Performance of gradient depends on size of implicitly used array (#1180)
- Initializing buffer twice in loop results in a corrupted array (#1191)
- Mismatch gradient output with compared to the docs. (#1193)
- Params iteration is type unstable (#1202)
- AD error due to interaction of missing gradient of besselk and struct with vector (#1204)
Merged pull requests:
- Ton of doctests added (#1194) (@arcAman07)
- Fixing spelling error in the docs (#1197) (@arcAman07)
- Fix type stability of Params.order (#1203) (@ancapdev)
- Handle ChainRulesCore.NotImplemented (#1205) (@devmotion)
- Julia
Published by github-actions[bot] almost 4 years ago
Zygote - v0.6.36
Zygote v0.6.36
Closed issues:
- Possible typo in copy!(x::AbstractVector, ps::Params) (#1135)
- Pullback evaluates to nothing for broadcasted distribution operations (regression) (#1178)
Merged pull requests: - Fix adjoint Iterators.product behavior with nothing (#1170) (@lxvm) - Docs: fix error in adjoint example (#1176) (@james-atkins) - Restrict type broadcast rule to numbers (#1179) (@mcabbott)
- Julia
Published by github-actions[bot] almost 4 years ago
Zygote - v0.6.35
Zygote v0.6.35
Closed issues:
- Matrix (and higher) comprehensions causes stackoverflow (#176)
- ERROR: LoadError: Need an adjoint for constructor SparseMatrixCSC{Float64,Int64}. Gradient is of type Array{Float64,2}. (#742)
- gradient calculation with explicit type cast is broken (#810)
- change repo description from "Intimate Affection Auditor" (#816)
- README should not mention @adjoint (#1105)
- Significant compile time latency in Flux with default optimization (#1126)
- Differentiation of a scalar times array times array results in non-differentiable expression (#1140)
- Error in gradient of custom AbstractMatrix subtypes (#1146)
- Non-deterministic AssertionError when differentiating ThreadsX.sum (#1159)
- Insane precompile times in Metalhead models (#1160)
- Type error with zip and heterogeneous vectors in pullback (#1162)
- Unable to differentiate through Einstein sums from Einsum.jl -- Mutating arrays is not supported (#1164)
Merged pull requests:
- Add codecov badge (#1151) (@ToucheSir)
- Update codecov action and only run on stable linux (#1152) (@ToucheSir)
- ntuple for _restore regardless of length (#1163) (@SBuercklin)
- CompatHelper: bump compat for "FillArrays" to "0.13" (#1165) (@github-actions[bot])
- CompatHelper: bump compat for "NaNMath" to "1" (#1166) (@github-actions[bot])
- update README to reference ChainRulesCore to define custom gradients (#1169) (@mzgubic)
- Broadcast rule for types (#1171) (@mcabbott)
- Julia
Published by github-actions[bot] about 4 years ago
Zygote - v0.6.34
Zygote v0.6.34
Closed issues: - [Suggestion] withhessian (#1139) - Hessian Vector Products (#1141)
Merged pull requests:
- Fix Buffer when storing arrays (#1134) (@avik-pal)
- Make value returned by copy! consistent (#1136) (@pakk-minidose)
- Update Buildkite config for 1.6 LTS and 1.7 (#1142) (@ToucheSir)
- Downstream test for Molly.jl (#1145) (@jgreener64)
- Julia
Published by github-actions[bot] about 4 years ago
Zygote - v0.6.33
Zygote v0.6.33
Closed issues: - Support sparse arrays/matrices as output? (#163) - AD through cuFFT fails, (type instability / broadcast) (#1129) - Broadcast gradient error (#1132)
Merged pull requests:
- CompatHelper: bump compat for "SpecialFunctions" to "2" (#1122) (@github-actions[bot])
- Fix incorrect @forwarding of Base.in on Params (#1130) (@ToucheSir)
- Tag for SpecialFunctions@2 (#1138) (@DhairyaLGandhi)
- Julia
Published by github-actions[bot] about 4 years ago
Zygote - v0.6.30
Zygote v0.6.30
Closed issues:
- Gradient doesn't work properly with enumerate, zip (#221)
- No adjoint for Base.Iterators.ProductIterator (#421)
- Gradient over implicit parameters returns nothing (#692)
- Type instability with structs (#1094)
- Dicts in struct fields don't propagate gradients (#1115)
Merged pull requests:
- Iterators. Product, Filter, enumerate, zip (including inside map) (#785) (@mcabbott)
- Add some downstream testing (#1033) (@ChrisRackauckas)
- Insert _project into getproperty's gradient, and then improve z2d etc. to restore stability (#1104) (@mcabbott)
- Implement copy and merge! for Grads (#1108) (@lassepe)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.26
Zygote v0.6.26
Closed issues: - Zygote.OneElement does not properly reshape (#1080) - error with BitVector (#1086)
Merged pull requests:
- added a dispatch for tuples to prevent LoadError (#1082) (@killah-t-cell)
- Fix broadcasting - with booleans (#1089) (@mcabbott)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.25
Zygote v0.6.25
Closed issues:
- Use forward-mode in broadcasting? (#336)
- Derivative of repeat(::Array{T,0}, ::Int) (#950)
Merged pull requests:
- Make OneElement constructor safer (#1085) (@mcabbott)
- Improve Map Type Stability (#1090) (@willtebbutt)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.24
Zygote v0.6.24
Closed issues: - AD is struggling with ForwardDiff.jacobian (#1081) - Zygote.gradient failed to process Flux.LSTM parameters (#1084)
Merged pull requests:
- Remove incorrect push! and pop! gradients (#1025) (@mcabbott)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.22
Zygote v0.6.22
Closed issues: - Complex gradient on real function with complex intermediates (#342) - Adjoints for functions of specialized matrices (#402) - Gradient of inv and logdet UpperTriangular matrix is not UpperTriangular (#431) - Trying to differentiate a function with complex and real inputs results in error (#917)
Merged pull requests:
- Use ProjectTo in broadcasting & gradient (#1044) (@mcabbott)
- Allow buffer typevar in CuArray type (#1062) (@DhairyaLGandhi)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.21
Zygote v0.6.21
Closed issues:
- Relation to capstan and cassette.jl (#1)
- Error when taking gradient involving zeros(eltype(x), ...). (#72)
- Error when taking gradient involving a range broadcast (#73)
- Deprecation warning in tests (#76)
- Error when trying to define gradient for addition (#84)
- CUDA broadcast over * and + blows up taking gradient (#113)
- cholesky keywords (#121)
- Division causes f32 -> f64 conversion in backward pass (#136)
- differentiating over x isa NTuple{<:Any, <:Integer} causes julia crush (#158)
- simple MLP gradient fails when dropout is included (#171)
- BoundsError in mutable array branch (#172)
- Trouble with reshape() (#187)
- simple broadcast not working (#195)
- Lazy adjoint/transpose gradient fails (#213)
- getindex for Adjoint does not back-propagate (#217)
- Add support for logpdf of Poisson (#281)
- Gradients for cumsum and cumprod (#282)
- Support for tuple and function argument destructuring (#303)
- Cannot differentiate through dictionary (#817)
- Scalar indexing error from GPU matmul against Zygote.OneElement (#1005)
- documentation seems stale because of CI failure (#1021)
- Typo in docs? (#1056)
- Second derivatives not working (#1067)
Merged pull requests:
- Support functions that splat namedtuples as keyword arguments (#1059) (@oxinabox)
- fix pair getfield pullback (#1063) (@CarloLucibello)
- Don't use dual numbers in broadcasting within 2nd derivatives (#1068) (@mcabbott)
- Add short-circuit to rrule_via_ad (#1069) (@mcabbott)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.20
Zygote v0.6.20
Closed issues:
- Batched RNN on GPU: CuArray only supports bits types (#814)
- gradient doesn't seem to work with Julia1.6 (#818)
Merged pull requests:
- Fix docstring cross-reference (#1054) (@st--)
- Support kwargs in rrule_via_ad (#1055) (@mzgubic)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.18
Zygote v0.6.18
Closed issues:
- Error (no method matching iterate(::Nothing)) when counting non-zero elements in loss function (#1027)
- Fix ChainRules deprecation warnings for InplaceableThunk (#1030)
- Can't construct Params with empty parameters (#1032)
- julia examples/mnist_mlp.jl -> ERROR: LoadError: UndefVarError: data not defined (#1046)
- Zygote+RandomNumbers Usage Broken: "ArgumentError: type does not have a definite number of fields" (#1048)
Merged pull requests:
- Tidy up a few things in broadcasting (#1018) (@mcabbott)
- Move to ChainRulesCore v1.0 (in OptingOut) (#1035) (@oxinabox)
- Fix UndefVarError (#1038) (@dlfivefifty)
- Extra fixes for ChainRulesCore @1.0 (#1039) (@mzgubic)
- Update CompatHelper script (#1040) (@DhairyaLGandhi)
- remove artifact warning (#1047) (@mzgubic)
- Remove examples folder (#1050) (@mcabbott)
- Bump patch (#1052) (@willtebbutt)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.17
Zygote v0.6.17
Closed issues:
- Base.Fix1 and Base.Fix2 are much slower than closures (#957)
- It seems a breaking change was introduced after v0.6.14 (#1029)
Merged pull requests: - construct Params with empty tuple (#1031) (@CarloLucibello)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.15
Zygote v0.6.15
Closed issues:
- custom getproperty of mutable struct fails (#685)
- Regression from v0.6.3 to v0.6.8: Mutating arrays error when not mutating anything (#941)
- Error when taking gradient of functions using similar with CUDA CuArray (#997)
- gradient is slow when a lambda expression is passed, due to 99% compilation time of the lambda expression. (#1007)
- Use ismutabletype on 1.7 (#1023)
Merged pull requests:
- fix broken link (#878) (@ho-oto)
- Add scalar method for vcat with number (#880) (@DhairyaLGandhi)
- Improve performance of Base.Fix1 and Base.Fix2 (#958) (@devmotion)
- Differentiate push! with implicit Params (#992) (@DhairyaLGandhi)
- Faster generic broadcasting (#1001) (@mcabbott)
- use rrules even when all the arguments are types (#1006) (@oxinabox)
- Use abstract GPU types for broadcast. (#1009) (@akashkgarg)
- Add convenience function to return primal & cotangents together (#1010) (@mcabbott)
- Documentation edit on implicit parameters (#1016) (@JordiBolibar)
- Whitespace fixes (#1019) (@DhairyaLGandhi)
- CompatHelper: bump compat for "FillArrays" to "0.12" (#1020) (@github-actions[bot])
- documentation updates (#1022) (@aviatesk)
- Make broadcasting over Params in the gradient an error (#1024) (@mcabbott)
- make sure to throw explicit CompileError (#1026) (@aviatesk)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.13
Zygote v0.6.13
Closed issues:
- Move over adjoints from Flux (#81)
- Two errors on Julia 1.6 (#897)
- Wrong Gradient with dot product of broadcast (#916)
- Tangent not defined (#980)
- Error when taking gradient of scalar function using rand.() (#996)
Merged pull requests: - delete rule for prod to use ChainRules' (#988) (@oxinabox) - Use ChainRules RuleConfig (#990) (@oxinabox) - fix #996 (#998) (@simeonschaub)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.12
Zygote v0.6.12
Closed issues:
- broadcast involving NTuple errors no method matching unbroadcast(::Tuple{… AND possible fix? (#975)
Merged pull requests:
- unbroadcast for tuples (#977) (@mcabbott)
- Basic cleanup (#979) (@DhairyaLGandhi)
- Julia
Published by github-actions[bot] over 4 years ago
Zygote - v0.6.11
Zygote v0.6.11
Closed issues:
- Cannot take gradient of function of jacobian (#305)
- error for hessian of a^2*b (#405)
- Unused comprehension throws "iterate(nothing)" method error (#804)
- Operations on StaticArrays give runtime BoundsError (#860)
- Gradient of SpecialFunctions.bessel... errors with SpecialFunctions >= 1 - support thunks? (#873)
- backedge for ChainRules.rrule not working correctly (#915)
- Internal error from a BoundsError (#960)
- Using round() for gradient: MethodError: no method matching iterate (#964)
- Grads algebra on GPU causes scalar getindex is disallowed error (#971)
Merged pull requests:
- Define custom adjoints for LogExpFunctions instead of StatsFuns (#949) (@devmotion)
- Handle nothing in map (#951) (@0)
- fix adjoint for sum (#955) (@simeonschaub)
- fix differentiation of loopinfo exprs (#956) (@simeonschaub)
- Change == to isapprox in some tests (#963) (@mcabbott)
- Adjoint for ForwardDiff.jacobian (#968) (@mcabbott)
- fix gradient algebra on gpu (#972) (@CarloLucibello)
- rename ChainRules differential types (#974) (@mzgubic)
- minor typo fix (#976) (@marius311)
- Julia
Published by github-actions[bot] almost 5 years ago
Zygote - v0.6.8
Zygote v0.6.8
Merged pull requests:
- Gradients for eachcol & friends (#896) (@mcabbott)
- Update Array printing in doctests for 1.6 (#935) (@ToucheSir)
- Fix docs deployment (#936) (@darsnack)
- nograd sizehint! (#938) (@DhairyaLGandhi)
- Julia
Published by github-actions[bot] almost 5 years ago
Zygote - v0.6.4
Zygote v0.6.4
Closed issues:
- How to calculate Jacobians (or just derivatives of vector functions) with Zygote? (#51)
- Jacobian and Hessian (#98)
- Jacobian in Zygote with Params (#413)
- Second derivative of univariate functions: hessian() only takes arrays (#891)
- Gradient of sum (#900)
- jacobian not implemented in v0.6.3 ? (#910)
- Zygote changes type of Interpolations within a function (#914)
Merged pull requests:
- fix cat with Val dims (#881) (@marius311)
- Add jacobian, at last? (#890) (@mcabbott)
- add map/broadcast/algebra/iteration/dict interface for Grads (#902) (@CarloLucibello)
- Use GitHub package server in CI (#904) (@DhairyaLGandhi)
- add more set interface to Params (#907) (@CarloLucibello)
- Julia
Published by github-actions[bot] almost 5 years ago
Zygote - v0.6.1
Zygote v0.6.1
Closed issues: - Possible race condition in distributed AD (#746) - Regression bug about Mutating arrays is not supported (#859) - How to write Jacobian and Hessian functions stripped of ForwardDiff (#865) - Compat (#867)
Merged pull requests: - CompatHelper: bump compat for "AbstractFFTs" to "1.0" (#862) (@github-actions[bot]) - Remove gitlab and add buildkite to GPU ci (#870) (@DhairyaLGandhi) - CompatHelper: bump compat for "FillArrays" to "0.11" (#874) (@github-actions[bot]) - Remove eigen and eigvals adjoints for Symmetric/Hermitian (#875) (@sethaxen) - Remove Symmetric/Hermitian matrix function rules (#882) (@sethaxen)
- Julia
Published by github-actions[bot] about 5 years ago
Zygote - v0.6.0
Zygote v0.6.0
Closed issues: - Forward pass of getfield acts like getproperty in _pullback (#851)
Merged pull requests: - Fix UnionAll stackoverflow (#819) (@DhairyaLGandhi) - fix Zygote on 1.6, fix #851 (#848) (@simeonschaub)
- Julia
Published by github-actions[bot] about 5 years ago
Zygote - v0.5.17
Zygote v0.5.17
Closed issues: - Column vectors work but row vectors fail (#331) - BUG: Array indexing with list comprehensions (#766)
Merged pull requests:
- move NNlib rules out of Zygote (#824) (@simeonschaub)
- Adjoint for broadcasting A .+-* Bool (#838) (@mcabbott)
- Remove LoopVectorization.jl (#842) (@mcabbott)
- Dispatch on AContext (#844) (@willtebbutt)
- Add missing dispatch for pmap (#845) (@ChrisRackauckas)
- Julia
Published by github-actions[bot] about 5 years ago
Zygote - v0.5.14
Zygote v0.5.14
Closed issues: - Some gradient errors (#66) - Gradient error with vec & transpose (#289)
Merged pull requests: - move to GitHub Actions CI (#834) (@CarloLucibello) - fix link to doc (#839) (@ho-oto) - CompatHelper: bump compat for "LoopVectorization" to "0.9" (#840) (@github-actions[bot])
- Julia
Published by github-actions[bot] about 5 years ago
Zygote - v0.5.9
Zygote v0.5.9
Closed issues: - Error with broadcasting == (#724) - Nan gradient for elu and selu. (#758)
Merged pull requests: - Changes needed for Julia 1.5 (#772) (@DhairyaLGandhi) - support ChainRules AbstractZero types (#786) (@mzgubic) - Use === when testing equality with nothing (#790) (@samuela) - fix error while broadcasting (#793) (@gxyd) - Correct primal of Matrix from UniformScaling & handle sum of boolean arrays (#794) (@oxinabox) - remove submodule (#805) (@CarloLucibello)
- Julia
Published by github-actions[bot] over 5 years ago