gradient of std(Array{Float32,N}) throws error

Question

gradient of std(Array{Float32,N}) throws error

rened opened this issue 6 years ago · comments

For example, when adding the following lines to test/statistics.jl, 6 of these tests fail:

@test gradcheck(mean, randn(Float32,2,3))
@test gradcheck(mean, randn(Float32,2,3), kwargs=[:dims=>1])
@test gradcheck(mean, randn(Float32,2,3), kwargs=[:dims=>(1,2)])
@test gradcheck(meanabs, randn(Float32,2,3))
@test gradcheck(meanabs2, randn(Float32,2,3))
@test gradcheck(var, randn(Float32,2,3))
@test gradcheck(var, randn(Float32,2,3), kwargs=[:dims=>1])
@test gradcheck(var, randn(Float32,2,3), kwargs=[:dims=>(1,2)])
@test gradcheck(std, randn(Float32,2,3))
@test gradcheck(std, randn(Float32,2,3), kwargs=[:dims=>1])
@test gradcheck(std, randn(Float32,2,3), kwargs=[:dims=>(1,2)])

It seems that the eltype of the input data is not taken into account when allocating the output:

  Expression: gradcheck(var, randn(Float32, 2, 3), kwargs=[:dims => (1, 2)])
  MethodError: no method matching sum_outgrads(::Array{Float32,2}, ::Array{Float64,2})
  Closest candidates are:
    sum_outgrads(!Matched::Nothing, ::Any) at /home/rene/.julia/dev/AutoGrad/src/core.jl:499
    sum_outgrads(::AbstractArray{T,N} where N, !Matched::AbstractArray{T,N} where N) where T at /home/rene/.julia/dev/AutoGrad/src/core.jl:486
    sum_outgrads(!Matched::Rec, ::Any) at /home/rene/.julia/dev/AutoGrad/src/core.jl:490
    ...
  Stacktrace:
   [1] backward_pass(::Rec{Array{Float32,2}}, ::Rec{Float32}, ::Array{AutoGrad.Node,1}) at /home/rene/.julia/dev/AutoGrad/src/core.jl:252
   [2] (::getfield(AutoGrad, Symbol("##gradfun#1#2")){getfield(Main, Symbol("#g#54")){getfield(Main, Symbol("##g#52#53")){typeof(var)}},Int64})(::Base.Iterators.Pairs{Symbol,Tuple{Int64,Int64},Tuple{Symbol},NamedTuple{(:dims,),Tuple{Tuple{Int64,Int64}}}}, ::Function, ::
Array{Float32,2}) at /home/rene/.julia/dev/AutoGrad/src/core.jl:41

Ekin Akyürek · Answer 1 · Sun Aug 19 2018 11:07:09 GMT+0800 (China Standard Time)

Fixed in #91

Ekin Akyürek · Answer 2 · Sun Aug 19 2018 13:12:46 GMT+0800 (China Standard Time)

It fails if dims argument exists.

Rene Donner · Answer 3 · Sun Aug 19 2018 18:46:40 GMT+0800 (China Standard Time)

Yes, with #91

@test gradcheck(std, randn(Float64,2,3))
@test gradcheck(std, randn(Float32,2,3))

works now, but std/var does not work with dims for neither Float32 nor Float64:

@test gradcheck(std, randn(Float64,2,3), kwargs=[:dims=>1])  # fails
@test gradcheck(std, randn(Float32,2,3), kwargs=[:dims=>1])  # fails

denizyuret · Answer 4 · Sun Aug 19 2018 19:04:48 GMT+0800 (China Standard Time)

@ekinakyurek we should test with Float32 arrays in other files as well to check for type consistency.

…

On Sun, Aug 19, 2018 at 6:46 AM Rene Donner ***@***.***> wrote: Yes, with #91 <#91> @test gradcheck(std, ***@***.*** gradcheck(std, randn(Float32,2,3)) works now, but std/var does not work with dims for neither Float32 nor Float64: @test gradcheck(std, randn(Float64,2,3), kwargs=[:dims=>1]) # ***@***.*** gradcheck(std, randn(Float32,2,3), kwargs=[:dims=>1]) # fails — You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <#87 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABvNpg9jpdsOCg7u269Ln7AABi4eAvtCks5uSUIQgaJpZM4WCmLQ> .

denizyuret · Answer 5 · Sun Aug 19 2018 21:43:53 GMT+0800 (China Standard Time)

Fixed this in latest master. Please check and if it is working add these tests to test/statistics.jl.

Rene Donner · Answer 6 · Sun Aug 19 2018 21:53:11 GMT+0800 (China Standard Time)

Thanks, this works! Will add tests.

Ekin Akyürek · Answer 7 · Sun Aug 19 2018 22:32:59 GMT+0800 (China Standard Time)

No need, I am currently adding different type tests to all test files.

…

On 19 Aug 2018, at 09:53, Rene Donner ***@***.***> wrote: Thanks, this works! Will add tests. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#87 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AOpr8deNAx_mtAYvM5CJDMv9sF9wJXzLks5uSW3IgaJpZM4WCmLQ>.