Error in CuArrays.CuArray

Question

Error in CuArrays.CuArray

sepehr3pehr opened this issue 5 years ago · comments

When running demos_train_query_base.jl, I get the following error in line 65 of encode_icm_cuda_single:

WARNING: CuArrays.BLAS is deprecated, use CUBLAS instead.
  likely near /home/sepehr/mcq/demos_train_query_base.jl:174
ERROR: LoadError: MethodError: no method matching CuArrays.CuArray{Float32,N} where N(::Int64)
Closest candidates are:
  CuArrays.CuArray{Float32,N} where N(!Matched::AbstractArray{S,N}) where {T, N, S} at /home/sepehr/.julia/packages/CuArrays/PD3UJ/src/array.jl:93
  CuArrays.CuArray{Float32,N} where N(!Matched::LinearAlgebra.UniformScaling, !Matched::Tuple{Int64,Int64}) at /home/sepehr/.julia/packages/GPUArrays/t8tJB/src/construction.jl:30
  CuArrays.CuArray{Float32,N} where N(!Matched::LinearAlgebra.UniformScaling, !Matched::Integer, !Matched::Integer) at /home/sepehr/.julia/packages/GPUArrays/t8tJB/src/construction.jl:34
  ...
Stacktrace:
 [1] encode_icm_cuda_single(::Array{Float32,2}, ::Array{Int16,2}, ::Array{Array{Float32,2},1}, ::Array{Int64,1}, ::Int64, ::Int64, ::Bool, ::Bool) at /home/sepehr/.julia/dev/Rayuela/src/LSQ_GPU.jl:65
 [2] encode_icm_cuda(::Array{Float32,2}, ::Array{Int16,2}, ::Array{Array{Float32,2},1}, ::Array{Int64,1}, ::Int64, ::Int64, ::Bool, ::Int64, ::Bool) at /home/sepehr/.julia/dev/Rayuela/src/LSQ_GPU.jl:231
 [3] train_lsq_cuda(::Array{Float32,2}, ::Int64, ::Int64, ::Array{Float32,2}, ::Array{Int16,2}, ::Array{Array{Float32,2},1}, ::Int64, ::Int64, ::Int64, ::Bool, ::Int64, ::Int64, ::Bool) at /home/sepehr/.julia/dev/Rayuela/src/LSQ_GPU.jl:300
 [4] experiment_lsq_cuda(::Array{Float32,2}, ::Array{Int16,2}, ::Array{Array{Float32,2},1}, ::Array{Float32,2}, ::Array{Float32,2}, ::Array{Float32,2}, ::Array{UInt32,1}, ::Int64, ::Int64, ::Int64, ::Int64, ::Int64, ::Bool, ::Int64, ::Int64, ::Int64, ::Int64, ::Bool) at /home/sepehr/.julia/dev/Rayuela/src/LSQ_GPU.jl:345
 [5] run_demos(::String, ::Int64, ::Int64, ::Int64, ::Int64) at /home/sepehr/mcq/demos_train_query_base.jl:76
 [6] top-level scope at /home/sepehr/mcq/demos_train_query_base.jl:175 [inlined]
 [7] top-level scope at ./none:0
 [8] include at ./boot.jl:326 [inlined]
 [9] include_relative(::Module, ::String) at ./loading.jl:1038
 [10] include(::Module, ::String) at ./sysimg.jl:29
 [11] exec_options(::Base.JLOptions) at ./client.jl:267
 [12] _start() at ./client.jl:436
in expression starting at /home/sepehr/mcq/demos_train_query_base.jl:174

Julieta Martinez · Answer 1 · Fri Mar 01 2019 04:19:30 GMT+0800 (China Standard Time)

Hi @sepehr3pehr,

Sorry about this -- I reran that script a few days ago and it worked fine with Julia 1.0, so you may want to give that a quick try if you are using 1.1.

I'll look into a way to solve this such that the code can work with both versions.

Julieta Martinez · Answer 2 · Tue Mar 05 2019 09:13:18 GMT+0800 (China Standard Time)

Hey @sepehr3pehr -- I was wondering, did this solve the issue?

Sepehr Eghbali · Answer 3 · Tue Mar 05 2019 11:09:53 GMT+0800 (China Standard Time)

Hey @una-dinosauria, unfortunately no! On julia 1.0.2, I get the following error:

julia> develop https://github.com/una-dinosauria/Rayuela.jl.git

(v1.0) pkg> develop https://github.com/una-dinosauria/Rayuela.jl.git
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
  Updating git-repo `https://github.com/una-dinosauria/Rayuela.jl.git`
[ Info: Path `/home/sepehr/.julia/dev/Rayuela` exists and looks like the correct package, using existing path instead of cloning
 Resolving package versions...
ERROR: Unsatisfiable requirements detected for package CuArrays [3a865a2d]:
 CuArrays [3a865a2d] log:
 ├─possible versions are: [0.1.0-0.1.1, 0.2.0-0.2.1, 0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled
 ├─restricted to versions * by Rayuela [84bd14ec], leaving only versions [0.1.0-0.1.1, 0.2.0-0.2.1, 0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
 │ └─Rayuela [84bd14ec] log:
 │   ├─possible versions are: 0.0.0 or uninstalled
 │   └─Rayuela [84bd14ec] is fixed to version 0.0.0
 ├─restricted by julia compatibility requirements to versions: [0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled, leaving only versions: [0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
 ├─restricted by compatibility requirements with CUDAdrv [c5f51814] to versions: [0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled, leaving only versions: [0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
 │ └─CUDAdrv [c5f51814] log:
 │   ├─possible versions are: [0.1.0-0.1.1, 0.2.0-0.2.4, 0.3.0-0.3.1, 0.4.0-0.4.2, 0.5.0-0.5.4, 0.6.0-0.6.1, 0.7.0-0.7.8, 0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1] or uninstalled
 │   ├─restricted to versions * by Rayuela [84bd14ec], leaving only versions [0.1.0-0.1.1, 0.2.0-0.2.4, 0.3.0-0.3.1, 0.4.0-0.4.2, 0.5.0-0.5.4, 0.6.0-0.6.1, 0.7.0-0.7.8, 0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1]
 │   │ └─Rayuela [84bd14ec] log: see above
 │   ├─restricted by julia compatibility requirements to versions: [0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1] or uninstalled, leaving only versions: [0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1]
 │   ├─restricted by compatibility requirements with CuArrays [3a865a2d] to versions: [0.5.0-0.5.4, 0.6.0-0.6.1, 0.7.0-0.7.8, 0.8.0-0.8.6, 1.0.1], leaving only versions: [0.8.0-0.8.6, 1.0.1]
 │   │ └─CuArrays [3a865a2d] log: see above
 │   └─restricted by compatibility requirements with CUDAapi [3895d2a7] to versions: [0.1.0-0.1.1, 0.2.0-0.2.4, 0.3.0-0.3.1, 0.4.0-0.4.2, 0.5.0-0.5.2, 0.7.8, 0.8.2-0.8.6, 0.9.0, 1.0.0-1.0.1] or uninstalled, leaving only versions: [0.8.2-0.8.6, 1.0.1]
 │     └─CUDAapi [3895d2a7] log:
 │       ├─possible versions are: [0.1.0-0.1.3, 0.2.0-0.2.1, 0.3.0-0.3.1, 0.4.0-0.4.3, 0.5.0-0.5.4, 0.6.0] or uninstalled
 │       ├─restricted by julia compatibility requirements to versions: [0.5.0-0.5.4, 0.6.0] or uninstalled
 │       ├─restricted by compatibility requirements with CuArrays [3a865a2d] to versions: [0.1.0-0.1.3, 0.2.0-0.2.1, 0.3.0-0.3.1, 0.4.0-0.4.3, 0.5.0-0.5.4, 0.6.0], leaving only versions: [0.5.0-0.5.4, 0.6.0]
 │       │ └─CuArrays [3a865a2d] log: see above
 │       └─restricted by compatibility requirements with CUDAdrv [c5f51814] to versions: [0.4.0-0.4.3, 0.5.0-0.5.4], leaving only versions: 0.5.0-0.5.4
 │         └─CUDAdrv [c5f51814] log: see above
 ├─restricted by compatibility requirements with CUDAapi [3895d2a7] to versions: [0.1.0-0.1.1, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled, leaving only versions: [0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
 │ └─CUDAapi [3895d2a7] log: see above
 └─restricted by compatibility requirements with ForwardDiff [f6369f11] to versions: [0.1.0-0.1.1, 0.2.0-0.2.1, 0.3.0, 0.4.0] or uninstalled — no versions left
   └─ForwardDiff [f6369f11] log:
     ├─possible versions are: [0.0.2-0.0.3, 0.1.0-0.1.8, 0.2.0-0.2.5, 0.3.0-0.3.5, 0.4.0-0.4.2, 0.5.0, 0.6.0, 0.7.0-0.7.5, 0.8.0-0.8.5, 0.9.0, 0.10.0-0.10.3] or uninstalled
     ├─restricted by julia compatibility requirements to versions: [0.9.0, 0.10.0-0.10.3] or uninstalled
     └─restricted by compatibility requirements with DiffRules [b552c78f] to versions: [0.0.2-0.0.3, 0.1.0-0.1.8, 0.2.0-0.2.5, 0.3.0-0.3.5, 0.4.0-0.4.2, 0.5.0, 0.6.0, 0.7.0-0.7.1] or uninstalled, leaving only versions: uninstalled
       └─DiffRules [b552c78f] log:
         ├─possible versions are: 0.0.1-0.0.10 or uninstalled
         └─restricted by julia compatibility requirements to versions: 0.0.8-0.0.10 or uninstalled

Julieta Martinez · Answer 4 · Tue Mar 05 2019 12:34:11 GMT+0800 (China Standard Time)

I just updated the Manifest file and the CI passed again, so maybe try updating the package and building it again.

cd ~/.julia/dev/Rayuela
git pull

Start julia and

> using Pkg
> Pkg.build("Rayuela")

This may take a few minutes to bring packages up to date, but hopefully will resolve the dependency issues.

Sepehr Eghbali · Answer 5 · Wed Mar 06 2019 09:49:19 GMT+0800 (China Standard Time)

" Pkg.build("Rayuela")" didn't work for me as it caused unresolved package error. I tried deleting the .julia folder and reinstalling the library but it again caused the same issue.
I am starting to think that there is something wrong with the Julia installation of the cluster that I am using. I will try to contact them to see if it can be resolved.

(v1.0) pkg> develop https://github.com/una-dinosauria/Rayuela.jl.git
Updating git-repo https://github.com/una-dinosauria/Rayuela.jl.git
Cloning default registries into /home/sepehr/.julia/registries
Cloning registry General from "https://github.com/JuliaRegistries/General.git"
Resolving package versions...
ERROR: Unsatisfiable requirements detected for package CuArrays [3a865a2d]:
CuArrays [3a865a2d] log:
├─possible versions are: [0.1.0-0.1.1, 0.2.0-0.2.1, 0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled
├─restricted to versions * by Rayuela [84bd14ec], leaving only versions [0.1.0-0.1.1, 0.2.0-0.2.1, 0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
│ └─Rayuela [84bd14ec] log:
│ ├─possible versions are: 0.0.0 or uninstalled
│ └─Rayuela [84bd14ec] is fixed to version 0.0.0
├─restricted by julia compatibility requirements to versions: [0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled, leaving only versions: [0.3.0, 0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
├─restricted by compatibility requirements with CUDAdrv [c5f51814] to versions: [0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled, leaving only versions: [0.4.0, 0.5.0, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
│ └─CUDAdrv [c5f51814] log:
│ ├─possible versions are: [0.1.0-0.1.1, 0.2.0-0.2.4, 0.3.0-0.3.1, 0.4.0-0.4.2, 0.5.0-0.5.4, 0.6.0-0.6.1, 0.7.0-0.7.8, 0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1] or uninstalled
│ ├─restricted to versions * by Rayuela [84bd14ec], leaving only versions [0.1.0-0.1.1, 0.2.0-0.2.4, 0.3.0-0.3.1, 0.4.0-0.4.2, 0.5.0-0.5.4, 0.6.0-0.6.1, 0.7.0-0.7.8, 0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1]
│ │ └─Rayuela [84bd14ec] log: see above
│ ├─restricted by julia compatibility requirements to versions: [0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1] or uninstalled, leaving only versions: [0.8.0-0.8.6, 0.9.0, 1.0.0-1.0.1]
│ ├─restricted by compatibility requirements with CuArrays [3a865a2d] to versions: [0.5.0-0.5.4, 0.6.0-0.6.1, 0.7.0-0.7.8, 0.8.0-0.8.6, 1.0.1], leaving only versions: [0.8.0-0.8.6, 1.0.1]
│ │ └─CuArrays [3a865a2d] log: see above
│ └─restricted by compatibility requirements with CUDAapi [3895d2a7] to versions: [0.1.0-0.1.1, 0.2.0-0.2.4, 0.3.0-0.3.1, 0.4.0-0.4.2, 0.5.0-0.5.2, 0.7.8, 0.8.2-0.8.6, 0.9.0, 1.0.0-1.0.1] or uninstalled, leaving only versions: [0.8.2-0.8.6, 1.0.1]
│ └─CUDAapi [3895d2a7] log:
│ ├─possible versions are: [0.1.0-0.1.3, 0.2.0-0.2.1, 0.3.0-0.3.1, 0.4.0-0.4.3, 0.5.0-0.5.4, 0.6.0] or uninstalled
│ ├─restricted by julia compatibility requirements to versions: [0.5.0-0.5.4, 0.6.0] or uninstalled
│ ├─restricted by compatibility requirements with CuArrays [3a865a2d] to versions: [0.1.0-0.1.3, 0.2.0-0.2.1, 0.3.0-0.3.1, 0.4.0-0.4.3, 0.5.0-0.5.4, 0.6.0], leaving only versions: [0.5.0-0.5.4, 0.6.0]
│ │ └─CuArrays [3a865a2d] log: see above
│ └─restricted by compatibility requirements with CUDAdrv [c5f51814] to versions: [0.4.0-0.4.3, 0.5.0-0.5.4], leaving only versions: 0.5.0-0.5.4
│ └─CUDAdrv [c5f51814] log: see above
├─restricted by compatibility requirements with CUDAapi [3895d2a7] to versions: [0.1.0-0.1.1, 0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1] or uninstalled, leaving only versions: [0.6.0-0.6.2, 0.7.0-0.7.3, 0.8.0-0.8.1, 0.9.0-0.9.1]
│ └─CUDAapi [3895d2a7] log: see above
└─restricted by compatibility requirements with ForwardDiff [f6369f11] to versions: [0.1.0-0.1.1, 0.2.0-0.2.1, 0.3.0, 0.4.0] or uninstalled — no versions left
└─ForwardDiff [f6369f11] log:
├─possible versions are: [0.0.2-0.0.3, 0.1.0-0.1.8, 0.2.0-0.2.5, 0.3.0-0.3.5, 0.4.0-0.4.2, 0.5.0, 0.6.0, 0.7.0-0.7.5, 0.8.0-0.8.5, 0.9.0, 0.10.0-0.10.3] or uninstalled
├─restricted by julia compatibility requirements to versions: [0.9.0, 0.10.0-0.10.3] or uninstalled
└─restricted by compatibility requirements with DiffRules [b552c78f] to versions: [0.0.2-0.0.3, 0.1.0-0.1.8, 0.2.0-0.2.5, 0.3.0-0.3.5, 0.4.0-0.4.2, 0.5.0, 0.6.0, 0.7.0-0.7.1] or uninstalled, leaving only versions: uninstalled
└─DiffRules [b552c78f] log:
├─possible versions are: 0.0.1-0.0.10 or uninstalled
└─restricted by julia compatibility requirements to versions: 0.0.8-0.0.10 or uninstalled

Jakub Hanko · Answer 6 · Thu Sep 08 2022 21:21:43 GMT+0800 (China Standard Time)

Hello, reviving an old thread.

Changing d_prevcost = CuArrays.CuArray{Cfloat}(n) to d_prevcost = CuArrays.CuArray{Cfloat}(undef, n) in LSQ_GPU.jl:66
has done the job for me, apparently. Same change for d_newcost. Letting everyone know in case someone stumbles upon this error just like I did.

Julieta Martinez · Answer 7 · Sun Sep 11 2022 02:25:24 GMT+0800 (China Standard Time)

Thanks for the fix @JakubHanko !