Librispeech training error
saurabhvyas opened this issue · comments
I have followed all install instructions as stated in wiki
saurabh@saurabh-MS-7923:~/saurabh/deepspeech.torch$ th MakeLMDB.lua -rootPath prepare_datasets/libri_dataset -lmdbPath prepare_datasets/libri_lmdb -windowSize 0.02 -stride 0.01 -sampleRate 16000 -processes 5 -audioExtension flac
eth0: error fetching interface information: Device not found
eth1: error fetching interface information: Device not found
wlan0: error fetching interface information: Device not found
wlan1: error fetching interface information: Device not found
Torch 7.0 Copyright (C) 2001-2011 Idiap, NEC Labs, NYU
Torch 7.0 Copyright (C) 2001-2011 Idiap, NEC Labs, NYU
Torch 7.0 Copyright (C) 2001-2011 Idiap, NEC Labs, NYU
eth0: error fetching interface information: Device not found
Torch 7.0 Copyright (C) 2001-2011 Idiap, NEC Labs, NYU
eth0: error fetching interface information: Device not found
eth0: error fetching interface information: Device not found
Torch 7.0 Copyright (C) 2001-2011 Idiap, NEC Labs, NYU
eth1: error fetching interface information: Device not found
wlan0: error fetching interface information: Device not found
wlan1: error fetching interface information: Device not found
eth1: error fetching interface information: Device not found
eth0: error fetching interface information: Device not found
eth1: error fetching interface information: Device not found
eth1: error fetching interface information: Device not found
wlan0: error fetching interface information: Device not found
wlan0: error fetching interface information: Device not found
eth0: error fetching interface information: Device not found
wlan0: error fetching interface information: Device not found
wlan1: error fetching interface information: Device not found
eth1: error fetching interface information: Device not found
wlan1: error fetching interface information: Device not found
wlan1: error fetching interface information: Device not found
wlan0: error fetching interface information: Device not found
wlan1: error fetching interface information: Device not found
Retrieving sizes for sorting...
Sorting...
Creating LMDB dataset to: prepare_datasets/libri_lmdb/train
luajit: MakeLMDB.lua:61: attempt to index field 'file' (a nil value)
stack traceback:
MakeLMDB.lua:61: in function 'code'
MakeLMDB.lua:168: in function 'f'
(command line):4: in main chunk
[C]: at 0x00405d50
luajit: MakeLMDB.lua:61: attempt to index field 'file' (a nil value)
stack traceback:
MakeLMDB.lua:61: in function 'code'
MakeLMDB.lua:168: in function 'f'
(command line):4: in main chunk
[C]: at 0x00405d50
luajit: MakeLMDB.lua:61: attempt to index field 'file' (a nil value)
stack traceback:
MakeLMDB.lua:61: in function 'code'
MakeLMDB.lua:168: in function 'f'
(command line):4: in main chunk
[C]: at 0x00405d50
luajit: MakeLMDB.lua:61: attempt to index field 'file' (a nil value)
stack traceback:
MakeLMDB.lua:61: in function 'code'
MakeLMDB.lua:168: in function 'f'
(command line):4: in main chunk
[C]: at 0x00405d50
luajit: MakeLMDB.lua:61: attempt to index field 'file' (a nil value)
stack traceback:
MakeLMDB.lua:61: in function 'code'
MakeLMDB.lua:168: in function 'f'
(command line):4: in main chunk
[C]: at 0x00405d50
MakeLMDB.lua:125: attempt to index local 'vec' (a nil value)
<parallel#000> closing session
and If I use a pretrained model , I get another error related to warp-ctc
saurabh@saurabh-MS-7923:~/saurabh/deepspeech.torch$ th Train.lua -loadModel -loadPath libri_deepspeech-light.t7
/home/saurabh/torch/install/bin/luajit: /home/saurabh/torch/install/share/lua/5.1/trepl/init.lua:389: /home/saurabh/torch/install/share/lua/5.1/trepl/init.lua:389: .../saurabh/torch/install/share/lua/5.1/luarocks/loader.lua:117: error loading module 'libwarp_ctc' from file '/home/saurabh/torch/install/lib/lua/5.1/libwarp_ctc.so':
libwarpctc.so: cannot open shared object file: No such file or directory
stack traceback:
[C]: in function 'error'
/home/saurabh/torch/install/share/lua/5.1/trepl/init.lua:389: in function 'require'
...saurabh/torch/install/share/lua/5.1/nnx/CTCCriterion.lua:13: in function '__init'
/home/saurabh/torch/install/share/lua/5.1/torch/init.lua:91: in function </home/saurabh/torch/install/share/lua/5.1/torch/init.lua:87>
[C]: in function 'CTCCriterion'
./Network.lua:86: in function 'trainNetwork'
Train.lua:43: in main chunk
[C]: in function 'dofile'
...rabh/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
[C]: at 0x00405d50
Seems like lua---parallel wasn't installed correctly. Did you run the below commands to install?
sudo apt-get install libzmq3-dev libzmq3
luarocks install parallel
I Installed the above but it still didnt work , I had to install the following to get it working ( even though I have ubuntu 16.04 )
sudo apt-get install libgflags-dev libgoogle-glog-dev liblmdb-dev
Thanks