castorini / pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

Home Page:http://pyserini.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Connection Reset Error in Reproducing DPR

AnsrM opened this issue · comments

When reproducing DPR, there is always a problem in downloading automatically "faiss.wikipedia-dpr-100w.dpr_multi.20200127.f403c3.tar.gz".

Running "python -m pyserini.search.faiss --index wikipedia-dpr-100w.dpr-multi --topics dpr-nq-test --encoded-queries dpr_multi-nq-test --output runs/dpr-run-nq.trec --batch-size 32 --threads 16"

Error Message: "
Traceback (most recent call last):
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/site-packages/pyserini/search/faiss/main.py", line 205, in
searcher = FaissSearcher.from_prebuilt_index(args.index, query_encoder)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/site-packages/pyserini/search/faiss/_searcher.py", line 429, in from_prebuilt_index
index_dir = download_prebuilt_index(prebuilt_index_name)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/site-packages/pyserini/util.py", line 234, in download_prebuilt_index
return download_and_unpack_index(url, local_filename=local_filename,
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/site-packages/pyserini/util.py", line 149, in download_and_unpack_index
download_url(url, index_directory, local_filename=local_filename, verbose=False, md5=md5)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/site-packages/pyserini/util.py", line 95, in download_url
urlretrieve(url, filename=destination_path, reporthook=t.update_to)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/urllib/request.py", line 276, in urlretrieve
block = fp.read(bs)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/http/client.py", line 459, in read
n = self.readinto(b)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/http/client.py", line 503, in readinto
n = self.fp.readinto(b)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/socket.py", line 669, in readinto
return self._sock.recv_into(b)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/ssl.py", line 1274, in recv_into
return self.read(nbytes, buffer)
File "/home/yxmeng/anaconda3/envs/gar_env/lib/python3.8/ssl.py", line 1132, in read
return self._sslobj.read(len, buffer)
ConnectionResetError: [Errno 104] Connection reset by peer"