The script works strangely
Taimerlan opened this issue · comments
Hi all,
I'm trying to index a site with 1 million pages, after a long time it gives out:
Web Search Indexing API quota is not consumed, no errors.
The cache is also not created in the folder. There is only one file.
Can anyone encounter it?
Hey @Taimerlan, what command did you run to start the script?
Hey @Taimerlan, what command did you run to start the script?
npm run index ....
Tried through a plugin on the site to start the index pages, all was successful.
But the script used to work when he could not take all pages from the site map, the maximum took 80-90 thousand, and when I made the site map quickly available, he captured all pages, maybe because of the number of pages such a problem?
Update: Trying to index small site, it was successful.
Hey @Taimerlan, what command did you run to start the script?
npm run index ....Tried through a plugin on the site to start the index pages, all was successful. But the script used to work when he could not take all pages from the site map, the maximum took 80-90 thousand, and when I made the site map quickly available, he captured all pages, maybe because of the number of pages such a problem?
Update: Trying to index small site, it was successful.
Are you using the latest version of this repository ?
Hello, sorry for late answer. First time I use the new version with ts extention. Where as I understand there was an update to stop after an error. #29
Now I tried the most recent version, but the same thing happens. I can send you the service_account.json file and the site address to your e-mail.
I realize it's due to what I said here: #38 (comment)
We'll try to improve it, but it's really a big black spot at the moment.