v2ray / domain-list-community

Community managed domain list

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

I'm curious about the reason why the dlc.dat file reduces about 500KB in size suddenly.

Loyalsoldier opened this issue · comments

No build errors. No problem with the speedtest generation script.

image

commented

I viewed that, some data get lost.
I'm looking into it.

commented

image

image

curl only downloads about 100 lines of speedtest domains. That's strange.

image

commented

Nothing writes into it, it's weird.
image

commented

I found it out.

https://c.speedtest.net/speedtest-servers-static.php didn't return a correct xml file, a html page instead.

image
image

I try wget. It responds 503 Status code. Then I try curl with Chrome User-Agent. It downloads the same content as without Chrome user-agent.

I think speedtest has banned Microsoft IPs.

commented

We have to use a former form, update it at a certain time instead of using GitHub Actions may be the only choice now.

Agree.

commented

Azure Cloud Ubuntu

curl 'https://c.speedtest.net/speedtest-servers-static.php' -H 'User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:72.0) Gecko/20100101 Firefox/72.0' -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8' --compressed

success

commented

I tested few more times.
If I enable gzip (add Header Accept-Encoding: gzip), it will return correct content.
If I don't, it won't.