Scraper does not account for thousands in Star/Watcher/Fork count
gianlucascoccia opened this issue · comments
I have found that, for popular repositories with thousands of stars and watchers, the scraper does not provide the correct output, probably as it disregards the 'k' appended after the number.
Take, for instance, the Atom repository:
This is the output provided by my simple script, that just outputs the data received from the scraper:
@gianlucascoccia thanks for opening this issue to inform us that the k
values are no longer working.
As you can see from the screenshot you have kindly shared, the commits
value is NaN
too ... 😕
GitHub have very recently updated their UI and changed a bunch of classes
so our scraper/parser is no longer getting the correct data. #113
We have a RegEx that parses the 52.3k
to 52300
:
Lines 2 to 16 in 47d0a46
and it has tests:
github-scraper/test/utils.test.js
Lines 7 to 14 in 47d0a46
But as I say, GitHub have changed their UI/classes so they have "broken" our scraper. 🤦
If you want to help fix this by updating the classes in the repo
file:
Lines 26 to 35 in 47d0a46
A pull request is very much welcome.
Thanks. ☀️