Data download does not follow the showed structure
filippoweb3 opened this issue · comments
In the Gov2 voting section for a referendum, the structure below
![Screenshot 2023-11-05 at 22 09 42](https://private-user-images.githubusercontent.com/110459737/280532343-ab39a181-df7a-484d-b252-47fbb885cee7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDY2NjcxOTYsIm5iZiI6MTcwNjY2Njg5NiwicGF0aCI6Ii8xMTA0NTk3MzcvMjgwNTMyMzQzLWFiMzlhMTgxLWRmN2EtNDg0ZC1iMjUyLTQ3ZmJiODg1Y2VlNy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTMxJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDEzMVQwMjA4MTZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hM2MxMTgyN2Y2ZDk0MjE5ZmEzYzJjZmZhOTMxYTg2NzNjMjA5MGIyYmFkYzAwNjJkYTQxNmU3MjkzNTU1OTljJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.oqUBkucf64-7A0sN2r2mlHeFaSsN0FYYc-t7d5QbhZ0)
is not the same as the one in the .csv file after the download
![Screenshot 2023-11-05 at 22 12 16](https://private-user-images.githubusercontent.com/110459737/280532352-5f5e309d-9d19-4ade-ac45-10ad36ad5e0c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDY2NjcxOTYsIm5iZiI6MTcwNjY2Njg5NiwicGF0aCI6Ii8xMTA0NTk3MzcvMjgwNTMyMzUyLTVmNWUzMDlkLTlkMTktNGFkZS1hYzQ1LTEwYWQzNmFkNWUwYy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTMxJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDEzMVQwMjA4MTZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0yMzQ4M2QxZjNhNWJlYTE0ZTYyYzM4NDk0ZmUzYTkwOWNhNzY4ZGQ5NTAxNDRlZmM4MmNlMGQwY2VkOWY5NjYzJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.YlEkUzDzpSznLnEkpCitghYz2qmGFbQEqLi-3t-qu10)
It would be also cool to download all the pages data :) Currently I can download one page at a time. It would be awesome to have this option (i.e. download all data on all pages, see below) on all similar sections across the website (staking, etc.)
![Screenshot 2023-11-05 at 22 15 35](https://private-user-images.githubusercontent.com/110459737/280532550-660ee077-fbdf-4657-90e3-08455fb3db6a.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDY2NjcxOTYsIm5iZiI6MTcwNjY2Njg5NiwicGF0aCI6Ii8xMTA0NTk3MzcvMjgwNTMyNTUwLTY2MGVlMDc3LWZiZGYtNDY1Ny05MGUzLTA4NDU1ZmIzZGI2YS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTMxJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDEzMVQwMjA4MTZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT04ZTJkMDI1NjYyNzM4YmE1ZWJhMTNhNDFhMzk0MDQyNTc0ZmE1OWJkODI5YmM3MjAxNGVmMzQxZTk5YWMzYmVhJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.nWZIt8u4PH9vvI3lfeitE51IAud04WqNbihlDNa3QMA)
@WoeOm, thanks for the update. It would be very helpful to download the whole dataset as it will ease data analytics by exporting the whole .csv file.
@WoeOm see an example of what I intend to do with subscan data: https://x.com/filippoweb3/status/1721761953205608888?s=20
Imagine downloading each page for each proposal. It would be a lot of pain :D
@WoeOm see an example of what I intend to do with subscan data: https://x.com/filippoweb3/status/1721761953205608888?s=20
Imagine downloading each page for each proposal. It would be a lot of pain :D
Visualizing votes data is a great idea.
We are evaluating the "Download All Votes Data" feature. But before that, you can easily fetch votes data through the subscan API.