lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Inaccessible Leaderboard with Screenreader

chigkim opened this issue · comments

Hi,

I'm a blind user, and I can't access leaderboard.lmsys.org with a screen reader.
I tried accessing the website with many screen readers including Jaws, NVDA, Narrator on Windows, and VoiceOver on Mac.
All of them see only one row, and some of them have browser freezing issues.
Alternative solution might be to publish the raw ranking data in json/csv format.
I know you guys published raw data for battles, but maybe just publishing the ranking with benchmark scores would be great.
If publishing the data synchronized with the website in real time is not possible, could you consider maybe at least publishing once a day? That would be helpful.
Thanks so much!