Giters

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

Home Page:https://lmms-lab.github.io/lmms-eval-blog/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

when we can expect this support for more datasets to be completed?（Raven/NLVR2/IconQA）

littleSunlxy opened this issue · comments

commented

Thank you for your wonderful works.
We are looking forward to supporting more datasets. Could you please inform us when we can expect this support to be completed?

  1. Winoground (winoground)
  2. NLVR2 (nlvr2)
  3. RavenIQ-Test (raveniq)
  4. IconQA (iconqa)

Waiting for reply

commented

We do not have a clear timeline for it, and we are welcome the community support~