Giters

imoneoi / openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data

Home Page:https://openchat.team

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

What is a minimum hardware requirements for setup as a sever ?

Altenrion opened this issue · comments

commented

I was trying to setup this project on different virtual environments without any luck.

There is no clear information abut the minimum and recommended hardware and software setup.
I found in one of the closed issues, that you recommnd to use A100 40 GB GPU (which is still over expensive right now).

Tried some GPUs

  • 1080 8GB (not started due to outdated drivers for everything)
  • T4 16GB (eventually started but ran into OOM error)

So what i ask for, is to clarify how to ran this project with 16-24 GB of GPU memory or provide real MINIMUM hardware requirements, that would be easy to see and get into account.

Thanks in advance!