How many GPU memories are needed？

[dzrdzrdzr]

[chenyzh28]

For me, the inference of grok cost 8*A800 and each GPU costs 65G memory.
#257 (comment)

[陆守鹏]

For me, the inference of grok cost 8*A800 and each GPU costs 65G memory. #257 (comment)

Then this has nothing to do with amateurs.

[Youhana Sheriff]

For me, the inference of grok cost 8*A800 and each GPU costs 65G memory. #257 (comment)

Then this has nothing to do with amateurs.

Still We stick around.