databricks / koalas

Koalas: pandas API on Apache Spark

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

databricks.koalas.info() doesn't show memory usage

AliWaheed opened this issue · comments

The documentation states that databricks.koalas.info() shows memory usage too but it doesn't in practice.
It doesn't show memory usage in the examples given in the documentation either.

Thanks for the report, @AliWaheed :)
Koalas doesn't show the memory usage because it's hard to calculate it since Koalas runs on a distributed manner.
Seems like it was mistakenly added when copying the pandas' one.
I think we should fix the documents.

Got it, thanks for the reply