databricks / koalas

Koalas: pandas API on Apache Spark

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Spammed with FutureWarnings that are unfilterable

CodyGreen-Datavant opened this issue · comments

When preforming any kind of itterable:
enc[example'] = enc.example.apply(lambda x: 1880 if pd.notnull(x) & ((x >=1880) & (x < 1890)) else x)

I am constantly spammed with:

/path/miniconda/lib/python3.8/site-packages/pyspark/python/lib/pyspark.zip/pyspark/pandas/internal.py:1573: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.

I believe this is due to the new pandas update.