tensorflow / data-validation

Library for exploring and validating machine learning data

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

TFDV treat 0 as missing value when dataset is in json format

miaoelenawang opened this issue · comments

When I generate statistics from json dataset, for numerical column, the zero is treated as missing value. And if the dataset is tfrecord, tfdv can correctly treat zero as zero.

@miaoelenawang , please provide a code snippet and the associated error trace to help us expedite the debug process.Thanks.

Hi, I think there are additional steps in the pipeline, I will investigate more. I am going to close the ticket for now. Will update when I find more details.