akvelon / DnA_accelerators

Akvelon is a digital product and software engineering company that empowers strategic advantage and accelerates your path to value in Data and Analytics, AI/ML, MLOps, Application development, and more with innovation and predictable delivery.

Home Page:https://akvelon.com/data-analitycs/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Batch Load Salesforce To Bigquery

gerrywhip opened this issue · comments

If a SalesForce row has a null value in any of its fields then it does not get inserted into BigQuery.

Using this repo I built a dataflow template based on CdapSalesforceBatchToBigQuery.java.
From there I have created a few jobs, changing the optional parameters. I am getting data through to BigQuery , but only for rows with no null values.

Is this intentional behaviour , if yes could you advise on how to adjust to allow for nulls?