Error on create_table_if_not_exists
edulauer opened this issue · comments
When using the DbtoDpOperator to copy a table to a non-existing destination table, the create_table_if_not_exists command creates only the table but misses the columns, resulting in an error. This scenario occurred with the following table from Quartzo: cipiws_VBL.arquivo_intervencao. The table was created in the data lake but without any columns.
The error was caused because the connection credentials in Airflow incorrectly contained capital letters, which led to empty rows in the metadata search of the table in the Teeid database. However, after directly correcting the connection in Airflow, the problem was solved.