dbt-labs / dbt-spark

dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks

https://getdbt.com

dbt-labs/dbt-spark Issues

[Bug] Cannot run unit tests against Spark/Hudi, receiving "NoneType is not iterable" error
Updated 8 days ago3
[Issue] sasl as a dependency
Updated 9 days ago2
Import relevant pytest(s) for cross-database `cast` macro
Closed 17 days ago
[Bug] New test failure for `tests/functional/adapter/test_python_model.py::TestPythonIncrementalModelSpark::test_incremental`
Closed 17 days ago
[Bug] dbt run will fail if default namespace doesn't exist.
Closed 18 days ago1
Cross-database `date` macro
Closed 18 days ago
[ADAP-1018] [Feature] Remove Databricks test profiles from integration tests
Closed 19 days ago2
[ADAP-804] [Bug] published dbt-spark docker images are missing latest versions (1.5.x, 1.6.0)
Closed 20 days ago4
[ADAP-999] [Feature] add support for Apache Paimon format
Closed 20 days ago2
[Bug] New test failure for `tests/functional/adapter/test_constraints.py::TestSparkIncrementalConstraintsRollback::test__constraints_enforcement_rollback`
Closed 22 days ago2
[Release Improvements] Refresh workflows for the `pyproject.toml` migration
Updated 24 days ago
[ADAP-873] [Regression] `1.6`does not work with `method: thrift` due to `pyhive`'s lack of `Cursor.fetchmany()` method
Closed 25 days ago4
[ADAP-970] [Feature] Incremental updates should update table description
Closed a month ago3
[ADAP-955] [Feature] Add debug logging for driver/connector packages
Closed a month ago2
[ADAP-702] [Feature] Allow user to specify location directly (instead of concatenating `location_root` and `alias`)
Updated a month ago4
[ADAP-1048] [Bug] Replacing existing table using incremental model
Closed 3 months ago1
[Bug] CI is broken on `main` due to dependency resolution and timeout issues
Closed 3 months ago1
[Bug] dbt docs generate does not include Data Type (data stored in iceberg format)
Updated 3 months ago
[Bug] The tblproperties are not applied when using Python Model to create a table
Closed 3 months ago1
[ADAP-803] The existing table '' is in another format than 'delta' or 'iceberg' or 'hudi'
Updated 3 months ago2
[ADAP-1085] [Bug] When using iceberg format, dbt docs generate is unable to populate the columns information
Updated 3 months ago1
[Bug] flake8 code smells
Updated 3 months ago
[Unit Testing] Add functional tests for unit testing:
Closed 3 months ago1
[ADAP-789] [Feature] Upgrade PyHive to support Python 3.11
Closed 3 months ago5
[Feature] Livy connection support for Spark SQL models
Updated 3 months ago
[Feature] Spike on supporting Py3.12
Updated 4 months ago
[ADAP-931] [Bug] Values in seeds that should convert to `null` aren't working for `session` connection method
Closed 4 months ago3
[ADAP-799] [Feature] Investigate removing dependency on PyHive
Updated 4 months ago1
[ADAP-920] [ADAP-919] [Bug] Delta table metadata changed/concurrent update
Updated 4 months ago1
[ADAP-802] [Bug] Unable to read Iceberg tables when using session connection
Updated 4 months ago3
[ADAP-1019] [Bug] Table already exists, you need to drop it first in incremental models
Updated 4 months ago1
[ADAP-904] [Bug] pip install dev-requirements only works on the second attempt
Updated 4 months ago
[ADAP-1071] [Bug] `latest` and `1.x.latest` tags for ghcr Docker releases are stale
Updated 4 months ago1
`dbt-core` Dockerfile does not work for `dbt-spark` due to `PyHive`
Closed 4 months ago2
[Feature] Support OCI Dataflow as a backend for dbt-spark
Updated 4 months ago
[Feature] Support HTTP transport protocol for Thrift method
Updated 4 months ago
[ADAP-1093] [Feature] Run integration tests against all supported python versions
Updated 5 months ago
[ADAP-913] Support Metadata Freshness
Updated 5 months ago
[ADAP-930] [Feature] Implement relation filtering on get_catalog macro
Updated 6 months ago
[ADAP-1074] [Implementation] Remove `invalid_insert_overwrite_delta_msg` message
Closed 6 months ago
[ADAP-1038] [Tests] Add tests for --empty flag
Closed 6 months ago
[ADAP-1012] Support for new agate data type in Spark
Closed 7 months ago
[ADAP-868] [Bug] Remove unused mypy ignore
Closed 9 months ago1
[ADAP-867] Dataclass updates needed to support migration off hologram
Closed 9 months ago1
[ADAP-675] [Feature] Support `server_side_parameters` for HTTP connection method
Closed 10 months ago
[ADAP-676] [Feature] Enforce `server_side_parameters` to have string keys and values
Closed 10 months ago
[ADAP-677] [Feature] Add a BaseClass to the ConnectionWrapper
Closed 10 months ago
[ADAP-790] [Bug] tblproperties macro not used when creating table neccessary for iceberg tables
Closed 10 months ago2
[ADAP-703] Alternative implementation for show table extended is not executed for session connection method
Closed 10 months ago1
[ADAP-678] test
Closed a year ago