bxparks / bigquery-schema-generator

Generates the BigQuery schema from newline-delimited JSON or CSV data records.

bxparks/bigquery-schema-generator Issues

[FEATURE] Starting with an existing schema, exclude rows that do not match the existing schema
Closed 6 months ago4
add configurable csv.field_size_limit in SchemaGenerator
Closed 9 months ago5
Is there a way to supress the logs from bigquery schema generator?
Closed 10 months ago
mode conflation in nullable nested, repeated records
Closed a year ago2
schema inference involving nulls and arrays produces inconsistent results
Closed a year ago4
Column name must start with a letter or underscore
Closed a year ago2
AttributeError: 'NoneType' object has no attribute 'lower'
Closed 2 years ago5
sanitize_name and field name starting by number
Closed 2 years ago1
Fails to generate schema on nested json
Closed 2 years ago
Python Code Examples 404
Closed 2 years ago1
Cannot flatten schema due to schema map being a tuple[OrderedDict, list]
Closed 3 years ago5
CSV Delimiter Option
Closed 3 years ago6
apply quoted_values_are_strings to timetstamps?
Closed 3 years ago5
Unsupported array element type: __array__
Closed 3 years ago3
[FEATURE] Starting with an existing schema, epoch time cannot mismatched type TIMESTAMP --> INTEGER
Updated 4 years ago6
Schema generation from a list
Closed 4 years ago3
[BUG] - empty nested records with keep_nulls=False produce a record with no fields
Closed 4 years ago6
Allow sections in test DataReader to appear in any order
Updated 4 years ago
[FEATURE] When a nested field has mismatched type print the full path to that nested field
Closed 4 years ago5
Loading GCP stackdriver logs into BQ
Closed 4 years ago3
Skip bad records instead of throwing an exception?
Closed 4 years ago8
Ignoring non-RECORD field with mismatched mode: - error
Closed 4 years ago2
Allow option to pass in iterable of dictionaries when used as a library
Closed 4 years ago3
Dates which are not in ISO format...
Closed 4 years ago8
recursive name sanitization of records of type RECORD fails
Closed 4 years ago1
Quick note to say thanks!
Closed 4 years ago1
getting error after running the generate-schema
Closed 4 years ago1
When creating a load job programmatically, load_job.schema has to be a list of bigquery.SchemaField objects
Closed 5 years ago2
Can the schema generation tool suppress case insensitive duplicates that are not accepted by bigquery?
Closed 5 years ago2
infer_mode still returns "REQUIRED" for json file
Closed 5 years ago2
Sudo pip install is discouraged
Closed 5 years ago1
Issue with invalid csv column names
Closed 5 years ago
Type Inferrence in inconsistent lists of dictionaries
Closed 5 years ago7
support sending an existing schema to deduce_schema
Closed 5 years ago2
Make quoted integer detection optional
Closed 5 years ago5
Integers exceeding the bigquery integer limit are still converted to integer in the schema
Closed 5 years ago2
Support for "UTC" suffix in TIMESTAMP data
Closed 5 years ago1
error with white spaces & other wrong characters in column names
Closed 6 years ago6
support timezone without a colon (:) character
Updated 6 years ago
create symlink at /usr/local/bin/generate-schema on MacOS
Closed 6 years ago2
Doesn't install properly from PyPI
Closed 6 years ago3