apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

https://hudi.apache.org/

apache/hudi Issues

A bug when RocksDBDAO executes the prefixDelete function to delete the last entry
Updated 12 hours ago3
[SUPPORT] write data skew when cow type table write data to parquet
Updated 12 hours ago
[SUPPORT]insert_overwrite_table table slow
Closed 3 days ago10
[SUPPORT] Some spark writer job failed caused by UserGroupInformation lost in the new thread of timeline service threadpool
Closed 5 days ago3
[SUPPORT] HudiDeltaStreaming consuming from Kafka - can't see the Kafka Consumer Group in Kafka
Closed 6 days ago1
[SUPPORT]Data Loss Issue with Hudi Table After 3 Days of Continuous Writes
Updated 6 days ago22
[SUPPORT] Flink-Hudi - Upsert into the same Hudi table via two different Flink pipelines (stream and batch)
Closed 8 days ago12
[SUPPORT] can't retrieve original partition column value when exacting date with CustomKeyGenerator
Updated 7 days ago4
[SUPPORT] Order rows with same key before precombine
Updated 7 days ago1
[SUPPORT] hoodie.combine.before.insert silently broken for bulk_insert if meta fields disabled (causes duplicates)
Updated 7 days ago
[SUPPORT] Flink-Hudi Unable to use Hudi metadata with S3
Updated 8 days ago
[SUPPORT] Task serialization failed: java.lang.NoSuchMethodError: void org.apache.hudi.common.util.HoodieCommonKryoRegistrar.registerClasses(com.esotericsoftware.kryo.Kryo)
Closed 8 days ago4
[SUPPORT] Issue with Repartition on Kafka Input DataFrame and Same Precombine Value Rows In One Batch
Closed 9 days ago6
[SUPPORT] How we can speed up individual file write(HoodieMergeHandle part)
Updated 9 days ago5
[SUPPORT] The Hive run_sync_tool's Logged Command & The Actual Command Do Not Match
Updated 9 days ago1
[SUPPORT] Spark job relying over Hudi are blocked after one or zero commit
Updated 10 days ago3
Recovering job from checkpoint, reporting NoSuchElementException and data exception
Updated 10 days ago1
[SUPPORT] StreamWriteFunction support Exectly-Once in Flink ?
Updated 10 days ago3
[BUG] When writing large amounts, primary keys are duplicated
Closed 10 days ago
ADS layer malfunctioned. After restarting the job, the data statistics were incorrect
Updated 10 days ago2
Different system parse different time zone of timestamp type from the parquet file created by hudi
Closed 10 days ago3
[SUPPORT]File Not Found Exception occurrs when Flink task read Hudi MOR table failure recover
Updated 10 days ago5
[SUPPORT]There is a deltacommit that remains in the REQUESTED state
Closed 11 days ago1
[SUPPORT]After compacting, there are a large number of logs with size 0, and they can never be cleared.
Closed 11 days ago2
[SUPPORT] Questions about LOG in Hudi source code
Closed a month ago2
[SUPPORT] Rollback failed clustering 0.12.2
Updated 13 days ago5
[SUPPORT] org.apache.avro.SchemaParseException: Can't redefine decimal field
Updated 13 days ago3
[SUPPORT] Optimized code ComparableVersion
Closed 14 days ago3
[SUPPORT] Insert and Delete in a Single Operation.
Closed 14 days ago2
[SUPPORT]Exception when executing log compaction : Unsupported Operation Exception
Closed 15 days ago1
Critical and High vulnerabilities reported in hudi jar
Updated 16 days ago8
[SUPPORT] IllegalArgumentException at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:33)
Updated 16 days ago16
[SUPPORT] No way to clean `archived/` folder
Updated 16 days ago4
[Feature Inquiry] index for randomized upserts
Updated 16 days ago2
[SUPPORT]The number of tasks in each distinct stage of building workload profile is always 60
Closed 17 days ago2
Nested object support in Hudi Table using Flink
Closed 17 days ago15
[SUPPORT] Could not sync using the meta sync class org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool
Closed 17 days ago2
[SUPPORT] Compaction job become much more slower after upgrade from 0.10 version to 0.14 version
Updated 17 days ago2
[SUGGEST] Can the community version be updated regularly and faster? The roadmap should also be updated regularly and synchronized.
Updated 21 days ago2
[SUPPORT] Requesting Support for insert_overwrite in Delta Streamer
Closed 22 days ago12
[SUPPORT] AWS Glue 4.0 taking to long to write to S3
Updated 24 days ago3
[SUPPORT] Data duplicated in base file on updating record partition
Closed 24 days ago4
Data lose after writing
Updated 24 days ago4
[SUPPORT] Avoid direct dependency on Flink Table Planner Jar
Updated 24 days ago2
[SUPPORT] Occur bucketid multiple cannot write data to the wrong partition
Updated 24 days ago4
[SUPPORT] The parquet files for the MOR table have been generated, but the RO table in Hive still cannot query the latest data in the parquet files.
Updated 24 days ago7
[SUPPORT] During the process of ingesting data from Kafka and persisting it into a Hudi MOR table, an Out of Memory exception was encountered
Updated a month ago3
[SUPPORT] `Caused by: org.apache.hudi.exception.HoodieException: Unable to instantiate class org.apache.hudi.hive.HiveSyncTool`
Closed a month ago4
[SUPPORT] How to run org.apache.spark.sql.execution.benchmark.LSMTimelineReadBenchmark ？
Updated a month ago6
[SUPPORT] Using BULK_INSERT mode multiple times writing causing a bug: Duplicate fileId 00000000-8651-4ae5-8f9e-4424fed2d181 from bucket 0 of partition found during the BucketStreamWriteFunction index bootstrap.
Closed a month ago1