Giters

xtdb / xtdb

An immutable database for application development and time-travel data compliance, with SQL and XTQL. Developed by @juxt

Home Page:https://xtdb.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Error while compacting

FiV0 opened this issue · comments

commented

After indexing the products benchmark, I am getting

17:24:36.640 [xtdb.compactor-7] ERROR xtdb.compactor - Error running compaction job.
java.lang.IllegalArgumentException: Could not load buffers for field value: Union(Dense, [0, 1, 2])<f64: FloatingPoint(DOUBLE) not null, null: Null, i64: Int(64, true) not null> not null. error message: index: 4, length: 1 (expected: range(0, 4))
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:122)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:133)
	at org.apache.arrow.vector.VectorLoader.load(VectorLoader.java:84)
	at xtdb.trie.ArrowDataRel$fn__28970.invoke(trie.clj:373)
	at xtdb.trie.ArrowDataRel.loadPage(trie.clj:372)
	at xtdb.trie$load_data_page.invokeStatic(trie.clj:410)
	at xtdb.trie$load_data_page.invoke(trie.clj:407)
	at clojure.core$mapv$fn__8551.invoke(core.clj:6988)
	at clojure.core.protocols$iter_reduce.invokeStatic(protocols.clj:49)
	at clojure.core.protocols$fn__8246.invokeStatic(protocols.clj:75)
	at clojure.core.protocols$fn__8246.invoke(protocols.clj:75)
	at clojure.core.protocols$fn__8194$G__8189__8207.invoke(protocols.clj:13)
	at clojure.core$reduce.invokeStatic(core.clj:6895)
	at clojure.core$mapv.invokeStatic(core.clj:6979)
	at clojure.core$mapv.invoke(core.clj:6979)
	at xtdb.compactor$merge_segments_into.invokeStatic(compactor.clj:76)
	at xtdb.compactor$merge_segments_into.invoke(compactor.clj:56)
	at xtdb.compactor$exec_compaction_job_BANG_$fn__40204$fn__40205$fn__40214$fn__40215.invoke(compactor.clj:134)
	at xtdb.compactor$exec_compaction_job_BANG_$fn__40204$fn__40205$fn__40214.invoke(compactor.clj:132)
	at xtdb.compactor$exec_compaction_job_BANG_$fn__40204$fn__40205.invoke(compactor.clj:132)
	at xtdb.compactor$exec_compaction_job_BANG_$fn__40204.invoke(compactor.clj:121)
	at xtdb.compactor$exec_compaction_job_BANG_.invokeStatic(compactor.clj:121)
	at xtdb.compactor$exec_compaction_job_BANG_.invoke(compactor.clj:116)
	at xtdb.compactor$eval40319$fn__40321$compactor_loop__40355.invoke(compactor.clj:280)
	at clojure.lang.AFn.run(AFn.java:22)
	at java.base/java.util.concurrent.ThreadPerTaskExecutor$TaskRunner.run(ThreadPerTaskExecutor.java:314)
	at java.base/java.lang.VirtualThread.run(VirtualThread.java:309)
Caused by: java.lang.IndexOutOfBoundsException: index: 4, length: 1 (expected: range(0, 4))
	at org.apache.arrow.memory.ArrowBuf.checkIndexD(ArrowBuf.java:319)
	at org.apache.arrow.memory.ArrowBuf.chk(ArrowBuf.java:306)
	at org.apache.arrow.memory.ArrowBuf.getByte(ArrowBuf.java:508)
	at org.apache.arrow.vector.complex.DenseUnionVector.getTypeId(DenseUnionVector.java:843)
	at org.apache.arrow.vector.complex.DenseUnionVector.loadFieldBuffers(DenseUnionVector.java:211)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:114)
	... 32 common frames omitted