cockroachdb / pebble

RocksDB/LevelDB inspired key-value database in Go

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

metamorphic: TestMeta failed; ingestAndExciseOp not simulating the excise in all cases

cockroach-teamcity opened this issue · comments

github.com/cockroachdb/pebble/internal/metamorphic.TestMeta failed with artifacts on refs/heads/master @ bd8563ecc1ad:

=== PAUSE TestMeta/execution/standard-008
=== CONT  TestMeta/execution/standard-008
=== RUN   TestMeta/compare/random-000
=== RUN   TestMeta/compare/standard-008
=== RUN   TestMeta/execution/random-021
=== PAUSE TestMeta/execution/random-021
=== CONT  TestMeta/execution/random-021
=== RUN   TestMeta/execution/random-024
=== PAUSE TestMeta/execution/random-024
=== CONT  TestMeta/execution/random-024
=== RUN   TestMeta/execution/random-027
=== PAUSE TestMeta/execution/random-027
=== CONT  TestMeta/execution/random-027
=== RUN   TestMeta/execution/random-029
=== PAUSE TestMeta/execution/random-029
=== CONT  TestMeta/execution/random-029
=== RUN   TestMeta/execution/standard-011
=== PAUSE TestMeta/execution/standard-011
=== CONT  TestMeta/execution/standard-011
=== RUN   TestMeta/execution/standard-012
=== PAUSE TestMeta/execution/standard-012
=== CONT  TestMeta/execution/standard-012
=== RUN   TestMeta/execution/standard-017
=== PAUSE TestMeta/execution/standard-017
=== CONT  TestMeta/execution/standard-017
=== RUN   TestMeta/execution/standard-024
=== PAUSE TestMeta/execution/standard-024
=== CONT  TestMeta/execution/standard-024
=== RUN   TestMeta/execution/standard-027
=== PAUSE TestMeta/execution/standard-027
=== CONT  TestMeta/execution/standard-027
=== RUN   TestMeta/execution/standard-026
=== PAUSE TestMeta/execution/standard-026
=== CONT  TestMeta/execution/standard-026
=== RUN   TestMeta/compare/standard-019
=== RUN   TestMeta/execution/random-013
=== PAUSE TestMeta/execution/random-013
=== CONT  TestMeta/execution/random-013
=== RUN   TestMeta/execution/random-025
=== PAUSE TestMeta/execution/random-025
=== CONT  TestMeta/execution/random-025
=== RUN   TestMeta/execution/random-026
=== PAUSE TestMeta/execution/random-026
=== CONT  TestMeta/execution/random-026
=== RUN   TestMeta/execution/standard-003
=== PAUSE TestMeta/execution/standard-003
=== CONT  TestMeta/execution/standard-003
=== RUN   TestMeta/execution/standard-013
=== PAUSE TestMeta/execution/standard-013
=== CONT  TestMeta/execution/standard-013
Help

To reproduce, try:

go test -tags 'invariants' -exec 'stress -p 1' -timeout 0 -test.v -run 'TestMeta$' ./internal/metamorphic -seed 1711167126052756618 -ops "uniform:5000-10000"

This test on roachdash | Improve this report!

github.com/cockroachdb/pebble/internal/metamorphic.TestMeta failed with artifacts on refs/heads/master @ 86b5f54ca026:

db1.SingleDelete("mzrwyjqxkiyq@21", false /* maybeReplaceDelete */)
db1.Set("inwsqmud@40", "vzbpxcivthdtn")
db1.RangeKeyUnset("hfsf", "mighofewel", "@24")
iter76.InternalNext()
iter76.Last()
iter76.SeekGE("mighofewel@22", "vqvpyftaeagm@47")
iter75.SeekPrefixGE("kzbdkn@43")
iter77 = iter75.Clone(false, "bjphtu@33", "bjphtu@33", 0 /* key types */, 0, 0, false /* use L6 filters */, "" /* masking suffix */)
iter77.Next("")
iter76.Next("")
db1.Set("fifxtnmcw", "lzsjfwgeulwvbzfwrk")
iter76.Next("")
iter77.First()
iter76.Prev("")
db1.Set("qtwny@49", "lzyttzejleemqvkioedj")
iter75.First()
iter76.Last()
iter75.SeekLT("mbdkfk", "")
iter75.SeekGE("mzrwyjqxkiyq@12", "")
iter77.SeekLT("mighofewel@22", "ajpmolemwx@13")
iter76.Prev("fifxtnmcw@39")
db1.Get("vqvpyftaeagm@47")
db1.Set("mcglhen@56", "rq")
iter76.SeekPrefixGE("zlxsq@21")
db1.Get("aqmjrsjqlx@29")
iter75.First()
iter77.Close()
iter75.Close()
iter76.Close()
db1.Close()

To reduce:  go test ./internal/metamorphic -tags invariants -run 'TestMeta$' --compare "/artifacts/meta/240324-052644.7921906959357/{standard-000,standard-008}" --try-to-reduce -v
=== RUN   TestMeta/execution
=== RUN   TestMeta/execution/random-007
=== PAUSE TestMeta/execution/random-007
=== CONT  TestMeta/execution/random-007
=== RUN   TestMeta/execution/standard-028
=== PAUSE TestMeta/execution/standard-028
=== CONT  TestMeta/execution/standard-028
=== RUN   TestMeta/compare/standard-001
=== RUN   TestMeta/compare/standard-006
=== RUN   TestMeta/execution/random-010
=== PAUSE TestMeta/execution/random-010
=== CONT  TestMeta/execution/random-010
=== RUN   TestMeta/execution/random-028
=== PAUSE TestMeta/execution/random-028
=== CONT  TestMeta/execution/random-028
=== RUN   TestMeta/execution/standard-013
=== PAUSE TestMeta/execution/standard-013
=== CONT  TestMeta/execution/standard-013
Help

To reproduce, try:

go test -tags 'invariants' -exec 'stress -p 1' -timeout 0 -test.v -run 'TestMeta$' ./internal/metamorphic -seed 1711258004792193680 -ops "uniform:5000-10000"

This test on roachdash | Improve this report!

The first failure looks like #3449. I am investigating a failure similar to the second one.

github.com/cockroachdb/pebble/internal/metamorphic.TestMeta failed with artifacts on refs/heads/master @ 5babbee7ffe8:

=== CONT  TestMeta/execution/standard-023
=== RUN   TestMeta/compare/standard-012
=== RUN   TestMeta/compare/standard-020
=== RUN   TestMeta/execution/random-005
=== PAUSE TestMeta/execution/random-005
=== CONT  TestMeta/execution/random-005
=== RUN   TestMeta/execution/random-008
=== PAUSE TestMeta/execution/random-008
=== CONT  TestMeta/execution/random-008
=== RUN   TestMeta/execution/random-027
=== PAUSE TestMeta/execution/random-027
=== CONT  TestMeta/execution/random-027
=== RUN   TestMeta/execution/standard-003
=== PAUSE TestMeta/execution/standard-003
=== CONT  TestMeta/execution/standard-003
=== RUN   TestMeta/execution/standard-020
=== PAUSE TestMeta/execution/standard-020
=== CONT  TestMeta/execution/standard-020
=== RUN   TestMeta/compare/random-000
=== RUN   TestMeta/compare/standard-002
=== RUN   TestMeta/execution/random-000
=== PAUSE TestMeta/execution/random-000
=== CONT  TestMeta/execution/random-000
=== RUN   TestMeta/execution/standard-021
=== PAUSE TestMeta/execution/standard-021
=== CONT  TestMeta/execution/standard-021
=== RUN   TestMeta/execution/standard-024
=== PAUSE TestMeta/execution/standard-024
=== CONT  TestMeta/execution/standard-024
=== RUN   TestMeta/compare/standard-007
=== RUN   TestMeta/compare/standard-015
=== RUN   TestMeta/compare/standard-019
=== RUN   TestMeta/execution/standard-027
=== PAUSE TestMeta/execution/standard-027
=== CONT  TestMeta/execution/standard-027
=== RUN   TestMeta/compare/standard-001
=== RUN   TestMeta/compare/standard-005
=== RUN   TestMeta/compare/standard-027
=== RUN   TestMeta/execution/random-009
=== PAUSE TestMeta/execution/random-009
=== CONT  TestMeta/execution/random-009
=== RUN   TestMeta/execution/random-021
=== PAUSE TestMeta/execution/random-021
=== CONT  TestMeta/execution/random-021
=== RUN   TestMeta/execution/random-024
=== PAUSE TestMeta/execution/random-024
=== CONT  TestMeta/execution/random-024
=== RUN   TestMeta/execution/standard-005
=== PAUSE TestMeta/execution/standard-005
=== CONT  TestMeta/execution/standard-005
Help

To reproduce, try:

go test -tags 'invariants' -exec 'stress -p 1' -timeout 0 -test.v -run 'TestMeta$' ./internal/metamorphic -seed 1711513800183377278 -ops "uniform:5000-10000"

This test on roachdash | Improve this report!