local cluster perfomance degrades

[volodyad]

Summary

I have started a local cluster and run test PAB apps connected to the cluster

At first it committed transactions in a seconds, after half an hour it took 5 - 10 minutes to commit transaction

There is also some error in cluster logs

[chain-index:Error:1602] [2021-12-15 15:48:07.83 UTC] {"contents":{"contents":{"contents":{"pointBlockId":"adcc193b2402e0a1c3778df7b513bb148bd92e4d453907709078b9944a25012e","pointSlot":{"getSlot":21372},"tag":"Point"},"tag":"OldPointNotFound"},"tag":"RollbackFailed"},"tag":"Err"}
[chain-index:Error:1602] [2021-12-15 15:48:07.83 UTC] {"contents":{"contents":{"contents":{"pointBlockId":"adcc193b2402e0a1c3778df7b513bb148bd92e4d453907709078b9944a25012e","pointSlot":{"getSlot":21372},"tag":"Point"},"tag":"OldPointNotFound"},"tag":"RollbackFailed"},"tag":"Err"}
[chain-index:Error:1602] [2021-12-15 15:48:07.83 UTC] {"contents":{"contents":{"contents":{"tipBlockId":"cf1bdf909988dd7d0932a3a36c45b8343e03acde12b2b6e3a39d47b767ce1eaa","tipSlot":{"getSlot":21379},"tipBlockNo":10652,"tag":"Tip"},"tag":"DuplicateBlock"},"tag":"InsertionFailed"},"tag":"Err"}
[chain-index:Error:1602] [2021-12-15 15:48:07.83 UTC] {"contents":{"contents":{"contents":{"tipBlockId":"cf1bdf909988dd7d0932a3a36c45b8343e03acde12b2b6e3a39d47b767ce1eaa","tipSlot":{"getSlot":21379},"tipBlockNo":10652,"tag":"Tip"},"tag":"DuplicateBlock"},"tag":"InsertionFailed"},"tag":"Err"}

Steps to reproduce the behavior

Run cluster and run some transaction,
try to run in one hour

Actual Result

Perfomance degrades

Expected Result

Perfomance should not degrade

Describe the approach you would take to fix this

No response

System info

mac os big sur
11.5.2

[Skylar-Ray O'Quinn]

Hey @volodyad we are looking into this, when a fix for the issue is found I will let you know!