oblador / loki

👁 Visual Regression Testing for Storybook

Home Page:https://loki.js.org/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Random false positives when testing stories for components that have not been modified

squidjam opened this issue · comments

Hi.
I am using loki 0.34.0 with storybook 7.6.10 and I'm experiencing random instances where the fonts seem to move 1 or 2 pixels, but only on the one story and only sometimes.

I am using pixelmatch with a threshold of 0.3. It's set up to run against a static-storybook generated on a previous pipeline step in Azure DevOps. The static storybook is served using http-server.

It fails randomly, we run the pipeline again, it succeeds.

Is it that I should not use pixelmatch? or that I'm setting the wrong threshold (30% seems generous to me)? or something else that's being looked at?

Thanks

image
image