o19s / quepid

Improve your Elasticsearch, OpenSearch, Solr, Vectara, Algolia and Custom Search search quality.

Home Page:http://www.quepid.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Compare Snapshots fails and compares current results to empty results instead of snapshot

wrigleyDan opened this issue · comments

Describe the bug
Compare snapshots feature is not working for some cases. After creating a snapshot you cannot compare it to your current search results. All query-doc pairs are "treated as ZSR" so the current results are compared to nothing. This is the case even when the snapshot stores equal results as the ones currently displayed (e.g. when you create a snapshot and immediately want to compare it to the current results).

To Reproduce
Steps to reproduce the behavior:

  1. Go to any relevancy case in Quepid
  2. Click on 'Create snapshot' (it does not matter if you want to "Record Document Fields")
  3. Give your snapshot a name and hit "Take Snapshot"
  4. Click on 'Compare snapshot'
  5. Select the snapshot you took and hit "Update Diff Settings"
  6. Observe all results from the snapshot are "treated as ZSR" and empty, so there's nothing to compare

In the case where snapshot comparison is not working the ids are URLs, in the case where snapshot comparison is working the ids are numbers. Is that the potential culprit?

Expected behavior
Comparing snapshots should work across all cases.

Screenshots
Working for one case:
image

Not working for another (only snapshot half shown):
image

Additional context
Quepid version: 7.16.0

that is... "interesting".....

Any chance I could convince you to use http://quepid-solr.dev.o19s.com:8985/solr or maybe https://reader:reader@quepid-opensearch.dev.o19s.com:9200/ and create a index with some url docs to duplicate this?