Consider adding the native SUT Request/Response to the TestItemRecord
brianwgoldman opened this issue · comments
Currently a PromptInteraction
records PromptWithContext
and SUTResponse
. However, we could also consider recording the SUT's native request/response (e.g. TogetherCompletionsRequest
and TogetherCompletionsResponse
). This may help in debugging why a SUT behaved as it did.
Some downsides:
- Could bloat the record by duplicating a lot of information.
- May accidentally contain some secret if the SUT is implemented strangely.