Promptfoo on self-deployed machine becomes unreachable after uploading a large json file
NoAchache opened this issue · comments
- Sharing small files to the promptfoo machine works well
- I am using an on disk memory store
- When I share a large evaluation the promptfoo interface becomes unreachable
- I cannot share the results because they contain private data but the json is an evaluation of 3 models over 253 questions.
PS: I am not sure it is the fact the file is large that produces the error.
Here is the log trace i have when I upload the large json file:
Using Memory store
214Storing eval result with id f:093d306e-eda2-40c2-bfab-35c5f0041330
215Storing eval result with id f:4190a09a-a9d4-4423-b6b4-50877006bf45
216Failed to read eval Error: Could not find eval
217at getDataForId (/app/.next/server/app/api/eval/[id]/route.js:283:19)
218at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
219at async GET (/app/.next/server/app/api/eval/[id]/route.js:306:22)
220at async /app/.next/server/chunks/2778.js:5604:37
221Failed to fetch data Error: Could not find eval
222at getDataForId (/app/.next/server/app/api/eval/[id]/route.js:283:19)
223at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
224at async GET (/app/.next/server/app/api/eval/[id]/route.js:306:22)
225at async /app/.next/server/chunks/2778.js:5604:37
226TypeError: fetch failed
227at Object.fetch (node:internal/deps/undici/undici:11731:11)
228at async invokeRequest (/app/node_modules/next/dist/server/lib/server-ipc/invoke-request.js:21:12)
229at async invokeRender (/app/node_modules/next/dist/server/lib/router-server.js:229:29)
230at async handleRequest (/app/node_modules/next/dist/server/lib/router-server.js:422:24)
231at async requestHandler (/app/node_modules/next/dist/server/lib/router-server.js:439:13) {
232cause: SocketError: other side closed
233at Socket.onSocketEnd (/app/node_modules/next/dist/compiled/undici/index.js:1:63301)
234at Socket.emit (node:events:529:35)
235at endReadableNT (node:internal/streams/readable:1400:12)
236at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
237code: 'UND_ERR_SOCKET',
238socket: {
239localAddress: '127.0.0.1',
240localPort: 56806,
241remoteAddress: '127.0.0.1',
242remotePort: 44815,
243remoteFamily: 'IPv4',
244timeout: undefined,
245bytesWritten: 14245943,
246bytesRead: 144
247}
248}
249}
Interesting - how large is this file?