promptfoo / promptfoo

Test your prompts, agents, and RAGs. Redteaming, pentesting, vulnerability scanning for LLMs. Improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Home Page:https://www.promptfoo.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Promptfoo on self-deployed machine becomes unreachable after uploading a large json file

NoAchache opened this issue · comments

  • Sharing small files to the promptfoo machine works well
  • I am using an on disk memory store
  • When I share a large evaluation the promptfoo interface becomes unreachable
    • I cannot share the results because they contain private data but the json is an evaluation of 3 models over 253 questions.

PS: I am not sure it is the fact the file is large that produces the error.

Here is the log trace i have when I upload the large json file:


Using Memory store
214Storing eval result with id f:093d306e-eda2-40c2-bfab-35c5f0041330
215Storing eval result with id f:4190a09a-a9d4-4423-b6b4-50877006bf45
216Failed to read eval Error: Could not find eval
217at getDataForId (/app/.next/server/app/api/eval/[id]/route.js:283:19)
218at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
219at async GET (/app/.next/server/app/api/eval/[id]/route.js:306:22)
220at async /app/.next/server/chunks/2778.js:5604:37
221Failed to fetch data Error: Could not find eval
222at getDataForId (/app/.next/server/app/api/eval/[id]/route.js:283:19)
223at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
224at async GET (/app/.next/server/app/api/eval/[id]/route.js:306:22)
225at async /app/.next/server/chunks/2778.js:5604:37
226TypeError: fetch failed
227at Object.fetch (node:internal/deps/undici/undici:11731:11)
228at async invokeRequest (/app/node_modules/next/dist/server/lib/server-ipc/invoke-request.js:21:12)
229at async invokeRender (/app/node_modules/next/dist/server/lib/router-server.js:229:29)
230at async handleRequest (/app/node_modules/next/dist/server/lib/router-server.js:422:24)
231at async requestHandler (/app/node_modules/next/dist/server/lib/router-server.js:439:13) {
232cause: SocketError: other side closed
233at Socket.onSocketEnd (/app/node_modules/next/dist/compiled/undici/index.js:1:63301)
234at Socket.emit (node:events:529:35)
235at endReadableNT (node:internal/streams/readable:1400:12)
236at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
237code: 'UND_ERR_SOCKET',
238socket: {
239localAddress: '127.0.0.1',
240localPort: 56806,
241remoteAddress: '127.0.0.1',
242remotePort: 44815,
243remoteFamily: 'IPv4',
244timeout: undefined,
245bytesWritten: 14245943,
246bytesRead: 144
247}
248}
249}

Interesting - how large is this file?