Giters

enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

Home Page:https://big-agi.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[BUG] constant unrequested call to {diagram model}

kaptainkangaroo opened this issue · comments

commented

Description

Issue: an unrequested call to the secondary diagram model is made every time the chat button is clicked. resulting in extra charges

Step 1. Configure Model settings with OpenRouter account.
Step 2. set Auto diagram to include "Phind: CodeLlama 34B v2" (see screenshot)
Step 3. start a session and click chat button , (in a session with ANY LLM model)
Step 4. See the extra charge on the activity page on OpenRouter (https://openrouter.ai/activity?page=1)

image

screenshot:
shows an additional call to "Phind: CodeLlama 34B v2" even when the free version of mistral is called
image

Device and browser

m1 Macbook Air, OS: 13.6.6 (22G630)
Chrome: Version 125.0.6422.142 (Official Build) (arm64)
BIG AGI: 1.16.1

Screenshots and more

Willingness to Contribute

  • 🙋‍♂️ Yes, I would like to contribute a fix.
commented

@kaptainkangaroo please try the following:

  1. Check if the call is from the Auto-Title:
  • switch off auto-title for chats
  • check if the secondary call (with a different model) is made
    image
  1. Make sure the "Auto Diagrams" is off as well.
  • with both auto-title and auto-diagrams off, please check the network requests
  • if there's a second network request, look into the prompt (example in chrome below)

image

Let me know once you're done.

commented

Let me know if you were able to solve @kaptainkangaroo or we'll close for inactivity as support has been provided.

commented

Closed for inactivity, and support has been provided.