Giters

enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

Home Page:https://big-agi.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Together AI vendor support.

enricoros opened this issue · comments

commented

Add support for Together models; for instance, the new Nous Mixtral is released there first.

commented

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

1.11.0.-.Together.AI.support.-.2024-01-15.150641.mp4
commented

Very fast performance!

1.11.0.-.Together.AI.support2.-.2024-01-15.162652.mp4
commented

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

image

Unexpected token 'A', "An error o"... is not valid JSON

commented

@qdrop17 I just tried it now and it works perfectly here.

Screenshot_20240130_113543_Chrome.jpg

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

commented

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

commented

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.