tryAGI / Anyscale

SDK for Anyscale Endpoint that makes it easy and cheap to use LLama 2

Anyscale

SDK for Anyscale Endpoint that makes it easy and cheap to use LLama 2

Usage

using Anyscale;

using var httpClient = new HttpClient();
var api = new AnyscaleApi(apiKey, httpClient);
var response = await api.CreateChatCompletionAsync(new CreateChatCompletionRequest
{
    Messages = new List<ChatCompletionRequestMessage>
    {
        "You are a helpful weather assistant.".AsSystemMessage(),
        "What's the weather like today?".AsUserMessage(),
    },
    Model = ModelIds.Llama2_70B,
});
var message = result.GetFirstChoiceMessage().Content;

Support

Priority place for bugs: https://github.com/tryAGI/Anyscale/issues
Priority place for ideas and general questions: https://github.com/tryAGI/Anyscale/discussions
Discord: https://discord.gg/Ca2xhfBf3v