Giters

confident-ai / deepeval

The LLM Evaluation Framework

Home Page:https://docs.confident-ai.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question: Using DeepEval with HuggingFace LLM

nikhilkomakula opened this issue · comments

commented

Hello,

Do you have a working example of using DeepEval with HuggingFace LLM without having to download the model to the local environment (like using HuggingFaceEndpoint)?

Thanks.

commented

@nikhilkomakula No we don't, but it should just be an API request. The important thing is the generate method should only accept the prompt (string) and output the generation (string)

commented

@nikhilkomakula If you come on our discord and share some code for your HugginFaceEndpoint i can give you an example: https://discord.com/invite/a3K9c8GRGt