PrivateGPT integration
ProxyAyush opened this issue · comments
Hi, @kyegomez i wanted to ask whether you can make a repository so that I can run llm locally like privategpt and also use the tree of thoughts prompting technique, or is there any way by which I can implement tot in privateGPT itself. Thank you.
Hey! yeah absolutely can you tell me more about privategpt and you can host your own private model using the huggingface class! In the examples folder if you use gitclone
On Tue, 30 May 2023 at 7:18 PM, Eternal Reclaimer ***@***.***> wrote:
Hey! yeah absolutely can you tell me more about privategpt and you can
host your own private model using the huggingface class! In the examples
folder if you use gitclone
—
Reply to this email directly, view it on GitHub
<#50 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/APVZXPXGQOZERI2EDZWQKBTXIX3BXANCNFSM6AAAAAAYT6CJOU>
.
You are receiving this because you authored the thread.Message ID:
***@***.***>
Yeah, so PrivateGPT uses models by gpt4all.io they help a person to use a
llm model to analyse the documents on their local machines and form an
answer only according to the documents, so I was wondering even if I use
hugginface models locally would it adhere to answer any query only
according to the documents I provide it? Or is there any other way
Ah okayyyy I understand now, you can implement the abstract language model class we have, it has to use similar prompts that tree of thoughts uses and as well as the tree of search algorithms! The prompt is key, and the search loop as well!