janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

Home Page:https://jan.ai/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Fully compatible with Phi-3

namutin opened this issue · comments

commented

Please support AIPhi-3, which is released by Microsoft and exceeds Llama3-8B. completely

Tested and not able to find the model Phi-3-mini-4k-instruct-q4 anywhere in the repo. Need further investigation from @hahuyhoang411. Many thanks
Jan v0.4.12-399

currently, phi-3 is not well supported by llama.cpp. Please stay tuned

ggerganov/llama.cpp#7225