li-plus / chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

官方docker无法使用

Whichbfj28 opened this issue · comments

image
出现错误:
./build/bin/main: error while loading shared libraries: libggml.so: cannot open shared object file: No such file or directory

image 出现错误: ./build/bin/main: error while loading shared libraries: libggml.so: cannot open shared object file: No such file or directory

这个需要pip install .,有的是直接pip install chatglm_cpp,都可以的,这个其实和cpp还是有关系的,这个主要就是实现C++加速推理嘛