Ar-Ray-code / ChatLLM

Test script of LLMs

ChatLLM

Chat test scripts for LLM

Setup

$ cd && git clone https://github.com/karaage0703/ChatLLM
$ cd ~/ChatLLM
$ docker build -t ubuntu:ChatLLM .

Usage

Use GPU

$ cd ~/ChatLLM
$ docker run -it -v $(pwd):/root --gpus all ubuntu:ChatLLM

Use CPU

$ cd ~/ChatLLM
$ docker run -it -v $(pwd):/root ubuntu:ChatLLM

root@hostname:/# cd /root
root@hostname:~# python3 chat_calm.py
root@hostname:~# python3 chat_rinna.py
root@hostname:~# python3 chat_rwkv.py
root@hostname:~# python3 chat_llama2.py

References

• https://huggingface.co/cyberagent/open-calm-7b
• https://huggingface.co/rinna/japanese-gpt-neox-3.6b-instruction-sft
• https://nowokay.hatenablog.com/entry/2023/05/17/144518
• https://note.com/npaka/n/n401dccfadedc
• https://note.com/npaka/n/n0ad63134fbe2
• https://zenn.dev/karaage0703/articles/2b753b4dc26471
• https://zenn.dev/karaage0703/articles/d58d79d8e77ab8
• https://zenn.dev/karaage0703/articles/d3893b551c68fa