atomiechen / HandyLLM

A handy toolkit for using LLM.

🌟 Support us! If you find HandyLLM useful, please consider starring it to help it spread and improve 🌟

HandyLLM

A handy toolkit for using LLM, with both development support and VSCode editor support.

🙌 Why HandyLLM?

📃 Handy Prompt: self-containing prompt in a human-friendly mark-up format .hprompt.

• Easy write: mark-up format, placeholder variables, request arguments, output logs... And most importantly VSCode syntax highlight!
• Easy run: both CLI and APIs available for parsing and running; run it with the CLI tool WITHOUT any code!
• Easy chain: You can chain hprompt files to construct dynamic logic.

Other features:

☯️ Unified API design with both sync and async support

🍡 OpenAI and Azure APIs all in one

☕️ Easy life with API endpoint management

Installation

pip3 install handyllm

or, install from the Github repo to get latest updates:

pip3 install git+https://github.com/atomiechen/handyllm.git

Please check HandyLLM VSCode extension for editor support.

Documentation

Please check out our wiki for comprehensive guides ^_^

License

HandyLLM © 2024 by Atomie CHEN is licensed under the MIT License - see the LICENSE file for details.