Thoughts on llama.cpp integration for local AI?

[Fau57]

I think I basically summed it up in title. Or is there and im just not seeing it?

[Brutal Strike]

Supported platforms:

Mac OS
Linux
Windows (via CMake)
Docker
FreeBSD