Python bindings for the llama.cpp library
llama-cpp-python is the Python bindings for the llama.cpp library/ The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.
$
pkg install py311-llama-cpp-pythonOrigin
misc/py-llama-cpp-python
Size
12.1MiB
License
MIT
Maintainer
yuri@FreeBSD.org
Dependencies
12 packages
Required by
0 packages