Privacy-first alternative to Ollama
Drop-in OpenAI API Replacement for Local LLMs. Shimmy is a 5.1MB single-binary that provides 100% OpenAI-compatible endpoints for GGUF models. Point your existing AI tools to Shimmy and they just work --- locally, privately, and free.
$
pkg install shimmyOrigin
misc/shimmy
Size
43.9MiB
License
APACHE20
Maintainer
tagattie@FreeBSD.org
Dependencies
1 packages
Required by
0 packages