shimmy

1.9.0

Privacy-first alternative to Ollama

Drop-in OpenAI API Replacement for Local LLMs. Shimmy is a 5.1MB single-binary that provides 100% OpenAI-compatible endpoints for GGUF models. Point your existing AI tools to Shimmy and they just work --- locally, privately, and free.

Origin: misc/shimmy

Category: misc

Size: 43.9MiB

License: APACHE20

Maintainer: tagattie@FreeBSD.org

Dependencies: 1 packages

Required by: 0 packages

Website: github.com/Michael-A-Kuykendall/shimmy

$pkg install shimmy

Dependencies (1)

vulkan-loader

More in misc

shared-mime-info2.4_2

MIME types database from the freedesktop.org project

libuuid2.41.1_1

Library to generate or parse 128-bit Universally Unique IDs (UUIDs)

iso-codes4.19.0

Lists of ISO standards, e.g. country, language, language scripts and currency names

py311-tqdm4.67.1

Fast, extensible progress bar for Python

py311-pytorch2.8.0_4

PyTorch: Tensors and dynamic neural networks in Python

rubygem-mime-types3.7.0

Ruby gem which provides a mailcap-like MIME Content-Type lookup

en-freebsd-doc20260213,1

Documentation from the FreeBSD Documentation Project

kf6-purpose6.22.0

Offers available actions for a specific purpose

SoapySDR0.8.1_1

Vendor and platform neutral SDR support library

hicolor-icon-theme0.18

High-color icon theme shell from the FreeDesktop project