py311-bitsandbytes
0.47.0k-bit optimizers and matrix multiplication routines
bitsandbytes enables accessible large language models via k-bit quantization for PyTorch. We provide three main features for dramatically reducing memory consumption for inference and training.
Origin: misc/py-bitsandbytes
Category: misc
Size: 1.50MiB
License: MIT
Maintainer: yuri@FreeBSD.org
Dependencies: 3 packages
Required by: 0 packages
$
pkg install py311-bitsandbytesDependencies (3)
More in misc
shared-mime-info2.4_2
MIME types database from the freedesktop.org projectlibuuid2.41.1_1
Library to generate or parse 128-bit Universally Unique IDs (UUIDs)iso-codes4.19.0
Lists of ISO standards, e.g. country, language, language scripts and currency namespy311-tqdm4.67.1
Fast, extensible progress bar for Pythonpy311-pytorch2.8.0_4
PyTorch: Tensors and dynamic neural networks in Pythonrubygem-mime-types3.7.0
Ruby gem which provides a mailcap-like MIME Content-Type lookupen-freebsd-doc20260213,1
Documentation from the FreeBSD Documentation Projectkf6-purpose6.22.0
Offers available actions for a specific purposeSoapySDR0.8.1_1
Vendor and platform neutral SDR support libraryhicolor-icon-theme0.18
High-color icon theme shell from the FreeDesktop project