Updated 10 months ago

torchao • Rank 25.9 • Science 64%

PyTorch native quantization and sparsity for training and inference

Updated 10 months ago

llmcompressor • Rank 22.6 • Science 54%

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Updated 10 months ago

bimp • Rank 3.2 • Science 38%

Code to reproduce the experiments of ICLR2023-paper: How I Learned to Stop Worrying and Love Retraining

Updated 10 months ago

compressedsensing.jl • Science 28%

Contains a wide-ranging collection of compressed sensing and feature selection algorithms. Examples include matching pursuit algorithms, forward and backward stepwise regression, sparse Bayesian learning, and basis pursuit.

Updated 10 months ago

SparseConnectivityTracer • Science 67%

Fast operator-overloading Jacobian & Hessian sparsity detection.

Updated 10 months ago

sms • Science 41%

Code to reproduce the experiments of the ICLR24-paper: "Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging"

Updated 10 months ago

https://github.com/danielathome19/engram-neural-network • Science 49%

tensorflow-engram: A Python package for Engram Neural Networks, adding biologically-inspired Hebbian memory and engram layers to TensorFlow/Keras models, supporting memory traces, plasticity, attention, and sparsity for neural sequence learning.