Recent Releases of sparsimony
sparsimony - v0.2.0
What's Changed
- global data helper cpu offloading, mask.sum() numerical stability by @mklasby in https://github.com/mklasby/sparsimony/pull/31
- SRigL 2:4 by @mklasby in https://github.com/mklasby/sparsimony/pull/32
- Mask calculator refactor by @mklasby in https://github.com/mklasby/sparsimony/pull/33
- fixing pyproject for coverage report by @mklasby in https://github.com/mklasby/sparsimony/pull/34
- Sr ste refactor by @mklasby in https://github.com/mklasby/sparsimony/pull/35
- vectorized topk in NMStructureScorer by @mklasby in https://github.com/mklasby/sparsimony/pull/36
- vectorized topk in NMStructureScorer by @mklasby in https://github.com/mklasby/sparsimony/pull/37
- adding kwargs to sr-ste by @mklasby in https://github.com/mklasby/sparsimony/pull/38
- Global pruning memory improvements by @mikel-cerebras in https://github.com/mklasby/sparsimony/pull/39
- remove passing of low_mem flag to super by @mklasby in https://github.com/mklasby/sparsimony/pull/40
- Version 0.2.0 - Transformers, deepspeed, uv build, and more! by @mklasby in https://github.com/mklasby/sparsimony/pull/42
Full Changelog: https://github.com/mklasby/sparsimony/compare/v0.1...v0.2
- Python
Published by mklasby 8 months ago
sparsimony - v0.1
Repo state to refactoring mask calculators and padding. Algorithms working but mask dtype needs to be revised to bool to improve numerical stablity on large tensors (for LLMs and global pruning vectors)
- Python
Published by mklasby over 1 year ago