LlamaCppOutlines - Initial Release: Windows Binaries with GPU Support

LlamaCppOutlines.jl v1.0.0

This is the initial release of LlamaCppOutlines.jl, providing pre-compiled Windows binaries for llama.cpp and outlines-core integration.

✨ What's Included

llama.cpp binaries (complete toolkit): - CPU-optimized version for Windows x64 - GPU-accelerated version with CUDA 12.9 support - All tools included: CLI, server, quantization, fine-tuning, LoRA export, and more

outlines-core integration: - JSON schema conversion utilities - Rust-based structured generation library

Key Features

• Automatic GPU detection - Uses GPU acceleration when available, falls back to CPU
• Complete toolset - Over 40 llama.cpp utilities including fine-tuning and advanced features
• Easy integration - Artifacts-based distribution for seamless Julia package management
• Production ready - Optimized builds with all necessary dependencies

Platform Support

• Windows x64 (CPU and GPU)
• Linux and macOS support coming in future releases

Getting Started

```julia using Pkg Pkg.add("LlamaCppOutlines")

- Julia
Published by krishnaveti 11 months ago

LlamaCppOutlines - Prebuild DLLs for public use

Dependencies included and runtime dll errors fixed.

- Julia
Published by krishnaveti 11 months ago