Marcin Mazureknarzędzia online · artykuły · księgarniaRSS
Okładka: Mastering LLM Quantization: Architecture and Code. From Quantization Mathematics to CUDA, Triton, Inference Runtimes, and Production Optimization

Mastering LLM Quantization: Architecture and Code. From Quantization Mathematics to CUDA, Triton, Inference Runtimes, and Production Optimization

Autor: Krzysztof Rybiński

przedsprzedaż

Helionebook

92,88 zł 129,00 zł -28%

Kup w księgarni Helion

Kategorie
Architektura oprogramowania, Deep Learning, Inżynieria AI
Wydawca
Packt Publishing
Rodzaj
ebook
Stron
446
Data wydania
2026-11-27
ISBN
9781808821608
Tytuł oryginału
Mastering LLM Quantization: Architecture and Code. From Quantization Mathematics to CUDA, Triton, Inference Runtimes, and Production Optimization
Formaty
PDF (948,8kB) · ePub (78,8kB)

Opis

Mastering LLM Quantization: Architecture and Code is a practical engineering guide to the mathematics, algorithms, implementation techniques, and production systems behind efficient large language model inference.

The book begins with quantization basics, numerical representations, error analysis, calibration, scaling, and sub-byte math. Readers explore GPTQ, AWQ, SmoothQuant, QLoRA, quantization-aware training, FP8, and other low-bit techniques. Implementation sections connect mathematical methods with real GPU systems, covering CUDA kernel engineering, Triton, CUTLASS, memory layouts, tensor operations, kernel optimization, and hardware-aware performance analysis. It also covers activation and KV-cache quantization, memory management, batching, and techniques for reducing inference cost while preserving model quality.

Practical deployment chapters examine GGUF, vLLM, TensorRT-LLM, ONNX Runtime, and other inference environments, showing how quantized models move into production systems. Hardware profiling, benchmarking, precision trade-offs, throughput, latency, memory consumption, and deployment optimization are treated as practical engineering problems. The result is an end-to-end perspective connecting quantization mathematics, algorithms, GPU architecture, optimized kernels, inference runtimes, and production deployment.

Linki do księgarni są linkami partnerskimi Grupy Helion i Księgarni PWN (przez sieć Adtraction). Ceny i dostępność pochodzą z oferty wydawcy i mogą się zmienić.