
Opis
Mastering LLM Quantization: Architecture and Code is a practical engineering guide to the mathematics, algorithms, implementation techniques, and production systems behind efficient large language model inference.The book begins with quantization basics, numerical representations, error analysis, calibration, scaling, and sub-byte math. Readers explore GPTQ, AWQ, SmoothQuant, QLoRA, quantization-aware training, FP8, and other low-bit techniques. Implementation sections connect mathematical methods with real GPU systems, covering CUDA kernel engineering, Triton, CUTLASS, memory layouts, tensor operations, kernel optimization, and hardware-aware performance analysis. It also covers activation and KV-cache quantization, memory management, batching, and techniques for reducing inference cost while preserving model quality.
Practical deployment chapters examine GGUF, vLLM, TensorRT-LLM, ONNX Runtime, and other inference environments, showing how quantized models move into production systems. Hardware profiling, benchmarking, precision trade-offs, throughput, latency, memory consumption, and deployment optimization are treated as practical engineering problems. The result is an end-to-end perspective connecting quantization mathematics, algorithms, GPU architecture, optimized kernels, inference runtimes, and production deployment.