Search — llmc 1.0.0 documentation

Home
Docs
xxx
GitHub

Table of Contents

Quick Start

Installation of llmc
Prepare the model
Download the datasets
Set Configs
Start to run
FAQ

Configs

Configs’ brief description
Configs’ detailed description

Advanced

Model accuracy test V1
Model accuracy test V2
Custom calibration datasets
Layerwise mixed bits quantization
Model Sparsification

Best Practice

AWQ
AWQ + OmniQuant
Quarot + GPTQ

Backbend

VLLM Quantized Inference

Docs >
Search
Edit on GitHub

Shortcuts

© Copyright 2024, llmc contributors.

Built with Sphinx using trojanzoo_sphinx_theme (modified from pytorch_sphinx_theme).

Docs

Access comprehensive developer documentation for llmc

View Docs

Home
Docs

xxx

GitHub