The GPTQ algorithm requires calibrating the quantized weights of the model by making inferences on the quantized model. The effectiveness of quantization greatly depends on the samples for evaluating ...