INT4 LoRA great-tuning vs QLoRA: A user inquired about the discrepancies amongst INT4 LoRA wonderful-tuning and QLoRA in terms of precision and speed. A further member explained that QLoRA with HQQ will involve frozen quantized weights, doesn't use tinnygemm, and utilizes dequantizing alongside torch.matmul Correct position sizing lets trade