r/LocalLLaMA
· Communities
LoRA over GGUF: Train Qwen3.6-35B-A3B in 16G VRAM
https://github.com/woct0rdho/transformers5-qwen3.5-recipe It's time for GGUF to replace bitsandbytes as the base model format for low-VRAM LoRA training. It's actively supporting new model types such as MoE, linear attentions, and DeepSeek WTF attentions, and new quant types such as 1-bit quants. Thanks to APEX quant w