X · @teortaxesTex
· X / Twitter
«If you have a calibration set, you can compute your own importance matrix and quantize the model yourself. All steps use stock llama.cpp tools»
«If you have a calibration set, you can compute your own importance matrix and quantize the model yourself. All steps use stock llama.cpp tools»Tencent Hy: Can't Find Benchmark and download link ? See here 👇https://huggingface.co/AngelSlim/Hy3-GGUF