r/LocalLLaMA
· Communities
Kind of unexpected: HuiHui abliterated winning over vanilla 3.6-35B-a3b on math and code.
Identical custom quantization recipe on HuiHui's and Vanilla 3.6-35B-a3B. Somehow removing refusal get's you closer to truth and wisdom (?) in math and coding. Benchmarks on instruct mode, no time for 3.6 long reasoning chains. oMLX benchmarking suite (yes I know, small sample size of questions, maybe leaked and used s