r/LocalLLaMA
· Communities
Could we have a –disk-moe or –n-disk-moe like –cpu-moe or –n-cpu-moe so we can use disk/cpu/gpu ?
Explicit title, It would be nice to have the ability to have 3 tiers moe offload :( submitted by /u/storm1er [link] [comments]