r/LocalLLaMA
· Communities
*Cries in 18GB unified memory*
Equivalent to 14GB of VRAM and 4GB of system RAM given the limits I assigned to the GPU. EDIT: we be getting lots of big (≥20B), small (≤4B) models these days but very little in between submitted by /u/banana_slurp_jug [link] [comments]