r/LocalLLaMA
· Communities
Ultra budget 20GB vram with 448GB/s for $100 bucks.
Here is the upper limit of what can be done with $100 bucks worth of video cards. You can have 3 concurrent users with plenty of context, better speeds or close enough speeds than a bunch of cards that provide less VRAM and cost 4+ times. 0.00.008.388 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) 0.00.008