r/LocalLLaMA
· Communities
Considering Buying Another RTX 3090 – Benefits?
Currently using dual RTX 3090s, and am happy with it. But never satisfied lol :) I know I've basically maxed out my single stream TPS. (140+ on standard benchmarks now). But I only have 48GB VRAM, So I can only do two concurrent requests, anymore and my KV-Cache will cause OOM errors. So I am considering adding a 3rd R