r/LocalLLaMA
· Communities
Optimal Configuration for 4x3090s
Aiming for RTX 6000 like performance at 25% of the cost. https://preview.redd.it/mi6fqpdd5hih1.png?width=631&format=png&auto=webp&s=9a639bcc79c7eb0a3834a88317220c289b7a52b6 2x3090s in tensor parallelism, then put those two in a pipeline feeding into another pair who are also using tensor parallelism. The reason being t