[–] bigyabai 10mo ago ↗ > you will need 8 GPUs (each with > 40GB of memory).oh joy [–] thot_experiment 10mo ago ↗ that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s
[–] thot_experiment 10mo ago ↗ that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s
3 comments
[ 1.4 ms ] story [ 20.0 ms ] threadoh joy