I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlarge (medium.com)

6 points by live_alone 11mo ago ↗ HN

2 comments

[ 4.6 ms ] story [ 15.0 ms ] thread

[deleted] 11mo ago ↗

(comment deleted)

kcb 11mo ago ↗

G6e surely would be much faster for inference and cheaper.