I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlarge (medium.com)

6 points by live_alone 1y ago ↗ HN

2 comments

[ 0.24 ms ] story [ 12.0 ms ] thread

[deleted] 1y ago ↗

(comment deleted)

kcb 1y ago ↗

G6e surely would be much faster for inference and cheaper.