Show HN: 60% higher tokens per second for 70B custom LLMs (baseten.co)

1 points by mikejulietbravo 1y ago ↗ HN

We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost

0 comments

[ 3.1 ms ] story [ 7.3 ms ] thread

No comments yet.