HN Explorer

yiro13

↗ HN profile [ 24.0 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Pay per pre-configured GPU hour or per token for open-source LLM inference?

    Is it worth paying for a pre-configured GPU for open-source LLM inference instead of using a traditional pay-per-token provider? The biggest advantage seems to be having no usage limits

    1 points 3
  2. 1 points 0