I assume this is idealized somehow, given how close it is to DeepInfer numbers at 100% utilization. My point was more that there is seemingly a lot of margin to absorb underutilization, outages and other costs.
Yes, I would not be shocked either. Sonnet 5.5 is 16x more expensive at $10 per million output tokens. Kimi K3.1 is also $10 per million output tokens, and its number of active parameters is only 6.5x larger than V4.1…
DeepSeek claims $38 of revenue per GPU, per hour for Flash V4. That is $332,880 per GPU, per year. This matches their DeepInfer numbers: 25,600 output tokens/s per GPU sold at $0.60 per million -> $55 minus some other…
"More tool work per model turn" could reduce the number of cache reads (or even cache misses) and associated cost?
I think initiatives for forge federation are trying to do too much. When running a forge for a project, I'd don't want to be dealing with spam or large amounts of data from other instances. And people should be able to…
Blender 2.5 has changed the UI significantly from the original commercial version, and most comments I read about it say that it has improved significantly. Blender the open source project has changed and grown so much…
I think this misses the point, if someone doesn't understand open source etiquette then I would give them a friendly reply. Even if it was mentioned somewhere in the documentation, I understand that people can miss it.…
I assume this is idealized somehow, given how close it is to DeepInfer numbers at 100% utilization. My point was more that there is seemingly a lot of margin to absorb underutilization, outages and other costs.
Yes, I would not be shocked either. Sonnet 5.5 is 16x more expensive at $10 per million output tokens. Kimi K3.1 is also $10 per million output tokens, and its number of active parameters is only 6.5x larger than V4.1…
DeepSeek claims $38 of revenue per GPU, per hour for Flash V4. That is $332,880 per GPU, per year. This matches their DeepInfer numbers: 25,600 output tokens/s per GPU sold at $0.60 per million -> $55 minus some other…
"More tool work per model turn" could reduce the number of cache reads (or even cache misses) and associated cost?
I think initiatives for forge federation are trying to do too much. When running a forge for a project, I'd don't want to be dealing with spam or large amounts of data from other instances. And people should be able to…
Blender 2.5 has changed the UI significantly from the original commercial version, and most comments I read about it say that it has improved significantly. Blender the open source project has changed and grown so much…
I think this misses the point, if someone doesn't understand open source etiquette then I would give them a friendly reply. Even if it was mentioned somewhere in the documentation, I understand that people can miss it.…