Most VCs avoided application layer believing it is too risky with few player would emerge as winner over application layers calling them GPT wrapper (now called Harness) and pouring money into infra layer. Would love to see your opinion about how this thesis would turn out going forward.
The title makes it sound like they just did a seed round, but the seed round was announced in August of last year [0].
Their website landing page is now also showing the software is no longer maintained. No mention of why they made this decision, my best guess is they burned through their seed money and were unable to attract further investments.
VCs think, 'Apps are risky, infrastructure is safe,'
so they invested in AI infra.
"infra is safe"
Hmm, but that wasn't a good idea.
because if an open source infrastructure project like TensorZero gets shut down this quickly, won't they start to realize that those investment theories are also risky?
The difficult thing about AI infrastructure is that, unlike other industries, it will not become fragmented. It will likely remain tied to specific big tech models. What does this mean? It means that because AI models are not yet standardized, the infrastructure itself is actually riskier. In other words, the privatization of standards is happening.
The challenge with AI infrastructure is that an independent, stable standard layer has not formed, unlike in other software infrastructure markets such as databases, web servers, cloud, and containers. Over time, those ecosystems developed relatively standardized interfaces and operational layers. But the LLM ecosystem is still evolving rapidly. Models themselves change fast, APIs differ, pricing differs, context windows, tool calling, structured output, evaluation, fine tuning, caching, routing, everything keeps changing.
So even if an infrastructure startup tries to build a common abstraction layer across multiple models, before that common layer can stabilize, big model or cloud providers like OpenAI, Anthropic, Google, AWS, or Azure can just absorb the same functionality directly. In the end, AI infrastructure is at high risk of becoming an attached feature of model providers rather than solidifying as an independent layer.
But if a startup that raised 7.3 million dollars fails this quickly, who would trust and invest in such things? That aside, it seems AI startups are all the rage these days. I also want to learn AI and get funded like that. Does anyone here trust me enough to invest? About one hundredth of that would probably be enough
Open source powers the business of many large corporations and they give essentially nothing back - why would maintainers refuse an offer for money in this environment?
About one year ago, I created an LLM gateway with metrics, provider fallback and switching, tools support, injecting, etc. etc., and unique features like acting as an MCP tools client and server, all streamed, with low latency.
It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field.
Putting $7.3M into such a project would make sense only in the case of a precise growth plan with already declared customers and an promising sales funnel. There is no technical moat.
Just use Plexus [1]. The maintainer is not trying to be a hero or raise seed dollars or even really trying to promote it. He's just making an excellent, useful product. (Unaffiliated, just a happy user). It's not a full-on "LLMOps" platform (whatever that is), it's just a proxy that works very well and has some nice features.
We started the company two and a half years ago, and raised $7.3m in 2024 (announced only almost a year later). We've spent less than half of this amount.
Earlier this week we came to the difficult decision to wind down the project. The open-source repository remains available on GitHub (Apache 2.0) but won't be actively maintained by the team moving forward.
I'm really sorry to hear that, and I wish you and the rest of the team luck. When you first came out, I thought the approach was really solid - particularly with regards to structured inputs and outputs.
Click through to their profiles and you'll find that they habitually do this. Preserve your own sanity and just eject them from your feed by removing comment subtrees starting with their comments. I see less than half of the comments in this thread and they're in the realm of reasonable.
Treat it as an engineering problem where you're trying to lower the noise floor.
39 comments
[ 4.0 ms ] story [ 46.4 ms ] threadTheir website landing page is now also showing the software is no longer maintained. No mention of why they made this decision, my best guess is they burned through their seed money and were unable to attract further investments.
[0]: https://www.tensorzero.com/blog/tensorzero-raises-7-3m-seed-...
"infra is safe" Hmm, but that wasn't a good idea. because if an open source infrastructure project like TensorZero gets shut down this quickly, won't they start to realize that those investment theories are also risky?
The difficult thing about AI infrastructure is that, unlike other industries, it will not become fragmented. It will likely remain tied to specific big tech models. What does this mean? It means that because AI models are not yet standardized, the infrastructure itself is actually riskier. In other words, the privatization of standards is happening.
The challenge with AI infrastructure is that an independent, stable standard layer has not formed, unlike in other software infrastructure markets such as databases, web servers, cloud, and containers. Over time, those ecosystems developed relatively standardized interfaces and operational layers. But the LLM ecosystem is still evolving rapidly. Models themselves change fast, APIs differ, pricing differs, context windows, tool calling, structured output, evaluation, fine tuning, caching, routing, everything keeps changing.
So even if an infrastructure startup tries to build a common abstraction layer across multiple models, before that common layer can stabilize, big model or cloud providers like OpenAI, Anthropic, Google, AWS, or Azure can just absorb the same functionality directly. In the end, AI infrastructure is at high risk of becoming an attached feature of model providers rather than solidifying as an independent layer.
But if a startup that raised 7.3 million dollars fails this quickly, who would trust and invest in such things? That aside, it seems AI startups are all the rage these days. I also want to learn AI and get funded like that. Does anyone here trust me enough to invest? About one hundredth of that would probably be enough
I think you're really overgeneralizing what "infrastructure" means in this case.
“TensorZero is used by companies ranging from frontier AI startups to the Fortune 10 and fuels ~1% of global LLM API spend today.”
One percent seems like a lot. Anyone on HN use this?
Wasn't GitHub once a place for humans? Now we could rename it SkyHub.
It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field.
Putting $7.3M into such a project would make sense only in the case of a precise growth plan with already declared customers and an promising sales funnel. There is no technical moat.
[1] https://github.com/mcowger/plexus
https://github.com/BerriAI/litellm/
We started the company two and a half years ago, and raised $7.3m in 2024 (announced only almost a year later). We've spent less than half of this amount.
Earlier this week we came to the difficult decision to wind down the project. The open-source repository remains available on GitHub (Apache 2.0) but won't be actively maintained by the team moving forward.
Treat it as an engineering problem where you're trying to lower the noise floor.