The reason OpenAI bought Rockset is to enhance their retrieval infrastructure, and move closer to the implementation side of Generative AI.
With more models being open-source, and the focus small language modes which many are open-sourced, it seems like the market value is shifting from Zone 4 to Zone 5.
Only a few months ago, it seemed like OpenAI has captured the LLM market and no-one will ever be able to compete.
Then Meta AI open-sourced numerous very capable models.
Followed by stellar work from Microsoft on imbuing Small Language Models (SLMs) with enhanced reasoning capabilities, and by open-sourcing models.
Organisations moved their focus from gradient approaches (fine-tuning) to adapt models to their environment, to non-gradient approaches, like RAG and prompt engineering techniques.
These non-gradient frameworks demand vector technology, data centric tooling and RAG frameworks.
LLMs are becoming a mere utility and innovation is taking place in building applications which are powered by LLMs under the hood.
At last the market is moving to toward a Data centric approach.
This acquisition also brings OpenAI closer to the developer community with Rockset’s integration with LangChian & LlamaIndex.
1 comment
[ 2.4 ms ] story [ 12.2 ms ] threadWith more models being open-source, and the focus small language modes which many are open-sourced, it seems like the market value is shifting from Zone 4 to Zone 5.
Only a few months ago, it seemed like OpenAI has captured the LLM market and no-one will ever be able to compete.
Then Meta AI open-sourced numerous very capable models.
Followed by stellar work from Microsoft on imbuing Small Language Models (SLMs) with enhanced reasoning capabilities, and by open-sourcing models.
Organisations moved their focus from gradient approaches (fine-tuning) to adapt models to their environment, to non-gradient approaches, like RAG and prompt engineering techniques.
These non-gradient frameworks demand vector technology, data centric tooling and RAG frameworks.
LLMs are becoming a mere utility and innovation is taking place in building applications which are powered by LLMs under the hood.
At last the market is moving to toward a Data centric approach. This acquisition also brings OpenAI closer to the developer community with Rockset’s integration with LangChian & LlamaIndex.