Ask HN: How to augment LLM/GPT with structured data in a safe way?

2 points by TroyZ ↗ HN
I have seen many applications augmenting LLM/GPT responses with unstructured text data using frameworks like LangChain/Vector databases. The idea is basically querying similar document chunks and plug them into the prompts.

But for structured data stored in SQL-like databases, there doesn't seem to be a widly adopted way.

I have seen exapmles from the LangChain library using GPT to generate a SQL query and execute it using Python, but this would create security issues if the LLM generates queries that tamper with the database.

Thanks for any inspirations or input.

0 comments

[ 3.0 ms ] story [ 11.4 ms ] thread

No comments yet.