Semantic or keyword search for finding ChatGPT context. Who searched it better? (xata.io) 5 points by tudorg 3y ago ↗ HN
[–] sharemywin 3y ago ↗ There are some libraries that can extract keywords that don't require a call to GPT. I wonder if those would be cheaper and work? [–] tudorg 3y ago ↗ Thanks for the idea, the cost wouldn't be a lot smaller because the question summary doesn't consume so many tokens compared to the context, however the latency would be improved significantly if we avoid one round-trip.
[–] tudorg 3y ago ↗ Thanks for the idea, the cost wouldn't be a lot smaller because the question summary doesn't consume so many tokens compared to the context, however the latency would be improved significantly if we avoid one round-trip.
2 comments
[ 4.3 ms ] story [ 19.2 ms ] thread