4 comments

[ 3.2 ms ] story [ 14.8 ms ] thread
This is insane. You can use OpenAI's API to tokenise a large text, do a vector search and generate a formal answer using it's chat completion API.

It's in the following 2 links on the OpenAI website:

- https://cookbook.openai.com/examples/question_answering_usin... - https://cookbook.openai.com/examples/embedding_wikipedia_art...

I trained a chatbot on the Godfather script for example and asked Open AI to give the exact response to a dialogue in the film. I'll open-source that too pretty soon if you guys are interested.

Article title: "Embedding Wikipedia articles for search". HN guidelines[0] prefer the original title: "Otherwise please use the original title, unless it is misleading or linkbait; don't editorialize."

[0]: https://news.ycombinator.com/newsguidelines.html

Yes, follow the next article to see how to use those embeddings to query the model and generate a human friendly answer.
(comment deleted)