2 comments

[ 3.1 ms ] story [ 16.6 ms ] thread
How do you handle very long documents that are the OpenAI token limit?
The document is first broken up into chunks. When a user prompts, Unriddle finds the most relevant chunks and then feeds them into GPT-3.