2 comments

[ 2.7 ms ] story [ 18.3 ms ] thread
How do you handle very long documents that are the OpenAI token limit?
The document is first broken up into chunks. When a user prompts, Unriddle finds the most relevant chunks and then feeds them into GPT-3.