HN Explorer

PSA: GPT4 (web) token limit down to 4k

2 points by 404mm ↗ HN
As a Plus subscriber, I asked GPT4 what is the maximum input size yesterday and today. To my big surprise, the limit went down from 8192 to 4096 tokens. Note that this is the limit of web version at https://chat.openai.com and not the API.

Yesterday's response: https://chat.openai.com/share/dd8f00db-1ddc-4af0-9a6a-7254e301c4b2

The input character limit for this version of GPT (GPT-4) is 8,192 tokens. Keep in mind that tokens can be parts of words, whole words, or several words, depending on the language and context.

Today: https://chat.openai.com/share/6d2e6753-d15e-4e40-b44b-0582d33953ce

The input size for GPT (including this version, GPT-4) is 4096 tokens. This includes both the prompt and the system's response. Each token can be a word or part of a word, so the actual number of words you can input will vary, but it's usually around 1500-2000 words depending on the complexity and length of the words.

5 comments

[ 2.3 ms ] story [ 25.7 ms ] thread
gtirloni
That's not really accurate data. Unless it was mentioned specifically in its latest training data, you shouldn't trust it to represent the latest state of the model.

You're not asking a REST API for some accurate number coming from a database.

philomath_mn
Agreed. I'm surprised to see people continue to make this kind of mistake. The limit may or may not have changed, but this is precisely the kind of query where I'd expect hallucinations
tikkun
It’s 128k tokens of input and 4096 tokens of output (gpt-4-turbo), though in chatgpt it’ll be different because it uses progressive summarization for long conversations. ChatGPT now uses gpt-4-turbo.