This is not an attempt at affected nonchalance, but I’ve simply never come across the idea that Dostoevsky is particularly difficult to read. A somewhat gifted teenager will race through it, as will an average adult.
Not hired Suleyman? Build his own research lab? Satya made moves early on with OpenAI that should be studied in business classes for all the right reasons. He also made moves later on that will be studied for all the…
The gap between Anthropic and the other guys keeps growing
Big respect Total humiliation for Hegseth, sure there will be a backlash
To somewhat state the obvious - the problem isn’t the amount of data, it’s the algorithms. We need to discover the set of learning algorithms nature has, and determine whether they’re implementable in silicon
Is everything OpenAI do/release now a response to something Anthropic have recently released? I remember the days when it was worth reading about their latest research/release. Halcyon days indeed.
“ This is one of my fundamental beliefs about the nature of consciousness. We are never able to interact with the physical world directly, we first perceive it and then interpret those perceptions. More often than not,…
I don’t have the experiments to prove this, but from my experience it’s highly variable between embedding models. Larger, more capable embedding models are better able to separate the different uses of a given word in…
Doesn’t seem like this will be SOTA in things that really matter, hoping enough people jump to it that Opus has more lenient usage limits for a while
As a fairly extensive user of both Python and R, I net out similarly. If I want to wrangle, explore, or visualise data I’ll always reach for R. If I want to build ML/DL models or work with LLM’s I will usually reach for…
Oh boy, if the benchmarks are this good and Opus feels like it usually does then this is insane. I’ve always found Opus significantly better than the benchmarks suggested. LFG
Please don’t actually use these 5,6,7-way Venn diagrams for anything practical, they’re virtually useless and communicate nothing.
I agree it is a profound question. My thesis is fairly boring. For any given clustering task of interest, there is no single value of K. Clustering & unsupervised machine learning is as much about creating meaning and…
“Skills are a simple concept with a correspondingly simple format.” From the Anthropic Engineering blog. I think Skills will be useful in helping regular AI users and non-technical people fall into better patterns. Many…
It came from nowhere to 1T tokens per week, seems… suspect.
What use-cases do you see for the 270M’s embeddings, and should we be sticking to token embeddings or can we meaningfully pool for sentence/document embeddings? Do we need to fine-tune for the embeddings to be…
Anthropic say Opus is better, benchmarks & evals say Opus is better, Opus has more parameters and parameters determine how much a NN can learn. Maybe Opus just is better
How have you tested your recall in the long and short term? And what were the results?
Just checking my notes here. This is the same Sam Altman who abandoned OpenAI’s founding mission in favour of profit? No it can’t be
I want to believe that it wasn’t announced at that time, with that name, purely to detract from Google I/O. But it’s hard
https://arxiv.org/abs/2309.08632
Nice story - I’ve seen you on the leaderboard a few times. Good luck through the rest of Foundations III
Nice, also find small classifiers work best for things like this. Out of interest, how many, if any, of the 3million were labelled? Did you end up labelling any/more, or distilling from a generative model?
Thanks for linking - I know this is pedantic but one might think OpenAI’s models could make their content free of basic errors quite easily? “Conretely, let's define a routine to be a list of instructions in natural…
This is not an attempt at affected nonchalance, but I’ve simply never come across the idea that Dostoevsky is particularly difficult to read. A somewhat gifted teenager will race through it, as will an average adult.
Not hired Suleyman? Build his own research lab? Satya made moves early on with OpenAI that should be studied in business classes for all the right reasons. He also made moves later on that will be studied for all the…
The gap between Anthropic and the other guys keeps growing
Big respect Total humiliation for Hegseth, sure there will be a backlash
To somewhat state the obvious - the problem isn’t the amount of data, it’s the algorithms. We need to discover the set of learning algorithms nature has, and determine whether they’re implementable in silicon
Is everything OpenAI do/release now a response to something Anthropic have recently released? I remember the days when it was worth reading about their latest research/release. Halcyon days indeed.
“ This is one of my fundamental beliefs about the nature of consciousness. We are never able to interact with the physical world directly, we first perceive it and then interpret those perceptions. More often than not,…
I don’t have the experiments to prove this, but from my experience it’s highly variable between embedding models. Larger, more capable embedding models are better able to separate the different uses of a given word in…
Doesn’t seem like this will be SOTA in things that really matter, hoping enough people jump to it that Opus has more lenient usage limits for a while
As a fairly extensive user of both Python and R, I net out similarly. If I want to wrangle, explore, or visualise data I’ll always reach for R. If I want to build ML/DL models or work with LLM’s I will usually reach for…
Oh boy, if the benchmarks are this good and Opus feels like it usually does then this is insane. I’ve always found Opus significantly better than the benchmarks suggested. LFG
Please don’t actually use these 5,6,7-way Venn diagrams for anything practical, they’re virtually useless and communicate nothing.
I agree it is a profound question. My thesis is fairly boring. For any given clustering task of interest, there is no single value of K. Clustering & unsupervised machine learning is as much about creating meaning and…
“Skills are a simple concept with a correspondingly simple format.” From the Anthropic Engineering blog. I think Skills will be useful in helping regular AI users and non-technical people fall into better patterns. Many…
It came from nowhere to 1T tokens per week, seems… suspect.
What use-cases do you see for the 270M’s embeddings, and should we be sticking to token embeddings or can we meaningfully pool for sentence/document embeddings? Do we need to fine-tune for the embeddings to be…
Anthropic say Opus is better, benchmarks & evals say Opus is better, Opus has more parameters and parameters determine how much a NN can learn. Maybe Opus just is better
How have you tested your recall in the long and short term? And what were the results?
Just checking my notes here. This is the same Sam Altman who abandoned OpenAI’s founding mission in favour of profit? No it can’t be
I want to believe that it wasn’t announced at that time, with that name, purely to detract from Google I/O. But it’s hard
https://arxiv.org/abs/2309.08632
Nice story - I’ve seen you on the leaderboard a few times. Good luck through the rest of Foundations III
Nice, also find small classifiers work best for things like this. Out of interest, how many, if any, of the 3million were labelled? Did you end up labelling any/more, or distilling from a generative model?
Thanks for linking - I know this is pedantic but one might think OpenAI’s models could make their content free of basic errors quite easily? “Conretely, let's define a routine to be a list of instructions in natural…