A lot of us went through a similar system and still retained both honour and desire to actually learn.
It's interesting that Claude also over-uses en-dashes. It's very willing to create compound-noun-phrases, especially in that compressed-summary-paragraph it often writes. The 0-days-vibes-vulns that started this thread…
People are missing that Willison is among the very best people we have in the role of (for lack of a good name): early access to frontier models, evaluate them in real scenarios, no wishful thinking, hype, or doom,…
> LLMs do just interpolate their training data "interpolate" has a technical meaning - in this meaning, LLMs almost never interpolate. It also has a very vague everyday meaning - in this meaning, LLMs do interpolate,…
But euros spent on tokens is a tiny fraction of the overall costs of the project.
> Since these companies can’t improve their AI models without fresh data created by human beings Totally wrong. Self-play dates back to Arthur Samuel in the 1950s and RL with verifiable rewards is a key part of training…
> Anglo Please, write US-American. These people are not coming from any other place.
I understand your point, but in response to GP (they should spend this money on houses for other poor people instead), the reduced reliance on other social welfare is totally legitimate to count.
You didn't read the article. The scheme gave positive return on investment.
Google Scholar provides imperfect citations - very often wrong article type (eg article versus conference paper), but up to and including missing authors, in my experience.
Jokes are one of the good parts of human existence, so - while I see your side of the story - there is another side.
The best example of all is Prolog. It is always held up as the paradigmatic representative of logic programming, a rare language paradigm. But it doesn't need to be a language. It is really a collection of algorithms…
But he actually uses frontier LLMs in his own work. Probably that's stronger evidence.
Yes. But "the gold standard" just means "the most natural, easy and dumb way".
This is on the semi-private set * https://x.com/arcprize/status/1990820655411909018 * https://arcprize.org/guide
"Pelican on bicycle" is one special case, but the problem (and the interesting point) is that with LLMs, they are always generalising. If a lab focussed specially on pelicans on bicycles, they would as a by-product…
About ARC 2: I would want to hear more detail about prompts, frameworks, thinking time, etc., but they don't matter too much. The main caveat would be that this is probably on the public test set, so could be in…
On HN it's very common to see a blog post along the lines of "I found this old piece of equipment with no brand name, I used some network traffic inspection to figure out what it does, I hacked around a bit, I got it…
(a) no it's not (b) your comment is miles off-topic, as he is not addressing doom in any sense
But they're submissions to ICML.
It could certainly replace the author of this article.
Modern LLMs can one-shot code in a totally new language, if you provide the language manual. And you have to provide the language manual, because otherwise how can the students learn the language.
> The fact that AI can do your homework should tell you how much your homework is worth. A lot of people who say this kind of thing have, frankly, a very shallow view of what homework is. A lot of homework can be easily…
Absolutely devastating for the credibility of FAIR.
Link [1] doesn't seem to mention svg or vector graphics at all.
A lot of us went through a similar system and still retained both honour and desire to actually learn.
It's interesting that Claude also over-uses en-dashes. It's very willing to create compound-noun-phrases, especially in that compressed-summary-paragraph it often writes. The 0-days-vibes-vulns that started this thread…
People are missing that Willison is among the very best people we have in the role of (for lack of a good name): early access to frontier models, evaluate them in real scenarios, no wishful thinking, hype, or doom,…
> LLMs do just interpolate their training data "interpolate" has a technical meaning - in this meaning, LLMs almost never interpolate. It also has a very vague everyday meaning - in this meaning, LLMs do interpolate,…
But euros spent on tokens is a tiny fraction of the overall costs of the project.
> Since these companies can’t improve their AI models without fresh data created by human beings Totally wrong. Self-play dates back to Arthur Samuel in the 1950s and RL with verifiable rewards is a key part of training…
> Anglo Please, write US-American. These people are not coming from any other place.
I understand your point, but in response to GP (they should spend this money on houses for other poor people instead), the reduced reliance on other social welfare is totally legitimate to count.
You didn't read the article. The scheme gave positive return on investment.
Google Scholar provides imperfect citations - very often wrong article type (eg article versus conference paper), but up to and including missing authors, in my experience.
Jokes are one of the good parts of human existence, so - while I see your side of the story - there is another side.
The best example of all is Prolog. It is always held up as the paradigmatic representative of logic programming, a rare language paradigm. But it doesn't need to be a language. It is really a collection of algorithms…
But he actually uses frontier LLMs in his own work. Probably that's stronger evidence.
Yes. But "the gold standard" just means "the most natural, easy and dumb way".
This is on the semi-private set * https://x.com/arcprize/status/1990820655411909018 * https://arcprize.org/guide
"Pelican on bicycle" is one special case, but the problem (and the interesting point) is that with LLMs, they are always generalising. If a lab focussed specially on pelicans on bicycles, they would as a by-product…
About ARC 2: I would want to hear more detail about prompts, frameworks, thinking time, etc., but they don't matter too much. The main caveat would be that this is probably on the public test set, so could be in…
On HN it's very common to see a blog post along the lines of "I found this old piece of equipment with no brand name, I used some network traffic inspection to figure out what it does, I hacked around a bit, I got it…
(a) no it's not (b) your comment is miles off-topic, as he is not addressing doom in any sense
But they're submissions to ICML.
It could certainly replace the author of this article.
Modern LLMs can one-shot code in a totally new language, if you provide the language manual. And you have to provide the language manual, because otherwise how can the students learn the language.
> The fact that AI can do your homework should tell you how much your homework is worth. A lot of people who say this kind of thing have, frankly, a very shallow view of what homework is. A lot of homework can be easily…
Absolutely devastating for the credibility of FAIR.
Link [1] doesn't seem to mention svg or vector graphics at all.