Robots that replace auto industry factory workers exist; the CEO of GM didn't imagine them as part of some sort of business media induced psychotic episode. The same is not true for the software industry execs.
Amazon lost a cumulative 2.8 billion over their first 17 quarters. So if you're asking about time, then amazon stopped a lot faster. OpenAI is 40 quarters old. If you are asking about money, then amazon... also stopped…
If you want to play games like that, you could also flip it around and ask if the AI would have been eventually fired (assuming no one knew they were talking to a computer). Not sure what that proves.
If you can make it 800 you can claim to be a 100x engineer!
Say what you want about nazis, but they are good at rockets.
But Google didn't go public until 2004, when they were highly profitable. Every startup goes through a phase where they aren't profitable... For most of of them that ends when they go bankrupt.
Didn't xAI basically donate the compute for that quarter so Anthropic could get to say they turned a profit?
But then go right back to being unprofitable again afterwards, which is a little weird.
They don't want to build trust. They want to build a trust wedge between the people making the buying decisions and the people with hands on experience of the product. When an employee says AI isn't speeding up his…
So, it's like if they were a pharma company that was barely profitable if you didn't take into account R&D costs?
[dead]
Sounds like a healthy industry, selling tokens at 1000x below cost.
Yeah, I use them all the time. I just don't see any good argument that it's anything other than statistical pattern matching plus some sort of logic encoded in language. My overfitted LLM obviously didn't arrive at…
Yeah, what about them? As far as I read it the tasks are fixed. The AI companies should know the tasks by now, and have overfitted their models on the tests by now, in the same way I'm implying I overfitted my model to…
I don't know why people are so impressed by 8h. I trained an LLM to write the whole Harry Potter series, and that took JK Rowling like 17 years. For my next point on the graph, I'll train the LLM to write the Bible,…
Karım Kahn at the International Criminal Court would like a word about that.
Google is the leader, they really don't want AI to be a success, it only comes with a risk of disruption. They probably don't even really believe it's going to be that big of a deal. They are only in that game to hedge;…
How do you propose to do a Turing test on a human (in a sense that is different from a machine simply passing the Turing test)? Like failing to pick out all the motorcycles in a captcha, or a turing test where you have…
They won't figure it out. It's the tragedy of the commons.
Yeah, so you are agreeing that the benchmarks are useless because they don't answer those questions.
Same question I have for all these benchmarks: What's going to stop e.g. OpenAI from hiring a bunch of teenagers to play these games non-stop for a month and annotate the game with their logic for deriving the rules,…
That pretty much describes shape up : https://basecamp.com/shapeup I have a mixed relationship to it, but the scope cutting part of it works extremely well. The focus it brings on focusing on the problem solved rather…
Yeah, enormously. People will hedge depending on how sure they are about something. They might also have credentials in whatever you ask them, if you get legal advice from a lawyer, that can be judged to be more…
In my experience the last answer it gives is usually the right one
Great, now I have two answers and still no clue which one is the right one.
Robots that replace auto industry factory workers exist; the CEO of GM didn't imagine them as part of some sort of business media induced psychotic episode. The same is not true for the software industry execs.
Amazon lost a cumulative 2.8 billion over their first 17 quarters. So if you're asking about time, then amazon stopped a lot faster. OpenAI is 40 quarters old. If you are asking about money, then amazon... also stopped…
If you want to play games like that, you could also flip it around and ask if the AI would have been eventually fired (assuming no one knew they were talking to a computer). Not sure what that proves.
If you can make it 800 you can claim to be a 100x engineer!
Say what you want about nazis, but they are good at rockets.
But Google didn't go public until 2004, when they were highly profitable. Every startup goes through a phase where they aren't profitable... For most of of them that ends when they go bankrupt.
Didn't xAI basically donate the compute for that quarter so Anthropic could get to say they turned a profit?
But then go right back to being unprofitable again afterwards, which is a little weird.
They don't want to build trust. They want to build a trust wedge between the people making the buying decisions and the people with hands on experience of the product. When an employee says AI isn't speeding up his…
So, it's like if they were a pharma company that was barely profitable if you didn't take into account R&D costs?
[dead]
Sounds like a healthy industry, selling tokens at 1000x below cost.
Yeah, I use them all the time. I just don't see any good argument that it's anything other than statistical pattern matching plus some sort of logic encoded in language. My overfitted LLM obviously didn't arrive at…
Yeah, what about them? As far as I read it the tasks are fixed. The AI companies should know the tasks by now, and have overfitted their models on the tests by now, in the same way I'm implying I overfitted my model to…
I don't know why people are so impressed by 8h. I trained an LLM to write the whole Harry Potter series, and that took JK Rowling like 17 years. For my next point on the graph, I'll train the LLM to write the Bible,…
Karım Kahn at the International Criminal Court would like a word about that.
Google is the leader, they really don't want AI to be a success, it only comes with a risk of disruption. They probably don't even really believe it's going to be that big of a deal. They are only in that game to hedge;…
How do you propose to do a Turing test on a human (in a sense that is different from a machine simply passing the Turing test)? Like failing to pick out all the motorcycles in a captcha, or a turing test where you have…
They won't figure it out. It's the tragedy of the commons.
Yeah, so you are agreeing that the benchmarks are useless because they don't answer those questions.
Same question I have for all these benchmarks: What's going to stop e.g. OpenAI from hiring a bunch of teenagers to play these games non-stop for a month and annotate the game with their logic for deriving the rules,…
That pretty much describes shape up : https://basecamp.com/shapeup I have a mixed relationship to it, but the scope cutting part of it works extremely well. The focus it brings on focusing on the problem solved rather…
Yeah, enormously. People will hedge depending on how sure they are about something. They might also have credentials in whatever you ask them, if you get legal advice from a lawyer, that can be judged to be more…
In my experience the last answer it gives is usually the right one
Great, now I have two answers and still no clue which one is the right one.