[dead]
[flagged]
That's a lie people repeat because they want it to be true. People evaluate dataset quality over time. There's no evidence that datasets from 2022 onwards perform any worse than ones from before 2022. There is some weak…
It's popular because it's true. By now, the main reason people expect AI progress to halt is cope. People say "AI progress is going to stop, any minute now, just you wait" because the alternative makes them very, very…
What makes you look at existing AI systems and then say "oh, this totally isn't capable of describing a problem or figuring out what's actually wrong"? Let alone "this wouldn't EVER be capable of that"?
> So for the most part access to AI is way cheaper than it will be in the next 5-10 years. That's a lie people repeat because they want it to be true. AI inference is currently profitable. AI R&D is the money pit.…
Major AI companies are not doing nearly enough to address the sycophancy problem. I get that it's not an easy problem to solve, but how is Anthropic supposed to solve the actual alignment problem if they can't even stop…
"Dying of old age" is often an agonizing death from multiple organ failure.
Cloudflare is growing more and more vile with each passing year. Half the tools they're building now should never have existed in the first place.
Because using an RTOS for anything complex sucks, and Linux is nice and easy to work with. Same reason why routers run Linux.
Nah, we settled on "all of the above". The modern approach is "fuck over everyone at least twice".
Kessler syndrome is incredibly overrated. It's completely incapable of "permanently blocking access to space". What it's capable of is "shit up specific orbit groups so that you can't loiter in them for years unless you…
Google teams seem to be in love with that Matryoshka tech. I wonder how far that scales.
This is a censorship program. Every time a system that allows for internet content to be blocked is created, it's extended, misused and abused shortly thereafter. "The tools already exist, why don't we use them to fight…
Of course. But everything adjacent is also deeply flawed, and inevitably leads to discrimination and dehumanisation. Ban non-residental IPs? You blocked all the guys in oppressive countries who route through VPNs to…
A sufficiently capable AI would be able to plug itself in properly too. One more reason to be wary of pushing for better capabilities.
No, training a smaller model off a more capable larger model (or an ensemble of models) is the "usual" distillation. "Self-distillation" refers to distilling from a model into a copy of itself. Which is of limited use -…
Given that "training AI on books you own" was ruled fair use, the "purpose" DRM is serving here is preventing fair use. Which is the kind of thing you would expect it to do.
LLMs are only capable of performing a finite amount of computation within a single forward pass. We know that much. They are also known to operate on high level abstracts and concepts - unlike systems operating strictly…
It is shallow. But as long as what you're asking it of is the kind of material covered in high school or college, it's fairly reliable. This generation of AI doesn't yet have the knowledge depth of a seasoned university…
Not every book is readily available as a digital copy. Things like textbooks, older technical books or just books that weren't too popular can be easier to source as physical books and scan destructively. A lot of…
[dead]
[dead]
[dead]
[flagged]
That's a lie people repeat because they want it to be true. People evaluate dataset quality over time. There's no evidence that datasets from 2022 onwards perform any worse than ones from before 2022. There is some weak…
It's popular because it's true. By now, the main reason people expect AI progress to halt is cope. People say "AI progress is going to stop, any minute now, just you wait" because the alternative makes them very, very…
What makes you look at existing AI systems and then say "oh, this totally isn't capable of describing a problem or figuring out what's actually wrong"? Let alone "this wouldn't EVER be capable of that"?
> So for the most part access to AI is way cheaper than it will be in the next 5-10 years. That's a lie people repeat because they want it to be true. AI inference is currently profitable. AI R&D is the money pit.…
[flagged]
Major AI companies are not doing nearly enough to address the sycophancy problem. I get that it's not an easy problem to solve, but how is Anthropic supposed to solve the actual alignment problem if they can't even stop…
"Dying of old age" is often an agonizing death from multiple organ failure.
Cloudflare is growing more and more vile with each passing year. Half the tools they're building now should never have existed in the first place.
Because using an RTOS for anything complex sucks, and Linux is nice and easy to work with. Same reason why routers run Linux.
Nah, we settled on "all of the above". The modern approach is "fuck over everyone at least twice".
Kessler syndrome is incredibly overrated. It's completely incapable of "permanently blocking access to space". What it's capable of is "shit up specific orbit groups so that you can't loiter in them for years unless you…
Google teams seem to be in love with that Matryoshka tech. I wonder how far that scales.
This is a censorship program. Every time a system that allows for internet content to be blocked is created, it's extended, misused and abused shortly thereafter. "The tools already exist, why don't we use them to fight…
Of course. But everything adjacent is also deeply flawed, and inevitably leads to discrimination and dehumanisation. Ban non-residental IPs? You blocked all the guys in oppressive countries who route through VPNs to…
A sufficiently capable AI would be able to plug itself in properly too. One more reason to be wary of pushing for better capabilities.
No, training a smaller model off a more capable larger model (or an ensemble of models) is the "usual" distillation. "Self-distillation" refers to distilling from a model into a copy of itself. Which is of limited use -…
Given that "training AI on books you own" was ruled fair use, the "purpose" DRM is serving here is preventing fair use. Which is the kind of thing you would expect it to do.
[flagged]
LLMs are only capable of performing a finite amount of computation within a single forward pass. We know that much. They are also known to operate on high level abstracts and concepts - unlike systems operating strictly…
It is shallow. But as long as what you're asking it of is the kind of material covered in high school or college, it's fairly reliable. This generation of AI doesn't yet have the knowledge depth of a seasoned university…
Not every book is readily available as a digital copy. Things like textbooks, older technical books or just books that weren't too popular can be easier to source as physical books and scan destructively. A lot of…