The problem is if DDR4 was viable here it would also be absurdly expensive. There’s no world in which we survive this demand without a corresponding increase in supply. It’s not like there are zettabytes of spare cheap…
I snagged my two 4tb acer variants for under 4k each. CDW still has them listed for close to what I paid.
I’ve got a 128gb m5 max mbp and two sparks. For my real-world use cases, a single spark running DS4 Flash will have fully responded by the time my Mac has even started generating tokens. I figured I’d have more…
Plenty of demand outside the US. Why would the hyperscalers not buy the chinese RAM for all of their datacenters across the world besides the US one? Rising supply from China will impact prices even in countries where…
Anything where you're dealing with a large volume of records/documents. Lots of people are using these for large-scale digitization of documents - scanned stuff being OCR'ed and summarized, generating embeddings, etc.…
> The cuda cores can be broken up into compute complexes which larger blocks of memory directly attached to the cores. Perhaps in theory, but for the gb10 stuff the memory is all on the CPU die and connected to the GPU…
The dgx spark is the same chip and those are in the low 3s to 5 range for most of them depending on manu, storage config, etc. The dgx sparks also have connectx 7 cards in them to support the 200gbps networking for…
Prefill is another advantage vs. Apple. It's way way way way faster on a spark than it is even on an m5 max. Same model, same quant, same query, as close to as matched settings as I can get from vllm, and for workloads…
Not true. This is aimed squarely at the Strix Halo and Mac markets. It's basically just strictly better than the Strix, and it's not clear cut vs that Macs in any sort of blanket statement. My M5 Max 128gb MBP decodes…
For these in specific, they appear basically transparently to the GPU. There's a lot of software/firmware stuff for this, but also a different hardware architecture - while the RAM is on the CPU die, the nvlink-c2c…
> If I see code like the one above posted by the OP, that the author wouldn't have written, I start to pay attention. Except the author did write it. https://github.com/RsyncProject/rsync/issues/959#issuecommen... Which…
Never had this issue with any of my MBP. I never even have magsafe available, couldn't tell you where a USB-C to magsafe cable is in my house if my life depended on it.
There are a variety of inference engines that support this, regardless of whether or not there is native FP8 in Ampere - llama.cpp will do it quite happily. VLLM you can do W8A16 quant too. There are a whole lot of ways…
I remember getting my first CalDigit TB dock and being excited - everyone seemed to love them. I expected it to largely Just Work. That thing Didn't Work more than it Worked, but options were slim. Eventually it fully…
You can split tensors across an AMD GPU and Nvidia GPU - different architectures are not an issue. People run LLMs across some pretty crazy setups.
I've had multiple X520-DAs in desktop cases for years without doing anything special for cooling. Hell, one of them was in a fully watercooled system that had very little in-case airflow.
To the best of my knowledge, the Indian support teams for AWS have all the same access their US/EU/etc. support teams have when it comes to escalation and communication avenues. Obviously real time communication is…
From talking to people I know on support teams at hyperscalers and other tech companies: A mind-boggling huge portion. But even as an AI believer and thinking it's great for this sort of thing, I also think if it's good…
You have a minority view on this argument, though. Scientific and structural realism both reject the idea that math is just a map. You've got company with the instrumentalists and antirealists, but the majority…
I don't know what you're even trying to argue here. We're not comparing math to reality (though there's a strong argument to be made that reality has a structure that is mathematical in nature - structural realism…
So basically you're asking everyone to just trust you, a random commentator that provides no evidence or sourcing, over an article written with extensive sourcing, details, and explanations? You might be the correct…
Most of the companies behind Valkey were writing significant code for Redis. It was certainly not a case of them paying nothing. Valkey has some of the (formerly) most prolific Redis contributors for the era in which it…
Avoidant behavior is defined as specifically attempted to avoid being exposed to things that remind you of your trauma. Avoidant behavior is basically universally agreed to be a maladaptive behavior to ptsd.
Facilitating negative behaviors that prevent/increase the difficulty of overcoming trauma is not being kind to someone.
> There has been no proper research on the effectiveness of "being given a trigger warning, and then not consuming the content because of it." Well, there has been. From multiple angles. One, avoiding content because it…
The problem is if DDR4 was viable here it would also be absurdly expensive. There’s no world in which we survive this demand without a corresponding increase in supply. It’s not like there are zettabytes of spare cheap…
I snagged my two 4tb acer variants for under 4k each. CDW still has them listed for close to what I paid.
I’ve got a 128gb m5 max mbp and two sparks. For my real-world use cases, a single spark running DS4 Flash will have fully responded by the time my Mac has even started generating tokens. I figured I’d have more…
Plenty of demand outside the US. Why would the hyperscalers not buy the chinese RAM for all of their datacenters across the world besides the US one? Rising supply from China will impact prices even in countries where…
Anything where you're dealing with a large volume of records/documents. Lots of people are using these for large-scale digitization of documents - scanned stuff being OCR'ed and summarized, generating embeddings, etc.…
> The cuda cores can be broken up into compute complexes which larger blocks of memory directly attached to the cores. Perhaps in theory, but for the gb10 stuff the memory is all on the CPU die and connected to the GPU…
The dgx spark is the same chip and those are in the low 3s to 5 range for most of them depending on manu, storage config, etc. The dgx sparks also have connectx 7 cards in them to support the 200gbps networking for…
Prefill is another advantage vs. Apple. It's way way way way faster on a spark than it is even on an m5 max. Same model, same quant, same query, as close to as matched settings as I can get from vllm, and for workloads…
Not true. This is aimed squarely at the Strix Halo and Mac markets. It's basically just strictly better than the Strix, and it's not clear cut vs that Macs in any sort of blanket statement. My M5 Max 128gb MBP decodes…
For these in specific, they appear basically transparently to the GPU. There's a lot of software/firmware stuff for this, but also a different hardware architecture - while the RAM is on the CPU die, the nvlink-c2c…
> If I see code like the one above posted by the OP, that the author wouldn't have written, I start to pay attention. Except the author did write it. https://github.com/RsyncProject/rsync/issues/959#issuecommen... Which…
Never had this issue with any of my MBP. I never even have magsafe available, couldn't tell you where a USB-C to magsafe cable is in my house if my life depended on it.
There are a variety of inference engines that support this, regardless of whether or not there is native FP8 in Ampere - llama.cpp will do it quite happily. VLLM you can do W8A16 quant too. There are a whole lot of ways…
I remember getting my first CalDigit TB dock and being excited - everyone seemed to love them. I expected it to largely Just Work. That thing Didn't Work more than it Worked, but options were slim. Eventually it fully…
You can split tensors across an AMD GPU and Nvidia GPU - different architectures are not an issue. People run LLMs across some pretty crazy setups.
I've had multiple X520-DAs in desktop cases for years without doing anything special for cooling. Hell, one of them was in a fully watercooled system that had very little in-case airflow.
To the best of my knowledge, the Indian support teams for AWS have all the same access their US/EU/etc. support teams have when it comes to escalation and communication avenues. Obviously real time communication is…
From talking to people I know on support teams at hyperscalers and other tech companies: A mind-boggling huge portion. But even as an AI believer and thinking it's great for this sort of thing, I also think if it's good…
You have a minority view on this argument, though. Scientific and structural realism both reject the idea that math is just a map. You've got company with the instrumentalists and antirealists, but the majority…
I don't know what you're even trying to argue here. We're not comparing math to reality (though there's a strong argument to be made that reality has a structure that is mathematical in nature - structural realism…
So basically you're asking everyone to just trust you, a random commentator that provides no evidence or sourcing, over an article written with extensive sourcing, details, and explanations? You might be the correct…
Most of the companies behind Valkey were writing significant code for Redis. It was certainly not a case of them paying nothing. Valkey has some of the (formerly) most prolific Redis contributors for the era in which it…
Avoidant behavior is defined as specifically attempted to avoid being exposed to things that remind you of your trauma. Avoidant behavior is basically universally agreed to be a maladaptive behavior to ptsd.
Facilitating negative behaviors that prevent/increase the difficulty of overcoming trauma is not being kind to someone.
> There has been no proper research on the effectiveness of "being given a trigger warning, and then not consuming the content because of it." Well, there has been. From multiple angles. One, avoiding content because it…