Often not in the same way - even if there are multiple queues (that can be given a priority), they're often limited in what they can schedule between. Often there's shared resources that are statically allocated to…
Realistically the models will always be resident in the GPU during processing - the CPU and it's memory would probably more be used for related development tasks (as this is a workstation not a cloud server). If it's…
Yeah, but then there's the size of KV cache needing to be read through that HBM interface for each token, putting a hard limit on the tok/s based on the memory bandwidth. On some models a large context can be a notable…
Yes, the "Big Scary Numbers" listing CCTV cameras per capita include private cameras, which can outnumber "public" (government, council and police) cameras by orders of magnitude. In the UK these include those owned by…
There's the simple physics of a vtol craft when landing needing to push down a lot of a air very fast just to lift an average human - plus the weight of the craft itself. There's a reason helicopters today don't land on…
No, but to most people the only exposure they've had to the term "Effective Altruism" (if they've even heard of the it) is morality-washing personal greed that never quite seems to get past the "accumulation" or…
A spaced en-dash is also commonly used in British english for the parenthesis equivalent. So it's not really "anglosphere". While there's no central authority, both Oxford and Cambridge University press style guidelines…
It mostly works because the object you're sling-shotting with is moving relative to the initial origin of the probe - if you can line it up so the object is moving in the direction you want to accelerate in you can get…
Yeah, many of the theoretical solar sail ideas fall down on what I consider a useful "probe" is, and what it can mass. As mentioned in my other comment, if you define the "probe" to be "a single particle" we /already/…
It might help a bit, as you mentioned that Voyager is currently going about ~17km/s, so nearly 0.005% c, so it's already nearly 1/200th of the way there to our target of 1% c. But then you're at a velocity so far beyond…
Space sails are super low thrust though, even lower than my VASIMIR example - so will take even longer to reach the desired speed - though they have the advantage of not having to carry the complex and heavy engine I…
No, not even close. The issue is simply exhaust velocity and reaction mass, that leads us into the tyranny of the rocket equation - in that you have to carry that reaction mass with you and accelerate that mass too.…
They're really simple - arguably the problem is people try to treat them as a single complex unit rather than just "5 junctions in a row". Trying to think of them as a whole is rather pointless and self defeating, as…
Even then the "reserved" section is a carve out guaranteed chunk to allow stuff that might need contiguous physical memory (display scan out buffers and page tables, for example) and similar. The GPU can still happily…
Imgur were found to be in breach of the data collection laws before any "you must check IDs" laws were even discussed in parliament, let alone passed, where the guidance was pretty much "Don't get caught actively…
I find this amusing as Apple were the people I had direct interactions with that didn't run stuff like fuzzers or sanitizers as a matter of course - at least not in the situations I was involved with. Though this was ~3…
I remember this being a thing done a while back using linux's MTD/phram drivers - https://wiki.archlinux.org/title/Swap_on_video_RAM - not sure if that's still relevant though as I don't know how it'll interact with DRM…
A modern allocator with per-thread cache can satisfy some allocations in 20-30 cycles - dynamic dispatch can easily double that, even if the target is still in cache. It's one of these things where it's extremely use…
I think the real point is they didn't - until it became a "marketing" thing for another company who did it for them. A lot of these issues would be highlighted by "legacy" (pre-AI) analysis tools. The issue is that they…
And the ones who get the "payday" are just the ones we've heard of. How many people didn't get media attention, don't have the ability (time/money) to sue, lost that case, and those where the intimidation and…
But each new customer is still losing money. As I said, subsidized growth only matters if you can recoup those subsidies afterwards - and that's what I'm not sure will be true. I think the idea of "all growth is good no…
From what I've seen pretty much every company is limited by hardware supply, to the level where's there complaints from current customers about the speed of new customer growth is exceeding their ability to service them…
Get back to me when there's an AI company that's actually profitable and we can compare their service and pricing. Claiming that there's some small subset of their services (like inference per token) that's "profitable"…
For higher than audible frequency sample rates there's a good chance you can tell the difference. It often causes weird aliasing and harmonics in the more audible frequencies on "real" playback equipment. You can train…
And bottled water likely varies by at least a similar amount - they're not testing and re-printing every bottle after all.
Often not in the same way - even if there are multiple queues (that can be given a priority), they're often limited in what they can schedule between. Often there's shared resources that are statically allocated to…
Realistically the models will always be resident in the GPU during processing - the CPU and it's memory would probably more be used for related development tasks (as this is a workstation not a cloud server). If it's…
Yeah, but then there's the size of KV cache needing to be read through that HBM interface for each token, putting a hard limit on the tok/s based on the memory bandwidth. On some models a large context can be a notable…
Yes, the "Big Scary Numbers" listing CCTV cameras per capita include private cameras, which can outnumber "public" (government, council and police) cameras by orders of magnitude. In the UK these include those owned by…
There's the simple physics of a vtol craft when landing needing to push down a lot of a air very fast just to lift an average human - plus the weight of the craft itself. There's a reason helicopters today don't land on…
No, but to most people the only exposure they've had to the term "Effective Altruism" (if they've even heard of the it) is morality-washing personal greed that never quite seems to get past the "accumulation" or…
A spaced en-dash is also commonly used in British english for the parenthesis equivalent. So it's not really "anglosphere". While there's no central authority, both Oxford and Cambridge University press style guidelines…
It mostly works because the object you're sling-shotting with is moving relative to the initial origin of the probe - if you can line it up so the object is moving in the direction you want to accelerate in you can get…
Yeah, many of the theoretical solar sail ideas fall down on what I consider a useful "probe" is, and what it can mass. As mentioned in my other comment, if you define the "probe" to be "a single particle" we /already/…
It might help a bit, as you mentioned that Voyager is currently going about ~17km/s, so nearly 0.005% c, so it's already nearly 1/200th of the way there to our target of 1% c. But then you're at a velocity so far beyond…
Space sails are super low thrust though, even lower than my VASIMIR example - so will take even longer to reach the desired speed - though they have the advantage of not having to carry the complex and heavy engine I…
No, not even close. The issue is simply exhaust velocity and reaction mass, that leads us into the tyranny of the rocket equation - in that you have to carry that reaction mass with you and accelerate that mass too.…
They're really simple - arguably the problem is people try to treat them as a single complex unit rather than just "5 junctions in a row". Trying to think of them as a whole is rather pointless and self defeating, as…
Even then the "reserved" section is a carve out guaranteed chunk to allow stuff that might need contiguous physical memory (display scan out buffers and page tables, for example) and similar. The GPU can still happily…
Imgur were found to be in breach of the data collection laws before any "you must check IDs" laws were even discussed in parliament, let alone passed, where the guidance was pretty much "Don't get caught actively…
I find this amusing as Apple were the people I had direct interactions with that didn't run stuff like fuzzers or sanitizers as a matter of course - at least not in the situations I was involved with. Though this was ~3…
I remember this being a thing done a while back using linux's MTD/phram drivers - https://wiki.archlinux.org/title/Swap_on_video_RAM - not sure if that's still relevant though as I don't know how it'll interact with DRM…
A modern allocator with per-thread cache can satisfy some allocations in 20-30 cycles - dynamic dispatch can easily double that, even if the target is still in cache. It's one of these things where it's extremely use…
I think the real point is they didn't - until it became a "marketing" thing for another company who did it for them. A lot of these issues would be highlighted by "legacy" (pre-AI) analysis tools. The issue is that they…
And the ones who get the "payday" are just the ones we've heard of. How many people didn't get media attention, don't have the ability (time/money) to sue, lost that case, and those where the intimidation and…
But each new customer is still losing money. As I said, subsidized growth only matters if you can recoup those subsidies afterwards - and that's what I'm not sure will be true. I think the idea of "all growth is good no…
From what I've seen pretty much every company is limited by hardware supply, to the level where's there complaints from current customers about the speed of new customer growth is exceeding their ability to service them…
Get back to me when there's an AI company that's actually profitable and we can compare their service and pricing. Claiming that there's some small subset of their services (like inference per token) that's "profitable"…
For higher than audible frequency sample rates there's a good chance you can tell the difference. It often causes weird aliasing and harmonics in the more audible frequencies on "real" playback equipment. You can train…
And bottled water likely varies by at least a similar amount - they're not testing and re-printing every bottle after all.