This is going to be very geographically dependent, surely?
Some of the inference engines can process multiple requests in parallel more efficiently than doing them sequentially. Not sure of the exact mechanism but e.g. llama.cpp's llama-server can do this (you tell it the…
They have a presence in London; have met someone who works there. Sounds like there is an office too
Disk space is one thing, but the actual download size is higher than some people's data allowances altogether! It baffles me that a lot of people don't seem to be aware of this
Disagreed; it's not a download you'd expect and it's also at least an order or two of magnitude than you'd expect to find reasonable for browsing a page. I have a 2GB mobile data plan. If I was using Chrome, then some…
Probably explains it, but one wonders why this page would need WebGL at all. It's not like it's a rich graphical application... is it? :)
Worth noting that NVIDIA confidential computing and similar schemes have been compromised and shouldn't be relied upon if it really matters. See https://tee.fail/ and similar.
> the function signature is what they read, but the scars are what they need. This feels like a golden quote. Don't know if you intended for it to rhyme, but well done :D
A while ago I checked this out and the homepage looked like it had fallen to the 'AI hype' trend, you know like how everything was 'AI-native XYZ for Autonomous Agents' at the time. I'm not seeing that now though. Am I…
they don't restrict you to using their opencode agent, you can use go in any other agent
Weird; I clicked through out of curiosity and didn't get any corruption of the sort in the end result. I also asked it some technical details about how diffusion LLMs could work and it provided grammatically-correct…
that said the documentation is rough, especially for their support for non-React frameworks
Do you have anywhere for people to follow the developments? :)
Do you have anywhere people can follow out of interest? :)
This looks really excellent, looking forward to giving it a try, thank you for sharing!
Sounds interesting, but if I may: the website is exceedingly sluggish, something like 1-2s interval between re-renders when trying to scroll the page (Firefox Linux). Not seeing any reason to explain this based on the…
This looks very nifty, I will check it out and consider using it after I can understand the underlying primitives :) Thanks for sharing!
I was going to use Firecracker in an untrusted code execution project (not AI stuff); any chance you'd be happy to elaborate a bit on how you found it a pain to use? Thanks :)
`WHERE status = 'pending'` is not enough to avoid the performance problem, even if you have an index on `(status)`, because the index will still contain dead tuples until it is vacuumed. Rough intuition: Postgres…
For disk usage, yes this doesn't address anything. But for read performance (which is IMO what the section in the article was motivated by), it doesn't actually matter to have a bunch of entries corresponding to dead…
Decent article, but some remarks: 1) It seems these two statements conflict with each other: > The oldest such transaction sets the cutoff—referred to as the "MVCC horizon." Until that transaction completes, every dead…
I have now been waiting 2 months for a response to a similar problem. Thanks for the reminder about it, it's time to dig out the chargebacks...
Maybe what the parent commenter was referring to is that recently CloudFlare have published multiple vibe-code demo blog posts whilst trying to pass it off as production grade, for example…
This is going to be very geographically dependent, surely?
Some of the inference engines can process multiple requests in parallel more efficiently than doing them sequentially. Not sure of the exact mechanism but e.g. llama.cpp's llama-server can do this (you tell it the…
They have a presence in London; have met someone who works there. Sounds like there is an office too
Disk space is one thing, but the actual download size is higher than some people's data allowances altogether! It baffles me that a lot of people don't seem to be aware of this
Disagreed; it's not a download you'd expect and it's also at least an order or two of magnitude than you'd expect to find reasonable for browsing a page. I have a 2GB mobile data plan. If I was using Chrome, then some…
Probably explains it, but one wonders why this page would need WebGL at all. It's not like it's a rich graphical application... is it? :)
Worth noting that NVIDIA confidential computing and similar schemes have been compromised and shouldn't be relied upon if it really matters. See https://tee.fail/ and similar.
> the function signature is what they read, but the scars are what they need. This feels like a golden quote. Don't know if you intended for it to rhyme, but well done :D
A while ago I checked this out and the homepage looked like it had fallen to the 'AI hype' trend, you know like how everything was 'AI-native XYZ for Autonomous Agents' at the time. I'm not seeing that now though. Am I…
they don't restrict you to using their opencode agent, you can use go in any other agent
Weird; I clicked through out of curiosity and didn't get any corruption of the sort in the end result. I also asked it some technical details about how diffusion LLMs could work and it provided grammatically-correct…
that said the documentation is rough, especially for their support for non-React frameworks
Do you have anywhere for people to follow the developments? :)
Do you have anywhere people can follow out of interest? :)
This looks really excellent, looking forward to giving it a try, thank you for sharing!
Sounds interesting, but if I may: the website is exceedingly sluggish, something like 1-2s interval between re-renders when trying to scroll the page (Firefox Linux). Not seeing any reason to explain this based on the…
This looks very nifty, I will check it out and consider using it after I can understand the underlying primitives :) Thanks for sharing!
I was going to use Firecracker in an untrusted code execution project (not AI stuff); any chance you'd be happy to elaborate a bit on how you found it a pain to use? Thanks :)
`WHERE status = 'pending'` is not enough to avoid the performance problem, even if you have an index on `(status)`, because the index will still contain dead tuples until it is vacuumed. Rough intuition: Postgres…
For disk usage, yes this doesn't address anything. But for read performance (which is IMO what the section in the article was motivated by), it doesn't actually matter to have a bunch of entries corresponding to dead…
Decent article, but some remarks: 1) It seems these two statements conflict with each other: > The oldest such transaction sets the cutoff—referred to as the "MVCC horizon." Until that transaction completes, every dead…
I have now been waiting 2 months for a response to a similar problem. Thanks for the reminder about it, it's time to dig out the chargebacks...
Maybe what the parent commenter was referring to is that recently CloudFlare have published multiple vibe-code demo blog posts whilst trying to pass it off as production grade, for example…