I'd absolutely love to play with this. one idea I had is to train another model to create bitmaps of sidewalks and roads and add a simulation for pedestrians and cars. day/night cycle would also be so cool!
switch to auto mode and it should still work!
Here's an interesting negative result. After watching this video, my first thought was whether recent results from columnar compression (e.g. https://docs.vortex.dev/references#id1) applied "naively" like QOI would have…
Deepseek is already using SSDs for their KV cache: https://github.com/deepseek-ai/3FS
I really love this space: Navarro's book is an excellent survey. Erik Demaine has a few great lectures on succinct data structures too: L17 and L18 on https://courses.csail.mit.edu/6.851/spring12/lectures/
that's roughly what the wasm component model is aiming for! https://hacks.mozilla.org/2019/11/announcing-the-bytecode-al...
can you specify the algorithm in more detail? this looks to be solving a different problem than A*, which operates over discrete graphs. this looks to be operating in 2D continuous space instead. so, what is the…
this is unbelievably cool. ~27ns overhead for searching for a u32 in a 4GB set in memory is unreal. it's interesting that the wins for batching start diminishing at 8. I'm curious then how the subsequent optimizations…
I love playing with it at UltraHigh quality and 1 solver iterations. It reminds me of gradually incorporating one ingredient into another when cooking: like incorporating flour into eggs when making pasta.
+1. I'd be curious how much of a pessimization to uncontended workloads it'd be to just use `tokio::sync::RwLock`. and, if we want to keep it as a spinlock, I'm curious how much the immediate wakeup compares to using…
looking forward to it! I'd be curious if y'all end up supporting adding filter attributes to the inverted index that can then be pushed down into the posting list traversal. for example, a restaurant search app may have…
very cool stuff! I just read the SPFresh paper a few days ago and was wondering if it's been implemented in industry (e.g. Turbopuffer's implementation of SPANN). I'd be curious how y'all represent the posting lists for…
note that convex is open source! https://github.com/get-convex/convex-backend if you don't want to manage your own infrastructure, you can use our hosted product, but otherwise it's totally fine to self-host the open…
yeah! we were talking to the antithesis folks during this project, but it wasn't far enough along when we started the project in 2016. we were heavily influenced by the original foundationdb testing talk from strange…
former area tech lead for dropbox (and frequent collaborator with isaac) here! happy to answer any questions.
adding to the chorus here - this is great tech. we use it internally at convex for implementing OLTP full text search. other than its runtime characteristics, the codebase is well organized and a great resource for…
we just open sourced the backend last month! https://news.convex.dev/convex-goes-open-source/
hey, sujay (the author) here! happy to answer any questions about the post or convex more generally.
this is a really cool idea. one followup I was thinking of is whether this can generalize to queries other than key value point lookups. if I'm understanding correctly, the article is suggesting to take a key value…
super cool stuff — such deep OS integration is refreshing when we mostly just see cross-platform electron apps these days.
the post calls out replication and durability, and I'd be curious to know more there too. do they replicate within a fly region? S3 replicates to multiple AZs within an AWS region -- is there an equivalent for fly? I'd…
It's a bit old and doesn't include recent microarchitectural changes, but Section 2 of the FlexSC paper from 2010 (https://www.usenix.org/legacy/event/osdi10/tech/full_papers/...) has a detailed discussion of these…
as someone who's followed along (in large production systems) from `eventual` to a large combinator-based `futures`-0.1 system to async/await today, I really enjoyed this post and all its historical context. despite its…
magic pocket's tech lead (disclaimer: my cofounder at convex) has a whole talk on this concept of "durability theater" [1]! the tldr is that those numbers of 9s are just table stakes. no system should ever lose data due…
hi! sujay from convex here. I remember reading about your "reverse query engine" when we were getting started last year and really liking that framing of the broadcast problem here. as james mentions, we entirely re-run…
I'd absolutely love to play with this. one idea I had is to train another model to create bitmaps of sidewalks and roads and add a simulation for pedestrians and cars. day/night cycle would also be so cool!
switch to auto mode and it should still work!
Here's an interesting negative result. After watching this video, my first thought was whether recent results from columnar compression (e.g. https://docs.vortex.dev/references#id1) applied "naively" like QOI would have…
Deepseek is already using SSDs for their KV cache: https://github.com/deepseek-ai/3FS
I really love this space: Navarro's book is an excellent survey. Erik Demaine has a few great lectures on succinct data structures too: L17 and L18 on https://courses.csail.mit.edu/6.851/spring12/lectures/
that's roughly what the wasm component model is aiming for! https://hacks.mozilla.org/2019/11/announcing-the-bytecode-al...
can you specify the algorithm in more detail? this looks to be solving a different problem than A*, which operates over discrete graphs. this looks to be operating in 2D continuous space instead. so, what is the…
this is unbelievably cool. ~27ns overhead for searching for a u32 in a 4GB set in memory is unreal. it's interesting that the wins for batching start diminishing at 8. I'm curious then how the subsequent optimizations…
I love playing with it at UltraHigh quality and 1 solver iterations. It reminds me of gradually incorporating one ingredient into another when cooking: like incorporating flour into eggs when making pasta.
+1. I'd be curious how much of a pessimization to uncontended workloads it'd be to just use `tokio::sync::RwLock`. and, if we want to keep it as a spinlock, I'm curious how much the immediate wakeup compares to using…
looking forward to it! I'd be curious if y'all end up supporting adding filter attributes to the inverted index that can then be pushed down into the posting list traversal. for example, a restaurant search app may have…
very cool stuff! I just read the SPFresh paper a few days ago and was wondering if it's been implemented in industry (e.g. Turbopuffer's implementation of SPANN). I'd be curious how y'all represent the posting lists for…
note that convex is open source! https://github.com/get-convex/convex-backend if you don't want to manage your own infrastructure, you can use our hosted product, but otherwise it's totally fine to self-host the open…
yeah! we were talking to the antithesis folks during this project, but it wasn't far enough along when we started the project in 2016. we were heavily influenced by the original foundationdb testing talk from strange…
former area tech lead for dropbox (and frequent collaborator with isaac) here! happy to answer any questions.
adding to the chorus here - this is great tech. we use it internally at convex for implementing OLTP full text search. other than its runtime characteristics, the codebase is well organized and a great resource for…
we just open sourced the backend last month! https://news.convex.dev/convex-goes-open-source/
hey, sujay (the author) here! happy to answer any questions about the post or convex more generally.
this is a really cool idea. one followup I was thinking of is whether this can generalize to queries other than key value point lookups. if I'm understanding correctly, the article is suggesting to take a key value…
super cool stuff — such deep OS integration is refreshing when we mostly just see cross-platform electron apps these days.
the post calls out replication and durability, and I'd be curious to know more there too. do they replicate within a fly region? S3 replicates to multiple AZs within an AWS region -- is there an equivalent for fly? I'd…
It's a bit old and doesn't include recent microarchitectural changes, but Section 2 of the FlexSC paper from 2010 (https://www.usenix.org/legacy/event/osdi10/tech/full_papers/...) has a detailed discussion of these…
as someone who's followed along (in large production systems) from `eventual` to a large combinator-based `futures`-0.1 system to async/await today, I really enjoyed this post and all its historical context. despite its…
magic pocket's tech lead (disclaimer: my cofounder at convex) has a whole talk on this concept of "durability theater" [1]! the tldr is that those numbers of 9s are just table stakes. no system should ever lose data due…
hi! sujay from convex here. I remember reading about your "reverse query engine" when we were getting started last year and really liking that framing of the broadcast problem here. as james mentions, we entirely re-run…