The spirit of this is correct, but a better approach to this is going for a walk with just your thoughts. Yes, that means no phone, no headphones, just you and your brain enjoying a walk. Let your mind wonder and be…
The underlying C library interacts directly with the postgres query parser (therefore, Postgres source). So unless you rewrite postgres in Rust, you wouldn't be able to do that.
https://grugbrain.dev/ grug very elated find big brain developer Bob Nystrom redeem the big brain tribe and write excellent book on recursive descent: Crafting Interpreters book available online free, but grug highly…
https://duckdb.org/docs/stable/core_extensions/vss It's not bad if you need something quick. I haven't had a large need of ANN in duckdb since it's doing more analytical/exploratory needs, but it's definitely there if…
Just curious what the state of the art around filtered vector search results is? I took a quick look at the SPFresh paper and didn't see it specifically address filtering.
In any API service, it's better to handle via dependency injection IMO. Instantiate all of your metadata once, and then send that logger down, so that anybody who uses that logger is guaranteed to have the right…
Might be missing my argument here - I stated that there are workable solutions to this like you have pointed out. But ANN search is still a sledgehammer and building out hybrid solutions that help bridge the gap between…
Sure they can handle the basic case of ANN. But ANN still doesn’t have good stories for lots of real-world problems. * filterable ANN, decomposes into prefiltering or postfiltering. * dynamic updates and versioning is…
I don't disagree that rock solid is a good choice, but there is a ton of innovation necessary for data stores. Especially in the context of embedding search, which this article is also trying to do. We need database…
The README is 100% just autogenerated by Claude. It looks like every README generated from these tools. Can’t speak for the code since I haven’t peaked into it
While not strictly for RDBMS, I think this book is pretty close! https://www.databass.dev/
Just wanted to say thank you for this article - I've read and shared this a few times over the years!
When Breath Becomes Air by Paul Kalanthi. A fascinating memoir by a philosopher turned brain surgeon, facing a terminal cancer diagnosis. A person who spent their entire life pondering the morality of life being faced…
My system’s programming teacher spent an entire week of a 12 week semester (3 classes) going over how to use gdb/vim for one of our projects. Still my favorite class and professor from my time at school.
Can anybody speak to how Vespa compares to some other Vector Database solutions? Seems like there's so many options today
Could also make a guess that the blackout has changed how their normal traffic patterns operate, causing some issues with autoscaling/hot partitions.
I like this viewpoint when you are a small company searching for PMF and your entire backend can fit into a small DB. At one point you'll have to reckon with IO costs and storage once that is over and then you have no…
As somebody that has done both contracting and worked in tech, I hope this comment makes sense. Most homeowners (product managers) want the cheapest (fastest) thing that fixes (delivers) a working home (feature) to…
I trust you have the numbers for this. And we can debate them until the world ends, but I think having a mental fallback that “yeah, some people suck” is valuable for your mental well being. Life’s too short to let the…
> I find it more efficient to work in topic-scoped batches, so I can load context on a protocol and codebase once and use it to land multiple changes. This is my favorite way of writing software as well. My current gig…
Lays off 20% of employees and the stock jumps 9% immediately. Really drives home a good message to all CEO's out there /s
It would always be nonsensical unless you were running on the database you were targeting (or one that contained similar data distributions). However, with Postgres its pretty trivial to get a JSON format of the output…
The feature requests (asks) that product wants to build - sorry for the confusion there.
No disagreement here. I love a good monolith.
Yep, there's a premium on making your architecture more cloudy. However, the best point for Use One Big Server is not necessarily running your big monolithic API server, but your database. Use One Big Database.…
The spirit of this is correct, but a better approach to this is going for a walk with just your thoughts. Yes, that means no phone, no headphones, just you and your brain enjoying a walk. Let your mind wonder and be…
The underlying C library interacts directly with the postgres query parser (therefore, Postgres source). So unless you rewrite postgres in Rust, you wouldn't be able to do that.
https://grugbrain.dev/ grug very elated find big brain developer Bob Nystrom redeem the big brain tribe and write excellent book on recursive descent: Crafting Interpreters book available online free, but grug highly…
https://duckdb.org/docs/stable/core_extensions/vss It's not bad if you need something quick. I haven't had a large need of ANN in duckdb since it's doing more analytical/exploratory needs, but it's definitely there if…
Just curious what the state of the art around filtered vector search results is? I took a quick look at the SPFresh paper and didn't see it specifically address filtering.
In any API service, it's better to handle via dependency injection IMO. Instantiate all of your metadata once, and then send that logger down, so that anybody who uses that logger is guaranteed to have the right…
Might be missing my argument here - I stated that there are workable solutions to this like you have pointed out. But ANN search is still a sledgehammer and building out hybrid solutions that help bridge the gap between…
Sure they can handle the basic case of ANN. But ANN still doesn’t have good stories for lots of real-world problems. * filterable ANN, decomposes into prefiltering or postfiltering. * dynamic updates and versioning is…
I don't disagree that rock solid is a good choice, but there is a ton of innovation necessary for data stores. Especially in the context of embedding search, which this article is also trying to do. We need database…
The README is 100% just autogenerated by Claude. It looks like every README generated from these tools. Can’t speak for the code since I haven’t peaked into it
While not strictly for RDBMS, I think this book is pretty close! https://www.databass.dev/
Just wanted to say thank you for this article - I've read and shared this a few times over the years!
When Breath Becomes Air by Paul Kalanthi. A fascinating memoir by a philosopher turned brain surgeon, facing a terminal cancer diagnosis. A person who spent their entire life pondering the morality of life being faced…
My system’s programming teacher spent an entire week of a 12 week semester (3 classes) going over how to use gdb/vim for one of our projects. Still my favorite class and professor from my time at school.
Can anybody speak to how Vespa compares to some other Vector Database solutions? Seems like there's so many options today
Could also make a guess that the blackout has changed how their normal traffic patterns operate, causing some issues with autoscaling/hot partitions.
I like this viewpoint when you are a small company searching for PMF and your entire backend can fit into a small DB. At one point you'll have to reckon with IO costs and storage once that is over and then you have no…
As somebody that has done both contracting and worked in tech, I hope this comment makes sense. Most homeowners (product managers) want the cheapest (fastest) thing that fixes (delivers) a working home (feature) to…
I trust you have the numbers for this. And we can debate them until the world ends, but I think having a mental fallback that “yeah, some people suck” is valuable for your mental well being. Life’s too short to let the…
> I find it more efficient to work in topic-scoped batches, so I can load context on a protocol and codebase once and use it to land multiple changes. This is my favorite way of writing software as well. My current gig…
Lays off 20% of employees and the stock jumps 9% immediately. Really drives home a good message to all CEO's out there /s
It would always be nonsensical unless you were running on the database you were targeting (or one that contained similar data distributions). However, with Postgres its pretty trivial to get a JSON format of the output…
The feature requests (asks) that product wants to build - sorry for the confusion there.
No disagreement here. I love a good monolith.
Yep, there's a premium on making your architecture more cloudy. However, the best point for Use One Big Server is not necessarily running your big monolithic API server, but your database. Use One Big Database.…