Hi, I am one of the authors of the post. We tried using LOPQ, but I don't know the exact parameters used. We probably did not put enough effort into it, though. Your approach seems interesting. Maybe we will try…
We do have our own custom word (piece) embeddings that we have trained on <good query, bad query>-pairs. There are a few more details about it in https://0x65.dev/blog/2019-12-06/building-a-search-engine-fr....
Just a couple of things: - We are actually using a weighted average. - This is just one of the techniques used for recall. The aim at this point is to be super fast and scalable, and not super accurate. Once we reach…
Hi, I am one of the authors of this post. As you mention, it is a trade-off. In this case we are trying to balance CPU and memory usage. First of all, if you just use the original vectors (or the quantized ones…
Hi, I am one of the authors of this post. The number 4 billion is made-up. It was chosen in order to illustrate the scale of the problem we are trying to solve. And it also happens to be just below the maximum number…
Hi, I am one of the authors of the post. We tried using LOPQ, but I don't know the exact parameters used. We probably did not put enough effort into it, though. Your approach seems interesting. Maybe we will try…
We do have our own custom word (piece) embeddings that we have trained on <good query, bad query>-pairs. There are a few more details about it in https://0x65.dev/blog/2019-12-06/building-a-search-engine-fr....
Just a couple of things: - We are actually using a weighted average. - This is just one of the techniques used for recall. The aim at this point is to be super fast and scalable, and not super accurate. Once we reach…
Hi, I am one of the authors of this post. As you mention, it is a trade-off. In this case we are trying to balance CPU and memory usage. First of all, if you just use the original vectors (or the quantized ones…
Hi, I am one of the authors of this post. The number 4 billion is made-up. It was chosen in order to illustrate the scale of the problem we are trying to solve. And it also happens to be just below the maximum number…