Cost and intelligence aren't the only axes. Terra has better latency and output speed than Sol for example.
I’ve been building this out too, and your comment made me realize the missing piece for me. I’ve given the agents tools to validate its own work, but I haven’t improved the experience of humans verifying the agents’…
I played again and found issues. After level 40ish, basically nothing can hurt you. You heal too fast. And once I got past level 80ish, I was running so fast, I ran through walls. And the saddest part, I got to level…
This was more fun than I was expecting. Nice way to waste 20 min!
At a minimum, you increase top-k to cast a wider net, then after reranking, take the N you really want. You have to play around with it a bit, but that’s the idea.
I’m very surprised this isn’t getting more attention. Am I missing something? It seems at or above SOTA on the given benchmarks, doesn’t have context rot, is orders of magnitude faster, and uses less compute that…
Just fyi, for RAG/similarity search, adding a reranker was much bigger pay off than switching embedding models.
I built one of the top 3 results on Google when you search “compound interest calculator” and a dozen other similarly popular calculator pages. The value isn’t the interface, it’s the trust that its calculations are…
Being flexible is important, but the latest research shows that heavy lifting improves flexibility about as much as a dedicated stretching program: https://pmc.ncbi.nlm.nih.gov/articles/PMC9935664/
That’s a new fire as of a couple hours ago - Sunset Fire. There are 5 going on in LA at the moment.
Less than 10% of my projects ever made anything. Check out indiehackers.com - tons of old posts of people starting things, but the domain is dead when you click through.
I’ve worked in e-commerce for years and the thing that always slows down the sites the most is 3rd party scripts. Are you addressing this? I couldn’t find anything in the repo. Ive had websites slow down 10x just by…
Fyi regarding cover images: I have built and run a handful of book related websites and Amazon is the easiest place I found to get book covers. You just need the Amazon id and every image is a standard url.
This resonates a lot. For years, I would dive in for a week or two, sometimes I would make it to a few months. Lately, I've just been telling myself no, to keep focus on my start up, but it sometimes feels like I'm…
I've recently come to believe the differences in hypertrophy are negligible between eccentric and concentric focused movements, but can't find any recent, compelling research that says so. There was a 2017 meta analysis…
This is RAG. They are retrieving specific info to augment the generation
I'm trying to understand this approach. Maybe I am expecting too much out of this basic approach, but how does this create a similarity between words with indices close to each other? Wouldn't it just be a popularity…
Came here to say this exact thing. I have the exact modem/router mentioned in the article - my reliability, speed, and coverage all improved when I switched to my own $100 router.
I looked into this to see where it was getting new information, and as far as I can tell, it is searching wikipedia exclusively. Useful for sure, but not exactly what I was expecting based on the title.
I’ve never really thought about this before, but it is obvious in hindsight. When I finally made enough money to move into a newer apartment, the noise from neighbors and outside was almost nonexistent. It was a stark…
While I haven't read 3BP yet, you might be interested in the Zones of Thought series by Vernor Vinge. Extremely grand and unique universe, some politics, diverse cast, lots of interesting tech. I use it as a benchmark…
I'm surprised this isn't getting more love. I love the concept of finetuned, hyper-specific, tiny LLMs. Of course, the data is the most important part.
Based on #2, it seems like they only use the LLM when the page changes. I had a prototype of this sort of system working and it was surprisingly fault tolerant.
You raise a good point - AI + human review might end up being more time than just a human doing everything. I can see a certain subset of issues could be simple enough to done by AI and a quick review - like changing a…
What percent does an average junior engineer solve? If it is even close, these models can be run all day and night for cheaper than one yearly SWE salary.
Cost and intelligence aren't the only axes. Terra has better latency and output speed than Sol for example.
I’ve been building this out too, and your comment made me realize the missing piece for me. I’ve given the agents tools to validate its own work, but I haven’t improved the experience of humans verifying the agents’…
I played again and found issues. After level 40ish, basically nothing can hurt you. You heal too fast. And once I got past level 80ish, I was running so fast, I ran through walls. And the saddest part, I got to level…
This was more fun than I was expecting. Nice way to waste 20 min!
At a minimum, you increase top-k to cast a wider net, then after reranking, take the N you really want. You have to play around with it a bit, but that’s the idea.
I’m very surprised this isn’t getting more attention. Am I missing something? It seems at or above SOTA on the given benchmarks, doesn’t have context rot, is orders of magnitude faster, and uses less compute that…
Just fyi, for RAG/similarity search, adding a reranker was much bigger pay off than switching embedding models.
I built one of the top 3 results on Google when you search “compound interest calculator” and a dozen other similarly popular calculator pages. The value isn’t the interface, it’s the trust that its calculations are…
Being flexible is important, but the latest research shows that heavy lifting improves flexibility about as much as a dedicated stretching program: https://pmc.ncbi.nlm.nih.gov/articles/PMC9935664/
That’s a new fire as of a couple hours ago - Sunset Fire. There are 5 going on in LA at the moment.
Less than 10% of my projects ever made anything. Check out indiehackers.com - tons of old posts of people starting things, but the domain is dead when you click through.
I’ve worked in e-commerce for years and the thing that always slows down the sites the most is 3rd party scripts. Are you addressing this? I couldn’t find anything in the repo. Ive had websites slow down 10x just by…
Fyi regarding cover images: I have built and run a handful of book related websites and Amazon is the easiest place I found to get book covers. You just need the Amazon id and every image is a standard url.
This resonates a lot. For years, I would dive in for a week or two, sometimes I would make it to a few months. Lately, I've just been telling myself no, to keep focus on my start up, but it sometimes feels like I'm…
I've recently come to believe the differences in hypertrophy are negligible between eccentric and concentric focused movements, but can't find any recent, compelling research that says so. There was a 2017 meta analysis…
This is RAG. They are retrieving specific info to augment the generation
I'm trying to understand this approach. Maybe I am expecting too much out of this basic approach, but how does this create a similarity between words with indices close to each other? Wouldn't it just be a popularity…
Came here to say this exact thing. I have the exact modem/router mentioned in the article - my reliability, speed, and coverage all improved when I switched to my own $100 router.
I looked into this to see where it was getting new information, and as far as I can tell, it is searching wikipedia exclusively. Useful for sure, but not exactly what I was expecting based on the title.
I’ve never really thought about this before, but it is obvious in hindsight. When I finally made enough money to move into a newer apartment, the noise from neighbors and outside was almost nonexistent. It was a stark…
While I haven't read 3BP yet, you might be interested in the Zones of Thought series by Vernor Vinge. Extremely grand and unique universe, some politics, diverse cast, lots of interesting tech. I use it as a benchmark…
I'm surprised this isn't getting more love. I love the concept of finetuned, hyper-specific, tiny LLMs. Of course, the data is the most important part.
Based on #2, it seems like they only use the LLM when the page changes. I had a prototype of this sort of system working and it was surprisingly fault tolerant.
You raise a good point - AI + human review might end up being more time than just a human doing everything. I can see a certain subset of issues could be simple enough to done by AI and a quick review - like changing a…
What percent does an average junior engineer solve? If it is even close, these models can be run all day and night for cheaper than one yearly SWE salary.