The research in this space is very conflicting about what methods actually work. In the graph on the page, the ETS model (basically just a weighted moving average) outperforms multiple, recent deep learning models. But…
I've worked in many research scientist/MLE roles over the years and I haven't met any IC who has this much of a fixation on AI being a moral evil/good. The ones who do are inevitably nontechnical hucksters, usually just…
I might be miunderstanding something here, but what complexity here is resolved by making this a framework? Isnt this just: 1. Train model like normal 2. Evaluate model using self 3. Use eval results for DPO finetune
IMO if you're going to profit off open research, you should at least make your own work available for other researchers. The white paper has 10 pages of performance benchmarks but 5 sentences on methodology.
Exactly one state has! https://en.wikipedia.org/wiki/Bank_of_North_Dakota It's state-owned but functions as a typical retail bank that takes deposits, makes mortgages, business loans, etc.
Dplyr actually supports some really cool join functionalities that I wish were in SQL implementations, including: - Ability to specify whether your join should be one-to-one, many-to-one, etc. So that R will throw an…
I know many people who've gotten big raises over the last 2-3 years, including individuals who have more than doubled their pay. And they always attribute their raises to hard work, job hopping, or climbing the…
Every tech company minus the few doing core research have been doing this for at least half a year. Generate training data with GPT4 or sometimes even 3.5 -> use it to do a QLoRA finetune on a llama or mistral base ->…
I've noticed a huge surge in negativity and pessimism on English-language social media within the last year or so, roughly corresponding with to the spread of LLM tech. I do wonder whether these people are mostly just…
I dont think the first part of this article is quite right. 1. I doubt many people would think of 9/11 as a "1 in 50 years" event if it didn't actually happen. If you had a year-by-country level dataset of every…
In my experience, you can get extremely good performance in this style of sports prediction with extremely basic methods. E.g. doing some sort of basic Elo rating system + choosing the higher rated competitor to win…
Honestly shocking that they would lay off a guy whose had this much of an influence on data science tooling generally. Every company I've worked at has had a sizable proportion of the analytics team using knitr+rmd. I…
I must be missing something here. I used to work on a voice assistant product and everything demoed is pretty bog standard stuff: play music, shop, order food, get Uber rides, ask random queries, recognize images. This…
A few months ago I tried migrating a large pandas codebase to polars. I'm not much of a fan of doing analytics/data pipelining in Python - a complex transformation takes me 2-5x as long in pandas compared to Julia or R…
I think companies in this "data analytics platform but with LLM integration" space are going to struggle in the next few years. The pain points of analytics are completely different than traditional software…
Many of the recent articles in the media about productivity are inaccurate, there is a big difference between plain English "productivity" and the economic concept of productivity. The quoted productivity #s are…
This is a really interesting perspective, and made me consider what pushed me to inflate my own prices (my salary) especially aggressively the last few years. In 2020-2022 my input costs (housing, food) went up ~20%, so…
The research in this space is very conflicting about what methods actually work. In the graph on the page, the ETS model (basically just a weighted moving average) outperforms multiple, recent deep learning models. But…
I've worked in many research scientist/MLE roles over the years and I haven't met any IC who has this much of a fixation on AI being a moral evil/good. The ones who do are inevitably nontechnical hucksters, usually just…
I might be miunderstanding something here, but what complexity here is resolved by making this a framework? Isnt this just: 1. Train model like normal 2. Evaluate model using self 3. Use eval results for DPO finetune
IMO if you're going to profit off open research, you should at least make your own work available for other researchers. The white paper has 10 pages of performance benchmarks but 5 sentences on methodology.
Exactly one state has! https://en.wikipedia.org/wiki/Bank_of_North_Dakota It's state-owned but functions as a typical retail bank that takes deposits, makes mortgages, business loans, etc.
Dplyr actually supports some really cool join functionalities that I wish were in SQL implementations, including: - Ability to specify whether your join should be one-to-one, many-to-one, etc. So that R will throw an…
I know many people who've gotten big raises over the last 2-3 years, including individuals who have more than doubled their pay. And they always attribute their raises to hard work, job hopping, or climbing the…
Every tech company minus the few doing core research have been doing this for at least half a year. Generate training data with GPT4 or sometimes even 3.5 -> use it to do a QLoRA finetune on a llama or mistral base ->…
I've noticed a huge surge in negativity and pessimism on English-language social media within the last year or so, roughly corresponding with to the spread of LLM tech. I do wonder whether these people are mostly just…
I dont think the first part of this article is quite right. 1. I doubt many people would think of 9/11 as a "1 in 50 years" event if it didn't actually happen. If you had a year-by-country level dataset of every…
In my experience, you can get extremely good performance in this style of sports prediction with extremely basic methods. E.g. doing some sort of basic Elo rating system + choosing the higher rated competitor to win…
Honestly shocking that they would lay off a guy whose had this much of an influence on data science tooling generally. Every company I've worked at has had a sizable proportion of the analytics team using knitr+rmd. I…
I must be missing something here. I used to work on a voice assistant product and everything demoed is pretty bog standard stuff: play music, shop, order food, get Uber rides, ask random queries, recognize images. This…
A few months ago I tried migrating a large pandas codebase to polars. I'm not much of a fan of doing analytics/data pipelining in Python - a complex transformation takes me 2-5x as long in pandas compared to Julia or R…
I think companies in this "data analytics platform but with LLM integration" space are going to struggle in the next few years. The pain points of analytics are completely different than traditional software…
Many of the recent articles in the media about productivity are inaccurate, there is a big difference between plain English "productivity" and the economic concept of productivity. The quoted productivity #s are…
This is a really interesting perspective, and made me consider what pushed me to inflate my own prices (my salary) especially aggressively the last few years. In 2020-2022 my input costs (housing, food) went up ~20%, so…