What a strangely hostile statement on an open weight model. Running like 20 benchmark evaluations isn't trivial by itself, and even updating visuals and press statements can take a few days at a tech company. It's…
It is absolutely awful at writing and general knowledge. IMO coding is its greatest strength by far.
How up to date are you on current open weights models? After playing around with it for a few hours I find it to be nowhere near as good as Qwen3-30B-A3B. The world knowledge is severely lacking in particular.
This is a little misleading. The data they quote is based on their previous article[1], which just uses this analysis[2] provided by a VC company. Funnily enough the same VC company put a seperate clickbaitish article…
The corporate politics at Meta is the result of Zuck's own decisions. Even in big tech, Meta is (along with Amazon) rather famous for its highly political and backstabby culture. This is because these two companies have…
The US has crashed its own stock market, tanked its own government's approval ratings, and had its own business leaders speak out against the government. This definitely does not increase leverage.
The paragraph immediately after that paragraph explains that the study was based off faulty analysis (and links to the below article). https://www.vox.com/future-perfect/2019/6/4/18650969/married...
I'm very skeptical on this, the paper they linked is not convincing. It says that GPT-4 is correct at predicting the experiment outcome direction 69% of the time versus 66% of the time for human forecasters. But this is…
They definitely would and do, the vast majority of time series work is not about asset prices or beating the stock market
I think what you say is true when comparing transformers to CNNs/RNNs, but not to MLPs. Transformers, RNNs, and CNNs are all techniques to reduce parameter count compared to a pure-MLP model. If you took a transformer…
From experience in payments/spending forecasting, I've found that deep learning generally underperform gradient-boosted tree models. Deep learning models tend to be good at learning seasonality but do not handle complex…
I get what this piece is trying to say, but it's ignoring the fact that schools are trying to maximize learning with pupils who often don't want or care about learning (unlike with athletes or musicians who are…
I'm not sure what would lead to you believe this. I've worked in the data science/ML space for over a decade now and I see the majority of pure analytics projects started in R, including at big tech companies I've…
The knowledge distillation is very interesting but generating trillions of outputs from a large teacher model seems insanely expensive. Is this really more cost efficient than just using that compute instead for…
Langchain feels very much like shovelware that was created for the sole purpose of parting VCs of their money. At one point the codebase had a "prompt template" class that literally just called Python's f-string.
I'm skeptical of that. Most western Europe countries have similarly low birth rates to Japan despite having some of the lowest working hours in the world.
Assuming you already know some basic linear algebra and calculus, know Python (or R), and have a decent-but-not-advanced grasp of statistics, I'd recommend working through these books. They are very readable and focus…
We tried using a multi-agent system for a complex NLP-type task and we found: - Too many errors that just propogate on top of each other, if a single agent in the chain generates something even a little bit off then the…
Their benchmark results seem roughly on par with Mistral 7B and Llama 3 8B, which hardly seems that great given the increase in model size. https://huggingface.co/tiiuae/falcon-11B…
Legality aside, I think the "payment" people get from posting free knowledge on the Internet is the human connection, and the satisfaction of knowing that other people are reading and appreciating it directly. Injecting…
Seems sort of misleading marketing as it seems to imply 1% of GDP = 1% of transactions. By that metric there's probably 5-10 companies who each process 5%+ of world GDP - e.g. https://en.wikipedia.org/wiki/FIS_(company)
I don't think either of those theories is right. (1) doesn't explain the rise in corporate profits, and (2) is of course silly. Here is my theory: Consumers generally have an "acceptable" price range in their head for…
This isn't apples to apples - they're taking the optimal prompting technique for their own model, then using that technique for both models. They should be comparing it against the optimal prompting technique for GPT-4.
There's a bunch of research on how optimism bias (which I imagine is very closely linked to overconfidence) can be evolutionarily driven, e.g. https://www.sciencedirect.com/science/article/pii/S096098221...
I don't think the target market for this is people looking for extremely knowledgeable LLMs that can handle deep technical tasks, given that you can't even finetune these models. I'd guess this is more of an attempt to…
What a strangely hostile statement on an open weight model. Running like 20 benchmark evaluations isn't trivial by itself, and even updating visuals and press statements can take a few days at a tech company. It's…
It is absolutely awful at writing and general knowledge. IMO coding is its greatest strength by far.
How up to date are you on current open weights models? After playing around with it for a few hours I find it to be nowhere near as good as Qwen3-30B-A3B. The world knowledge is severely lacking in particular.
This is a little misleading. The data they quote is based on their previous article[1], which just uses this analysis[2] provided by a VC company. Funnily enough the same VC company put a seperate clickbaitish article…
The corporate politics at Meta is the result of Zuck's own decisions. Even in big tech, Meta is (along with Amazon) rather famous for its highly political and backstabby culture. This is because these two companies have…
The US has crashed its own stock market, tanked its own government's approval ratings, and had its own business leaders speak out against the government. This definitely does not increase leverage.
The paragraph immediately after that paragraph explains that the study was based off faulty analysis (and links to the below article). https://www.vox.com/future-perfect/2019/6/4/18650969/married...
I'm very skeptical on this, the paper they linked is not convincing. It says that GPT-4 is correct at predicting the experiment outcome direction 69% of the time versus 66% of the time for human forecasters. But this is…
They definitely would and do, the vast majority of time series work is not about asset prices or beating the stock market
I think what you say is true when comparing transformers to CNNs/RNNs, but not to MLPs. Transformers, RNNs, and CNNs are all techniques to reduce parameter count compared to a pure-MLP model. If you took a transformer…
From experience in payments/spending forecasting, I've found that deep learning generally underperform gradient-boosted tree models. Deep learning models tend to be good at learning seasonality but do not handle complex…
I get what this piece is trying to say, but it's ignoring the fact that schools are trying to maximize learning with pupils who often don't want or care about learning (unlike with athletes or musicians who are…
I'm not sure what would lead to you believe this. I've worked in the data science/ML space for over a decade now and I see the majority of pure analytics projects started in R, including at big tech companies I've…
The knowledge distillation is very interesting but generating trillions of outputs from a large teacher model seems insanely expensive. Is this really more cost efficient than just using that compute instead for…
Langchain feels very much like shovelware that was created for the sole purpose of parting VCs of their money. At one point the codebase had a "prompt template" class that literally just called Python's f-string.
I'm skeptical of that. Most western Europe countries have similarly low birth rates to Japan despite having some of the lowest working hours in the world.
Assuming you already know some basic linear algebra and calculus, know Python (or R), and have a decent-but-not-advanced grasp of statistics, I'd recommend working through these books. They are very readable and focus…
We tried using a multi-agent system for a complex NLP-type task and we found: - Too many errors that just propogate on top of each other, if a single agent in the chain generates something even a little bit off then the…
Their benchmark results seem roughly on par with Mistral 7B and Llama 3 8B, which hardly seems that great given the increase in model size. https://huggingface.co/tiiuae/falcon-11B…
Legality aside, I think the "payment" people get from posting free knowledge on the Internet is the human connection, and the satisfaction of knowing that other people are reading and appreciating it directly. Injecting…
Seems sort of misleading marketing as it seems to imply 1% of GDP = 1% of transactions. By that metric there's probably 5-10 companies who each process 5%+ of world GDP - e.g. https://en.wikipedia.org/wiki/FIS_(company)
I don't think either of those theories is right. (1) doesn't explain the rise in corporate profits, and (2) is of course silly. Here is my theory: Consumers generally have an "acceptable" price range in their head for…
This isn't apples to apples - they're taking the optimal prompting technique for their own model, then using that technique for both models. They should be comparing it against the optimal prompting technique for GPT-4.
There's a bunch of research on how optimism bias (which I imagine is very closely linked to overconfidence) can be evolutionarily driven, e.g. https://www.sciencedirect.com/science/article/pii/S096098221...
I don't think the target market for this is people looking for extremely knowledgeable LLMs that can handle deep technical tasks, given that you can't even finetune these models. I'd guess this is more of an attempt to…