Take a look at The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text (https://arxiv.org/pdf/2506.05209). They build a reasonable 7B parameter model using only open-licensed data.
Fruition is my entry recommendation. Every bar they make is good. Then Castronova, Goodnow Farms, Askinosie, Soma, and Dick Taylor. A good heuristic for evaluating a new brand is if the package tells you where the beans…
> Here’s what we’ve found out: It’s not about the cocoa-beans, but about the way they are treated during the manufacturing process. I eat a lot of high end single origin chocolate bars, and I simply don’t believe this.…
We've collectively failed at this problem as a society. We've 1. made it extremely difficult, even illegal, to build more denser housing. 2. devalued the status of electricians, plumbers, and carpenters leading to a…
By having nearly no volume to begin with. Many US stocks are listed across many of the ~13 US exchanges, so what you're describing is already the status quo. According to RegNMS regulations, traders cannot trade through…
The point of that comment doesn't have anything to do with how ResNets actually work. You missed the actual point. > We don’t actually know why resnets work so well. Yes actually we do. We know, from the literature,…
Yes, I have a very good point in fact. But the above comment purposely chooses not to argue with it, because it's easier to ignore it entirely and argue something else.
Empirically yes, I can consider a very deep fully-connected network, measure the gradients in each layer with and without skip connections, and compare. I can do this across multiple seeds and run a statistical test on…
No, there are many very mathematically inclined deep learning researchers. It's an empirical science because the mathematical tools we possess are not sufficient to describe the phenomena we observe and make predictions…
Just read the section on ResNets (Section 1.5) and tell me if you think that's the best way to explain ResNets to literally anyone. Tell me if, from that description, you take away that the reason skip connections…
I've seen quite a few of these books attempting to explain deep learning from a mathematical perspective and it always surprises me. Deep learning is clearly an empirical science for the time being, and very little…
Looks like you left the submissions instructions for AISTATS on the last page of the PDF. Don't know if that was intentional but I'm guessing it wasn't.
> however, it was not truly "independent", Of course I don't mean to imply they operate in a vacuum. They can obviously see competitors raising their prices. I just mean to say they don't get into a room and actively…
There's a theory, price-over-volume, that the sudden shift in demand and expectation of inflation gave companies room to explore a different point on the revenue curve, where they increase the price and simply sell less…
Transformers have disadvantages too, and so LSTMs are still used in industry. But also it's not that hard to learn a couple new things every year.
Quite a lot of techniques in deep learning have stood the test of time at this point. Also new techniques are developed either depending on or trying to solved deficiencies in old techniques. For example Transformers…
Because he's the former president of YC. One of the powerful people you'd be pissing of by doing this is Sam Altman.
You'd be getting on the bad side of some of the most powerful people in tech and taking the helm of a company full of people who don't want you running it. It's not a surprise a lot of people don't want the role.
I think it's pretty clear by this point that the board consists of several people who are woefully ignorant about the way the world actually works.
These simply can't be the real reasons.
In computational geometry, Raimund Seidel wrote a paper that proves an upper bound theorem for polytopes in two sentences in the abstract. The rest of the paper just comments on the result.…
Take a look at The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text (https://arxiv.org/pdf/2506.05209). They build a reasonable 7B parameter model using only open-licensed data.
Fruition is my entry recommendation. Every bar they make is good. Then Castronova, Goodnow Farms, Askinosie, Soma, and Dick Taylor. A good heuristic for evaluating a new brand is if the package tells you where the beans…
> Here’s what we’ve found out: It’s not about the cocoa-beans, but about the way they are treated during the manufacturing process. I eat a lot of high end single origin chocolate bars, and I simply don’t believe this.…
We've collectively failed at this problem as a society. We've 1. made it extremely difficult, even illegal, to build more denser housing. 2. devalued the status of electricians, plumbers, and carpenters leading to a…
By having nearly no volume to begin with. Many US stocks are listed across many of the ~13 US exchanges, so what you're describing is already the status quo. According to RegNMS regulations, traders cannot trade through…
The point of that comment doesn't have anything to do with how ResNets actually work. You missed the actual point. > We don’t actually know why resnets work so well. Yes actually we do. We know, from the literature,…
Yes, I have a very good point in fact. But the above comment purposely chooses not to argue with it, because it's easier to ignore it entirely and argue something else.
Empirically yes, I can consider a very deep fully-connected network, measure the gradients in each layer with and without skip connections, and compare. I can do this across multiple seeds and run a statistical test on…
No, there are many very mathematically inclined deep learning researchers. It's an empirical science because the mathematical tools we possess are not sufficient to describe the phenomena we observe and make predictions…
Just read the section on ResNets (Section 1.5) and tell me if you think that's the best way to explain ResNets to literally anyone. Tell me if, from that description, you take away that the reason skip connections…
I've seen quite a few of these books attempting to explain deep learning from a mathematical perspective and it always surprises me. Deep learning is clearly an empirical science for the time being, and very little…
Looks like you left the submissions instructions for AISTATS on the last page of the PDF. Don't know if that was intentional but I'm guessing it wasn't.
> however, it was not truly "independent", Of course I don't mean to imply they operate in a vacuum. They can obviously see competitors raising their prices. I just mean to say they don't get into a room and actively…
There's a theory, price-over-volume, that the sudden shift in demand and expectation of inflation gave companies room to explore a different point on the revenue curve, where they increase the price and simply sell less…
Transformers have disadvantages too, and so LSTMs are still used in industry. But also it's not that hard to learn a couple new things every year.
Quite a lot of techniques in deep learning have stood the test of time at this point. Also new techniques are developed either depending on or trying to solved deficiencies in old techniques. For example Transformers…
Because he's the former president of YC. One of the powerful people you'd be pissing of by doing this is Sam Altman.
You'd be getting on the bad side of some of the most powerful people in tech and taking the helm of a company full of people who don't want you running it. It's not a surprise a lot of people don't want the role.
I think it's pretty clear by this point that the board consists of several people who are woefully ignorant about the way the world actually works.
These simply can't be the real reasons.
In computational geometry, Raimund Seidel wrote a paper that proves an upper bound theorem for polytopes in two sentences in the abstract. The rest of the paper just comments on the result.…