Interesting point. Nvidia have been improving the int performance for quantized inference on their GPUs a lot. It might be a lot of work but could it be possible to scale up this NNUE approach to the point where it…
The published hyperparameters are usually ridiculously conservative, for the simple games like breakout and pong you can usually converge in far fewer frames than in the papers.
> We're getting a bit off-topic here, but the #1 target by far in reducing greenhouse emissions is power generation. I readily admit I don't know any of the numbers associated with carbon production and my comment was…
Yes it's something I often see ignored as "common knowledge" dictates that in ML inference is way cheaper than training. But if you're running a model in production at google with loads of google searches hitting it…
The Strubell paper which is the origin of this "5 cars" number isn't even in the right ballpark for this stuff. What they did was take desktop GPU power consumption running the model in fp32, extrapolate to a 240x GPU…
Yann is a consistently sober voice in this world of AI hype. I find it quite refreshing. Personally I see little evidence that this "just scale a transformer until sentience" hype-train is going to take us anywhere…
I would start with David Silvers (DeepMind) youtube series to get an idea of what's possible or not. Running an already trained reinforcement learning agent is relatively cheap (unless your model is massive). I suspect…
Vectorization: I'm not an expert in this area so I can only tell you what I've personally found difficult in dealing with vectorization. Usually it all comes down to alignment and vector lanes. To utilize the vector…
Since you are right that I have no idea what you are talking about, could you explain what you are talking about?
I find it very surprising that someone would rely on unvalidated mathematical models for this, that goes for the Imperial College people as well as Sweden. Are they even able to fit the parameters in retrospect? Anyone…
Interesting point. Nvidia have been improving the int performance for quantized inference on their GPUs a lot. It might be a lot of work but could it be possible to scale up this NNUE approach to the point where it…
The published hyperparameters are usually ridiculously conservative, for the simple games like breakout and pong you can usually converge in far fewer frames than in the papers.
> We're getting a bit off-topic here, but the #1 target by far in reducing greenhouse emissions is power generation. I readily admit I don't know any of the numbers associated with carbon production and my comment was…
Yes it's something I often see ignored as "common knowledge" dictates that in ML inference is way cheaper than training. But if you're running a model in production at google with loads of google searches hitting it…
The Strubell paper which is the origin of this "5 cars" number isn't even in the right ballpark for this stuff. What they did was take desktop GPU power consumption running the model in fp32, extrapolate to a 240x GPU…
Yann is a consistently sober voice in this world of AI hype. I find it quite refreshing. Personally I see little evidence that this "just scale a transformer until sentience" hype-train is going to take us anywhere…
I would start with David Silvers (DeepMind) youtube series to get an idea of what's possible or not. Running an already trained reinforcement learning agent is relatively cheap (unless your model is massive). I suspect…
Vectorization: I'm not an expert in this area so I can only tell you what I've personally found difficult in dealing with vectorization. Usually it all comes down to alignment and vector lanes. To utilize the vector…
Since you are right that I have no idea what you are talking about, could you explain what you are talking about?
I find it very surprising that someone would rely on unvalidated mathematical models for this, that goes for the Imperial College people as well as Sweden. Are they even able to fit the parameters in retrospect? Anyone…