That's interesting. My brain does the same in terms of attempting to simulate that model of the people, but when it becomes impossible to run the algorithm (too large of a group), instead of just giving up, my brain…
Very excellent point. One simple possibility I could imagine to mitigate this would be having an additional device/button one had to physically press in order for the thoughts to be vocalized. I think that would be an…
From the study: "It should be remarked that, in the majority of the cases, people adopting plant-based diets are more prone to engage in healthy lifestyles that include regular physical activity, reduction/avoidance of…
You are correct, that is an error in an otherwise great video. The k+1 token is not merely a function of the kth vector, but rather all prior vectors (combined using attention). There is nothing "special" about the kth…
I suspect in the near future there will be a number of cases where individuals will intentionally release a bunch of AI "chaff", in the sense that having a very large number of bad videos/texts about them, of which many…
I love Nomnoml. I have lately been using it to visualize hierarchical tag structures in a browser-based PKM project I am working on. I find it creates fairly clean layouts. Example: https://imgbox.com/9A1mDyNv
Why would RWKV have a particular advantage in this context? (I may be missing some key intuitions)
You have been shamelessly self-promoting your Hopf algebra/deep learning research on a very large percentage of posts I have seen on HN lately, to the degree that I actually felt the need to log in so as to be able to…
Easy. Have a setting where someone can consent to (or not) receiving images that may potentially have nudity in them.
I have found the books System Design Interview (volumes 1 and 2), to be really nice and informative reading material on this topic.
Maybe I'm missing something obvious, but this seems like a way to calculate a mode, not a median.
So I just googled "differentiable Monte Carlo" and it looks like that concept has so far only been applied to ray tracing, but I would be shocked if that (or similar) doesn't become a thing in the next year or three,…
Thank you!
Completely agree! Plus, less trivially, there can be a bunch of different link weight settings (for an assumed distribution of inputs) that result in nearly-symmetric behaviors, and then that is multiplied by the…
Here are some "animated" loss landscapes I made quite a long time ago: http://evolvingstuff.blogspot.com/2011/02/animated-fractal-f... These are related to recurrent neural networks evolved to maximize fitness whilst…
May have looked it up.
Back in the early 2000's (when I first started getting into this stuff), Schmidhuber's ideas were absolutely off-the-charts revolutionary compared to anything any other lab was doing. The level of creativity coming out…
If I remember correctly, a big advantage of particle filters over Kalman filters is that the particle filters can model complex, multi-modal distributions, whereas the Kalman filter just updates the mean and covariance…
I am acquainted with a person working on this: http://code.google.com/p/openworm/
Another fun fact about high-dimensional spaces: Randomly pick k points in an n-dimensional space. Now, find their average location. As the number of dimensions increases, it becomes progressively more likely that every…
Agreed. To elaborate: Saccades to an unexpected stimulus normally take about 200 milliseconds (ms) to initiate, and then last from about 20–200 ms, depending on their amplitude (20–30 ms is typical in language reading).…
Only twice as unreasonable :)
One way the circumvent the need for 5000 teraflops mentioned in the article is to exploit the fact that our eye is only capable of seeing a relatively small area in great detail at any given instant. Per viewer, we only…
Anyone else not really care for the line break in the title? Seems to me like it would have been better after the colon, so that "Minimalist Web Design" would be grouped together on the next line. I wouldn't normally be…
Standard hill-climbing would indeed work better under the assumption that the fitness landscape is fairly unimodal, in terms of local optima. In this problem that may or may not be the case. I think that this is the…
That's interesting. My brain does the same in terms of attempting to simulate that model of the people, but when it becomes impossible to run the algorithm (too large of a group), instead of just giving up, my brain…
Very excellent point. One simple possibility I could imagine to mitigate this would be having an additional device/button one had to physically press in order for the thoughts to be vocalized. I think that would be an…
From the study: "It should be remarked that, in the majority of the cases, people adopting plant-based diets are more prone to engage in healthy lifestyles that include regular physical activity, reduction/avoidance of…
You are correct, that is an error in an otherwise great video. The k+1 token is not merely a function of the kth vector, but rather all prior vectors (combined using attention). There is nothing "special" about the kth…
I suspect in the near future there will be a number of cases where individuals will intentionally release a bunch of AI "chaff", in the sense that having a very large number of bad videos/texts about them, of which many…
I love Nomnoml. I have lately been using it to visualize hierarchical tag structures in a browser-based PKM project I am working on. I find it creates fairly clean layouts. Example: https://imgbox.com/9A1mDyNv
Why would RWKV have a particular advantage in this context? (I may be missing some key intuitions)
You have been shamelessly self-promoting your Hopf algebra/deep learning research on a very large percentage of posts I have seen on HN lately, to the degree that I actually felt the need to log in so as to be able to…
Easy. Have a setting where someone can consent to (or not) receiving images that may potentially have nudity in them.
I have found the books System Design Interview (volumes 1 and 2), to be really nice and informative reading material on this topic.
Maybe I'm missing something obvious, but this seems like a way to calculate a mode, not a median.
So I just googled "differentiable Monte Carlo" and it looks like that concept has so far only been applied to ray tracing, but I would be shocked if that (or similar) doesn't become a thing in the next year or three,…
Thank you!
Completely agree! Plus, less trivially, there can be a bunch of different link weight settings (for an assumed distribution of inputs) that result in nearly-symmetric behaviors, and then that is multiplied by the…
Here are some "animated" loss landscapes I made quite a long time ago: http://evolvingstuff.blogspot.com/2011/02/animated-fractal-f... These are related to recurrent neural networks evolved to maximize fitness whilst…
May have looked it up.
Back in the early 2000's (when I first started getting into this stuff), Schmidhuber's ideas were absolutely off-the-charts revolutionary compared to anything any other lab was doing. The level of creativity coming out…
If I remember correctly, a big advantage of particle filters over Kalman filters is that the particle filters can model complex, multi-modal distributions, whereas the Kalman filter just updates the mean and covariance…
I am acquainted with a person working on this: http://code.google.com/p/openworm/
Another fun fact about high-dimensional spaces: Randomly pick k points in an n-dimensional space. Now, find their average location. As the number of dimensions increases, it becomes progressively more likely that every…
Agreed. To elaborate: Saccades to an unexpected stimulus normally take about 200 milliseconds (ms) to initiate, and then last from about 20–200 ms, depending on their amplitude (20–30 ms is typical in language reading).…
Only twice as unreasonable :)
One way the circumvent the need for 5000 teraflops mentioned in the article is to exploit the fact that our eye is only capable of seeing a relatively small area in great detail at any given instant. Per viewer, we only…
Anyone else not really care for the line break in the title? Seems to me like it would have been better after the colon, so that "Minimalist Web Design" would be grouped together on the next line. I wouldn't normally be…
Standard hill-climbing would indeed work better under the assumption that the fitness landscape is fairly unimodal, in terms of local optima. In this problem that may or may not be the case. I think that this is the…