That's interesting. My brain does the same in terms of attempting to simulate that model of the people, but when it becomes impossible to run the algorithm (too large of a group), instead of just giving up, my brain…
Very excellent point. One simple possibility I could imagine to mitigate this would be having an additional device/button one had to physically press in order for the thoughts to be vocalized. I think that would be an…
From the study: "It should be remarked that, in the majority of the cases, people adopting plant-based diets are more prone to engage in healthy lifestyles that include regular physical activity, reduction/avoidance of…
You are correct, that is an error in an otherwise great video. The k+1 token is not merely a function of the kth vector, but rather all prior vectors (combined using attention). There is nothing "special" about the kth…
I love Nomnoml. I have lately been using it to visualize hierarchical tag structures in a browser-based PKM project I am working on. I find it creates fairly clean layouts. Example: https://imgbox.com/9A1mDyNv
Why would RWKV have a particular advantage in this context? (I may be missing some key intuitions)
You have been shamelessly self-promoting your Hopf algebra/deep learning research on a very large percentage of posts I have seen on HN lately, to the degree that I actually felt the need to log in so as to be able to…
Easy. Have a setting where someone can consent to (or not) receiving images that may potentially have nudity in them.
I have found the books System Design Interview (volumes 1 and 2), to be really nice and informative reading material on this topic.
So I just googled "differentiable Monte Carlo" and it looks like that concept has so far only been applied to ray tracing, but I would be shocked if that (or similar) doesn't become a thing in the next year or three,…
Here are some "animated" loss landscapes I made quite a long time ago: http://evolvingstuff.blogspot.com/2011/02/animated-fractal-f... These are related to recurrent neural networks evolved to maximize fitness whilst…
May have looked it up.
Back in the early 2000's (when I first started getting into this stuff), Schmidhuber's ideas were absolutely off-the-charts revolutionary compared to anything any other lab was doing. The level of creativity coming out…
If I remember correctly, a big advantage of particle filters over Kalman filters is that the particle filters can model complex, multi-modal distributions, whereas the Kalman filter just updates the mean and covariance…
I am acquainted with a person working on this: http://code.google.com/p/openworm/
Another fun fact about high-dimensional spaces: Randomly pick k points in an n-dimensional space. Now, find their average location. As the number of dimensions increases, it becomes progressively more likely that every…
Agreed. To elaborate: Saccades to an unexpected stimulus normally take about 200 milliseconds (ms) to initiate, and then last from about 20–200 ms, depending on their amplitude (20–30 ms is typical in language reading).…
Only twice as unreasonable :)
Standard hill-climbing would indeed work better under the assumption that the fitness landscape is fairly unimodal, in terms of local optima. In this problem that may or may not be the case. I think that this is the…
And another: http://www.earslap.com/projectslab/otomata?q=0q0o88801y1f7b7...
This is quite fun to play around with! Many of the other CA-based music generators I've seen have sounded rather atonal and random compared to this one. Here's one I made using symmetric initial conditions (doing this…
There may indeed be more distracted/stupid people, but the inebriated ones cause about twice the number of deaths overall in the US: http://www.cdc.gov/MotorVehicleSafety/distracted_driving/ind...…
Very interesting video, these concepts seemed to have progressed a lot since last I checked in on them. That being said, I'm finding it very difficult to find any objective comparisons of these algorithms to other, more…
As far as I understand it, higher levels of vitamin D3 greatly increases absorption of calcium from the gut, and the K2 is necessary to ensure that the calcium gets deposited in the right places. Sorry, I don't have an…
You might consider switching to a D3 supplement that includes some K2; they play nicely together.
That's interesting. My brain does the same in terms of attempting to simulate that model of the people, but when it becomes impossible to run the algorithm (too large of a group), instead of just giving up, my brain…
Very excellent point. One simple possibility I could imagine to mitigate this would be having an additional device/button one had to physically press in order for the thoughts to be vocalized. I think that would be an…
From the study: "It should be remarked that, in the majority of the cases, people adopting plant-based diets are more prone to engage in healthy lifestyles that include regular physical activity, reduction/avoidance of…
You are correct, that is an error in an otherwise great video. The k+1 token is not merely a function of the kth vector, but rather all prior vectors (combined using attention). There is nothing "special" about the kth…
I love Nomnoml. I have lately been using it to visualize hierarchical tag structures in a browser-based PKM project I am working on. I find it creates fairly clean layouts. Example: https://imgbox.com/9A1mDyNv
Why would RWKV have a particular advantage in this context? (I may be missing some key intuitions)
You have been shamelessly self-promoting your Hopf algebra/deep learning research on a very large percentage of posts I have seen on HN lately, to the degree that I actually felt the need to log in so as to be able to…
Easy. Have a setting where someone can consent to (or not) receiving images that may potentially have nudity in them.
I have found the books System Design Interview (volumes 1 and 2), to be really nice and informative reading material on this topic.
So I just googled "differentiable Monte Carlo" and it looks like that concept has so far only been applied to ray tracing, but I would be shocked if that (or similar) doesn't become a thing in the next year or three,…
Here are some "animated" loss landscapes I made quite a long time ago: http://evolvingstuff.blogspot.com/2011/02/animated-fractal-f... These are related to recurrent neural networks evolved to maximize fitness whilst…
May have looked it up.
Back in the early 2000's (when I first started getting into this stuff), Schmidhuber's ideas were absolutely off-the-charts revolutionary compared to anything any other lab was doing. The level of creativity coming out…
If I remember correctly, a big advantage of particle filters over Kalman filters is that the particle filters can model complex, multi-modal distributions, whereas the Kalman filter just updates the mean and covariance…
I am acquainted with a person working on this: http://code.google.com/p/openworm/
Another fun fact about high-dimensional spaces: Randomly pick k points in an n-dimensional space. Now, find their average location. As the number of dimensions increases, it becomes progressively more likely that every…
Agreed. To elaborate: Saccades to an unexpected stimulus normally take about 200 milliseconds (ms) to initiate, and then last from about 20–200 ms, depending on their amplitude (20–30 ms is typical in language reading).…
Only twice as unreasonable :)
Standard hill-climbing would indeed work better under the assumption that the fitness landscape is fairly unimodal, in terms of local optima. In this problem that may or may not be the case. I think that this is the…
And another: http://www.earslap.com/projectslab/otomata?q=0q0o88801y1f7b7...
This is quite fun to play around with! Many of the other CA-based music generators I've seen have sounded rather atonal and random compared to this one. Here's one I made using symmetric initial conditions (doing this…
There may indeed be more distracted/stupid people, but the inebriated ones cause about twice the number of deaths overall in the US: http://www.cdc.gov/MotorVehicleSafety/distracted_driving/ind...…
Very interesting video, these concepts seemed to have progressed a lot since last I checked in on them. That being said, I'm finding it very difficult to find any objective comparisons of these algorithms to other, more…
As far as I understand it, higher levels of vitamin D3 greatly increases absorption of calcium from the gut, and the K2 is necessary to ensure that the calcium gets deposited in the right places. Sorry, I don't have an…
You might consider switching to a D3 supplement that includes some K2; they play nicely together.