This seems closely related to the "Mixtral" approach of a mixture-of-experts transformer [1]... I'm not claiming the approach is not original, it just helped me understand what was going on. Consider a case of two…
This code seems to somewhat re-create effect, except noise is symmetric at both sides (also true of the xkcd-style plot in this article, actually). Plot: https://imgur.com/a/dGZyylf It seems a crucial piece of context…
Link to biorxiv version: https://www.biorxiv.org/content/10.1101/2020.02.03.931923v1 Summary because the title overstates significance a bit (of a cool paper): Most sequencing today is done using Illumina machines,…
The problem of experienced professionals vs grad students seems to be a real problem for science. Academia could really do with a build-out of experienced research scientists able to make careers out of consistently…
A problem that I was surprised to not be solved well is the study of paths (not represented as graphs). It seems that for example trying to cluster trajectories over time through real coordinates has a bit of prior work…
Went up this morning on arXiv: https://arxiv.org/abs/1911.04523
The posted article isn't particularly fascinating, but for a bit of fun, there's an OpenAI project where they demonstrate that due to the non-linear rounding of Float32 values you can actually train "non-linear" linear…
The DNA/RNA that encodes the proteins can itself be structured in a way that might be disrupted by synonymous amino acid changes. In particular, recent work in the field has shown that changing codons near the start of…
The Decameron has a contemporaneous account of the plague in Florence that has always stuck with me in its first section, "The Plague of Florence" (you can see here, http://faculty.sgc.edu/rkelley/The%20Decameron.pdf ).…
Worth noting that there has been a fair bit of good research in causal machine learning in the last year or so, for example "Implicit Causal Models for Genome-wide Association Studies"…
Another more modern and well-documented example of this would seem to occur in a 2015 write-up of the "Right Whale" competition in Kaggle: http://felixlaumon.github.io/2015/01/08/kaggle-right-whale.h... Contrary to this…
I think an aspect of deep learning that is often overlooked is that it is still not clear how much of current algorithm performance is defined by local "obsession to detail" vs global "understanding" of the subject…
This seems closely related to the "Mixtral" approach of a mixture-of-experts transformer [1]... I'm not claiming the approach is not original, it just helped me understand what was going on. Consider a case of two…
This code seems to somewhat re-create effect, except noise is symmetric at both sides (also true of the xkcd-style plot in this article, actually). Plot: https://imgur.com/a/dGZyylf It seems a crucial piece of context…
Link to biorxiv version: https://www.biorxiv.org/content/10.1101/2020.02.03.931923v1 Summary because the title overstates significance a bit (of a cool paper): Most sequencing today is done using Illumina machines,…
The problem of experienced professionals vs grad students seems to be a real problem for science. Academia could really do with a build-out of experienced research scientists able to make careers out of consistently…
A problem that I was surprised to not be solved well is the study of paths (not represented as graphs). It seems that for example trying to cluster trajectories over time through real coordinates has a bit of prior work…
Went up this morning on arXiv: https://arxiv.org/abs/1911.04523
The posted article isn't particularly fascinating, but for a bit of fun, there's an OpenAI project where they demonstrate that due to the non-linear rounding of Float32 values you can actually train "non-linear" linear…
The DNA/RNA that encodes the proteins can itself be structured in a way that might be disrupted by synonymous amino acid changes. In particular, recent work in the field has shown that changing codons near the start of…
The Decameron has a contemporaneous account of the plague in Florence that has always stuck with me in its first section, "The Plague of Florence" (you can see here, http://faculty.sgc.edu/rkelley/The%20Decameron.pdf ).…
Worth noting that there has been a fair bit of good research in causal machine learning in the last year or so, for example "Implicit Causal Models for Genome-wide Association Studies"…
Another more modern and well-documented example of this would seem to occur in a 2015 write-up of the "Right Whale" competition in Kaggle: http://felixlaumon.github.io/2015/01/08/kaggle-right-whale.h... Contrary to this…
I think an aspect of deep learning that is often overlooked is that it is still not clear how much of current algorithm performance is defined by local "obsession to detail" vs global "understanding" of the subject…