Oh wow, how did I not know about this :) Looks super useful. How would ELMo work if a neural network needs to be run?
Ya it seems like just another deep learning course. I can vouch for fast.ai though. They're the best if you're just starting.
I don't think (some) people understand; a slick data annotation tool like this is vastly more useful than the 20th variant of GAN that DeepMind produces :)
Hi jo_, We have - 1 ML/NLP engineer (me) - 1 CEO w/ a linguistics background - 1 founder is an English professor at Berkeley - 2 with previous experience teaching English - 1 Berkeley PhD in Deep Learning / NLP advising…
Not sure how to edit but should be $!
WriteLab | ML Engineer | Berkeley, CA | ONSITE, SALARY: 100K-130K We at WriteLab (writelab.com) are building ML tools to give immediate writing feedback for students and English language learners. There is plenty of…
I think spaCy uses perceptrons (essentially a shallow neural network) so it should be faster. Accuracy is pretty similar with SyntaxNet at least on the training data but I'm guessing SyntaxNet works better on long range…
Cool, I feel like the days of the LSTM as the de facto strong baseline is ending as these new sequence models come out.
I don't understand the math completely but it looks like dropout can be derived from a Gaussian prior (approximating the Bernoulli) in a Bayesian context. One useful tidbit is that you can get prediction intervals from…
I actually like the keyboard. I tend to glide over the keyboard to find the right keys, minimizing wrist movement. Combination of feel, sound, flatness are somehow very satisfying. But! The butterfly keys are stiffer…
I feel like a touch screen on the trackpad would've made more sense. Since it's so large there's room to be creative with on-screen shortcuts, dragging sliders, choosing an emoji :), etc. You can still keep all the…
We (foxtype) actually have a dev tool that does exactly this. If we publish it as an online tool do you think people will find it useful? We have multiple corpora, some language models built in neural networks, etc.
Oops, accidently sent. We're currently building an online editor that: 1 checks for compatibility of words in a sentence (essentially popularity) 2 give example sentences for a certain word 3 word suggestions depending…
Thanks for the mention above (foxtype.com). We're currently building an online editor checks
Reddit and Hacker News comments are surprisingly good data. They cover a wide array of topics and writing styles, generally written better than Facebook comments or Twitter, easier to process than Common Crawl or ukWac,…
Thanks for the background info. If the layers are learned locally, can it take into account interactions between layers?
Any hints on how to integrate the whole document for summarization? ;) I've seen copynet, where you do seq2seq but also have a copy mechanism to copy rare words from the source sentence to the target sentence.
I agree Keras is the easiest way to get into RNNs and deep learning in general.
It learns word representations and sentiment classification at the same time. Traditionally, word representations are learned by looking at surrounding words. So "good" and "bad" will have similar word representations.…
If it uses stochastic gradient descent (it should) to train using batches of data, you can apply that to online learning.
Cool stuff! It wasn't described in the paper (afaict), but did you have ConceptNet embeddings as well? I can certainly see a way of creating embeddings by using all the links as context. (e.g.…
Looks really good. How is this different from Crowdflower? https://www.crowdflower.com
A lot of commoner food (like ketchup and soy sauce) would be revolutionary if they were discovered today. Ketchup is the perfect blend of umami (tomato), salt and vinegar. Soy sauce goes well with most anything. Many of…
It's really interesting how English -> Emoji doesn't get criticized as much as Emoji -> English. Compare to Dango: https://news.ycombinator.com/item?id=11870283
The meaning of emojis are generally pretty ambiguous so not all sentences will make sense because the emojis themselves don't make sense. There's definitely some syntactic constraints (picks one emoji for the…
Oh wow, how did I not know about this :) Looks super useful. How would ELMo work if a neural network needs to be run?
Ya it seems like just another deep learning course. I can vouch for fast.ai though. They're the best if you're just starting.
I don't think (some) people understand; a slick data annotation tool like this is vastly more useful than the 20th variant of GAN that DeepMind produces :)
Hi jo_, We have - 1 ML/NLP engineer (me) - 1 CEO w/ a linguistics background - 1 founder is an English professor at Berkeley - 2 with previous experience teaching English - 1 Berkeley PhD in Deep Learning / NLP advising…
Not sure how to edit but should be $!
WriteLab | ML Engineer | Berkeley, CA | ONSITE, SALARY: 100K-130K We at WriteLab (writelab.com) are building ML tools to give immediate writing feedback for students and English language learners. There is plenty of…
I think spaCy uses perceptrons (essentially a shallow neural network) so it should be faster. Accuracy is pretty similar with SyntaxNet at least on the training data but I'm guessing SyntaxNet works better on long range…
Cool, I feel like the days of the LSTM as the de facto strong baseline is ending as these new sequence models come out.
I don't understand the math completely but it looks like dropout can be derived from a Gaussian prior (approximating the Bernoulli) in a Bayesian context. One useful tidbit is that you can get prediction intervals from…
I actually like the keyboard. I tend to glide over the keyboard to find the right keys, minimizing wrist movement. Combination of feel, sound, flatness are somehow very satisfying. But! The butterfly keys are stiffer…
I feel like a touch screen on the trackpad would've made more sense. Since it's so large there's room to be creative with on-screen shortcuts, dragging sliders, choosing an emoji :), etc. You can still keep all the…
We (foxtype) actually have a dev tool that does exactly this. If we publish it as an online tool do you think people will find it useful? We have multiple corpora, some language models built in neural networks, etc.
Oops, accidently sent. We're currently building an online editor that: 1 checks for compatibility of words in a sentence (essentially popularity) 2 give example sentences for a certain word 3 word suggestions depending…
Thanks for the mention above (foxtype.com). We're currently building an online editor checks
Reddit and Hacker News comments are surprisingly good data. They cover a wide array of topics and writing styles, generally written better than Facebook comments or Twitter, easier to process than Common Crawl or ukWac,…
Thanks for the background info. If the layers are learned locally, can it take into account interactions between layers?
Any hints on how to integrate the whole document for summarization? ;) I've seen copynet, where you do seq2seq but also have a copy mechanism to copy rare words from the source sentence to the target sentence.
I agree Keras is the easiest way to get into RNNs and deep learning in general.
It learns word representations and sentiment classification at the same time. Traditionally, word representations are learned by looking at surrounding words. So "good" and "bad" will have similar word representations.…
If it uses stochastic gradient descent (it should) to train using batches of data, you can apply that to online learning.
Cool stuff! It wasn't described in the paper (afaict), but did you have ConceptNet embeddings as well? I can certainly see a way of creating embeddings by using all the links as context. (e.g.…
Looks really good. How is this different from Crowdflower? https://www.crowdflower.com
A lot of commoner food (like ketchup and soy sauce) would be revolutionary if they were discovered today. Ketchup is the perfect blend of umami (tomato), salt and vinegar. Soy sauce goes well with most anything. Many of…
It's really interesting how English -> Emoji doesn't get criticized as much as Emoji -> English. Compare to Dango: https://news.ycombinator.com/item?id=11870283
The meaning of emojis are generally pretty ambiguous so not all sentences will make sense because the emojis themselves don't make sense. There's definitely some syntactic constraints (picks one emoji for the…