Maybe we can look for historical examples of how legislation had a positive impact on a widespread harmful habit. Early on, the U.S. Congress adopted the Federal Cigarette Labeling and Advertising Act of 1965 and the…
They trained a >600B parameter translation model (GPT-3 is 175B parameters). GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding (https://arxiv.org/abs/2006.16668)
I'm as impressed as anyone with GPT-3 samples, but you're sort of ignoring the symbol grounding elephant in the room regarding language models (https://openreview.net/pdf?id=GKTvAcb12b). Language models are not grounded…
They have published multiple major TTS papers since the original WaveNet paper in 2016. Including the recent Tacotron results with impressive style control. Tacotron (Mar. 2017): https://arxiv.org/abs/1703.10135…
This is called federated learning[0] at least by Google. I don't know whether they've added this to more products or whether it works well. It would be interesting to see this done in open source. [0]…
They're most likely referring to adversarial attacks where degenerate inputs are constructed that could cause AlphaGo Zero to perform sub-optimally or catastrophically fail (see OpenAI Research [0]). This is distinct…
It was trained with self-play and evaluated on AlphaGo Lee (the version that beat Lee Sedol) and AlphaGo Master (the version that beat Ke Jie and I believe a number of online matches against top-ranked professional…
>No one is ever going to use word vectors to figure out what genders are capable of what jobs. How can you possibly make this claim? Biased word embeddings have the potential to bias inference in downstream systems…
Have you seen the results from Dynamic Memory Networks? [0] The relevant example from the paper: I: Jane went to the hallway. I: Mary walked to the bathroom. I: Sandra went to the garden. I: Daniel went back to the…
DeepMind is the name of an AI company that was acquired by Google. https://deepmind.com/ AlphaGo is the program that beat Go. These game playing algorithms are variations of Deep Q Learning Reinforcement Learning algos.
Maybe we can look for historical examples of how legislation had a positive impact on a widespread harmful habit. Early on, the U.S. Congress adopted the Federal Cigarette Labeling and Advertising Act of 1965 and the…
They trained a >600B parameter translation model (GPT-3 is 175B parameters). GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding (https://arxiv.org/abs/2006.16668)
I'm as impressed as anyone with GPT-3 samples, but you're sort of ignoring the symbol grounding elephant in the room regarding language models (https://openreview.net/pdf?id=GKTvAcb12b). Language models are not grounded…
They have published multiple major TTS papers since the original WaveNet paper in 2016. Including the recent Tacotron results with impressive style control. Tacotron (Mar. 2017): https://arxiv.org/abs/1703.10135…
This is called federated learning[0] at least by Google. I don't know whether they've added this to more products or whether it works well. It would be interesting to see this done in open source. [0]…
They're most likely referring to adversarial attacks where degenerate inputs are constructed that could cause AlphaGo Zero to perform sub-optimally or catastrophically fail (see OpenAI Research [0]). This is distinct…
It was trained with self-play and evaluated on AlphaGo Lee (the version that beat Lee Sedol) and AlphaGo Master (the version that beat Ke Jie and I believe a number of online matches against top-ranked professional…
>No one is ever going to use word vectors to figure out what genders are capable of what jobs. How can you possibly make this claim? Biased word embeddings have the potential to bias inference in downstream systems…
Have you seen the results from Dynamic Memory Networks? [0] The relevant example from the paper: I: Jane went to the hallway. I: Mary walked to the bathroom. I: Sandra went to the garden. I: Daniel went back to the…
DeepMind is the name of an AI company that was acquired by Google. https://deepmind.com/ AlphaGo is the program that beat Go. These game playing algorithms are variations of Deep Q Learning Reinforcement Learning algos.