Hello! Spinning Up author here. I would love to hear your thoughts on this! So far I have had a lot of success teaching people about DDPG using this code example, but I'm grateful for every fresh perspective. :) Feel…
Hello! Spinning Up author here. Very reasonable point that it is not clearly explained why you need to store logp_pi in the buffer. But the reason is that it would require additional code complexity to calculate it on…
Hi! Keep an eye on our blog and twitter accounts. We announced this workshop back in November (in the original blog post for Spinning Up, located here: https://blog.openai.com/spinning-up-in-deep-rl/), and tweeted about…
The guide doesn't assume access to specialized hardware. Experiments and iterations with all of those algorithms can be done on a normal CPU that anyone has. :) Quote: "Iterate fast in simple environments. To debug your…
Hi! A few people had this question on Twitter also. Our response: "Several of us at OpenAI are thinking seriously about how to make something like this happen! I can't promise anything, but we definitely want to remove…
No, but please open up an issue on Github and we'll look into making one! :) https://github.com/openai/spinningup/issues/new
Let us know by opening an issue on Github: https://github.com/openai/spinningup/issues/new
Hi! Primary developer for Spinning Up here. The code for this was developed mostly in June and July this year, and Eager still felt relatively new to me. I wanted to wait for Eager to stabilize and hit maturity before…
Hello! Spinning Up author here. I would love to hear your thoughts on this! So far I have had a lot of success teaching people about DDPG using this code example, but I'm grateful for every fresh perspective. :) Feel…
Hello! Spinning Up author here. Very reasonable point that it is not clearly explained why you need to store logp_pi in the buffer. But the reason is that it would require additional code complexity to calculate it on…
Hi! Keep an eye on our blog and twitter accounts. We announced this workshop back in November (in the original blog post for Spinning Up, located here: https://blog.openai.com/spinning-up-in-deep-rl/), and tweeted about…
The guide doesn't assume access to specialized hardware. Experiments and iterations with all of those algorithms can be done on a normal CPU that anyone has. :) Quote: "Iterate fast in simple environments. To debug your…
Hi! A few people had this question on Twitter also. Our response: "Several of us at OpenAI are thinking seriously about how to make something like this happen! I can't promise anything, but we definitely want to remove…
No, but please open up an issue on Github and we'll look into making one! :) https://github.com/openai/spinningup/issues/new
Let us know by opening an issue on Github: https://github.com/openai/spinningup/issues/new
Hi! Primary developer for Spinning Up here. The code for this was developed mostly in June and July this year, and Eager still felt relatively new to me. I wanted to wait for Eager to stabilize and hit maturity before…