Thank you so much!
Haha, 649 pages! Thanks for the discussion. I can understand your perspective. Maybe it would be best to add something to the blog post that discusses it from both perspectives and readers can then choose which…
Thank you! You have a good point. I think I would agree with you if somebody already has cloud computing skills, then the cloud is much more powerful to learn deep learning than your own GPU. I figured that most people…
I just did a small fix to address this. Thanks again.
Thank you, I just updated the blog post with more detailed clarification of where the data comes from. One thing that I am quite sure of for the A100 is its transformer performance. It turns out, large transformers are…
I should have been a bit clearer what went into the charts. I do not use theoretical marketing numbers but real-life benchmark data from NVIDIA and 4 other sources of benchmark between Titan V, V100, RTX 2080, RTX 2080…
This is good feedback. Will note this down and incorporate it in a small update.
What else would you like to see?
Is up again and stable it seems. I shot my cache while trying to "tune" it. Well, I learned my lesson.
Please see my detailed answer on this question that you can find on quora: https://www.quora.com/Why-are-GPUs-well-suited-to-deep-learn...
Your data are inconsistent with the benchmarks that I mention in the blog post: https://github.com/u39kun/deep-learning-benchmark You also do not benchmark LSTMs:…
Thanks for your feedback! Someone mentioned this on twitter as well and I thought it was a good point so I implemented that change.
The site is up again. I have a prepared draft for a blog post exactly on the topic of cloud computing and deep learning. I did not finish it as I thought that there would not be much interest in the overall question…
A very valuable comment – this is an important perspective, thanks! I think I will add a EC2 section to my blog post.
Thanks for sharing your experience – this is a fair point. Often it is possible to pre-process your data and save it to disk so that you can skip this decompression/conversion/transformation step once you start training…
Thanks four your feedback, this is an important point and I will update my blog posts accordingly.
These are some good points. I heard from another person that he had problems with the form factor and I will add that to the post tomorrow. I think a 2kW PSU is overkill, but you are right that more is better for PSUs.…
If you have no desktop PC or no money for a GPU, it might be a better choice to use a EC2 instance instead of buying the hardware. You pay about $11 a week for a EC2, which is quite good once you compare it against the…
There are several cryptocurrency mining benchmarks which are bandwidth bound; those benchmarks reflect almost one to one the deep learning performance of a GPU. You can see this for example for litecoin mining:…
Thanks for your feedback. I updated the blog post with a small NVIDIA vs. AMD section.
Thanks for elaborating, these are exactly the points why AMD's GPUs are just not used in deep learning. AWS is great if you want to use a single or two separate GPUs. However, you cannot use them for multi-GPU…
If you are dissatisfied with the 970 you might be able to get a refund: NVIDIA advertised specs that differ from the real thing – that is a good reason to demand and get a refund.
Tesla GPUs are also rather slow, but the value of Tesla lies in increased double performance, larger memory and memory correction -- and you cannot beat Tesla GPUs in these departments.
AMD cards were much faster than the Kepler equivalents, but now NVIDIA fixed their mistakes in that architecture and they are as fast as AMD cards. So AMDs hardware is good, it is just a software issue.
Why I did not mention AMD cards: NVIDIA's standard libraries made it very easy to establish the first deep learning libraries in CUDA, while there are no such powerful standard libraries for AMD's OpenCL. Right now,…
Thank you so much!
Haha, 649 pages! Thanks for the discussion. I can understand your perspective. Maybe it would be best to add something to the blog post that discusses it from both perspectives and readers can then choose which…
Thank you! You have a good point. I think I would agree with you if somebody already has cloud computing skills, then the cloud is much more powerful to learn deep learning than your own GPU. I figured that most people…
I just did a small fix to address this. Thanks again.
Thank you, I just updated the blog post with more detailed clarification of where the data comes from. One thing that I am quite sure of for the A100 is its transformer performance. It turns out, large transformers are…
I should have been a bit clearer what went into the charts. I do not use theoretical marketing numbers but real-life benchmark data from NVIDIA and 4 other sources of benchmark between Titan V, V100, RTX 2080, RTX 2080…
This is good feedback. Will note this down and incorporate it in a small update.
What else would you like to see?
Is up again and stable it seems. I shot my cache while trying to "tune" it. Well, I learned my lesson.
Please see my detailed answer on this question that you can find on quora: https://www.quora.com/Why-are-GPUs-well-suited-to-deep-learn...
Your data are inconsistent with the benchmarks that I mention in the blog post: https://github.com/u39kun/deep-learning-benchmark You also do not benchmark LSTMs:…
Thanks for your feedback! Someone mentioned this on twitter as well and I thought it was a good point so I implemented that change.
The site is up again. I have a prepared draft for a blog post exactly on the topic of cloud computing and deep learning. I did not finish it as I thought that there would not be much interest in the overall question…
A very valuable comment – this is an important perspective, thanks! I think I will add a EC2 section to my blog post.
Thanks for sharing your experience – this is a fair point. Often it is possible to pre-process your data and save it to disk so that you can skip this decompression/conversion/transformation step once you start training…
Thanks four your feedback, this is an important point and I will update my blog posts accordingly.
These are some good points. I heard from another person that he had problems with the form factor and I will add that to the post tomorrow. I think a 2kW PSU is overkill, but you are right that more is better for PSUs.…
If you have no desktop PC or no money for a GPU, it might be a better choice to use a EC2 instance instead of buying the hardware. You pay about $11 a week for a EC2, which is quite good once you compare it against the…
There are several cryptocurrency mining benchmarks which are bandwidth bound; those benchmarks reflect almost one to one the deep learning performance of a GPU. You can see this for example for litecoin mining:…
Thanks for your feedback. I updated the blog post with a small NVIDIA vs. AMD section.
Thanks for elaborating, these are exactly the points why AMD's GPUs are just not used in deep learning. AWS is great if you want to use a single or two separate GPUs. However, you cannot use them for multi-GPU…
If you are dissatisfied with the 970 you might be able to get a refund: NVIDIA advertised specs that differ from the real thing – that is a good reason to demand and get a refund.
Tesla GPUs are also rather slow, but the value of Tesla lies in increased double performance, larger memory and memory correction -- and you cannot beat Tesla GPUs in these departments.
AMD cards were much faster than the Kepler equivalents, but now NVIDIA fixed their mistakes in that architecture and they are as fast as AMD cards. So AMDs hardware is good, it is just a software issue.
Why I did not mention AMD cards: NVIDIA's standard libraries made it very easy to establish the first deep learning libraries in CUDA, while there are no such powerful standard libraries for AMD's OpenCL. Right now,…