Hyperparameter Tuning Is a Resource Scheduling Problem (jchandra.com) 2 points by jchandra 1y ago ↗ HN
[–] vivahir215 1y ago ↗ I dont think its just a resource scheduling problem, there are more to it as well. The goal is Model Performance, not just efficient resource use.Nice article but I can see your point. [–] jchandra 1y ago ↗ Totally fair point — at the end of the day, it's all about getting the best model performance. I was mostly trying to highlight how, under the hood, a lot of modern HPO algos really boil down to smart scheduling decisions. [–] vivahir215 1y ago ↗ Total Computational Budget in Hyperband need to be elaborated. There are more things to it.
[–] jchandra 1y ago ↗ Totally fair point — at the end of the day, it's all about getting the best model performance. I was mostly trying to highlight how, under the hood, a lot of modern HPO algos really boil down to smart scheduling decisions. [–] vivahir215 1y ago ↗ Total Computational Budget in Hyperband need to be elaborated. There are more things to it.
[–] vivahir215 1y ago ↗ Total Computational Budget in Hyperband need to be elaborated. There are more things to it.
3 comments
[ 3.1 ms ] story [ 15.8 ms ] threadNice article but I can see your point.