I hit rate limits recently after the Astra launch while using the goal feature, and I was surprised as it was an afternoon of work, something I hadn’t seen with Sol over much longer time horizons.
In this article, I found the supposed lacked of accounting for cached tokens interesting, as well as the wasteful goal/wait behavior, but I haven’t proven either.
3 comments
[ 8.4 ms ] story [ 39.9 ms ] threadI hit rate limits recently after the Astra launch while using the goal feature, and I was surprised as it was an afternoon of work, something I hadn’t seen with Sol over much longer time horizons.
In this article, I found the supposed lacked of accounting for cached tokens interesting, as well as the wasteful goal/wait behavior, but I haven’t proven either.