[–] nick_rocks 2y ago ↗ 83% cost reduction seems impressive, but is this really an issue for anyone? [–] sp332 2y ago ↗ Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l... [–] [deleted] 2y ago ↗ (comment deleted) [–] nick_rocks 2y ago ↗ Fair enough! But have you heard of 2 cases?
[–] sp332 2y ago ↗ Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l... [–] [deleted] 2y ago ↗ (comment deleted) [–] nick_rocks 2y ago ↗ Fair enough! But have you heard of 2 cases?
[–] aazo11 2y ago ↗ Is langsmith still useful if your app is not built with Langchain? Given how early these technologies wouldn't it be better to use a framework agnostic tool to not be tied in to a single framework?
5 comments
[ 1.6 ms ] story [ 23.8 ms ] thread