2 comments

[ 4.0 ms ] story [ 19.6 ms ] thread
We made a simple profiler to help optimize AI token spend. Generally speaking anytime you want to optimize your app, whether it's for memory or otherwise you typically start with a profiler. There are a ton of MiTM Gateways but there aren't many true profilers, so I thought I'd make one. Just sign up, create a "system", instrument it, and watch. Great way to see where your tokens are going.
We added a comparison mode today so that you can see how your system reacts to the same prompt with different tools!