2 comments

[ 2.8 ms ] story [ 18.4 ms ] thread
I was able to run alpaca 7B model on Pixel 7 Pro.
that's pretty inspiring! Any drawbacks? What is the time delay (which I realize are dependent on a lot of factors) between input prompts -> result of what you have tested?