Thanks so much again. Got it working. 8 seconds. Nvidia is the king. Updated the blog post.
I just can't get it to work, it errors out with 'NotImplementedError: The model type whisper is not yet supported to be used with BetterTransformer.' Did you happen to run into this problem?
Thanks so much again. Got it working. 8 seconds. Nvidia is the king. Updated the blog post.
I just can't get it to work, it errors out with 'NotImplementedError: The model type whisper is not yet supported to be used with BetterTransformer.' Did you happen to run into this problem?