I am back for day 4 of Livebook's Launch Week. This time we use Livebook to build a Whisper chat app - where you can only talk via audio transcriptions - and deploy it to Hugging Face. All done with Elixir!
You can give the deployed application a try here: https://huggingface.co/spaces/josevalim/livebook - and then click on "Whisper chat" on the right. Audio messages are concurrently handled and batched within the same instance before being handled by the GPU. I guess we will soon find out if a Nvidia T4 is enough. :)
Have fun and I am glad to answer questions once more.
2 comments
[ 5.1 ms ] story [ 18.0 ms ] threadI am back for day 4 of Livebook's Launch Week. This time we use Livebook to build a Whisper chat app - where you can only talk via audio transcriptions - and deploy it to Hugging Face. All done with Elixir!
You can give the deployed application a try here: https://huggingface.co/spaces/josevalim/livebook - and then click on "Whisper chat" on the right. Audio messages are concurrently handled and batched within the same instance before being handled by the GPU. I guess we will soon find out if a Nvidia T4 is enough. :)
Have fun and I am glad to answer questions once more.
Very curious to poke this whole app building thing.