[–] ValleZ 2y ago ↗ One way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!
[–] Zambyte 2y ago ↗ Cool project! Where is the source code for this? [–] ValleZ 2y ago ↗ It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp
[–] ValleZ 2y ago ↗ It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp
3 comments
[ 3.0 ms ] story [ 19.5 ms ] thread