Llama.cpp with CUDA Support on Original Jetson Nano (4GB) (github.com) 2 points by Abishek_Muthian 7mo ago ↗ HN
[–] Abishek_Muthian 7mo ago ↗ Original title: Llama.cpp with CUDA support on a Jetson NanoEditorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.
[–] politelemon 7mo ago ↗ Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.
2 comments
[ 5.4 ms ] story [ 23.4 ms ] threadEditorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.