Llama.cpp with CUDA Support on Original Jetson Nano (4GB) (github.com) 2 points by Abishek_Muthian 3mo ago ↗ HN
[–] Abishek_Muthian 3mo ago ↗ Original title: Llama.cpp with CUDA support on a Jetson NanoEditorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.
[–] politelemon 3mo ago ↗ Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.
2 comments
[ 1.1 ms ] story [ 20.3 ms ] threadEditorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.