2 pointsby Abishek_Muthian10 hours ago2 comments
  • Abishek_Muthian10 hours ago
    Original title: Llama.cpp with CUDA support on a Jetson Nano

    Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.

  • politelemon9 hours ago
    Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.