5 pointsby aldielshala2 hours ago1 comment
  • benlimantoan hour ago
    This is a good sample, how far you can push to edge device? Any usecase like in raspberry pi?
    • aldielshalaan hour ago
      Haven't tested on a Pi yet, llm.sql is still in alpha, focused on validating that SQLite can actually work for LLM inference and profiling memory usage. That said, 210MB peak RSS should fit comfortably on a Pi. In theory, any device that runs SQLite (which is almost every device) could run llm.sql. Planning to benchmark across different hardware as the project matures.