3 pointsby jmathai6 hours ago1 comment
  • ernsheongan hour ago
    Hey there, nice one. Care to share a bit what is under the hood? What are the challenges of local AI? It is RAG-ging? What small models do you use?
    • jmathaia minute ago
      To avoid misquoting scripture it’s using a couple techniques including tool calls for grounding and a client-side parsing layer to find and replace citations.

      It currently uses deepseek flash. We’ll evaluate local models in the future.