5 pointsby Sean-Der4 months ago2 comments
  • qazxcvbnmlp4 months ago
    What's the round trip latency on this? ask question -> response. Do you parse the question word by word and feed into llm or wait for the whole question before feeling into llm?
  • Sean-Der4 months ago
    [dead]