7 pointsby gczh5 hours ago3 comments
  • michaelastreiko5 hours ago
    Curious how the switch felt day-to-day for a small team — was the win mostly lower spend, or did the outputs stay predictable enough that you stopped second-guessing every call?
    • vitran_orca4 hours ago
      We have Jev running as shadow calls alongside with the control calls (LLM models). Agreement rate differ across use cases. We then use this data to tune the confidence and probabilities threshold for each case to achieve around high enough agreement rate with the current model.
  • vitran_orca5 hours ago
    I’m the author, tysm for sharing the article! Happy to share more if anyone has questions.
  • matanyall5 hours ago
    so much jev hype, honestly deserved