9 pointsby logickkk12 hours ago1 comment
  • p_stuart822 hours ago
    Does this catch intermittent fallback between requests?
    • logickkk1an hour ago
      Yes, picchio monitors a running llama-server on a timer and flags when the prefill/decode ratio goes CPU-shaped. I hot-swapped one mid-run. probe 4 caught ENGAGED -> NOT ENGAGED.