Ask HN: Are your code benchmarks statistically valid?
1 pointby DenisM14 hours ago1 comment
  • Magma740414 hours ago
    I haven't got a clue since I have never used any benchmark tool in my whole life. Could you tell us in which professional context you would use that kind of tool?
    • DenisM13 hours ago
      Run a benchmark to compare performance of my product before and after making a change in code.
      • gus_massa7 hours ago
        I run it 5 times and drop the two extremes. If the middle tree don't overlap, I'm probably fine. Not super precise, but good enough and easy.

        Also, add a loop so the benchmark is like 1 second long, I'm old enough to be worried about anything smaller than 1/18 seconds.