Show HN: I built a tool that reviews any GitHub PR and quizzes you on it(makesensegithub.com)
6 pointsby atomicnature7 hours ago1 comment
  • levi8407146 hours ago
    Is the quiz meant for the reviewer or the author? The quiz is the part I find genuinely new here. My one hesitation: since the questions come from the same model that wrote the summary, passing might just prove I absorbed the AI's reading of the diff, not that the reading was correct or that I understood the actual code. Curious whether the questions are grounded in the diff itself. Only tried the example on the landing page.
    • atomicnature6 hours ago
      The underlying assumption here is -- at least part of code is AI generated.

      Also another unstated assumption is that both the "author" and "reviewer" are reading AI-generated stuff, at least partly

      First of all -- the author should not be surprised by any of the things the AI is reporting. If the author is -- either the reviewer AI went wrong, or the generative component went wrong. Either way -- there is something worth looking at in greater depth.

      For the reviewer -- or "traditional reviewer" as we may term them -- they are dealing with much greater volume per day now, again due to AI generation. This is supposed to help them get through things faster while not losing comprehension altogether.

      There's a reason we still have the code diff right below -- they are encouraged to check things themselves if they feel "something is off" with the quiz.

      The point is -- a few questions hopefully gets the wheels spinning in the reader rather than looking at the diff passively and saying "LGTM"

      And yes -- all the review results are grounded strictly in the diff