59 pointsby cpp_frog3 days ago3 comments
  • laGrenouillean hour ago
    Great visualizations. Really enjoyed having a well-written example where mathematical proofs directly help with understanding a practical application.

    I wonder what would happen with this analysis if a momentum term was added to the gradient descent. It seems that it would fix the specific failure modes in the examples, but I wonder if there's a corresponding mathematical way of categorizing what kinds of functions can(not) be quickly optimized with GD + momentum.

  • xuzhenpeng3 hours ago
    The animation is very good, making the article easy to understand
    • Guestmodinfo2 hours ago
      We studied it in our peparation for college entrance exams in India. Though the detail the article goes in is exhaustive. But I thought that this maybe common or almost common knowledge. We used to call it sandwich theorem
  • xzp121382 hours ago
    [flagged]