Same for being stuck in local maxima: getting out of that requires big changes, not small-step optimizations.