Iteration from the wrong starting point could end up in a local minima. I think that's hard to recognize in some cases and takes something more dramatic to address (like simulated annealing)