Why? It's an awful,method.Yes gradient descent with back-propagation is the most widely used method when training a neural networks with supervised learning.
later more discussion material!..
Why do you like invoking Godwin's Law?He did the worst thing to natural sciences - crowned mathematics their queen. He's like Hitler compared to Atiyah's and Shorr's little crimes!