Nice detailed explanation of back propagation in neural networks:
- A nice post using straight python
- Couple of nice post using numpy basic neural network and RNN.
- MIT class notes
- Graph view of the gradient. The "Computational Victories" has good explanation of why back propagation is the preferred method of gradient calculation.