This tutorial code: https://github.com/MorvanZhou/tutoria... Tensorboard can not only show you the network graph, but also show how good is your training, plot the changes of your loss and weights etc. We can use this to determine which part should be improved to have a better result. This is the way to a higher level.