Undoubtedly Deep Learning is a recent significant step towards Artificial General Intelligence because of its sheer ability to learn most complex tasks. Deep Learning has been shown to achieve spectacular results in almost all domains. But as expected, there is always a price to pay for everything, especially for better things. And here the price is the interpretability and simplicity. Moreover, the amount of resources required by deep learning is huge, but that is not much of a concern in today’s era. With such huge promises, deep learning has become the panacea. Is it really true? How deep is Deep Learning? We explore such questions and will discuss some interesting findings and insights when deep learning is applied in education domain (Knowledge Tracing, to be precise).