What is a deep neural network? At its simplest, a neural network with some level of complexity, usually at least two layers , qualifies as a deep neural network (DNN), or deep net for short. Deep nets process data in complex ways by employing sophisticated math modeling.