By generating the neural network in a space-oriented 3-D fashion, you are allowing the network to generate it’s own recurrent loops as necessary. In fact, those recurrent loops need not be simple single layer loops. Since they are being made up of more nodes, they could involve hundreds of nodes just to generate the appropriate recurrent state information, whatever that may be!