Theory of deep learning

Abstract

What is going on inside a neural network. How and why does it generalise despite overtraining? Is it memorising the input? Is deep learning fundamentally different to shallow learning?

Personnel

Tags

Deep Learning, Learning Theory

Related Publications

L. Szymanski, B. McCane and C. Atkinson. Conceptual complexity of neural networks. Neurocomputing, 469:52-64, 2022. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
L. Szymanski, B. McCane and M. Albert. The effect of the choice of neural network depth and breadth on the size of its hypothesis space. CoRR, abs/1806.02460, 2018. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
L. Szymanski, B. McCane, W. Gao and Z. Zhou. Effects of the optimisation of the margin distribution on generalisation in deep architectures. CoRR, abs/1704.05646, 2017. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
B. McCane and L. Szymanski. Efficiency of deep networks for radially symmetric functions. Neurocomputing, 313:119-124, 2017. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
B. McCane and L. Szymanski. Deep networks are efficient for circular manifolds. In 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 3464-3469, 2016. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
L. Szymanski and B. McCane. Deep Networks are Effective Encoders of Periodicity. IEEE Transactions on Neural Networks and Learning Systems, 25(10):1816-1827, 2014. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
L. Szymanski and B. McCane. Deep, super-narrow neural network is a universal classifier. In The 2012 International Joint Conference on Neural Networks (IJCNN), pp. 1-8, 2012. Copy bibtex to clipboard
Bibtex has been copied to clipboard.
L. Szymanski and B. McCane. Push-pull separability objective for supervised layer-wise training of neural networks. In The 2012 International Joint Conference on Neural Networks (IJCNN), pp. 1-8, 2012. Copy bibtex to clipboard
Bibtex has been copied to clipboard.