The coupling effect of Lipschitz regularization in neural networks - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue SN Computer Science Année : 2021

The coupling effect of Lipschitz regularization in neural networks

(1, 2)
1
2

Résumé

We investigate the robustness of feed-forward neural networks when input data are subject to random uncertainties. More specifically, we consider regularization of the network by its Lipschitz constant and emphasize its role. We highlight the fact that this regularization is not only a way to control the magnitude of the weights but has also a coupling effect on the network weights across the layers. We claim and show evidence on regression and classification datasets that this coupling effect brings a trade-of between robustness and expressiveness of the network. This suggests that Lipschitz regularization should be carefully implemented so as to maintain coupling across layers.
Fichier principal
Vignette du fichier
LipANN.pdf (587.24 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02090498 , version 1 (04-04-2019)

Identifiants

Citer

Nicolas Couellan. The coupling effect of Lipschitz regularization in neural networks. SN Computer Science, 2021, 2 (2), pp.113. ⟨10.1007/s42979-021-00514-x⟩. ⟨hal-02090498⟩
141 Consultations
691 Téléchargements

Altmetric

Partager

Gmail Facebook Twitter LinkedIn More