Skip to Main content Skip to Navigation
Conference papers

Probabilistic Robustness Estimates for Deep Neural Networks

Abstract : Robustness of deep neural networks is a critical issue in practical applications. In the case of deep dense neural networks, under random noise attacks, we propose to study the probability that the output of the network deviates from its nominal value by a given threshold. We derive a simple concentration inequality for the propagation of the input uncertainty through the network using the Cramer-Chernoff method and estimates of the local variation of the neural network mapping computed at the training points. We further discuss and exploit the resulting condition on the network to regularize the loss function during training. Finally, we assess the proposed tail probability estimate empirically on three public regression datasets and show that the observed robustness is very well estimated by the proposed method.
Document type :
Conference papers
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal-enac.archives-ouvertes.fr/hal-02572277
Contributor : Nicolas Couellan <>
Submitted on : Wednesday, May 13, 2020 - 3:40:33 PM
Last modification on : Tuesday, October 20, 2020 - 10:32:07 AM

File

ProbDNNp.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02572277, version 1

Collections

Citation

Nicolas Couellan. Probabilistic Robustness Estimates for Deep Neural Networks. ICML workshop on Uncertainty and Robustness in Deep Learning, International Conference on Machine Learning (ICML), Jul 2020, Virtual Conference, United States. ⟨hal-02572277v1⟩

Share

Metrics

Record views

88

Files downloads

124