CaltechAUTHORS
  A Caltech Library Service

Robustifying Binary Classification to Adversarial Perturbation

Salehi, Fariborz and Hassibi, Babak (2020) Robustifying Binary Classification to Adversarial Perturbation. . (Unpublished) https://resolver.caltech.edu/CaltechAUTHORS:20201109-152308798

[img] PDF - Submitted Version
See Usage Policy.

360Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20201109-152308798

Abstract

Despite the enormous success of machine learning models in various applications, most of these models lack resilience to (even small) perturbations in their input data. Hence, new methods to robustify machine learning models seem very essential. To this end, in this paper we consider the problem of binary classification with adversarial perturbations. Investigating the solution to a min-max optimization (which considers the worst-case loss in the presence of adversarial perturbations) we introduce a generalization to the max-margin classifier which takes into account the power of the adversary in manipulating the data. We refer to this classifier as the "Robust Max-margin" (RM) classifier. Under some mild assumptions on the loss function, we theoretically show that the gradient descent iterates (with sufficiently small step size) converge to the RM classifier in its direction. Therefore, the RM classifier can be studied to compute various performance measures (e.g. generalization error) of binary classification with adversarial perturbations.


Item Type:Report or Paper (Discussion Paper)
Related URLs:
URLURL TypeDescription
http://arxiv.org/abs/2010.15391arXivDiscussion Paper
Record Number:CaltechAUTHORS:20201109-152308798
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20201109-152308798
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:106565
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:09 Nov 2020 23:34
Last Modified:09 Nov 2020 23:34

Repository Staff Only: item control page