Attacking Neural Networks with Neural Networks: Towards Deep Synchronization for Backdoor Attacks

Backdoor attacks inject poisoned samples into training data, where backdoor triggers are embedded into the model trained on the mixture of poisoned and clean samples.An interesting phenomenon can be observed in the training process: the loss of poisoned samples tends to drop significantly faster than that of clean samples, which we call the early-fitting phenomenon.Early-fitting provides a simple but effective evidence to defend against backdoor attacks, where the poisoned samples can be detected by selecting the samples with the lowest loss values in the early training epochs.Then, two questions naturally arise: (1) What characteristics of poisoned samples cause early-fitting?(2) Does a stronger attack exist which could circumvent the defense methods?To answer the first question, we find that early-fitting could be attributed to a unique property among poisoned samples called synchronization, which depicts the similarity between two samples at different layers of a model.Meanwhile, the degree of synchronization could be controlled based on whether it is captured by shallow or deep layers of the model.Then, we give an affirmative answer to the second question by proposing a new backdoor attack method, Deep Backdoor Attack (DBA), which utilizes deep synchronization to reverse engineer trigger patterns by activating neurons in the deep layer of a base neural network.Experimental results validate our propositions and the effectiveness of DBA.Our code is available at https://github.com/GuanZihan/Deep-Backdoor-Attack.