
B Architectures of Target Classifiers
The target classifiers are convolutional neural networks, and the details are shown in Table 1. We used A and B architectures for
MNIST and Fashion-MNIST, and C and D architectures for CIFAR-10.
Table 1: Neural network architectures used for target classifiers
A B C D
Conv(64, 5×5, 1) Conv(128, 3×3, 1) Conv(64, 5×5, 1) Conv(128, 3×3, 1)
ReLU ReLU ReLU ReLU
Conv(64, 5×5, 2) Conv(64, 3×3, 2) Conv(128, 5×5, 1) Conv(256, 3×3, 1)
ReLU ReLU ReLU ReLU
Dropout(0.25) Dropout(0.25) Conv(256, 5×5, 2) Conv(512, 3×3, 2)
FC(128) FC(128) ReLU ReLU
ReLU ReLU Dropout(0.25) Dropout(0.25)
Dropout(0.5) Dropout(0.5) FC(512) FC(512)
FC(10) + Softmax FC(10) + Softmax ReLU ReLU
Dropout(0.5) Dropout(0.5)
FC(256) FC(10) + Softmax
ReLU
FC(10) + Softmax