Abstract:Besides ResNet-20, we further evaluate DualNet based on the deeper ResNet [6], e.g., with 32 layers and 56 layers (denoted as ResNet-32&ResNet-56, referring to the third-party implementation available at [2]). ResNet32&ResNet-56, as well as the corresponding DualNet (denoted as DNR32&DNR56), are also trained on the augmented CIFAR-100 and the experimental results are shown in Table 1. The performance comparison demonstrates that DualNet performs well with ResNet-32 and ResNet-56. For DNR56, although the joint finetuning does not helps a lot, the performance (75.57%) is still 2.76% higher than the base model (72.81%). Table 1. The top-1 accuracy on the augmented CIFAR-100 achieved by the standard deep model (ResNet-32&ResNet-56) and the corresponding DualNet (DNR32&DNR56). The first row shows the results of ResNet-32&ResNet-56 and the rest are all achieved by DNR32&DNR56. After the iterative training, we respectively evaluate the performance of the Fused Classifier and the weighted average of three classifiers, while the latter one can help validate the necessity of the joint finetuning.

Supplementary Material for “DualNet: Learn Complementary Features for Image Recognition”