Race classification based on deep features and Fisher vectors of iris texture
Yali Wang,Jing Ma,Haiqing Li,Man Zhang,Zhenan Sun
DOI: https://doi.org/10.11834/jig.170219
2018-01-01
Journal of Image and Graphics
Abstract:Objective Iris is the annular part between the pupil and white sclera of human eyes and possesses rich texture information.The iris texture is highly discriminative and stable,which makes iris an important part of the human body for biometric identification.Iris recognition aims to assign a unique identity label to each iris image based on automatic preprocessing,feature analysis,and feature matching.As a reliable method for personal identification,iris recognition has numerous important applications in public and personal security areas.The rapid development of iris recognition in commercialapplications has dramatically increased the sizes of iris databases,thereby resulting in large database sizes and slow system responses.Race classification is a key method in solving large-scale iris classification problems.Iris is initially classified according to race,and a rough classification result is obtained.Iris is then matched with the subclass where it belongs.In this way,the runtime for iris recognition can be reduced effectively.Several applications can be adopted for race classification.In the era of information,if a computer can automatically detect the race information of a user,then it can match the computer language with the user language and provide a personalized login interface.Existing approaches to iris-based race classification mainly focus on Asian and non-Asian iris image classification,and the features used for classification are man ually designed.Sub-ethnic classification,such as the classification of Koreans,Japanese,and Chinese,has also emerged in recent years.However,no sub-ethnic classification based on iris images has been conducted.No significant difference in iris texture exists among subspecies compared with the iris of the basic race,and manually designed features for basic race are not suited to sub-ethnic classification.These problems pose a great challenge to sub-ethnic classification on iris images.This study proposes a novel race classification method based on deep features and Fisher vectors of iris texture.The study focuses on basic race classification of Asian and non-Asian iris images and sub-ethnic classification of Han and Tibetan iris images.Method The original iris image contains not only the annular iris but also the pupil,eyelids,eyelashes,and other eye areas,as well as some light reflection of the formation of light spots.Therefore,the iris image should be preprocessed before features are extracted.The iris image preprocessing mainly includes iris detection,localization,segmentation,and normalization.Normalized unwrapped iris images are obtained.Our method feeds the preprocessed iris images to a convolutional neural network to extract deep features as low-level features.We use a Gaussian mixture model to cluster the features to obtain iris texture textons,and the model is then used with Fisher vector to extract high-level features.A support vector machine is used for classification.Result We evaluate our proposed method on two iris image databases,namely,CASIA multi-race iris race database and Han-Tibetan iris race database,for basic race and sub-ethnic classifications,respectively.Thus far,no iris database dedicated to sub-ethnic classification has been developed.We establish a Han-Tibetan subethnic classification database to further study race classification.We perform an evaluation in two different dataset settings,namely non-person-disjoint and person disjoint.Non-person-disjoint experimental setting refers to the random selection of certain iris images as the training set and the remaining iris images are the test set.In this way,the iris image of the same person can appear in the training and testing sets.Person-disjoint experimental setting means we randomly select iris images of some people as the training set and the iris images of remaining people as the testing set.This method can ensure that the iris images of the same person do not appear in the training and testing sets simultaneously.When we design the experiment,we compare the two methods on the two databases.Experimental results show that the proposed method can achieve 99.93％ accuracy in non-person-disjoint approach and 91.94％ in person-disjoint manner on the Asian and non-Asian dataset.For the Han-Tibetan dataset,the proposed method can obtain 99.69％ accuracy in non-person-disjoint approach and 82.25％ accuracy in person-disjoint manner.Conclusion This study proposes a race classification method based on deep features and Fisher vector of iris texture.The method learns low-level visual features highly suitable for iris race classification from training data to solve the problem of traditional methods,in which a strong prior knowledge is required to design discriminating features.In a data-driven manner,the proposed method can learn features significantly suitable for basic race classification and sub-ethnic classification,which improves the accuracy of race classification.Fisher vector is used to encode low-level visual features.The obtained features can describe the global texture features of iris images,as well as retain local texture features,which is favorable to race classification.We use iris images to solve the sub-ethnic classification of Hart and Tibetan for the first time and prove the feasibility and validity of sub-ethnic classification based on iris images.A new iris image database,which is suitable for sub-ethnic classification based on iris images is also established.The experimental results show that the differences in sub-ethnic iris images are insignificant and that the classification is challenging.