COMPUTATION THE POSE OF SKULL AND PHOTO IN PHOTOGRAPHIC SUPERIMPOSITION

Liu Xiaoning,Zhou Mingquan,Geng Guohua

DOI: https://doi.org/10.3969/j.issn.1000-386X.2006.12.008

2006-01-01

Abstract:Superimposition is an important way to identify persons.A method is presented to solve the problem of pose in superimposition.Projection and geometry are used here to compute the angles of X,Y and Z.Experimental results show that the proposed method performs well.

What problem does this paper attempt to address?

Automatically Mark the Feature Points of Skull

LIU Xiao-ning,ZHOU Ming-quan,GAO Yuan

DOI: https://doi.org/10.3321/j.issn:1000-274x.2005.03.004

2005-01-01

Abstract:Aim Photographic superimposition is a new way to do identification. It is important to automatically mark the feature points of skull in photographic superimposition. An automatical method is presented.Methods First, get the contour of skull based on image preprocess technique and calculate the skull centroid. Then according to the relationship between skull centroid and the centre point of orbital cavity, the centre point of orbital cavitiey is obtained. Finally, nine key points are located according to SUSAN operator and the topology between feature points.Results Experimental results show that the method performs well and provides higher accuracy and speed.Conclusion The key problem of automatically marking the feature points of skull is resolved,the accuracy and efficiency are improved greatly.
Computation of 3D Pose of 2D Photo

Xiaoning LIU,Mingquan ZHOU,Guohua GENG

DOI: https://doi.org/10.3969/j.issn.1000-3428.2006.06.081

2006-01-01

Abstract:It is a nut of face recognition and photographic superimposition to compute the 3D pose through only one photo. This paper presents the ideas on lane-rotation, vertical-rotation and side-rotation. Lane-rotation is got by the two outer-eye points, vertical-rotation is obtained by middle-eyebrow points, lower-nose point and chin point, side-rotation is gained by lower-nose and two outer-eye points. Experimental results show that presented methods perform well. Recognition ratio can be raised effectively.
Superimposition-guided Facial Reconstruction from Skull

Celong Liu,Xin Li

DOI: https://doi.org/10.48550/arXiv.1810.00107

2018-09-29

Abstract:We develop a new algorithm to perform facial reconstruction from a given skull. This technique has forensic application in helping the identification of skeletal remains when other information is unavailable. Unlike most existing strategies that directly reconstruct the face from the skull, we utilize a database of portrait photos to create many face candidates, then perform a superimposition to get a well matched face, and then revise it according to the superimposition. To support this pipeline, we build an effective autoencoder for image-based facial reconstruction, and a generative model for constrained face inpainting. Our experiments have demonstrated that the proposed pipeline is stable and accurate.

Graphics,Computer Vision and Pattern Recognition
An Image Registration Approach Based on 3D Geometric Projection Similarity of the Human Head

Jun Liu,Yun Peng,Hao Chen,Thomas Potter,Yingchun Zhang

DOI: https://doi.org/10.1007/s40846-018-0395-9

IF: 2

2018-01-01

Journal of Medical and Biological Engineering

Abstract:This study aims to develop a novel brain image registration algorithm, the geometry projection similarity (GPS) algorithm, which utilizes the anatomical feature of human head and simplifies the objective function for optimization and search for registration parameters in a step-by-step fashion, largely reducing the solution space and improving the efficiency. The algorithm was tested and compared with existing algorithms in simulation environment and tested on computed tomography/magnetic resonance imaging (CT/MRI) clinical datasets pre- and post-craniotomy surgery. Compared with the maximal mutual information algorithm, the GPS algorithm showed significantly smaller errors (1.2 ± 1.1 vs. 4.5 ± 3.5, 1.0 ± 1.0 vs. 3.5 ± 2.5, 0.8 ± 1.1 vs. 2.8 ± 2.4 pixels, at cluster size of 100, 150 and 200, respectively) and shorter computational durations. Compared with the iterative closest point algorithm, the GPS algorithm showed a greater robustness to the perturbed initial mismatch between registering images (registration failure rate 0 vs. 29 out of 200 trials), while keeping a satisfactorily low registration error (0.71 ± 0.83 pixels). Overall results demonstrated that registration accuracy, efficiency, and robustness of this new algorithm surpass those of existing methods. Pilot test on CT/MRI clinical datasets also showed a satisfactory outcome, demonstrating great potentials for future applications of registration of brain images across modalities.
Photo-skull overlay method based on real-coded genetic algorithm

Wei Liu,Kang Li,Guohua Geng,Wenzhe Tang

DOI: https://doi.org/10.3969/j.issn.1001-3695.2016.06.064

2016-01-01

Abstract:Regarding the photo-skull overlay process in computer-aided photographic superimposition,this paper proposed an automated method based on a real-coded genetic algorithm.First,it used the genetic algorithm to search for the geometric transformation f,which matched 3D skull model with 2D photo optimally according to corresponding landmarks.The selection operator,crossover operator and mutation operator of the real-coded genetic algorithm are best retention operator,Wright’s heuristic crossover and a random mutation operator respectively.Then it mapped the 3D skull model onto the 2D photo using a similarity transformation and a perspective projection transformation.The experiments show that this method realizes the process of skull-photo overlay automatically,fast and accurately.
Research on Similarity Discrimination of Skull-photo Contours Curves

ZHANG Zhi-gang,ZHOU Ming-quan,GENG Guo-hua

2008-01-01

Abstract:The similarity discrimination of skull-photo contours curves is an important research aspect in computer-aided photographic superimposition.Large amount of manpower is involved in traditional method an improved method is proposed:Correspondence points between curves are localized automatically,the quantitative analyses is presented with distances and relativity of scale-based curvature.In this method,the automation degree of photographic superimpositions is improved,and the subjective factors can be decreased by index quantization.
Method of Skull-photo Overlay Based on Curve Matching

晋武侠,耿国华,李康,韩翼

DOI: https://doi.org/10.16182/j.cnki.joss.2013.09.045

2013-01-01

Abstract:In order to solve the problem of artificially marking features in skull-photo overlay process, a method of skull-photo overlay based on curve matching was proposed according to the theory of Image Registration and forensic science: Firstly, unify and locate 3D skull model in the standard Frankfurt coordinate system, and map the model to 2D skull; Then, automatically locate the subnasal point and extract the partial contour curve in face and photo image, employ Unsigned Curvature Integration (UCI) method to parameterize the two curves, and the partial contour curve of the face photo in consistence with skull's mandible was found using means of whole-to-part curve matching; Thirdly, employ the updated Procrustes Analysis to evaluate the optimal transformation of two curves; At last, the 2D skull was converted based on the gained transformation and the best overlay state was achieved. The experiment shows that this method can realize the process of skull-photo overlay automatically, has low time complexity and lays a foundation for automatic craniofacial superimposition of identity authentication. © Copyright.
Parameter Estimation for Perspective Projection Based on Camera Calibration in Skull-Face Overlay

Wuxia Jin,Guohua Geng,Kang Li,Yi Han

DOI: https://doi.org/10.1109/icvrv.2013.62

2013-01-01

Abstract:Craniofacial superimposition is a forensic process that aims to identify a missing person from a photograph and an unknown dead's skull. One of the crucial steps is skull-face overlay in consistent with photographic space according to the face photo. Thus parameter estimation of perspective projection becomes key problem. In this paper, we employ a method of camera calibration based on vanishing point(VPBC) to estimate relevant parameters including perspective angle, orientation of camera and photographic object distance. Firstly, according to two vanishing points in image calculate the perspective angle and focal length using photo-geography theory, then evaluate camera direction and photographic object distance based on equal focal length, finally, map the 3D skull according to above known parameters, and implement skull-face overlay process. Result shows that this approach is effective, efficient and accurate for follow-up research work.
Automatic Localization and Marking for Features of Skull by Ct Image

Bin Yu,An-Bing Wang,Zhi-Jing Liu,Ming-Quan Zhou

DOI: https://doi.org/10.1109/itcs.2009.200

2009-01-01

Abstract:The feature points of skull location and mark is an important research aspect in computer-aided facial Reconstruction and computer-aided photographic superimposition. Based on technique in the topology between feature points analyzing, an automatic localization and marking method for key points of skull is proposed. First, get the contour of skull based on image preprocess technique and calculate the centroid of skull. Then according to the relationship between skull centroid and the centre point of orbital cavity, the centre point of orbital cavitiey is obtained. Finally, key points are located according to SUSAN operator and the topology between feature points. Experimental results prove that this method is efficient and better accuracy can be obtained.
An Approach for Moving Marked Point on the Surface of 3D-Skull as Clean as a Whistle

王晓强,周明全,耿国华

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.17.025

2004-01-01

Abstract:In the computer aided photographic superimposition system, it's essential to make mark on the surface of 3D-skull,where is a feature point place. Add also need to operate the marks in the 3D-space .The operation of moving mark is a more difficult one in these operation. In this paper, a new method based on plane intersection is proposed for this question. The experimental result demonstrates the benefits of the method in precision and computational complication.
Study on the identification limits of craniofacial superimposition

Óscar Ibáñez,Enrique Bermejo,Andrea Valsecchi

DOI: https://doi.org/10.48550/arXiv.2301.09461

2023-01-24

Abstract:Craniofacial Superimposition involves the superimposition of an image of a skull with a number of ante-mortem face images of an individual and the analysis of their morphological correspondence. Despite being used for one century, it is not yet a mature and fully accepted technique due to the absence of solid scientific approaches, significant reliability studies, and international standards. In this paper we present a comprehensive experimentation on the limitations of Craniofacial Superimposition as a forensic identification technique. The study involves different experiments over more than 1 Million comparisons performed by a landmark-based automatic 3D/2D superimposition method. The total sample analyzed consists of 320 subjects and 29 craniofacial landmarks.

Computer Vision and Pattern Recognition,Artificial Intelligence
Pose-based Composition Improvement for Portrait Photographs.

Xiaoyan Zhang,Kap Luk Chan,Martin Constable

DOI: https://doi.org/10.1109/tcsvt.2018.2817231

IF: 5.859

2019-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This paper studies the composition of portrait paintings and develops an algorithm to improve the composition of portrait photographs. The study of portrait paintings shows that placement of the face and the figure in portrait paintings is pose-related. Based on this observation, this paper develops an algorithm to improve the composition of a portrait photograph by learning the placement of the face and the figure from an example portrait painting. The example portrait painting is selected based on the similarity of its figure pose to that of the input photograph. This similarity measure is modeled as a graph matching problem. Finally, space cropping is performed using an optimization function. Experimental results and a user study demonstrate that the proposed pose-based improvement is preferred more than rule-based methods.
Skull Identification via Correlation Measure Between Skull and Face Shape

Fuqing Duan,Yanchao Yang,Yan Li,Yun Tian,Ke Lu,Zhongke Wu,Mingquan Zhou

DOI: https://doi.org/10.1109/TIFS.2014.2332981

IF: 7.231

2014-01-01

IEEE Transactions on Information Forensics and Security

Abstract:Skull identification is an important subject for research in forensic medicine. Current research can be divided into two categories: 1) craniofacial superimposition and 2) craniofacial reconstruction. Both categories rely essentially on the accurate extraction and representation of the intrinsic relationship between the skull and face in terms of the morphology, which still remain unsolved. They h...
Superimposition of Cone-Beam Computed Tomography Images by Joint Embedding

Yuru Pei,Gengyu Ma,Gui Chen,Xiaoyun Zhang,Tianmin Xu,Hongbin Zha

DOI: https://doi.org/10.1109/tbme.2016.2598584

2017-01-01

Abstract:OBJECTIVE:The superimposition of cone-beam computed tomography (CBCT) images is an essential step to evaluate shape variations of pre and postorthodontic operations due to pose variations and the bony growth. The aim of this paper is to present and discuss the latest accomplishments in voxel-based craniofacial CBCT superimpositions along with structure discriminations.METHODS:We propose a CBCT superimposition method based on joint embedding of subsets extracted from CBCT images. The subset is defined at local extremes of the first-order difference of Gaussian-smoothed volume images to reduce the data involved in the computation. A rotation-invariant integral operator is proposed as the context-aware textural descriptor of subsets. We cope with subset correspondences by joint embedding with matching identifications in manifolds, which take into account the structure of subsets as a whole to avoid mapping ambiguities. Once given subset correspondences, the rigid transformations, as well as the superimposition of volume images, are obtained. Our system allows users to specify the structure-of-interest based on a semisupervised label propagation technique.RESULTS:The performance of the proposed method is evaluated on ten pairs of pre and postoperative CBCT images of adult patients and ten pairs of growing patients, respectively. The experiments demonstrate that the craniofacial CBCT superimposition can be performed effectively, and outperform state of the arts.CONCLUSION:The integration of sparse subsets with context-aware spherical intensity integral descriptors and correspondence establishment by joint embedding enables the reliable and efficient CBCT superimposition.SIGNIFICANCE:The potential of CBCT superimposition techniques discussed in this paper is highlighted and related challenges are addressed.
Head Pose Estimation Algorithm Based on Structured Light Three-Dimensional Reconstruction

Zhong Junyu,Qiu Jian,Han Peng,Luo Kaiqing,Peng Li,Liu Dongmei

DOI: https://doi.org/10.3788/lop57.181008

2020-01-01

Laser & Optoelectronics Progress

Abstract:Head pose estimation is widely used in many fields, mostly based on two-dimensional (2D) images. However, there is little research on the combination of three-dimensional (3D) face reconstruction. The reconstructed head 3D information can provide more effective data information for head pose estimation, and greatly improve the accuracy and accuracy of head pose estimation. Hence, in this paper, a recombination of 3D reconstruction based on structured light and 3D head pose estimation is proposed to reconstruct 3D facial morphology and realize 3D point cloud visualization. At the same time, a 3D head pose estimation algorithm is put forward, which searches the nose tip and nose bridge, establishes the space rectangular coordinate system and the face eigen coordinate system, and uses the vertical symmetry of the face to estimate the Euler angle of the head posture. The results show that the Euler angle of the 3D reconstruction can be measured in the range of -25 degrees to 25 degrees. The average and standard deviations of the absolute errors arc both less than 1 degrees. The linear correlation between the value and the true value is 99.8%. Comparing with the head pose estimation based on 2D images, the algorithm in this paper is more accurate and robust.
The Application and Accuracy of Feature Matching on Automated Cephalometric Superimposition

Yiran Jiang,Guangying Song,Xiaonan Yu,Yuanbo Dou,Qingfeng Li,Siqi Liu,Bing Han,Tianmin Xu

DOI: https://doi.org/10.1186/s12880-020-00432-z

IF: 2.7949

2020-01-01

BMC Medical Imaging

Abstract:Background The aim of this study was to establish a computer-aided automated method for cephalometric superimposition and to evaluate the accuracy of this method based on free-hand tracing. Methods Twenty-eight pairs of pre-treatment (T 1 ) and post-treatment (T 2 ) cephalograms were selected. Structural superimpositions of the anterior cranial base, maxilla and mandible were independently completed by three operators performing traditional hand tracing methods and by computerized automation using the feature matching algorithm. To quantitatively evaluate the differences between the two methods, the hand superimposed patterns were digitized. After automated and hand superimposition of T 2 cephalograms to T 1 cephalometric templates, landmark distances between paired automated and hand T 2 cephalometric landmarks were measured. Differences in hand superimposition among the operators were also calculated. Results The T 2 landmark differences in hand tracing between the operators ranged from 0.61 mm to 1.65 mm for the three types of superimposition. There were no significant differences in accuracy between hand and automated superimposition ( p > 0.05). Conclusions Computer-aided cephalometric superimposition provides comparably accurate results to those of traditional hand tracing and will provide a powerful tool for academic research.
Rapid Pose Estimation of Mongolian Faces using Projective Geometry

Huaming Li,Mingquan Zhou,Guohua Geng

DOI: https://doi.org/10.1109/AIPR.2004.37

2005-01-01

Abstract:We present a new method to estimate the pose of human head from a monocular image in this paper. The method only uses a face model that formed by five points (four eye-corners and subnasale) in human face, does not need any auxiliary equipment. The estimation involves the research result of the anthropometry in the Mongolian race's feature we had obtained, and employs the theory of the projective geometry. We divide the pose computation into separate estimation of the orientation about X, Y and Z-axis, respectively. For the automatic detectionof these points, Active Appearance Models (AAM) is utilized in our experiment. It had been shown that the results of experiment were very close with actual rotational angles of human face. Especially when facial rotation in a naturally small angle, less than 30°, we can obtainthe approximate accurate value of rotational angles by using this method.
A Learning-Based Pocs Algorithm For Face Image Super-Resolution Reconstruction

HUA HUANG,XIN FAN,CHUN QI,SHI-HUA ZHU

DOI: https://doi.org/10.1109/ICMLC.2005.1527837

2005-01-01

Abstract:Super-resolution (SR) reconstruction, particularly on face images, can be widely used in forensic analysis and video surveillance. In this paper, we investigate the statistical characteristics of face images and incorporate them into SR reconstruction in terms of deterministic sets. Based on the set theoretic formulation, the projection onto convex sets (POCS) algorithm is applied to rind the solution to face image reconstruction. Compared with the traditional POCS based SR methods, the proposed approach imposes additional constraints to the solution. The experimental results on frontal face images show that the proposed approach gains a better performance both on noise suppression and reconstruction quality.
Reconstruction of Super-resolution Image Using MAP and POCS Algorithms

CHEN Guangsheng,LI Shutao

DOI: https://doi.org/10.3969/j.issn.1671-1815.2006.04.012

2006-01-01

Abstract:Projections onto Convex Sets(POCS) and Maximum A Posterior (MAP) are now two of the most successful algorithms in super-resolution(SR) image fusion. However, they both have their own insuperable limitations. Based on the comprehensive analyses of their advantages and disadvantages. It addes the convex constraints to the MAP method and finds excellent properties of the both algorithms in fusion results. The following experimental results prove the effectiveness of the proposed algorithm.
A computerized craniofacial reconstruction method for an unidentified skull based on statistical shape models

Wuyang Shui,Mingquan Zhou,Steve Maddock,Yuan Ji,Qingqiong Deng,Kang Li,Yachun Fan,Yang Li,Xiujie Wu

DOI: https://doi.org/10.1007/s11042-020-09189-7

IF: 2.577

2020-07-04

Multimedia Tools and Applications

Abstract:Craniofacial reconstruction (CFR) has been widely used to produce the facial appearance of an unidentified skull in the realm of forensic science. Many studies have indicated that the computerized CFR approach is fast, flexible, consistent and objective in comparison to the traditional manual CFR approach. This paper presents a computerized CFR system called CFRTools, which features a CFR method based on a statistical shape model (SSM) of living human head models. Given an unidentified skull, a geometrically-similar template skull is chosen as a template, and a non-registration method is used to improve the accuracy of the construction of dense corresponding vertices through the alignment of the template and the unidentified skull. Generalized Procrustes analysis (GPA) and principal component analysis (PCA) are carried out to construct the skull and face SSMs. The sex of the unidentified skull is then predicted based on skull SSM and centroid size, rather than geometric measurements based on anatomical landmarks. Furthermore, a craniofacial morphological relationship which is learnt from the principal component (PC) scores of the skull and face dataset is used to produce a possible reconstructed face. Finally, multiple possible reconstructed faces for the same skull can further be recreated based on adjusting the PC coefficients. The experimental results show that the average rate of sex classification is 97.14% and the reconstructed face of the unidentified skull can be produced. In addition, experts' understanding and experience can be harnessed in production of face variations for the same skull, which can further be used as a reference for portraiture creation.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering

COMPUTATION THE POSE OF SKULL AND PHOTO IN PHOTOGRAPHIC SUPERIMPOSITION

Automatically Mark the Feature Points of Skull

Computation of 3D Pose of 2D Photo

Superimposition-guided Facial Reconstruction from Skull

An Image Registration Approach Based on 3D Geometric Projection Similarity of the Human Head

Photo-skull overlay method based on real-coded genetic algorithm

Research on Similarity Discrimination of Skull-photo Contours Curves

Method of Skull-photo Overlay Based on Curve Matching

Parameter Estimation for Perspective Projection Based on Camera Calibration in Skull-Face Overlay

Automatic Localization and Marking for Features of Skull by Ct Image

An Approach for Moving Marked Point on the Surface of 3D-Skull as Clean as a Whistle

Study on the identification limits of craniofacial superimposition

Pose-based Composition Improvement for Portrait Photographs.

Skull Identification via Correlation Measure Between Skull and Face Shape

Superimposition of Cone-Beam Computed Tomography Images by Joint Embedding

Head Pose Estimation Algorithm Based on Structured Light Three-Dimensional Reconstruction

The Application and Accuracy of Feature Matching on Automated Cephalometric Superimposition

Rapid Pose Estimation of Mongolian Faces using Projective Geometry

A Learning-Based Pocs Algorithm For Face Image Super-Resolution Reconstruction

Reconstruction of Super-resolution Image Using MAP and POCS Algorithms

A computerized craniofacial reconstruction method for an unidentified skull based on statistical shape models