Department of Computer Science and Engineering
University of Washington

Shape-Based Retrieval of 3D Craniofacial Data

This research is supported by the National Institute of Dental and Craniofacial Research under Grant No. 1U01DE020050-01.

Click here for subproject Ontology of Craniofacial Development and Deformation .

Project Summary:

The goal of this work is to provide tools for the study of craniofacial anatomy from either CT scans or from a 12-camera active stereo photogrammetry system. Our image-analysis tools provide low-level operators for working with 3D craniofacial data. Our feature extraction tools produce quantitative representations (descriptors) of the 3D data that can be used to summarize the 3D shape as pertains to the condition being studied and the question being asked. Our similarity-measure tools compare the data from two individuals (or between an individual and the average of a population) and produce a numeric similarity score. Our organizational tools provide an image indexing mechanism that allows rapid retrieval of all images in a database that are similar to a query image in order of similarity. Our user-interface tools allow users to easily pose queries specifying both relational constraints on alphanumeric data and similarity constraints on image data in order to find subjects in a database who are most similar to a query subject with respect to studies from multiple different imaging modalities.

We will apply our tools for analysis, description, similarity measurement, organization and shape-based retrieval to a database of patients with midface hypoplasia and cleft lip and/or palate as part of the NIH/NIDCR FaceBase Consortium.

People:

Linda Shapiro, PI	James Brinkley, Key Personnel	Michael Cunningham, Key Personnel	Ezgi Mercan, CSE Fellow	Michael Lam, Research Programmer

Irma Lam, NLM Trainee	Jia Wu, RA	Lynn Yang, RA	Sara Rolfe, RA	Ambar Choudhury, Research Programmer

Collaborators:

Carrie Heike	Timothy Cox	Indriyati Atmosukarto	Katarzyna Wilamowska

Publications:

S. Rolfe, S. I. Lee, L. G. Shapiro, "Associations between Genetic Data and Quantitative Assessment of Normal Facial Asymmetry," Frontiers in Genetics: Applied Genetic Epidemiology, Dec, 2018.

E. Mercan, C. S. Morrison, E. Stuhaug, L. G. Shapiro, R. W. Tse, "Novel Computer Vision Analysis of Nasal Shape in Children with Unilateral Cleft Lip," Journal of Cranio-Maxillofacial Surgery, Elsevier ScienceDirect, October 2017.

S. Liang, L. Shapiro, R. Tse, "Measuring Symmetry in Children with Cleft Lip. Part 3: Quantifying Nasal Symmetry and Nasal Normalcy Before and After Unilateral Cleft Repair," The Cleft Palate-Craniofacial Journal, 2016.

J. Wu, C. Heike, C. Birgfeld, K. Evans, M. Maga, C. Morrison, B. Saltzman, L. Shapiro, R. Tse, "Measuring Symmetry in Children with Unrepaired Cleft Lip: Defining a Standard for the Three-Dimensional Mid-facial Reference Plane," The Cleft Palate-Craniofacial Journal, 2016.

J. Wu, S. Liang, L. Shapiro, R. Tse, "Measuring Symmetry in Children with Cleft Lip. Part 2: Quantification of Nasolabial Symmetry Before and After Cleft Lip Repair," The Cleft Palate-Craniofacial Journal, 2015.

E. Mercan, I. Atmosukarto, J. Wu, S. Liang, L. G. Shapiro, ``Craniofacial Image Analysis," in Comprehensive Health Monitoring and Personalized Feedback using Multimedia Data, A. Briassouli and J. Benois-Pineau (Ed.), Springer International, 2015.

D. Aneja, S.R. Vora, E.E. Camci, L.G. Shapiro, and T. C. Cox,``Automated Detection of 3D Landmarks for the Elimination of Non-Biological Variation in Geometric Morphometric Analyses," IEEE Computer Based Medical Systems, June 2015.

S. Liang, I. Kemelmacher-Shlizerman, L. G. Shapiro, ``3D Face Hallucination from a Single Kinect Frame,'' International Conference on 3D Vision, 2014.

J. Wu, R. Tse, L. G. Shapiro, "Automated Face Extraction and Normalization of 3D Mesh Data," IEEE Engineering in Medicine and Biology Society Annual Conference, August, 2014.

I. Lam, M. Cunningham, C. Birgfeld, M. Speltz, L. Shapiro, "Quantification of Skull Deformity for Craniofacial Research," IEEE Engineering in Medicine and Biology Society Annual Conference, August, 2014.

J. Wu, R. Tse, L. G. Shapiro, "Learning to Rank the Severity of Unreparied Cleft Lip Nasal Deformity on 3D Mesh Data," International Conference on Pattern Recognition, August 2014.

I. Lam, M. Cunningham, M. Speltz, L. Shapiro, "Classifying Craniosynostosis with a 3D Projection-Based Feature Extraction System," IEEE International Symposium on Computer-Based Medical Systems, June 2014.

E. Mercan, L. G. Shapiro, S. M. Weinberg, and S.-I. Lee, "The Use of Pseudo-Landmarks for Craniofacial Analysis: A Comparative Study with L1-Regularized Logistic Regression," IEEE Engineering in Medicine and Biology Society Annual Conference, July, 2013.

S. Liang, J. Wu, S. M. Weingberg, L. G. Shapiro, "Improved Detection of Landmarks on 3D Human Face Data," IEEE Engineering in Medicine and Biology Society Annual Conference, July, 2013.

S. M. Rolfe, E. D. Camci, E. Mercan, L. G. Shapiro, and T. C. Cox, "A New Tool for Quantifying and Characterizing Asymmetry in Bilaterally Paired Structures," IEEE Engineering in Medicine and Biology Society Annual Conference, July, 2013.

I Atmosukarto and L. G. Shapiro, "3D Object Retrieval Using Salient Views," International Journal of Multimedia Information Retrieval , online July, 2012, in hardcopy Vol. 2, No. 2, 2013, pp. 103-115, PMCID: PMC3702181.

X. Pan and L. Shapiro, "3D Shape Isometric Correspondence by Spectral Assignment," International Conference on Pattern Recognition, 2012.

S. Yang, L. Shapiro, M. Cunningham, M. Speltz, C. Birgfeld, I. Atmosukarto, S.-I. Lee, "Skull Retrieval for Craniosynostosis Using Sparse Logistic Regression Models," Proceedings of the MICCAI Workshop on Medical Content Based Retrieval for Clinical Decision Support, Springer, 2012. Winner of the Best Paper Award.

K. Wilamowska, J. Wu, C. Heike, and L. Shapiro, "Shape-Based Classification of 3D Facial Data to Support 22q11.2DS Craniofacial Research," Journal of Digital Imaging, Nov 2011.

S. M. Rolfe, L. G. Shapiro, T. C. Cox, A.M. Maga, L. L. Cox, "A Landmark-free Framework for the Detection and Description of Shape Differences in Embryos", International IEEE EMBS Conference, 2011.

J. Wu, R. Tse, C. L. Heike, L. G. Shapiro, "Learning to Compute the Symmetry Plane for Human Faces", ACM-BCB '11, August 2011.

S. Yang, L. G. Shapiro, M. L. Cunningham, M. Speltz, S.- I. Lee, "Classification and Feature Selection for Craniosynostosis," ACM-BCB '11, August 2011.

J. H. Chen and L. G. Shapiro, "Groupwise Pose Normalization for Craniofacial Applications," IEEE Workshop on Applications of Computer Vision, January 2011.

J.H. Chen, K. Zheng, and L. G. Shapiro, "3D Point Correspondence by Minimum Description Length in Feature Space," European Conference on Computer Vision, 2010.

I. Atmosukarto, L. G. Shapiro, C. Heike, "Use of Genetic Programming for Learning 3D Craniofacial Shape Quantification", ICPR 2010.

L Shapiro, K Wilamowska, I Atmosukarto, J Wu, CL Heike, M Spelz, and M Cunningham. "Shape-Based Classification of 3D Head Data." International Conference on Image Analysis and Processing, 2009.

Software

Progress Reports