GENDER IDENTIFICATION FROM LEFT HAND-WRIST X-RAY IMAGES WITH A HYBRID DEEP LEARNING METHOD

Year 2023, Volume: 11 Issue: 4, 1118 - 1133, 01.12.2023

Cüneyt Özdemir , Mehmet Ali Gedik , Hüdaverdi Küçüker , Yılmaz Kaya

https://doi.org/10.36306/konjes.1294139

Abstract

In forensic investigations, characteristics such as gender, age, ethnic origin, and height are important in determining biological identity. In this study, we developed a deep learning-based decision support system for gender recognition from wrist radiographs using 13,935 images collected from individuals aged between 2 and 79 years. Differences in all regions of the images, such as carpal bones, radius, ulna bones, epiphysis, cortex, and medulla, were utilized. A hybrid model was proposed for gender determination from X-ray images, in which deep metrics were combined in appropriate layers of transfer learning methods. Although gender determination from X-ray images obtained from different countries has been reported in the literature, no such study has been conducted in Turkey. It was found that gender discrimination yielded different results for males and females. Gender identification was found to be more successful in females aged between 10 and 40 years than in males. However, for age ranges of 2-10 and 40-79 years, gender discrimination was found to be more successful in males. Finally, heat maps of the regions focused on by the proposed model were obtained from the images, and it was found that the areas of focus for gender discrimination were different between males and females.

Keywords

Hand-Wrist X-ray images, Gender identification, Hybrid model, InceptionV3, DenseNet201

References

• M. Y. İşcan ve M. Steyn, "The Human Skeleton in Forensic Medicine," 3rd ed.
• A. P. Agelarakis, "Studies in Crime: An Introduction to Forensic Archaeology. By John R. Hunter, Charlotte A. Roberts, and Anthony L. Martin. Making Faces: Using Forensic and Archaeological Evidence. By John Prag and Richard Neave," Am J Archaeol, vol. 102, 1998. [Online]. Available: https://doi.org/10.2307/506107
• M. Didi AL, R. R. Azman, ve M. Nazri, "Sex determination from carpal bone volumes: A Multi Detector Computed Tomography (MDCT) study in a Malaysian population," Leg Med, vol. 20, 2016. [Online]. Available: https://doi.org/10.1016/j.legalmed.2016.04.002
• ILO Barrier ve EN L’Abbé, "Sex determination from the radius and ulna in a modern South African sample," Forensic Sci Int, vol. 179, 2008. [Online]. Available: https://doi.org/10.1016/j.forsciint.2008.04.012
• T. K. Black, "A new method for assessing the sex of fragmentary skeletal remains: Femoral shaft circumference," Am J Phys Anthropol, vol. 48, 1978. [Online]. Available: https://doi.org/10.1002/ajpa.1330480217
• L. R. Frutos, "Metric determination of sex from the humerus in a Guatemalan forensic sample," Forensic Sci Int, vol. 147, 2005. [Online]. Available: https://doi.org/10.1016/j.forsciint.2004.09.077
• M. Y. Işcan, "Forensic anthropology of sex and body size," Forensic Sci Int, vol. 147, 2005. [Online]. Available: https://doi.org/10.1016/j.forsciint.2004.09.069
• K. Sakaue, "Sexual determination of long bones in recent Japanese," Anthropol Sci, vol. 112, 2004. [Online]. Available: https://doi.org/10.1537/ase.00067
• M. Šlaus, Ž. Bedić, D. Strinović, ve V. Petrovečki, "Sex determination by discriminant function analysis of the tibia for contemporary Croats," Forensic Sci Int, vol. 226, 2013. [Online]. Available: https://doi.org/10.1016/j.forsciint.2013.01.025
• C. Ozdemir, M. A. Gedik, ve Y. Kaya, "Age Estimation from Left-Hand Radiographs with Deep Learning Methods," Trait du Signal, vol. 38, 2021. [Online]. Available: https://doi.org/10.18280/ts.380601
• S. Gornale, A. Patil, ve C. V, "Fingerprint based Gender Identification using Discrete Wavelet Transform and Gabor Filters," Int J Comput Appl, vol. 152, 2016. [Online]. Available: https://doi.org/10.5120/ijca2016911794
• X. Li, X. Zhao, Y. Fu, ve Y. Liu, "Bimodal gender recognition from face and fingerprint," in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
• R. K, A. Patil, ve S. Gornale, "Fusion of Features and Synthesis Classifiers for Gender Classification using Fingerprints," Int J Comput Sci Eng, vol. 7, 2019. [Online]. Available: https://doi.org/10.26438/ijcse/v7i5.526533
• S. Aryanmehr, M. Karimi, ve F. Z. Boroujeni, "CVBL IRIS Gender Classification Database Image Processing and Biometric Research, Computer Vision and Biometric Laboratory (CVBL)," In: 2018 3rd IEEE International Conference on Image, Vision and Computing, ICIVC 2018.
• M. Singh, S. Nagpal, M. Vatsa, ve diğerleri, "Gender and ethnicity classification of Iris images using deep class-encoder," In: IEEE International Joint Conference on Biometrics, IJCB 2017, 2018.
• V. Thomas, N. V. Chawla, K. W. Bowyer, ve P. J. Flynn, "Learning to predict gender from iris images," In: IEEE Conference on Biometrics: Theory, Applications and Systems, BTAS’07, 2007.
• S. S. Gornale, A. Patil, M. Hangarge, ve R. Pardesi, "Automatic human gender identification using palmprint," In: Smart Computational Strategies: Theoretical and Practical Aspects, 2019.
• E. Tartaglione, C. A. Barbano, C. Berzovini, ve diğerleri, "Unveiling COVID-19 from chest x-ray with deep learning: A hurdles race with small data," Int J Environ Res Public Health, vol. 17, 2020. [Online]. Available: https://doi.org/10.3390/ijerph17186933
• Y. Kaya ve Ö. F. Ertuğrul, "Gender classification from facial images using gray relational analysis with novel local binary pattern descriptors," Signal, Image Video Process, vol. 11, 2017. [Online]. Available: https://doi.org/10.1007/s11760-016-1021-3
• L. Bui, D. Tran, X. Huang, ve G. Chetty, "Classification of gender and face based on gradient faces," In: 3rd European Workshop on Visual Information Processing, EUVIP 2011 - Final Program, 2011.
• A. Hasnat, S. Halder, D. Bhattacharjee, ve M. Nasipuri, "A proposed system for gender classification using the lower part of the face image," In: Proceedings - IEEE International Conference on Information Processing, ICIP 2015, 2016.
• M. Wu ve Y. Yuan, "Gender classification based on geometry features of palm image," Sci World J, vol. 2014. [Online]. Available: https://doi.org/10.1155/2014/734564
• M. V. Rajee ve C. Mythili, "Gender classification on digital dental x-ray images using deep convolutional neural network," Biomed Signal Process Control, vol. 69, 2021. [Online]. Available: https://doi.org/10.1016/j.bspc.2021.102939
• S. Babacan, S. Isiklar, I. M. Kafa, ve G. Gokalp, "Redesign of missing mandible by determining age group and gender from morphometric features of the skull for facial reconstruction (approximation)," Archaeol Anthropol Sci, vol. 13, 2021. [Online]. Available: https://doi.org/10.1007/s12520-021-01315-2
• T. Danisman, I. M. Bilasco, ve J. Martinet, "Boosting gender recognition performance with a fuzzy inference system," Expert Syst Appl, vol. 42, 2015. [Online]. Available: https://doi.org/10.1016/j.eswa.2014.11.023
• P. Gnanasivam ve S. Muttan, "Gender classification using ear biometrics," In: Lecture Notes in Electrical Engineering, 2013.
• R. Djemili, H. Bourouba, ve M. C. A. Korba, "A speech signal-based gender identification system using four classifiers," In: Proceedings of 2012 International Conference on Multimedia Computing and Systems, ICMCS 2012, 2012.
• L. Zimman, "Transgender voices: Insights on identity, embodiment, and the gender of the voice," Lang Linguist Compass, vol. 12, 2018. [Online]. Available: https://doi.org/10.1111/lnc3.12284
• A. B. A. Graf ve F. A. Wichmann, "Gender classification of human faces," In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2002.
• X. Li, S. J. Maybank, S. Yan, ve diğerleri, "Gait components and their application to gender recognition," IEEE Trans. Syst. Man Cybern. Part C Appl. Rev., vol. 38, 2008.
• S. Yune, H. Lee, M. Kim, ve diğerleri, "Beyond Human Perception: Sexual Dimorphism in Hand and Wrist Radiographs Is Discernible by a Deep Learning Model," J Digit Imaging, vol. 32, 2019. [Online]. Available: https://doi.org/10.1007/s10278-018-0148-x
• A. E. Barnes, D. T. Case, S. E. Burnett, ve P. Mahakkanukrauh, "Sex estimation from the carpal bones in a Thai population," Aust J Forensic Sci, vol. 52, 2020. [Online]. Available: https://doi.org/10.1080/00450618.2019.1620856
• N. Vila-Bianco, R. R. Vilas, M. J. Carreira, ve I. Tomás, "Towards deep learning reliable gender estimation from dental panoramic radiographs," In: CEUR Workshop Proceedings, 2020.
• J. Bewes, A. Low, A. Morphett, ve diğerleri, "Artificial intelligence for sex determination of skeletal remains: Application of a deep learning artificial neural network to human skulls," J Forensic Leg Med, vol. 62, 2019. [Online]. Available: https://doi.org/10.1016/j.jflm.2019.01.004
• E. Korot, N. Pontikos, X. Liu, ve diğerleri, "Predicting sex from retinal fundus photographs using automated deep learning," Sci Rep, vol. 11, 2021. [Online]. Available: https://doi.org/10.1038/s41598-021-89743-x
• S. Gornale S, A. Patil, ve R. K, "Multimodal Biometrics Data Analysis for Gender Estimation Using Deep Learning," Int J Data Sci Anal, vol. 6, 2020. [Online]. Available: https://doi.org/10.11648/j.ijdsa.20200602.11
• Ş. Kılıç ve Y. Doğan, "Deep learning-based gender identification using ear images," Traitement du Signal, vol. 40, 2023. [Online]. Available: https://doi.org/10.18280/ts.400431
• Y. Doğan, "Derin Öğrenme Yöntemleriyle Çapraz Veri Seti Değerlendirmesi Altında COVID-19 Tespiti," Gazi University Journal of Science Part C: Design and Technology, vol. 11, no. 3, 2023.
• M. A. Morid, A. Borjali, ve G. Del Fiol, "A scoping review of transfer learning research on medical image analysis using ImageNet," Comput. Biol. Med., vol. 128, 2021.
• C. Szegedy, W. Liu, Y. Jia, ve diğerleri, "Going deeper with convolutions," In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
• G. Huang, Z. Liu, L. Van Der Maaten, ve K. Q. Weinberger, "Densely connected convolutional networks," In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017.
• B. Karadayi, A. Kaya, H. Koc, ve diğerleri, "Sex determination for using hand and wrist measurements in the Turkish population," Turkish J Forensic Med, vol. 28, 2014. [Online]. Available: https://doi.org/10.5505/adlitip.2014.98700
• S. C. Jee, S. Bahn, ve M. H. Yun, "Determination of sex from various hand dimensions of Koreans," Forensic Sci Int, vol. 257, 2015. [Online]. Available: https://doi.org/10.1016/j.forsciint.2015.10.014
• M. Prabhat, S. Rai, M. Kaur, ve diğerleri, "Computed tomography-based forensic gender determination by measuring the size and volume of the maxillary sinuses," J Forensic Dent Sci, vol. 8, 2016. [Online]. Available: https://doi.org/10.4103/0975-1475.176950
• R. DeSilva, A. Flavel, ve D. Franklin, "Estimation of sex from the metric assessment of digital hand radiographs in a Western Australian population," Forensic Sci Int, vol. 244, 2014. [Online]. Available: https://doi.org/10.1016/j.forsciint.2014.08.019
• T. Sozen, L. Ozisik, ve N. Calik Basaran, "An overview and management of osteoporosis," Eur J Rheumatol, vol. 4, 2017. [Online]. Available: https://doi.org/10.5152/eurjrheum.2016.048
• F. Cosman, S. J. de Beur, M. S. LeBoff, ve diğerleri, "Clinician’s Guide to Prevention and Treatment of Osteoporosis," Osteoporos Int, vol. 25, 2014. [Online]. Available: https://doi.org/10.1007/s00198-014-2794-2
• Ş. Öztürk, U. Özkaya, ve M. Barstuğan, "Classification of Coronavirus (COVID‐19) from X‐ray and CT images using shrunken features," Int J Imaging Syst Technol, vol. 31, no. 1, 2021. [Online]. Available: https://doi.org/10.1002/ima.22432