DOI: 10.14704/nq.2018.16.5.1306

A Method of Ultrasonic Image Recognition for Thyroid Papillary Carcinoma Based on Deep Convolution Neural Network

Yonghua Wang, Wei Ke, Pin Wan


Thyroid cancer is a malignant tumor that occurs in the thyroid gland and is the most common malignant tumor in the endocrine system. Ultrasound examination is the most important method to diagnose thyroid cancer. The accuracy of ultrasound examination for thyroid cancer is closely related to doctors' cognition and understanding of ultrasound images, and there are subjective judgment and misjudgment. The ultrasound images of thyroid papillary carcinoma are mostly represented by two-dimensional gray scale, and with lower resolution, complicated internal tissue structure, and not obvious features of the cancer, it is difficult to distinguish and diagnose the thyroid papillary carcinoma. In this paper, we introduce the theory of convolution neural network (CNN) in view of the difficulty in recognizing the ultrasound image of thyroid papillary carcinoma, and propose a method which can automatically recognize the ultrasound image of thyroid papillary carcinoma. In terms of the need of ultrasonic image recognition of thyroid papillary carcinoma, the Fast Region-based Convolutional Network method (Faster RCNN) network is improved and normalized by connecting the fourth layer and the fifth layer of the shared convolution layer in the Faster RCNN network. Then, a multi-scale ultrasound image is used at the time of input. Finally, according to the main features of the ultrasound images of thyroid papillary carcinoma, they are classified so as to output detailed ultrasound image diagnosis reports. The experimental results show that compared with the original Faster RCNN network, the proposed method has higher recognition accuracy, shorter training time and higher efficiency in ultrasonic image recognition of thyroid papillary carcinoma.


Thyroid papillary carcinoma, Ultrasound image, Convolutional neural network

Full Text:



Alcantarilla P F, Bartoli A, Davison A J. KAZE Features. European Conference on Computer Vision. Springer, Berlin, Heidelberg 2012: 214-27.

Cruz-Roa A, Basavanhally A, Gonzalez F, Feldman M, Ganesan S, Shih N, Tomaszewski J, Gilmore H, Madabhushi A. A Feature Learning Framework for Reproducible Invasive Tumor Detection of Breast Cancer in Whole-Slide Images. Laboratory Investigation 2015: 40A.

Davies L, Welch HG. Increasing Incidence of Thyroid Cancer in the United States, 1973-2002. JAMA 2006; 295(18): 2164–67.

Destrempes F, Meunier J, Giroux M F, et al. Segmentation in Ultrasonic B-Mode Images of Healthy Carotid Arteries Using Mixtures of Nakagami Distributions and Stochastic Optimization. IEEE Transactions on Medical Imaging 2009; 28(2): 215-29.

Girshick R, Donahue J, Darrell T, Malik J.Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014: 580-87.

Girshick R. Fast R-CNN. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 2015:1440-48.

He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016: 770-78.

He K, Zhang X, Ren S, Sun J. Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 2015: 1026-34.

Hinton G, Deng L, Yu D, Dahl GE, Mohamed AR, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN, Kingsbury B. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine 2012; 29(6): 82-97.

Hwang C L, Chou Y J, Lan C W. Comparisons Between Two Visual Navigation Strategies for Kicking to Virtual Target Point of Humanoid Robots. IEEE Transactions on Instrumentation & Measurement 2013; 62(11): 3050-63.

Kallenberg M, Karssemeijer N. Multi-class probabilistic atlas-based segmentation method in breast MRI. Iberian Conference on Pattern Recognition and Image Analysis. Springer-Verlag, 2011: 660-67.

Ke W, Wang Y, Wan P, Liu W, Li H. An Ultrasonic Image Recognition Method for Papillary Thyroid Carcinoma Based on Depth Convolution Neural Network. InInternational Conference on Neural Information Processing 2017; 10635: 82-91.

Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. International Conference on Neural Information Processing Systems. Curran Associates Inc. 2012: 1097-1105.

Längkvist M, Karlsson L, Loutfi A. A review of unsupervised feature learning and deep learning for time-series modeling. Pattern Recognition Letters 2014;42(1):11-24.

Litjens G, Sánchez CI, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I, Hulsbergen-Van De Kaa C, Bult P, Van Ginneken B, Van Der Laak J. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Scientific Reports 2016; 6: 26286.

Liu W, Rabinovich A, Berg A C. ParseNet: Looking Wider to See Better. arXiv:1506.04579v2.

Moeskops P, Viergever MA, Mendrik AM, de Vries LS, Benders MJ, Išgum I. Automatic segmentation of MR brain images with a convolutional neural network. IEEE Transactions on Medical İmaging 2016; 35(5):1252-61.

Niwas SI, Palanisamy P, Zhang WJ, Isa NA, Chibbar R. Log-gabor wavelets based breast carcinoma classification using least square support vector machine.IEEE International Conference on Imaging Systems and Techniques. IEEE 2011: 219-23.

Prakosa A, Sermesant M, Allain P. Cardiac electrophysiological activation pattern estimation from images using a patient-specific database of synthetic image sequences. IEEE Transactions on Biomedical Engineering 2014; 61(2): 235-36.

Ren S, He K, Girshick R, et al. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.IEEE Transactions on Pattern Analysis and Machine Intelligence 2017, 39(6):1137-49.

Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC. Imagenet large scale visual recognition challenge. International Journal of Computer Vision 2015;115(3): 211-52.

Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J. Convolutional neural networks for medical image analysis: Full training or fine tuning?. IEEE transactions on medical imaging 2016; 35(5):1299-312.

Toki Y, Tanaka T. Image feature extraction method with SIFT to diagnose prostate cancer. Sice Conference. IEEE 2012: 2185-88.

Wu L, Hoi S C H, Yu N. Semantics-Preserving Bag-of-Words Models and Applications. IEEE Transactions on Image Processing 2010; 19(7): 1908-20.

Zeiler M D, Fergus R. Visualizing and Understanding Convolutional Networks.European Conference on Computer Vision 2014: 818-33.

Zhang C, Zhang Z. Improving multiview face detection with multi-task deep convolutional neural networks. IEEE Winter Conference on Applications of Computer Vision 2014: 1036-41.

Zhang R,Liu Q,Liu Q. The Research on Preprocessing for the Gray-Scale Ultrasound Breast Tumor Images of 76 Cases. Hans Journal of Biomedicine 2015; 5: 9-16.

Supporting Agencies

| NeuroScience + QuantumPhysics> NeuroQuantology :: Copyright 2001-2019