A Survey on Medical Image and Its Segmentation

  • Thi Lam Thuy Le
  • Ngoc Thanh Sang Vu
  • Trung Hieu Huynh
  • The Bao Pham PGS. Trưởng khoa CNTT, ĐH Sài Gòn
Keywords: Medical images, medical image processing, medical image segmentation


Medical image processing and analysis are critical for assisting physicians with non-invasive clinical diagnoses.
Understanding medical imaging techniques enables you to tackle corresponding medical image processing methodologically. Each imaging technique has distinct properties and produces images of various body regions. Medical image segmentation is crucial to improving treatment accuracy and assisting doctors’ diagnosis conclusion. This article discusses medical imaging techniques and approaches to medical image segmentation.

Author Biographies

Thi Lam Thuy Le

e Nhi Lam Thuy received B.S. and M.S.
degree in Computer Science from Vienam
National University – Hochiminh city, Vietnam in 2004 and 2009. She was lecturer
in the Fundamental Science Department,
HCMC College of Economics from 2005
– 2/2018. She have been lecturer in the
Information Science Faculty, Sai Gon University, Vietnam. She is Ph.D. student of Industrial University of
Hochiminh City, Vietnam.
Email: thuylnl@sgu.edu.vn, ncs.lnlthuy@iuh.edu.vn

Ngoc Thanh Sang Vu

Vu Ngoc Thanh Sang received the B.Sc.
degree in biomedical engineering from the
International University–National University of HCM City, Vietnam, in 2014, the
M.Sc. degree from the Department of Information Sciences, Tokyo University of Agriculture and Technology, Japan, in 2016,
and the Ph.D. degree from the Department
of Electronic and Information Sciences, Tokyo University of
Agriculture and Technology, Japan, in 2019. Since 2019, he has
been a Lecturer with the Computer Science Department, Saigon
University, Vietnam.
Email: vntsang@sgu.edu.vn

Trung Hieu Huynh

Huynh Trung Hieu received the B.S.
and M.S. in Computer Engineering from
Ho Chi Minh city University of Technology in 1998 and 2003, respectively,
and Ph.D. degree in Computer Engineering from Chonnam National University in
2009. He worked with the Faculty of Electrical and Electronics Engineering, Ho Chi
Minh city University of Technology from 1998 to 2010. He is
currently an associate professor in Industrial University of Ho
Chi Minh city. His research interests focus on the computational
intelligence for image analysis, pattern recognition, network and
communication security, biological and medical data analysis.
Email: hthieu@ieee.org


S. Webb, “The physics of medical imaging-medical science series,” 1996.

ScienceDirect Topics, “Medical imaging, medical imaging - an overview.” [Online]. Available: https://www.sciencedirect.com/topics/computerscience/medical-imaging (accessed: 2022-01-01)

History, “German scientist discovers x-ray.” [Online]. Available: https://www.history.com/this-day-in-history/germanscientist-discovers-x-rays (accessed: 2022-01-01)

Ultrasound schools info, “History of ultrasound.” [Online]. Available: https://www.ultrasoundschoolsinfo.com/history/ (accessed: 2022-01-01)

The evolution of imaging technology, “History of the pet/ct scanner.” [Online]. Available:

https://www.theevolutionofimagingtechnology.net/historyof-the-pet-ct-scanner/ (accessed: 2022-01-01)

H. Zaidi, “Medical imaging: Current status and future perspectives,” 1997.

M. Akay, “Time frequency and wavelets in biomedical signal processing,” 1998.

Z.-H. Cho, J. P. Jones, and M. Singh, Foundations of medical imaging. Wiley New York, 1993, vol. 228.

S. Ogawa, D. W. Tank, R. Menon, J. M. Ellermann, S. G. Kim, H. Merkle, and K. Ugurbil, “Intrinsic signal changes

accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging,” Proceedings of the National Academy of Sciences, vol. 89, no. 13, pp. 5951–5955, 1992.

S. Ogawa, T. Lee, and B. Barrere, “The sensitivity of magnetic resonance image signals of a rat brain to changes in the cerebral venous blood oxygenation,” Magnetic resonance in medicine, vol. 29, no. 2, pp. 205–210, 1993.

A. Maier, S. Steidl, V. Christlein, and J. Hornegger, “Medical imaging systems: An introductory guide,” 2018.

T. Heimann, B. Van Ginneken, M. A. Styner, Y. Arzhaeva, V. Aurich, C. Bauer, A. Beck, C. Becker, R. Beichel,

G. Bekes et al., “Comparison and evaluation of methods for liver segmentation from ct datasets,” IEEE transactions on medical imaging, vol. 28, no. 8, pp. 1251–1265, 2009.

O. J. Tobias and R. Seara, “Image segmentation by histogram thresholding using fuzzy sets,” IEEE transactions on Image Processing, vol. 11, no. 12, pp. 1457–1465, 2002.

N. Salem, H. Malik, and A. Shams, “Medical image enhancement based on histogram algorithms,” Procedia Computer Science, vol. 163, pp. 300–311, 2019.

S. Patel, K. Bharath, S. Balaji, and R. K. Muthu, “Comparative study on histogram equalization techniques for medical image enhancement,” in Soft Computing for Problem Solving. Springer, 2020, pp. 657–669.

S. C. Satapathy, D. J. Hemanth, S. Kadry, G. Manogaran, N. M. Hannon, and V. Rajinikanth, “Segmentation and evaluation of covid-19 lesion from ct scan slices-a study with kapur/otsu function and cuckoo search algorithm,” 2020.

F. Riaz, S. Rehman, M. Ajmal, R. Hafiz, A. Hassan, N. R. Aljohani, R. Nawaz, R. Young, and M. Coimbra, “Gaussian mixture model based probabilistic modeling of images for medical image segmentation,” IEEE Access, vol. 8, pp. 16 846–16 856, 2020.

E. R. Arce-Santana, A. R. Mejia-Rodriguez, E. MartinezPena, A. Alba, M. Mendez, E. Scalco, A. Mastropietro, and ˜G. Rizzo, “A new probabilistic active contour region-based method for multiclass medical image segmentation,” Medical & biological engineering & computing, vol. 57, no. 3, pp. 565–576, 2019.

D. M. Kumar, D. Satyanarayana, and M. Prasad, “An improved gabor wavelet transform and rough k-means clustering algorithm for mri brain tumor image segmentation,” Multimedia Tools and Applications, vol. 80, no. 5, pp. 6939– 6957, 2021.

K. M. Aljebory and T. S. Mohammed, “Modified fuzzy c-means clustering algorithm application in medical image segmentation,” JEA Journal of Electrical Engineering, vol. 2, no. 1, pp. 1–9, 2018.

Z. Zhang and J. Song, “An adaptive fuzzy level set model with local spatial information for medical image segmentation and bias correction,” IEEE Access, vol. 7, pp. 27 322– 27 338, 2019.

D. Jia and X. Zhuang, “Directional fast-marching and multimodel strategy to extract coronary artery centerlines,” Computers in Biology and Medicine, vol. 108, pp. 67–77, 2019.

A. Tsai, A. Yezzi, W. Wells, C. Tempany, D. Tucker, A. Fan, W. E. Grimson, and A. Willsky, “A shape-based approach to the segmentation of medical imagery using level sets,” IEEE transactions on medical imaging, vol. 22, no. 2, pp. 137–154, 2003.

R. Hemalatha, T. Thamizhvani, A. J. A. Dhivya, J. E. Joseph, B. Babu, and R. Chandrasekaran, “Active contour

based segmentation techniques for medical image analysis,” Medical and Biological Image Analysis, vol. 4, no. 17, p. 2, 2018.

S. Nithya, S. Bhuvaneswari, and S. Senthil, “Robust minimal spanning tree using intuitionistic fuzzy c-means clustering algorithm for breast cancer detection,” Am. J. Neural Netw. Appl, vol. 5, pp. 12–22, 2019.

X. Liu, D. Liu, T. Fu, Z. Pan, W. Hu, and K. Zhang, “Shortest path with backtracking based automatic layer segmentation in pathological retinal optical coherence tomography images,” Multimedia Tools and Applications, vol. 78, no. 12, pp. 15 817–15 838, 2019.

N. Ghorpade and H. Bhapkar, “Evaluation and performance analysis of brain mri segmentation methods,” Int. J. Computer Sci. Eng, vol. 6, no. 8, pp. 687–696, 2018.

N. N. Gopal and M. Karnan, “Diagnose brain tumor through mri using image processing clustering algorithms such as fuzzy c means along with intelligent optimization techniques,” in 2010 IEEE international conference on computational intelligence and computing research. IEEE, 2010, pp. 1–4.

A. Ladgham, F. Hamdaoui, A. Sakly, and A. Mtibaa, “Fast mr brain image segmentation based on modified shuffled frog leaping algorithm,” Signal, Image and Video Processing, vol. 9, no. 5, pp. 1113–1120, 2015.

W. Zhang, R. Li, H. Deng, L. Wang, W. Lin, S. Ji, and D. Shen, “Deep convolutional neural networks for multimodality isointense infant brain image segmentation,” NeuroImage, vol. 108, pp. 214–224, 2015.

Y. Bar, I. Diamant, L. Wolf, and H. Greenspan, “Deep learning with non-medical training used for chest pathology identification,” in Medical Imaging 2015: Computer-Aided Diagnosis, vol. 9414. International Society for Optics and Photonics, 2015, p. 94140V.

P. Moeskops, J. M. Wolterink, B. H. van der Velden, K. G. Gilhuijs, T. Leiner, M. A. Viergever, and I. Isgum, ˇ

“Deep learning for multi-task medical image segmentation in multiple modalities,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2016, pp. 478–486.

G. Urban, M. Bendszus, F. Hamprecht, and J. Kleesiek, “Multi-modal brain tumor segmentation using deep convolutional neural networks,” MICCAI BraTS (brain tumor segmentation) challenge. Proceedings, winning contribution, pp. 31–35, 2014.

K. Kamnitsas, L. Chen, C. Ledig, D. Rueckert, and B. Glocker, “Multi-scale 3d convolutional neural networks

for lesion segmentation in brain mri,” Ischemic stroke lesion segmentation, vol. 13, p. 46, 2015.

F. Xu, H. Ma, J. Sun, R. Wu, X. Liu, and Y. Kong, “Lstm multi-modal unet for brain tumor segmentation,” in 2019 IEEE 4th International Conference on Image, Vision and Computing (ICIVC). IEEE, 2019, pp. 236–240.

J. Freixenet, X. Munoz, D. Raba, J. Martí, and X. Cufí, “Yet another survey on image segmentation: Region and

boundary information integration,” in European conference on computer vision. Springer, 2002, pp. 408–422.

R. Hapsari, M. Utoyo, R. Rulaningtyas, and H. Suprajitno, “Iris segmentation using hough transform method and fuzzy c-means method,” in Journal of Physics: Conference Series, vol. 1477, no. 2. IOP Publishing, 2020, p. 022037.

B. Peng, L. Zhang, and D. Zhang, “A survey of graph theoretical approaches to image segmentation,”Pattern recognition, vol. 46, no. 3, pp. 1020–1038, 2013.

P. F. Felzenszwalb and D. P. Huttenlocher, “Efficient graphbased image segmentation,” International journal of computer vision, vol. 59, no. 2, pp. 167–181, 2004.

D. Brindha and N. Nagarajan, “An efficient automatic segmentation of spinal cord in mri images using interactive random walker (rw) with artificial bee colony (abc) algorithm,” Multimedia Tools and Applications, vol. 79, no. 5, pp. 3623– 3644, 2020.

J. Dogra, S. Jain, and M. Sood, “Analysis of graph cut technique for medical image segmentation,” in International Conference on Advanced Informatics for Computing Research. Springer, 2019, pp. 451–463.

S. Wang and J. M. Siskind, “Image segmentation with minimum mean cut,” in Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, vol. 1. IEEE, 2001, pp. 517–524.

S. Wang and J. M. Siskind, “Image segmentation with ratio cut,” vol. 25, no. 6, pp. 675–690, 2003.

D. L. Pham, C. Xu, and J. L. Prince, “Current methods in medical image segmentation,” Annual review of biomedical engineering, vol. 2, no. 1, pp. 315–337, 2000.

F. Commandeur, M. Goeller, J. Betancur, S. Cadet, M. Doris, X. Chen, D. S. Berman, P. J. Slomka, B. K. Tamarappoo, and D. Dey, “Deep learning for quantification of epicardial and thoracic adipose tissue from non-contrast ct,” IEEE transactions on medical imaging, vol. 37, no. 8, pp. 1835– 1846, 2018.

A. Bergamo, L. Torresani, and A. Fitzgibbon, “Picodes: Learning a compact code for novel-category recognition,” Advances in neural information processing systems, vol. 24, 2011.

A. Prasoon, K. Petersen, C. Igel, F. Lauze, E. Dam, and M. Nielsen, “Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network,” in International conference on medical image computing and computer-assisted intervention. Springer, 2013, pp. 246– 253.

H. R. Roth, L. Lu, A. Seff, K. M. Cherry, J. Hoffman, S. Wang, J. Liu, E. Turkbey, and R. M. Summers, “A new

5 d representation for lymph node detection using random sets of deep convolutional neural network observations,” in International conference on medical image computing and computer-assisted intervention. Springer, 2014, pp. 520– 527.

R. Fakoor, F. Ladhak, A. Nazi, and M. Huber, “Using deep learning to enhance cancer diagnosis and classification,” in Proceedings of the international conference on machine learning, vol. 28. ACM, New York, USA, 2013, pp. 3937–3949.

Q. Dou, L. Yu, H. Chen, Y. Jin, X. Yang, J. Qin, and P.-A. Heng, “3d deeply supervised network for automated

segmentation of volumetric medical images,” Medical image analysis, vol. 41, pp. 40–54, 2017.

S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural computation, vol. 9, no. 8, pp. 1735–1780, 1997.

N. Srivastava, E. Mansimov, and R. Salakhudinov, “Unsupervised learning of video representations using lstms,” in International conference on machine learning. PMLR, 2015, pp. 843–852.

X. Shi, Z. Chen, H. Wang, D.-Y. Yeung, W.-K. Wong, and W.-c. Woo, “Convolutional lstm network: A machine

learning approach for precipitation nowcasting,” Advances in neural information processing systems, vol. 28, 2015.

J. Cai, L. Lu, Y. Xie, F. Xing, and L. Yang, “Improving deep pancreas segmentation in ct and mri images via recurrent neural contextual learning and direct loss function,” arXiv preprint arXiv:1707.04912, 2017.

O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in International Conference on Medical image computing and computer-assisted intervention. Springer, 2015, pp. 234–241.

J. Chen, L. Yang, Y. Zhang, M. Alber, and D. Z. Chen, “Combining fully convolutional and recurrent neural networks for 3d biomedical image segmentation,” Advances in neural information processing systems, vol. 29, 2016.

M. F. Stollenga, W. Byeon, M. Liwicki, and J. Schmidhuber, “Parallel multi-dimensional lstm, with application to fast biomedical volumetric image segmentation,” Advances in neural information processing systems, vol. 28, 2015.

D. Cheng and M. Liu, “Combining convolutional and recurrent neural networks for alzheimer’s disease diagnosis using pet images,” in 2017 IEEE International Conference on Imaging Systems and Techniques (IST). IEEE, 2017, pp. 1–5.

R. P. Poudel, P. Lamata, and G. Montana, “Recurrent fully convolutional neural networks for multi-slice mri cardiac segmentation,” in Reconstruction, segmentation, and analysis of medical images. Springer, 2016, pp. 83–94.

D. J. Rezende, S. Mohamed, and D. Wierstra, “Proceedings of the 31st international conference on international conference on machine learning,” 2014.

J. Koutnik, K. Greff, F. Gomez, and J. Schmidhuber, “A clockwork rnn,” in International Conference on Machine Learning. PMLR, 2014, pp. 1863–1871.

Y. Xie, Z. Zhang, M. Sapkota, and L. Yang, “Spatial clockwork recurrent neural network for muscle perimysium segmentation,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2016, pp. 185–193.

D. Ciresan, A. Giusti, L. Gambardella, and J. Schmidhuber, “Deep neural networks segment neuronal membranes in electron microscopy images,” Advances in neural information processing systems, vol. 25, 2012.

P. T. Truc, M. A. Khan, Y.-K. Lee, S. Lee, and T.-S. Kim, “Vessel enhancement filter using directional filter bank,” Computer Vision and Image Understanding, vol. 113, no. 1, pp. 101–112, 2009.