A novel algorithm for PET and MRI fusion based on digital curvelet transform via extracting lesions on both images
Keywords:
Medical Image Fusion, MRI, PET, Digital Curvelet TransformAbstract
Background and aim: Merging multimodal images is a useful tool for accurate and efficient diagnosis and analysis in medical applications. The acquired data are a high-quality fused image that contains more information than an individual image. In this paper, we focus on the fusion of MRI gray scale images and PET color images.
Methods: For the fusion of MRI gray scale images and PET color images, we used lesion region extracting based on the digital Curvelet transform (DCT) method. As curvelet transform has a better performance in detecting the edges, regions in each image are perfectly segmented. Curvelet decomposes each image into several low- and high-frequency sub-bands. Then, the entropy of each sub-band is calculated. By comparing the entropies and coefficients of the extracted regions, the best coefficients for the fused image are chosen. The fused image is obtained via inverse Curvelet transform. In order to assess the performance, the proposed method was compared with different fusion algorithms, both visually and statistically.
Result: The analysis of the results showed that our proposed algorithm has high spectral and spatial resolution. According to the results of the quantitative fusion metrics, this method achieves an entropy value of 6.23, an MI of 1.88, and an SSIM of 0.6779. Comparison of these experiments with experiments of four other common fusion algorithms showed that our method is effective.
Conclusion: The fusion of MRI and PET images is used to gather the useful information of both source images into one image, which is called the fused image. This study introduces a new fusion algorithm based on the digital Curvelet transform. Experiments show that our method has a high fusion effect.
References
Javed U, Riaz MM, Ghafoor A, Ali SS, Cheema TA. MRI and PET Image Fusion Using Fuzzy Logic and
Image Local Features. Scientific World Journal. 2014; 2014: 708075. doi: 10.1155/ 2014/ 708075. PMID:
, PMCID: PMC3916105.
He C, Liu Q, Li H, Wang H. Multimodal medical image fusion based on IHS and PCA. Procedia
Engineering. 2010; 7: 280-5. doi: 10.1016/ j.prpeng.2010,11,045.
Malviya A, Bhirud S. Image Fusion of Digital Images. Entropy. 2009; 7(7.4735): 7.4955.
Ge Z, Wang B, Zhang L. Remote sensing image fusion based on Bayesian linear estimation. Sci China
Inform Sci. 2007; 50(2): 227-40. doi: 10.1007/ s11432-007-008-7.
Zhou H, Cheng Q, Zargham M, editors. Fast fusion of medical images based on Bayesian risk minimization
and pixon map. Computational Science and Engineering, 2009 CSE'09 International Conference; 2009;
IEEE. 2; 1086-91. doi: 10.1109/CSE.2009.59.
Tu TM, Su SC, Shyu HC, Huang PS. A new look at IHS-like image fusion methods. Information fusion.
; 2(3): 177-86. doi: 10.1016/s1566-2535(01)00036-7.
Hao-quan W, Hao X, editors. Multi-mode medical image fusion algorithm based on principal component
analysis. Computer Network and Multimedia Technology. 2009 CNMT 2009 International Symposium on;
: IEEE. 1-4. doi: 10.11.9/CNMT.2009.5374652.
Al-Azzawi NA, Sakim HAM, Wan Abdullah A, editors. An efficient medical image fusion method using
contourlet transform based on PCM. Industrial Electronics & Applications. 2009 ISIEA 2009 IEEE
Symposium on; 2009: IEEE.1; 11-14. doi: 10.1109/ISIEA.2009.5356493.
Cui Z, Zhang G, Wu J, editors. Medical image fusion based on wavelet transform and independent
component analysis. Artificial Intelligence. 2009 JCAI'09 International Joint Conference on; 2009: IEEE.
-3. doi: 10.1109/JCAI.169.
Zheng Y, Qin Z. Medical image fusion algorithm based on bidimensional empirical mode decomposition.
Journal of Software. 2009; 20(5): 1096-105. doi: 10.3724/SP.J1001.2009.03542.
Pajares G, Manuel de la Cruz J. A wavelet-based image fusion tutorial. Pattern recognition. 2004; 37(9):
-72. doi: 10.1016/j.patcog.2004.03.010.
Pradeep M, editor. Implementation of image fusion algorithm using MATLAB (LAPLACIAN
PYRAMID). Automation, Computing, Communication, Control and Compressed Sensing (iMac4s), 2013
International Multi-Conference on; 2013: IEEE. 165-8. doi: 10.1109/iMac4s.2013.6526401.
Kumar YK, editor. Three-Band MRI Image Fusion: A Curvelet Transform Approach. World Congress on
Medical Physics and Biomedical Engineering, September 7-12, 2009, Munich, Germany; 2010: Springer.
/4 :105-6. doi: 10.1007/978-3-642-03882-2_27.
Ali F, El-Dokany I, Saad A, Abd El-Samie FES. Curvelet fusion of MR and CT images. Progress In
Electromagnetics Research C. 2008; 3: 215-24. doi: 10.2528/PIERC08041305.
Sahu DK, Parsai M. Different Image Fusion Techniques–A Critical Review. International Journal of
Modern Engineering Research (IJMER). 2012; 2(5): 4298-301. doi: 10.1.1.417.139.
Stathaki T. Image fusion: algorithms and applications: Academic Press; 2011. ISBN: 978-0-12-372529-5. 17) Al-Wassai FA, Kalyankar NV, Al-Zuky AA. The IHS Transformations Based Image Fusion. Cmputer
vision and pattern recognition. 2011; 2(5). arXiv preprint arXiv:11074396. 2011.
Sasi NM, Jayasree V. Contrast Limited Adaptive Histogram Equalization for Qualitative Enhancement of
Myocardial Perfusion Images. Engineering. 2013; 5: 331-26. doi: 10.4236/eng.2013.510B066.
Donoho DL, Duncan MR, editors. Digital curvelet transform: strategy, implementation, and experiments.
AeroSense. 2000; 2000: International Society for Optics and Photonics: SPIE. doi: 10.1117/12.381679.
Hajeb Mohammad Alipour S, Rabbani H, Akhlaghi M. A new combined method based on curvelet
transform and morphological operators for automatic detection of foveal avascular zone. Signal, Image and
Video Processing. 2014; 8(2): 205-22. doi: 10.1007/s11760-013-0530-6.
Candes E, Demanet L, Donoho D, Ying L. Fast discrete curvelet transforms. Multiscale Modeling &
Simulation. 2006; 5(3): 861-99. doi: 10.1137/05064182X.
Do MN, Vetterli M. The finite ridgelet transform for image representation. IEEE Trans Image Process.
; 12(1): 16-28. doi: 10.1109/TIP.2002.806252, PMID: 18237876.
Esmaeili M, Rabbani H, Dehnavi A, Dehghani A. Automatic detection of exudates and optic disk in retinal
images using curvelet transform. Image Processing, IET. 2012; 6(7): 1005-13. doi: 10.1049/ietipr.2001.0333.
Hajeb Mohammad Alipour S, Rabbani H, Akhlaghi MR. Diabetic retinopathy grading by digital curvelet
transform. Comput Math Methods Med. 2012; 2012: 761901. doi: 10.1155/2012/761901, PMID:
Teng J, Wang X, Zhang J, Wang S, editors. Wavelet-based texture fusion of CT/MRI images. Image and
Signal Processing (CISP), 2010 3rd International Congress on; 2010: IEEE. 6: 2709-2713. doi:
1109/CISP.2010.564768.
Piella G. A general framework for multiresolution image fusion: from pixels to regions. Information fusion.
; 4(4): 259-80. doi: 10.1016/S1566-2535(03)00046-0.
Pajares G, De La Cruz JM. A wavelet-based image fusion tutorial: Pattern recognition. 2004; 37(9): 1855- 72. doi: 10.1016/j.patcog.2004.03.010.
Li T, Wang Y. Biological image fusion using a NSCT based variable-weight method: Information Fusion.
; 12(2): 85-92. doi: 10.1016/J.inffus.2010.03.007.
Savitha M, Jeyaseeli VS, Sindumathi S. Image Fusion with Guided Filtering. IEEE Trans Image Process.
; 22(7): 2864-75. doi: 10.1109/TIP.2013.2244222, PMID: 23372084.
Kim Y, Lee C, Han D, Kim Y, Kim Y. Improved additive-wavelet image fusion. Geoscience and Remote
Sensing Letters, IEEE. 2011; 8(2): 263-7. doi: 10.1109/LGRS.2010.2067192.
Published
Issue
Section
License
Copyright (c) 2020 KNOWLEDGE KINGDOM PUBLISHING
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
