Linguistics

Independent component analysis

Philosophy

Principal component analysis

Component (thermodynamics)

Computer science

Image segmentation

Thermodynamics

Physics

Fusion

Pattern recognition (psychology)

Image (mathematics)

Image fusion

Artificial intelligence

Component analysis

Convolutional neural network

Computer vision

IEEE Signal Processing Letters

In this letter, a sparse representation (SR) model named convolutional sparsity based morphological component analysis (CS-MCA) is introduced for pixel-level medical image fusion. Unlike the standard SR model, which is based on single image component and overlapping patches, the CS-MCA model can simultaneously achieve multi-component and global SRs of source images, by integrating MCA and convolutional sparse representation (CSR) into a unified optimization framework. For each source image, in the proposed fusion method, the CSRs of its cartoon and texture components are first obtained by the CS-MCA model using pre-learned dictionaries. Then, for each image component, the sparse coefficients of all the source images are merged and the fused component is accordingly reconstructed using the corresponding dictionary. Finally, the fused image is calculated as the superposition of the fused cartoon and texture components. Experimental results demonstrate that the proposed method can outperform some benchmarking and state-of-the-art SR-based fusion methods in terms of both visual perception and objective assessment.

Medical Image Fusion via Convolutional Sparsity Based Morphological Component Analysis