The problem — Denoising, super-resolution, and restoration pipelines are routinely benchmarked by a single scalar computed against a clean reference. SSIM is the dominant choice: it correlates better with human perception than MSE or PSNR, and it is trivially available in every image-processing library. The problem is what it cannot see. In quantitative microscopy the reference image rarely exists — the photon-limited acquisition is the measurement — and even when a reference can be constructed, SSIM is intensity-weighted and spatially global: a denoiser can raise the score while eroding the texture and intensity statistics that encode cell morphology.
What it is / how it works — SSIM decomposes image similarity into three multiplicative components — luminance, contrast, and structural correlation — comparing local windows between a test image and a ground-truth reference. The decomposition is motivated by human visual system properties: the eye is sensitive to structural patterns rather than absolute intensities, and SSIM reflects that more faithfully than squared-error approaches. The result is a scalar in (−1, 1], where 1 means pixel-perfect agreement, scaled as a mean-SSIM (MSSIM) over all local windows. It was introduced by Wang et al. (2004) and remains the default benchmark for image restoration across computer vision and microscopy alike.
Where it breaks — Three failure modes matter in practice.
First, SSIM requires a noise-free reference. In fluorescence microscopy — especially single-molecule, low-photon, or live-cell imaging — the reference cannot be acquired without altering the experiment. Synthetic references introduce distribution shift; averaged-frame references corrupt temporal dynamics.
Second, SSIM is spatially global and intensity-weighted, so it is dominated by high-signal, large-area regions. In sparse biological images — isolated cells, low-density structures, subcellular puncta — structure corruption in the sparse regions contributes negligibly to the global score. A restoration model can smooth those structures toward background while posting a high MSSIM.
Third, and most consequentially for profiling pipelines, SSIM optimizes pixel similarity, not morphological fidelity. In Cell Painting, oversmoothing by a denoiser lifts SSIM while collapsing the texture and granularity features that encode phenotype; profile reproducibility (percent-replicating) can fall while SSIM rises. This is the level-decoupling problem described in image-quality-is-not-one-number: image-space quality is only the first of four nested quality levels, and a gain at the pixel level does not propagate to the readout level.