The problem — Bioimage models report softmax scores that look like probabilities but are not calibrated: a cell classified as mitotic with 0.91 confidence may be wrong 30% of the time on your plate layout, your cell line, your staining lot. That miscalibration is invisible until it propagates into a readout and corrupts a decision.
What it is / how it works — Conformal prediction converts a black-box classifier or regressor into a set predictor with a coverage guarantee. Given a small held-out calibration set, it computes nonconformity scores — how surprising each example is relative to the model — then finds the score threshold that achieves the target coverage (e.g., 90%) on that set. At inference, every prediction becomes a set of labels whose nonconformity scores fall below the threshold. The guarantee is marginal: across the calibration distribution, the true class is in the set at least 90% of the time. No distributional assumption, no retraining.
Where it fits in a pipeline — Conformal sets are most useful at the readout and report stages, where a model's output becomes an actionable call. A prediction set of size 1 is high-confidence; a set of size 4 flags an ambiguous cell that warrants human review or QC escalation. This makes conformal prediction a natural complement to uncertainty-drift-and-failure-modes: instead of monitoring raw confidence histograms, you monitor set-size distributions — a sudden increase in average set size is a leading indicator of distribution shift.
Where it breaks — The coverage guarantee holds under exchangeability, roughly meaning calibration and test data are drawn from the same distribution. If your run-to-run batch effects or reagent lots violate exchangeability, the guarantee weakens. For deployment in production imaging pipelines, this means calibration sets must be drawn from the same acquisition context as the production data — a requirement that connects directly to the concerns raised in validation-without-ground-truth.