Method / tool

deepImageJ

ImageJ/Fiji plugin that runs pre-trained deep-learning models from the BioImage Model Zoo inside a familiar GUI — handling pre-processing, inference, and post-processing in a zero-code workflow accessible to any microscopist.

The problem — Pre-trained deep-learning models for bioimage analysis are usually distributed as Python scripts and weight files. For the majority of microscopy users working inside Fiji or ImageJ, there is no practical path from a model repository to a running inference step — the tool they use daily and the ecosystem where models live are completely disconnected.

What it is / how it works — deepImageJ is an open-source Fiji plugin (Gómez-de-Mariscal et al., Nature Methods 2021) that bridges that gap. It runs models packaged in the BioImage Model Zoo format (bioimage.io) directly inside ImageJ, guiding the user through the full inference workflow: image pre-processing (normalisation, tiling, channel ordering), model prediction via a local TensorFlow or PyTorch runtime, and post-processing (thresholding, connected-components labelling). The plugin reads the model's description file — which specifies expected input/output shapes, pre/post-processing steps, and test tensors — so the user does not need to know the model architecture to run it correctly. Supported task types include semantic segmentation, instance segmentation, denoising, virtual staining, and object detection. Models exported from ZeroCostDL4Mic in bioimage.io format are directly deployable via deepImageJ.

Where it fits — deepImageJ is an inference consumer at the segment and preprocess stages — the ImageJ-native entry point to the model zoo ecosystem. It makes zoo models usable in the interactive platform that most biologists already have open.

Where it breaks — deepImageJ runs inference on full images or tiles; it does not offer training. Local Java/Python runtime setup can fail on machines with conflicting environments, and the plugin is sensitive to model format versions — a model packaged for an older bioimage.io spec may not load in newer releases. Tiling behaviour must be set correctly for very large images; incorrect overlap padding produces seam artifacts in the output.

deepImageJ runs a model as published — it does not validate that the model is fit for your data. Use test images from your own instrument and compare outputs against a known reference before trusting the plugin results in a production workflow.

References

Appears in these notes

  • Model Zoos for Bioimage Analysis — From a Zoo Model to a Validated WorkflowThe BioImage Model Zoo and community packaging tools make pre-trained models shareable, runnable, and reproducible across tools — solving distribution and provenance. They do not solve fitness: a downloaded model is a component, and the path from a zoo entry to a trustworthy readout still runs through validation.

← Back to the constellation