Fig. 2

Deep learning-enhanced motion-affected synthetic and experimental data. a, Synthetic portrayal of spontaneous calcium dynamics within the mouse cortex without noise. b, Raw data degraded from the clean image. TP-SSL restoration (c) and MP-SSL restoration (d) of the low-SNR recording. The magnified neuron in the lower sections, depicted at various time points, is highlighted within yellow boxes, with the moving direction indicated by yellow arrows. Correct restoration via MP-SSL is marked by green arrowheads, while ghosted neurons resulting from TP-SSL are denoted by magenta arrowheads. e, The \({\varvec{y}}\)-\({\varvec{t}}\) views of the neuron exhibiting calcium signals and temporal shifts within a 15-second window. Also, see the orthogonal \({\varvec{x}}\)-\({\varvec{t}}\) views in Fig. S4. f, Tukey box-and-whisker plot illustrating spatiotemporal correlation changes in calcium data pre and post-denoising (n = 70 \({\varvec{x}}\)-\(\mathbf{y}\)-\({\varvec{t}}\) stacks). g, Improvement of the 3D SNR. Each line represents 1 of 70 spatiotemporal data. The overlay of a statistical Tukey box-and-whisker plot provides context. Correlation and SNR calculations reference clean stacks. h, Experimentally captured astrocyte image with a low SNR using the bidirectional resonant scan TPLSM. i, Image restored from the low-SNR image using the pretrained calcium MP-SSL network. j, Temporal average of the raw input frames (n = 300). Yellow boxes indicate the extracted neuron magnified in the insets. Magenta arrowhead indicates the vague neuron (h), while green arrowheads point to the clear neuron (i,j). k, Astrocyte images at a larger cortical depth. The TPLSM input and MP-SSL result are shown in the left and right portion, respectively. Error maps, RSP, and RSE values for raw input (l) and network output (m) were calculated in relation to the temporal average image. Column bar graph of SSIM (n) and \({\varvec{x}}\)-\(\mathbf{y}\) spatial correlation (o) calculated between each frame and the 300-frame average (n = 51 stacks with 300 temporal frames per stack from a depth range of 300–550 μm). Two-tailed Wilcoxon matched-pairs signed rank tests were applied between the raw input and MP-SSL output in f. g and n, and mean ± standard deviation (SD) was shown in n and o. Scale bars, 50 μm in d and 30 μm in the other images