Skip to main content

Dual-plane coupled phase retrieval for non-prior holographic imaging

Abstract

Accurate depiction of waves in temporal and spatial is essential to the investigation of interactions between physical objects and waves. Digital holography (DH) can perform quantitative analysis of wave–matter interactions. Full detector-bandwidth reconstruction can be realized based on in-line DH. But the overlapping of twin images strongly prevents quantitative analysis. For off-axis DH, the object wave and the detector bandwidth need to satisfy certain conditions to perform reconstruction accurately. Here, we present a reliable approach involving a coupled configuration for combining two in-line holograms and one off-axis hologram, using a rapidly converging iterative procedure based on two-plane coupled phase retrieval (TwPCPR) method. It realizes a fast-convergence holographic calculation method. High-resolution and full-field reconstruction by exploiting the full bandwidth are demonstrated for complex-amplitude reconstruction. Off-axis optimization phase provides an effective initial guess to avoid stagnation and minimize the required measurements of multi-plane phase retrieval. The proposed strategy works well for more extended samples without any prior assumptions of the objects including support, non-negative, sparse constraints, etc. It helps to enhance and empower applications in wavefront sensing, computational microscopy and biological tissue analysis.

Introduction

Accurate detection of wave propagation in spatial and temporal domains is essential for the investigation of wave–matter interactions. Holographic imaging records the entire complex-amplitude wavefront by interference [1, 2], becoming a powerful technique of quantitative phase imaging. Holographic recording and replaying of waves have been widely applied in various fields, such as quantitative phase measurements for stain-free biological cells [3,4,5,6,7], wavefront shaping [8, 9], particle analysis and 3D tracking [10, 11], etc.

Two main holographic configurations exist, i.e., off-axis and in-line holography. Off-axis holography can achieve separation of the object wave and conjugate wave by introducing a tilted reference wave. It is widely used in phase microscopic imaging and instruments [12,13,14,15,16]. The maximum bandwidth of the sample should be less than a half of the bandwidth of the detector [17]. Nevertheless, the in-line configuration is affected by the fact that the main ray of the object wave and its conjugate wave share the same optical path. The full bandwidth utilization of the detector can be achieved but the superposition of twin images interferes with the quantitative amplitude and phase map. It has been applied in live cell observation [18, 19] and the imaging of whole pathological sections [20,21,22,23]. Several strategies have been reported for extracting the object phase including single-plane phase retrieval [24,25,26,27,28], multi-image phase retrieval [22, 23, 29,30,31,32,33,34,35,36,37,38,39,40,41] and non-iterative method [42,43,44,45,46]. The single-plane method carries out an iterative procedure between the measured plane and the estimated plane. It requires prior constrains of the object to escape local convergence in the iterative procedure. The multi-distance phase retrieval (MPR) method can achieve high-fidelity and stable reconstruction at the expense of measuring many observation planes through axial scanning [30, 31, 34,35,36,37,38,39,40,41]. Object-based constraints can be transferred to detection-based constraints without prior assumption. The accuracy of MPR highly depends on the number of measurements. When the paraxial approximation is satisfied, the distribution of the object's diffraction field at different distances is approximately a transversal elongation effect; thus, the hologram at another distance can be obtained by stretching the hologram [47].

Phase retrieval (PR) solves the inverse problem of nonconvex optimization under the known constraints with an iterative procedure [48]. The convergence of nonconvex optimization suffers from phase-stagnation problem with a limited initial guess. The support prior, sparsity assumption, non-negative assumption or random modulation can help to escape local convergence [49,50,51,52,53,54]. The phase solution of transport of intensity equation (TIE) between multiple planes can be considered as the initial phase guess to assist the convergence of iterative reconstruction [22, 55, 56]. Accurately solving the TIE initial-phase (TP) estimation requires imposing boundary conditions and certain approximations [57]. Higher convergence speed can be obtained by using off-axis optimization phase in the hologram plane while prior knowledge and non-negative constraints still need to be imposed on the object [49, 58,59,60,61]. Here, we propose a two-plane coupled phase retrieval (TwPCPR) method to achieve stable and versatile spatial complex-amplitude reconstruction. No constraint or prior knowledge of the object is needed in the proposed approach. Two in-line holograms at two distances z 1 and z 2 and one off-axis hologram at z 1 (or z 2) are recorded with the hybrid optical setup. It realizes a fast-convergence holographic calculation method.

Essentially, all the constraints of the TwPCPR method are derived from measurements without any prior constraints of the object, making it expand the ability to become a wavefront sensor. Off-axis optimization phase provides an effective initial guess to avoid stagnation and minimize the required measurements of the MPR method. Two imaging sensors capture holograms simultaneously to avoid the mechanical shift. We demonstrate the superiority of the proposed method by reporting imaging reconstruction of a variety of objects, i.e., an amplitude resolution target, phase resolution targets and biological samples, using both numerical simulations and experiments.

Materials and methods

The optical setup coupled DH system

The geometrical configuration of the lensless hybrid holographic system is shown in Fig. 1(a), and it also includes microscopic mode, respectively. The light source is a He-Ne laser with a wavelength of 632.8 nm. The illumination plane wave is divided into two beams by using beam splitter (BS) 1. The imaging sensor chip has the resolution of 1200×1920 with a pixel size of 5.86 μm (QHY174, QHYCCD Co., Ltd.). The total field of view (FOV) of this lensless system is 7.032×11.251 mm2. Two sensors are used to detect holograms simultaneously without mechanical shift. The system includes an in-line device and an off-axis device. They are combined by BS2 and switched by a shutter. In the lensless system, the sample is placed in front of BS2, and the reference wave illuminates from its adjacent surface. The distance between the object and the sensor can be adjusted by changing the size of the BS. In the microscopic system, the parameters of the microscope objective (MO) are 10× Mitutoyo Plan Apo infinity corrected objective with 0.28 NA (MY10X-803, Thorlabs). The MO is combined with a tube lens (TL) to form a microscopic imaging system. The focused positions magnified object can be adjusted by axially moving the sample. The sample is placed before the MO and the focused image can be directly obtained by the detectors.

Fig. 1
figure 1

a Optical setup for recording a hologram. b1 The TwPCPR process, where is the in-line recording at distance z 1, is the in-line recording at distance z 2, and is the off-axis recording at distance z 2. b2 Bandwidth limitation of holography in normalized coordinates, where Δ is the pixel size of the camera, NA is numerical aperture, and λ is wavelength. b3 Reconstructed Peak Signal-to-Noise Ratio (PSNR) for different holographic imaging methods. c Reconstructions for different holographic imaging methods

The TwPCPR principle

The distribution of the hologram is I = | P(O)+ R|2. O and R are the distributions of the object and reference waves, respectively, and P is the propagation vector from the object plane to the hologram plane. The MPR method receives N holograms as input, and the phase field is initially unknown. The complex-amplitude field is solved to make the current estimate closely fit the input actual captured holograms, and the quantification is given by the objective function as follows [48]:

$$\hat{O}=\mathrm{argmin}\sum_{k=1}^N\left\Vert {I}_k-{\left[{P}_k(O)\right]}^2\right\Vert,$$
(1)

where . is the Euclidean norm, Ik is the intensity of the kth captured hologram, and O is the current estimated function corresponding to the object. Operator Pk is the transmission process from the object plane to the kth hologram plane. N is the number of detections. The process provides a relatively correct solution in early iterations but then overshoots, which can often be attributed to the nonconvex characteristic of phase retrieval [48]. The convergence depends on more known detection-based constraints. The lateral displacement error accumulates between each hologram as the number of measured holograms increases. Fewer constraints are desired to reduce the accumulation of errors, but having a weak convergence of iteration. Efficient sub-pixel registration can be achieved in the lateral displacement between different holograms [62,63,64].

The in-line and off-axis recording modes can be switched by the presence or absence of a reference wave by using the shutter, where the reference wave is \(R\left(x,y\right)=A\exp \left\{i\frac{2\pi }{\lambda}\left[x\sin \left({\theta}_x\right)+y\sin \left({\theta}_y\right)\right]\right\}\). Here, θx is the angle between the projection of the reference wave illumination direction on the xz plane and the z axis, and θy is the angle between the projection of the reference wave illumination direction on the yz plane and the z axis. The process of the TwPCPR method is shown in Fig. 1b1. Two in-line holograms at z1 and z2 and one off-axis hologram at z1 (or z2) are obtained for the reconstruction. Half of irradiation energy is lost before the camera by using BS. The bandwidth limitations of different holographic methods are shown at the bottom of Fig. 1b2. The numerical aperture (NA) of the system determines the optical bandwidth of the object wave. The reconstruction is also limited by the sensor pixel size based on the Nyquist theorem. The highest frequency in the horizontal or vertical direction of the wave collection in detector can be described as min{1.22NA/(), 1/(2Δ)} under the coherent diffraction limit [3], where M is the magnification, and Δ is the pixel size of the camera. One-dimensional is considered for analysis here. If \(\frac{2.44 NA}{M\lambda}\le \frac{1}{4\varDelta }\), the object wave can be completely separated from its conjugate wave and autocorrelation (AC) term in the spatial frequency domain (SFD). If \(\frac{1}{4\varDelta}\le \frac{2.44 NA}{M\lambda}\le \frac{1}{2\varDelta }\), the object wave can be separated from its conjugate wave, but it overlaps with its AC term to form a slight off-axis hologram [65]. For lensless imaging systems, the off-axis bandwidth requirement is usually not satisfied (See supplementary). However, an estimated low-frequency complex-amplitude envelope of the sample can be extracted from it. In Fig. 1b3 and c, an object is assumed with a spectrum of full camera’s bandwidth. 2Δ is the smallest detection period of the camera based on the Nyquist theorem. The in-line reconstruction is obtained by using back-propagation method. Full bandwidth reconstruction can be achieved but twin image is superimposed on the reconstructed object. The slight off-axis reconstruction is the inverse Fourier transform after filtering the 1st order spectrum under the circular pupil function with the radius of a quarter of camera’s bandwidth. Twin image is almost removed, but high-frequency details are missing and some artifacts remain in the object due to incomplete-bandwidth reconstruction. A faithful reconstruction of the TwPCPR method is shown as a result of combining the advantages of the two holographic configurations. It works for more extended samples without any prior assumptions in the object plane.

The specific optimization process is described by the following steps:

  • Step 0: Initialization. The size of each hologram is M 1 × M 1 pixels. The in-line holograms I 1 and I 2 are located at object-detector distances z 1 and z 2, respectively. The off-axis hologram is located at z 1 (or z 2). In the MPR method, the initial phase φ 0 are set to constant or random. In the TwPCPR method, the initial phase φ 0 comes from off-axis hologram. The diffraction wave is filtered in the SFD of the off-axis hologram. First, the off-axis hologram is performed by Fourier transform. Second, the 1st order spectrum is filtered by using a pupil function. The radius of the pupil function is one-sixth of the bandwidth for the camera (See supplementary). Thirdly, the inverse Fourier transform is performed in the filtering spectrum and the phase is initial phase φ 0. Then, the initial wave field at distance z 1 is

$${U}_1=\sqrt{I_1}\exp \left(i{\varphi}_0\right).$$
(2)

Step 1: The complex-amplitude field U 2 = t 2 exp( 2) at the distance z 2 is obtained from the complex-amplitude field U 1 by using the angular spectrum propagation method [2].

  • Step 2: The amplitude of U 2 is replaced with the square root of the intensity of the hologram I 2. The phase value is maintained. Operator \({P}_{z_1-{z}_2}\) represents the function of propagation from distances z 1 and z 2. The complex-amplitude field is obtained:

$${U}_2=\sqrt{I_2}\frac{P_{z_1-{z}_2}\left({U}_1\right)}{\left|{P}_{z_1-{z}_2}\left({U}_1\right)\right|}.$$
(3)
  • Step 3: The complex-amplitude field U 1 = t 1exp ( 1) is obtained from the complex-amplitude field U 2 by using the angular spectrum propagation method.

  • Step 4: The amplitude of U 1 is replaced with the square root of the intensity of the hologram I 1. The phase value is maintained. The complex-amplitude field U 1 is obtained:

$${U}_1=\sqrt{I_1}\frac{P_{z_1-{z}_2}^{-1}\left({U}_2\right)}{\left|{P}_{z_1-{z}_2}^{-1}\left({U}_2\right)\right|}.$$
(4)

The next iteration is calculated through steps 1–4. Then, back-propagation to the object plane is performed to achieve the reconstruction from the complex amplitude U 1 or U 2. The distances z 1 and z 2 are calculated by using the auto-focusing algorithm [10, 66]. The interval between two hologram planes can be determined in this system.

Samples for testing

Three types of samples are considered: an amplitude USAF-1951 resolution target, two phase resolution targets and two biological tissues, respectively. The amplitude USAF target is fabricated by etching lines onto a glass plate using nano processing methods. The phase object is the Quantitative Phase Microscopy Target (QPMT, Benchmark Technologies). It is a completely transparent measurable artifact which provides a well-characterized optical path difference for quantitative phase imaging. The optical path difference is achieved by increasing the thickness of pattern on the glass plate. It is made of an acrylate polymer (The refractive index is 1.52) on Corning Eagle XG Glass. The phase USAF-1951 resolution target includes group 6-10 with the feature height of 250 nm. The other QPMT is an optically focus star on simulate circular structures with the feature height of 250 nm. The third type of sample includes two biological sections, one of which is a muscle cell section on the glass slide. It includes the transverse and longitudinal morphology of the skeletal muscle cells mainly composed of muscle fibers. The other is the mitotic section of horse roundworm fertilized egg section. It is drawn from the cross-sectional of the uterus of horse roundworm. The uterus contains cells at various stages of division.

Results and discussion

The TwPCPR method

Figure 2 shows the reconstruction of complex objects by using the proposed method and the MPR method. For the MPR method, constant initial phase and TIE initial phase (TP) are both considered. The simulation parameters are as follows: the wavelength is 500 nm, the pixel pitch is 6 μm, and the propagation distances of the three planes are 4.00, 4.05, and 4.10 cm, respectively. Figures 2a1 and a2 show the amplitude and phase of the object 1. Figure 2(b) is one of the three in-line holograms of the original scene. The pixels number of diffraction field is 1000×1000 and the central area with 400×400 pixels is shown. Figures 2c1-c4 are the amplitude-reconstructions by using the 2-plane MPR (2-MPR), 3-plane MPR (3-MPR), 3-plane MPR with TP (3-MPR-TP) and TwPCPR method with 20 iterations, respectively. Figures 2d1-d4 are the phase-reconstructions by using the 2-MPR, 3-MPR, 3-MPR-TP and TwPCPR method with 20 iterations, respectively. The constant initial phase is used in 2-MPR and 3-MPR method. The reconstructions by using random initial phase are presented in supplementary. The normalized mean square errors (MSEs) \({E}_s=\left[\sum_{ii}\sum_{jj}{\left|r\left( ii, jj\right)-{r}_0\Big( ii, jj\Big)\right|}^2\right]/\left[\sum_{ii}\sum_{jj}{\left|{r}_0\left( ii, jj\right)\right|}^2\right]\)of the reconstruction are calculated in Fig. 2, where r(ii, jj) is the estimated distribution and r 0(ii, jj) is the initial distribution. Figure 2e1 and e2 show the logarithm MSE of the reconstructed amplitude and phase with different numbers of iterations, respectively. The TP in the plane 2 are calculated by using the axial derivative of plane 1 and plane 3. The object 1 is centrally isolated in the image FOV. The hologram can be approximately regarded as the flat boundary, which is recovered regardless of the selected boundary conditions [57]. The universal solution is used to obtain the TP here [68]. The 2-MPR and 3-MPR method remain the crosstalk between the amplitude and phase. A higher convergence speed and better reconstructed quality can be achieved by increasing the sampling plane in the MPR method [31, 67]. The usual expectation is a reduction in the complexity with fewer detection planes but higher reconstructed quality. The TP can speed up convergence of MPR method and it effectively avoids the stagnation in the MPR method [22, 56, 57]. The TP and the off-axis initial guess perform initial input to minimize the required measurements. The cross-sections of the reconstructed amplitude and phase are shown below Fig. 2c1-d4, respectively. The phase errors of TP originate from the nonlinear components related to the finite difference approximation [55, 56]. The estimation using TP provides limited convergence assistance in this parameter of the system. Figure 2f1 and f2 show the amplitude and phase of the object 2 without flat boundary. Figure 2(g) is one of the three in-line holograms of the original scene. The whole diffraction field with 750×750 pixels is shown. Figure 2h1-h4 and i1-i4 are the reconstructed amplitude and phase by using the 2-MPR, 3-MPR, 3-MPR-TP and TwPCPR method with 20 iterations, respectively. The TwPCPR method shows the advantage of parameter-free of the imaging with insensitivity to the interval between different planes, boundary conditions, object assumptions and paraxial approximation. It is reflected in the reconstructed MSE of the amplitude and phase with different numbers of iterations in Fig. 2e1, e2, j1 and j2, respectively. The proposed TwPCPR method can achieve a lower MSE than those of the MPR methods after a few iterations.

Fig. 2
figure 2

Reconstruction of a complex scene. a1-a2 Ground-truth amplitude and phase of the original complex scene with ‘flat’ boundary. b Hologram of the object 1. c1-d4 The amplitude and phase reconstructions by using the 2-MPR, 3-MPR, 3-MPR-TP and TwPCPR method with 20 iterations, respectively. e1-e2 Logarithm MSE of the reconstructed amplitude and phase with different numbers of iterations in object 1. f1-f2 Ground-truth amplitude and phase of the original complex scene with random boundary. g Hologram of the object 2. h1-i4 The amplitude and phase reconstructions by using the 2-MPR, 3-MPR, 3-MPR-TP and TwPCPR method with 20 iterations, respectively. j1-j2 Logarithm MSE of the reconstructed amplitude and phase with different numbers of iterations in object 2

Reconstruction on pure amplitude objects

Figure 3(a) shows the lensless holographic system. The red lines represent the route of the illuminating wave. Figure 3b1 is one of the raw in-line holograms. The distance between the two diffraction planes of two sensors is 2.5 mm. For the MPR method, the distance interval between different hologram planes is 0.5 mm. Figure 3b2 is the raw off-axis hologram. Figure 3c1 is the reconstruction from the in-line hologram. It is the result from Fig. 3b1 by using back-propagation to the object plane. Figure 3c2 is the reconstruction from the off-axis hologram. The radius of the pupil function is one-sixth of the camera’s bandwidth (See supplementary). The advantages and disadvantages of the two types of holographic imaging are clearly shown. The in-line hologram provides a high-resolution reconstruction but fails to give a correct estimate of the object, while the off-axis hologram has the opposite function. The in-line reconstruction in Fig. 3c1 shows the best resolvable feature with all of group 5 (line width from 8.77 to 15.6 μm) and even in group 6, element 3 (line width 6.2 μm, close to the pixel size). The off-axis reconstruction in Fig. 3c2 shows the best resolvable feature with group 4, element 4 (line width 22.1 μm). The in-line reconstruction makes full use of the bandwidth of the entire camera to achieve the extreme resolution but with twin image. Figure 3(d) is the reconstruction achieved by using the TwPCPR method with only 5 iterations. Figure 3e1-e4 are enlargements of Fig. 3(d) by using the 2-MPR, 3-MPR, 3-MPR-TP and TwPCPR method, respectively. The TwPCPR method outputs contrast-enhanced images in which the artifacts are remarkably removed. The resolution of this system is close to the pixel size of the detector. The best resolvable feature corresponds to group 6 element 4 of USAF 1951 (6.2 μm line width). The minimum distance between the object and the sensor is the width of the BS.

Fig. 3
figure 3

Experimental reconstruction of the amplitude USAF resolution target. a Lensless holography system. b1 Raw measured in-line hologram. b2 Raw measured off-axis hologram in one plane of the raw in-line data. c1 Reconstruction from in-line hologram by using the back-propagation method. c2 Reconstruction from the off-axis hologram. d Reconstruction by using the TwPCPR method with 5 iterations. e1-e4 Zoomed reconstruction in (d) by using the 2-MPR, 3-MPR, 3-MPR-TP and TwPCPR method, respectively

Reconstruction for biological section

To further demonstrate the capability of complex-amplitude reconstruction, an experiment on skeletal muscle cells is performed in Fig. 4. The transverse and longitudinal morphology of the skeletal muscle cells are prepared in one specimen. The whole specimen can be detected in the area of sensor. Figure 4(a) shows the muscle cells on a glass slide. Figure 4b1 is the raw measured in-line hologram. Figure 4b2 is the raw off-axis hologram. Figure 4(c) shows the amplitude-reconstruction achieved by using the TwPCPR method with 5 iterations. Figures 4d1 and d2 are the reconstructed amplitudes by using the 3-MPR and 3-MPR-TP with 50 iterations, respectively. Figures 4(e)-(f) are the corresponding phase, respectively. The reconstructed phase is calculated by the phase unwrapping algorithm [69]. Observation field by using TwPCPR method includes the transverse and longitudinal morphology of the muscle cells. They can be clearly distinguished from the reconstructed amplitude and phase. Twin images are covered in the detailed texture in Fig. 4f1-f2. The reconstructions achieved by using the TwPCPR method show that it eliminates the noise artifacts and accomplishes contrast-enhanced reconstruction with fewer iterations.

Fig. 4
figure 4

Experimental reconstruction of muscle cells. a Muscle cells on a glass slide. b1 Raw measured in-line hologram. b2 Raw measured off-axis hologram in one plane. c Amplitude-reconstruction by using the TwPCPR method with 5 iterations. d1-d2 Amplitude reconstruction by using the 3-MPR and 3-MPR-TP method with 50 iterations, respectively. e Phase-reconstruction by using the TwPCPR method with 5 iterations. f1-f2 Phase reconstruction by using the 3-MPR and 3-MPR-TP method with 50 iterations, respectively. The scale bar is 200 μm

Reconstruction for microscopic imaging on quantitative phase target

At the aim to verify the universality of the TwPCPR method, the geometrical configuration of the hybrid DH microscopy imaging system is shown in Fig. 5(a). The principle of configuration is similar to Fig. 1(a), excepts that a microscopic system is considered between the sample and BS2. The distance difference between the two the two diffraction planes of two sensors is 3.3 mm. For the MPR method, the interval between different hologram planes is 1 mm. The bandwidth limit of this system belongs to the scope of in-line holography in Fig. 1b2 according to the bandwidth calculation (See supplementary). Figure 5(c) shows the reconstruction of QPMT with the feature height of 250 nm by using TwPCPR method with 5 iterations. Figure 5(d) shows the red area of USAF 1951 in Fig. 5(c) by using 3-MPR, 3-MPR-TP and TwPCPR method, respectively. The TwPCPR method outputs the detected height of the pattern with only 5 iterations. According to the refractive index of the QPMT and the wavelength of source, the pattern height can be calculated as 249.58 nm. The best resolvable feature corresponds to group 8 element 5 of USAF 1951 (1.23 μm line width). Figure 5(e) shows the red area of optically focus star in Fig. 5(c) by using 3-MPR, 3-MPR-TP and TwPCPR method, respectively. The TwPCPR method reflects the height of 249.06 nm with 5 iterations. The convergence of the MPR method is limited with a small number of captured planes in the score of in-line bandwidth limitation. The initial estimation of the off-axis phase can reduce the required number of captured planes for convergence.

Fig. 5
figure 5

Quantitative phase by using TwPCPR method in microscopic imaging system. a Hybrid DH microscopic system. b Quantitative phase target. c The reconstruction by using TwPCPR method with 5 iterations in (b). d The reconstruction of red area of USAF 1951 in (c) by using 3-MPR, 3-MPR-TP and TwPCPR method, respectively. e The reconstruction of red area of optically focus star in (c) by using 3-MPR, 3-MPR-TP and TwPCPR method, respectively

Reconstruction for microscopy imaging on biological sections

We demonstrate the biological imaging experiments of the TwPCPR method based on the hybrid DH microscopic system in Fig. 5(a). Figure 6(a) shows the reconstructed amplitude of the mitotic section of horse roundworm fertilized egg on the glass slide by different method. Figure 6(b) shows the corresponding phase. Some cells are distributed along the edge of original FOV without flat boundary condition. The red area (a1)-(a2) and (b1)-(b2) show the reconstructed amplitude of anaphase mitosis and telophase mitosis of the horse roundworm fertilized egg, respectively. The cell and nucleus of horse roundworm fertilized egg have not degenerated in the normal style. The phase reflects the thickness and refractive index of the cells. The chromosomes in the nucleus gradually begin to split from the equatorial plate to the poles in the anaphase in (a1) and (b1). The thickness of the nucleus increases significantly. A new nucleus is gradually formed in the telophase and the two daughter cells begin to separate, which is clearly shown in red area (a2) and (b2). The reconstructed phase by using MPR method only represent edge contours of the cells. The results of the quantitative phase microscopy and biological experimental validation show that the TwPCPR method can be combined with modern microscopy systems to achieve robust reconstruction of complex-amplitude with fast convergence.

Fig. 6
figure 6

Experimental reconstruction of the mitotic section of horse roundworm fertilized egg on the glass slide by using the 2-MPR method with 50 iterations, 3-MPR method with 50 iterations and TwPCPR method with 5 iterations in microscopic imaging system. a-b The reconstructed amplitude and phase by using TwPCPR method with 5 iterations, respectively. a1-a2 The reconstructed amplitude of anaphase mitosis and telophase mitosis of the horse roundworm fertilized egg in (a), respectively. b1-b2 The corresponding reconstructed phase in (a1)-(a2), respectively

The advantage of non-prior TwPCPR reconstruction without constrains on the object is that the spatial complex-amplitude field can be reconstructed even if the exact location of the object cannot be obtained, such as atmospheric turbulence and air disturbance. The TwPCPR method can also achieve precise wavefront detection of phase disturbance. But the TwPCPR method still suffers from a few limitations that need to be addressed in the future. Currently, this method captures three images to accurately recover a field. Time division method are required to obtain the off-axis hologram though two cameras are used without real-time calibration and registration of multi-image. The distance between the object and the sensor can be adjusted by changing the size of the BS. But it limits the numerical aperture of the lensless system due to cube shape of BS. With the development of integrated optics, BS by specially designing with large area and small thickness may be help to perform the TwPCPR method in pixel super-resolution with fast convergence, and then it can apply in lensless on-chip microscopy. Moreover, this method can only handle static aberrations because we calibrate aberrations prior to the measurement, and we assume that they remain unchanged during the acquisition process. An optimization framework to automatically separate the object and aberrations without calibration is great interest to its applications in high-precision and real-time measurement.

Conclusions

We demonstrate that the proposed TwPCPR method performs a reliable, rapidly converging iterative procedure by involving only two in-line holograms and one off-axis hologram between only two planes. Full-bandwidth reconstruction can be realized based on in-line holography. It realizes a fast-convergence holographic calculation method. The reported results show robust reconstructions of the complex-amplitude fields of different types of objects by combining the advantages of in-line and off-axis holography. Off-axis optimization phase provides an effective initial guess to avoid stagnation and minimize the required measurements of multi-plane phase retrieval. This universal complex-amplitude reconstruction method works well for more extended samples. The TwPCPR method does not require any prior assumptions of objects including support, non-negative, sparse constraints, etc. It realizes both amplitude and phase solutions for complex-amplitude wave field analysis and imaging. Experimentally, the high phase reconstructed accuracy enables this method to have important applications in high-resolution wavefront sensing. It can be easily combined with modern microscopy system to realize complex-amplitude microscopy imaging. The versatility of TwPCPR method can significantly improve the performance of existing technologies such as adaptive optics. This technique helps to perform improvements in DH and quantitative phase imaging, thus enlarging and empowering applications in wavefront sensing, computational microscopy and biological tissue analysis.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

DH:

Digital holography

References

  1. Yaroslavski LP, Merzlyakov NS. Methods of Digital Holography. New York: Consultants Bureau; 1980.

    Book  Google Scholar 

  2. Goodman JW. Introduction to Fourier optics. 3rd ed. Roberts & Company Publishers; 2005.

  3. Cotte Y, Toy F, Jourdain P, Pavillon N, Boss D, Magistretti P, et al. Marker-free phase nanoscopy. Nat. Photonics. 2013;7:113–7.

    Article  Google Scholar 

  4. Park YK, Depeursinge C, Popescu G. Quantitative phase imaging in biomedicine. Nat. Photonics. 2018;12:578–89.

    Article  Google Scholar 

  5. Marquet P, Rappaz B, Magistretti PJ, Cuche E, Emery Y, Colomb T, et al. Digital holographic microscopy: a noninvasive contrast imaging technique allowing quantitative visualization of living cells with subwavelength axial accuracy. Opt. Lett. 2005;30:468–70.

    Article  Google Scholar 

  6. Kemper B, von Bally G. Digital holographic microscopy for live cell applications and technical inspection. Appl. Opt. 2008;47:A52–61.

    Article  Google Scholar 

  7. Fan Y, Li JJ, Lu LP, Sun JS, Hu Y, Zhang JL, et al. Smart computational light microscopes (SCLMs) of smart computational imaging laboratory (SCILab). PhotoniX. 2021;2:19.

    Article  Google Scholar 

  8. Mosk AP, Lagendijk A, Lerosey G, Fink M. Controlling waves in space and time for imaging and focusing in complex media. Nat. Photonics. 2012;6:283–92.

    Article  Google Scholar 

  9. Park JH, Park J, Lee KR, Park YK. Disordered optics: exploiting multiple light scattering and wavefront shaping for nonconventional optical elements. Adv. Mater. 2019;32:1903457.

    Article  Google Scholar 

  10. Memmolo P, Miccio L, Paturzo M, Caprio GD, Coppola G, Netti PA, et al. Recent advances in holographic 3D particle tracking. Adv. Opt. Photon. 2015;7:713–55.

    Article  Google Scholar 

  11. Su TW, Xue L, Ozcan A. High-throughput lensfree 3D tracking of human sperms reveals rare statistics of helical trajectories. Proc. Natl. Acad. Sci. USA. 2012;109:16018–22.

    Article  Google Scholar 

  12. Bhaduri B, Edwards C, Pham H, Zhou RJ, Nguyen TH, Goddard LL, et al. Diffraction phase microscopy: principles and applications in materials and life sciences. Adv. Opt. Photon. 2014;6:57–119.

    Article  Google Scholar 

  13. Toda K, Tamamitsu M, Ideguchi T. Adaptive dynamic range shift (ADRIFT) quantitative phase imaging. Light: Sci. Appl. 2021;10:1.

    Article  Google Scholar 

  14. Shaked NT, Micó V, Trusiak M, Kuś A, Mirsky SK. Off-axis digital holographic multiplexing for rapid wavefront acquisition and processing. Adv. Opt. Photon. 2020;12:556–611.

    Article  Google Scholar 

  15. Girshovitz P, Shaked NT. Doubling the field of view in off-axis low-coherence interferometric imaging. Light.: Sci. Appl. 2014;3:e151.

    Article  Google Scholar 

  16. Bianco V, Mandracchia B, Marchesano V, Pagliarulo V, Olivieri F, Coppola S, et al. Endowing a plain fluidic chip with micro-optics: a holographic microscope slide. Light: Sci. Appl. 2017;6:e17055.

    Article  Google Scholar 

  17. Baek YS, Lee KR, Shin S, Park YK. Kramers–Kronig holographic imaging for high-space-bandwidth product. Optica. 2019;6:45–51.

    Article  Google Scholar 

  18. Herve L, Cioni O, Blandin P, Navarro F, Menneteau M, Bordy T, et al. Multispectral total-variation reconstruction applied to lens-free microscopy. Biomed. Opt. Express. 2018;9:5828–36.

    Article  Google Scholar 

  19. Ryu D, Wang ZH, He K, Zheng GA, Horstmeyer R, Cossairt O. Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video. Biomed. Opt. Express. 2017;8:1981–95.

    Article  Google Scholar 

  20. Jiang S, Guan ML, Wu JM, Fang GC, Xu XZ, Jin DY, et al. Frequency-domain diagonal extension imaging. Adv. Photonics. 2020;2:036005.

    Google Scholar 

  21. Greenbaum A, Luo W, Su TW, Göröcs Z, Xue L, Isikman SO, et al. Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy. Nat. Methods. 2012;9:889–95.

    Article  Google Scholar 

  22. Greenbaum A, Zhang YB, Feizi A, Chung PL, Luo W, Kandukuri SR, et al. Wide-field computational imaging of pathology slides using lensfree on-chip microscopy. Sci. Transl. Med. 2014;6:267ra175.

    Article  Google Scholar 

  23. Zhang YB, Shin Y, Sung K, Yang S, Chen H, Wang HD, et al. 3D imaging of optically cleared tissue using a simplified CLARITY method and on-chip microscopy. Sci. Adv. 2017;3:e1700553.

    Article  Google Scholar 

  24. Latychevskaia T, Fink H–W. Solution to the twin image problem in holography. Phys. Rev. Lett. 2007; 98: 233901.

  25. Huang ZZ, Cao LC. Bicubic interpolation and extrapolation iteration method for high resolution digital holographic reconstruction. Opt. Lasers. Eng. 2020;130:106090.

    Article  Google Scholar 

  26. Khare K, Ali PTS, Joseph J. Single shot high resolution digital holography. Opt. Express. 2013;21:2581–91.

    Article  Google Scholar 

  27. Singh M, Khare K. Single-shot full resolution region-of-interest (ROI) reconstruction in image plane digital holographic microscopy. J. Mod. Opt. 2018;65:1127–34.

    Article  Google Scholar 

  28. Huang ZZ, Cao LC. Faithful digital holographic reconstruction using a sparse sensor array. Appl. Phys. Lett. 2020;117:031105.

    Article  Google Scholar 

  29. Luo W, Greenbaum A, Zhang YB, Ozcan A. Synthetic aperture-based on-chip microscopy. Light: Sci. Appl. 2015;4:e261.

    Article  Google Scholar 

  30. Zhang Y, Pedrini G, Osten W, Tiziani HJ. Whole optical wave field reconstruction from double or multi in-line holograms by phase retrieval algorithm. Opt. Express. 2003;11:3234–41.

    Article  Google Scholar 

  31. Greenbaum A, Ozcan A. Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy. Opt. Express. 2012;20:3129–43.

    Article  Google Scholar 

  32. Zheng GA, Horstmeyer R, Yang CH. Wide-field, high-resolution Fourier ptychographic microscopy. Nat. Photonics. 2013;7:739–45.

    Article  Google Scholar 

  33. Ou XZ, Horstmeyer R, Yang CH, Zheng GA. Quantitative phase imaging via Fourier ptychographic microscopy. Opt. Lett. 2013;38:4845–8.

    Article  Google Scholar 

  34. Luo W, Zhang YB, Feizi A, Göröcs Z, Ozcan A. Pixel super-resolution using wavelength scanning. Light: Sci. Appl. 2016;5:e16060.

    Article  Google Scholar 

  35. Wang HD, Göröcs Z, Luo W, Zhang YB, Rivenson Y, Bentolila LA, et al. Computational out-of-focus imaging increases the space–bandwidth product in lens-based coherent microscopy. Optica. 2016;3:1422–9.

    Article  Google Scholar 

  36. Guo C, Shen C, Li Q, Tan JB, Liu ST, Kan XC, et al. A fast-converging iterative method based on weighted feedback for multi-distance phase retrieval. Sci. Rep. 2018;8:6436.

    Article  Google Scholar 

  37. Latychevskaia T. Iterative phase retrieval for digital holography: tutorial. J. Opt. Soc. Am. A. 2019;36:D31–40.

    Article  Google Scholar 

  38. Guo C, Liu XM, Kan XC, Zhang FL, Tan JB, Liu ST, et al. Lensfree on-chip microscopy based on dual-plane phase retrieval. Opt. Express. 2019;27:35216–29.

    Article  Google Scholar 

  39. Guo C, Wei C, Tan JB, Chen K, Liu ST, Wu Q, et al. A review of iterative phase retrieval for measurement and encryption. Opt. Lasers. Eng. 2017;89:2–12.

    Article  Google Scholar 

  40. Rodrigo JA, Duadi H, Alieva T, Zalevsky Z. Multi-stage phase retrieval algorithm based upon the gyrator transform. Opt. Express. 2010;18:1510–20.

    Article  Google Scholar 

  41. Pedrini G, Osten W, Zhang Y. Wave-front reconstruction from a sequence of interferograms recorded at different planes. Opt. Lett. 2005;30:833–5.

    Article  Google Scholar 

  42. Yamaguchi I, Zhang T. Phase-shifting digital holography. Opt. Lett. 1997;22:1268–70.

    Article  Google Scholar 

  43. Awatsuji Y, Sasada M, Kubota T. Parallel quasi-phase shifting digital holography. Appl. Phys. Lett. 2004;85:1069–71.

    Article  Google Scholar 

  44. Awatsuji Y, Fujii A, Kubota T, Matoba O. Parallel three-step phase-shifting digital holography. Appl. Opt. 2006;45:2995–3002.

    Article  Google Scholar 

  45. Awatsuji Y, Tahara T, Kaneko A, Koyama T, Nishio K, Ura S, et al. Parallel two-step phase-shifting digital holography. Appl. Opt. 2008;47:D183–9.

    Article  Google Scholar 

  46. Shen C, Liang MS, Pan A, Yang CH. Non-iterative complex wave-field reconstruction based on Kramers–Kronig relations. Photon. Res. 2021;9:1003–12.

    Article  Google Scholar 

  47. Paturzo M, Memmolo P, Finizio A, Näsänen R, Naughton TJ, Ferraro P. Synthesis and display of dynamic holographic 3D scenes with real-world objects. Opt. Express. 2010;18:8806–15.

    Article  Google Scholar 

  48. Shechtman Y, Eldar YC, Cohen O, Chapman HN, Miao JW, Segev M. Phase Retrieval with Application to Optical Imaging: A contemporary overview. IEEE Signal Process. Mag. 2015;32:87–109.

    Article  Google Scholar 

  49. Wang FP, Wang DY, Rong L, Wang YX, Zhao J. Single-shot dual-wavelength in-line and off-axis hybrid digital holography. Appl. Phys. Lett. 2018;112:091903.

    Article  Google Scholar 

  50. Rivenson Y, Wu YC, Wang HD, Zhang YB, Feizi A, Ozcan A. Sparsity-based multi-height phase recovery in holographic microscopy. Sci. Rep. 2016;6:37862.

    Article  Google Scholar 

  51. Fannjiang A, Liao WJ. Phase retrieval with random phase illumination. J. Opt. Soc. Am. A. 2012;29:1847–59.

    Article  Google Scholar 

  52. Kashter Y, Vijayakumar A, Rosen J. Resolving images by blurring: superresolution method with a scattering mask between the observed objects and the hologram recorder. Optica. 2017;4:932–9.

    Article  Google Scholar 

  53. Kwon H, Arbabi E, Kamali S, Faraji-Dana M, Faraon A. Computational complex optical field imaging using a designed metasurface diffuser. Optica. 2018;5:924–31.

    Article  Google Scholar 

  54. Eguchi A, Brewer J, Milster T. Optimization of random phase diversity for adaptive optics using an LCoS spatial light modulator. Appl. Opt. 2019;58:6834–40.

    Article  Google Scholar 

  55. Waller L, Tian L, Barbastathis G. Transport of Intensity phase-amplitude imaging with higher order intensity derivatives. Opt. Express. 2010;18:12552–61.

    Article  Google Scholar 

  56. Zuo C, Sun JS, Zhang JL, Hu Y, Chen Q. Lensless phase microscopy and diffraction tomography with multi-angle and multi-wavelength illuminations using a LED matrix. Opt. Express. 2015;23:14314–28.

    Article  Google Scholar 

  57. Zuo C, Li JJ, Sun JS, Fan Y, Zhang JL, Lu LP, et al. Transport of intensity equation: a tutorial. Opt. Lasers. Eng. 2020;135:106187.

    Article  Google Scholar 

  58. Ozsoy-Keskinbora C, Boothroyd CB, Dunin-Borkowski RE, Van Aken PA, Koch CT. Hybridization approach to in-line and off-axis (electron) holography for superior resolution and phase sensitivity. Sci. Rep. 2014;4:7020.

    Article  Google Scholar 

  59. Orzó L. High speed phase retrieval of in-line holograms by the assistance of corresponding off-axis holograms. Opt. Express. 2015;23:16638–49.

    Article  Google Scholar 

  60. Wang FP, Wang DY, Panezai S, Rong L, Wang YX, Zhao J. Imaging on the surfaces of an uneven thickness medium based on hybrid phase retrieval with the assistance of off-axis digital holography. Opt. Commun. 2017;401:59–65.

    Article  Google Scholar 

  61. Zhao Y, Vandenrijt J-F, Kirkove M, Georges M. Iterative phase-retrieval-assisted off-axis terahertz digital holography. Appl. Opt. 2019;58:9208–16.

    Article  Google Scholar 

  62. Guizar-Sicairos M, Thurman ST, Fienup JR. Efficient subpixel image registration algorithms. Opt. Lett. 2008;33:156–8.

    Article  Google Scholar 

  63. Zhang JL, Sun JS, Chen Q, Li JJ, Zuo C. Adaptive pixel-super-resolved lensfree in-line digital holography for wide-field on-chip microscopy. Sci. Rep. 2017;7:11777.

    Article  Google Scholar 

  64. Shen C, Guo C, Geng Y, Tan JB, Liu ST, Liu ZJ. Noise-robust pixel-super-resolved multi-image phase retrieval with coherent illumination. J. Opt. 2018;20:115703.

    Article  Google Scholar 

  65. Dardikman G, Shaked NT. Is multiplexed off-axis holography for quantitative phase imaging more spatial bandwidth-efficient than on-axis holography? [Invited]. J. Opt. Soc. Am. A. 2019;36:A1–A11.

    Article  Google Scholar 

  66. Dubois F, Schockaert C, Callens N, Yourassowsky C. Focus plane detection criteria in digital holography microscopy by amplitude analysis. Opt. Express. 2006;14:5895–908.

    Article  Google Scholar 

  67. Huang ZZ, Kuang CF, Xu L, Cao LC. Multiplane digital holography based on extrapolation iterations. Opt. Commun. 2021;481:126526.

    Article  Google Scholar 

  68. Zhang JL, Chen Q, Sun JS, Tian L, Zuo C. On a universal solution to the transport-of-intensity equation. Opt. Lett. 2020;45:3649–52.

    Article  Google Scholar 

  69. Bioucas-Dias J, Valadão G. Phase unwrapping via graph cut. IEEE Trans. Image Process. 2007;16:698–709.

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

We thank Yunhui Gao for imaging the sample.

Funding

National Natural Science Foundation of China (NSFC) (61827825).

Author information

Authors and Affiliations

Authors

Contributions

ZH and LC proposed the framework of this research. ZH and LC conducted the experiments. ZH, PM, PF carried out the computations and data processing, ZH, PM, PF, LC analysed and discussed the results. All the authors contributed to the writing of manuscript.

Corresponding authors

Correspondence to Pietro Ferraro or Liangcai Cao.

Ethics declarations

Ethics approval and consent to participate

There is no ethics issue for this paper.

Consent for publication

All authors agreed to publish this paper.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, Z., Memmolo, P., Ferraro, P. et al. Dual-plane coupled phase retrieval for non-prior holographic imaging. PhotoniX 3, 3 (2022). https://doi.org/10.1186/s43074-021-00046-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43074-021-00046-w

Keywords