Time Multiplexing Super Resolving Technique for Imaging from a Moving Platform
February 12th, 2014
A method for overcoming the optical diffraction limit is presented. The method includes a two-step process: optical phase retrieval using iterative Gerchberg-Saxton algorithm, and imaging system shifting followed by repetition of the first step. A synthetically increased lens aperture is generated along the direction of movement, yielding higher imaging resolution.
The overall goal of this procedure is to synthetically increase the lens aperture of a scanning imaging platform. This is accomplished by first capturing three low resolution, differently defocused images of a target while moving along the optical axis of the system. The second step is to shift the entire imaging system perpendicularly, and then take three defocused images of the target.
Next, shift the imaging system to the other side of the optical axis and capture three more defocused images of the target. The final step is to numerically retrieve the optical phases in order to determine the optical fields and then properly combine them to achieve a super resolved image. Ultimately, a synthetically increased lens aperture is generated along the direction of movement yielding higher imaging resolution.
The main advantage of the proposed technique over other time multiplexing super resolving approaches is that our technique is passive, and therefore it does not require projection of encoding patterns that are later unused to obtain the super resolved image, This experiment is normally performed in relative darkness. However, some of the video is filmed with the light on In order to better visualize the protocol, begin set up with the rough alignment of the laser beam expander lens and camera on the same optical axis. Mount both the lens and camera on a translation stage to allow for subtle movements perpendicular to the optical axis.
Additionally, mount the camera on a translation stage for small motion parallel to the optical axis. Turn on the laser and use an aperture iris to make sure the light passes through the center of the lens. Next, turn on the camera and use the linear Z stage to check the alignment of the laser beam.
When it is aligned, defocusing, the camera will only cause the spot to change its size, but will not cause lateral shift of the spot. After alignment has been completed, insert a US Air Force test target in front of the beam expander. Place the target so that light passing through it passes through the center of the lens.
Use the linear Z stage in order to focus the target. This initial xz position of the camera will serve as the anchor point. Once focus is achieved, insert the 0.1 inch square aperture and capture the first image of the target.
Now adjust the linear Z stage. Use it to shift the camera away from the target 0.2 inches. Capture a second image of the target, move the camera another 0.2 inches away.
Take a third image. These three images will be referred to as the B series. Return the camera to its original anchor position before proceeding.
After returning to the anchor position, begin to use the linear X stage shift. The entire imaging system laterally a distance of positive 0.1 inches. The imaging system is now off center of the laser beam.
Capture an image of the target from this position. Adjust the Z stage to move the camera away from the target 0.2 inches. Capture an image, then move it back another 0.2 inches.
Take a third image of the target. These three images will be referred to as the A series. Return the camera to the anchor position.
Starting at the anchor position, shift the camera negative 0.1 inches. Capture three more images at the same Z positions as the other series. These images will be the C series.
Since the camera captures only the field intensity, the optical phase information is lost. In order to recover it and find the optical field, make use of the numerical three planes method. Once the optical field of each image series is found, use the phenal free space integral to back propagate the optical field of the B series to the lens playing for the A series.
Make certain the field is shifted to reflect its position with respect to the optical axis. Free space propagate its optical field to the lens plane. Repeat the same steps for the C series below the optical axis.
Sum the three fields to combine them and synthetically increase the aperture size. Finally, free space propagate the resulting field to the image plane. The target used in the experiment was the negative 1951 USAF test target shown here in a high resolution image.
Compare this to the low resolution image taken at the anchor position on the optical axis. None of the resolution bars are visible in the super resolved image. The vertical bars are visible up to the third element on the right.
Because the aperture was only increased in the horizontal direction X, there is no improvement in resolution of the horizontal bars. After watching this video, you should have a good understanding of how to a passive super resolution system that synthetically increases the lens aperture by using the motion of the imaging platform and numerical computation. Although the demonstration you saw was on an optical bench, the proposed concept is feasible for real airborne imaging systems.
View the full transcript and gain access to thousands of scientific videos
Overview
This article presents a method for overcoming the optical diffraction limit through a two-step process involving optical phase retrieval and imaging system shifting. The technique allows for a synthetically increased lens aperture, resulting in enhanced imaging resolution.
Key Study Components
Area of Science
- Optical Imaging
- Super Resolution Techniques
- Phase Retrieval Methods
Background
- Optical diffraction limits the resolution of imaging systems.
- Traditional methods often require complex setups or active illumination.
- Passive techniques can simplify the imaging process.
- Understanding optical phase retrieval is crucial for improving resolution.
Purpose of Study
- To develop a passive method for increasing lens aperture.
- To enhance imaging resolution without complex encoding patterns.
- To demonstrate the feasibility of the technique for real-world applications.
Methods Used
- Capture low-resolution, defocused images while moving along the optical axis.
- Shift the imaging system perpendicularly and capture additional defocused images.
- Utilize numerical methods to retrieve optical phases and combine images.
- Free space propagate the resulting fields to achieve super resolution.
Main Results
- The proposed method successfully increases the effective lens aperture.
- Higher resolution images were obtained compared to low-resolution captures.
- Vertical resolution bars were visible up to the third element in the super resolved image.
- The technique is applicable to airborne imaging systems.
Conclusions
- The method provides a novel approach to passive super resolution.
- It simplifies the imaging process while enhancing resolution.
- The technique has potential applications in various imaging fields.
Frequently Asked Questions
Executive Industry Relevance
This technique addresses the challenge of achieving high-resolution imaging in dynamic environments where traditional optical systems are limited by diffraction and platform motion. By synthetically increasing the effective lens aperture through passive optical phase retrieval and controlled platform shifting, the method enhances predictive confidence in target detection and characterization. It supports early discovery workflows by enabling reliable imaging data collection from moving platforms, reducing mechanistic ambiguity in surveillance and reconnaissance applications.
Strategic Applications in Biopharma R&D
Early Discovery & Target Validation
- Scientific Value: Enables interrogation of spatial hypotheses by resolving fine structural details in imaged targets.
- Operational Value: Provides a passive approach that avoids complex illumination patterns, simplifying experimental setup.
- Predictive Value: Increases confidence in target identification through improved resolution without active encoding.
Screening & Assay Development
- Scientific Value: Generates quantitative optical field data suitable for downstream image analysis and pattern recognition.
- Operational Value: Produces reproducible, defocused image series that can be standardized across imaging runs.
- Scalability Value: Supports platform reuse by leveraging motion-based aperture synthesis rather than hardware modification.
Translational & Preclinical Research
- Translational Value: Maintains continuity from bench-top demonstration to potential airborne system deployment.
- Risk Mitigation: Reduces uncertainty in target classification by improving resolution along the direction of motion.
- Predictive Confidence: Enables better go/no-go decisions in imaging-dependent validation pipelines.
Pipeline & Workflow Integration
The method fits within the discovery continuum by enhancing imaging readiness during early hypothesis testing and supporting scalable data generation for lead identification stages.
- Discovery Biology: Supports hypothesis testing by resolving sub-diffraction features in target structures.
- Screening: Delivers assay-ready, quantitative image data through standardized defocused capture and phase retrieval.
- Analytics: Enables comparison of optical fields across conditions via numerical back-propagation and field combination.
- Translational Research: Connects optical bench validation to real-world airborne imaging feasibility.
- Enterprise Reuse: Functions as a reusable imaging enhancement capability rather than a single-use protocol.
Operational & Enterprise Impact
- Scientific Value: Increases predictive confidence in target validation through diffraction-limited resolution improvement.
- Operational Value: Ensures reproducibility and standardization via passive, motion-based image acquisition.
- Strategic Value: Reduces biological and technical risk in imaging-dependent discovery workflows.
- Portfolio Impact: Supports risk-adjusted prioritization by improving data quality for go/no-go assessments.
Implementation Considerations
- Requires expertise in optical physics, phase retrieval algorithms, and precision translation stages.
- Depends on stable laser illumination, beam alignment, and controlled platform movement along orthogonal axes.
- Necessitates cross-team standardization of image capture protocols and numerical processing pipelines.
- Involves adaptation considerations when translating from optical bench to airborne or satellite platforms.
- Limited to resolution enhancement along the direction of synthetic aperture movement, as demonstrated in the X-axis only.
