Open Access
28 April 2021 Compound eye image scanner optimally arranged for image combining and suppressing axial chromatic aberration by wavefront coding
Hiroyuki Kawano, Shigeru Takushima, Yoshitaka Toyoda, Miki Sugano, Taku Matsuzawa
Author Affiliations +
Abstract

A compound eye optical system design allows us to construct a compact image scanner with a large field of view and a large depth of field, both of which are beneficial for use in a copier’s flatbed scanner. Our prototypes are constructed of 32 or 28 imaging units, which are ommatidia, and the representations from the imaging units are electrically combined. Since the arrangement of the imaging units is a key factor in combining the images correctly without any loss at the boundaries, we discuss two types of arrangements along with results of their prototypes: a one-line arrangement of varying magnification imaging units and a two-line staggered arrangement of telecentric imaging units. We also discuss the effectiveness of wavefront coding (WFC) in suppressing chromatic aberration, which is caused using cheap refractive imaging units, along with experimental results of applying both cubic- and quartic-phase-modulated WFC.

1.

Introduction

A compound eye imaging system, which greatly reduces the size of optics, provides an abundant variety of new options in structures and functions.1,2 The document scanner used in a copier must be compact but with a wide field of view, have a high 600-dpi resolution, and work with a short object distance. Therefore, a system implementing compound eye optics has been applied in this field. Two types of optics have been used to create a whole image from plural images by ommatidia: directly creating an optically superimposed image and combining images in electrical processing.

In the first method, which creates an optically superimposed image, each unit image is erected by relaying an intermediate image. Anderson used two arrays of lenses to form an erect composite image3 for a close-up imaging system. Meyer et al.4 developed a 2D compact camera called oCley. For line image scanners, some patents adopt a refractive lens array5 or a reflective concave mirror lens array,6 thus making an erect optical image with identical magnification. The most commercially successful contact image scanner is a gradient index lens array,7 which is widely used in automated teller machines or automatic document feeders embedded in the paper-guide components of copiers. As documents flow in close contact with sensors, such applications need only a short depth of field (DOF). One merit of optically superimposing systems is that they do not need an image-combining process. On the other hand, such systems cannot afford a large DOF because the overlap of the images between adjacent imaging units becomes misaligned when the object distance changes. A copier’s flatbed scanner needs a large DOF because when a thick book is opened and placed down, a gap inevitably appears at the gutter between pages. Consequently, optically superimposing systems are unsuitable for flatbed scanners.

In the second method, which creates a whole image by combining images through electrical processing, plural imaging units reduce the images. Since it does not involve optically overlapped images between adjacent imaging units, a large DOF is possible if appropriate image processing combines the images. Brückner et al.8 developed a thin 2D camera called eClay using such an electrical combining process.

Here we develop a compact imaging scanner for use as a copier’s flatbed scanner. We previously developed two types of image scanners to achieve compactness: a lensless image scanner9 and a compound eye image scanner implementing the above electrical combining processing.10,11 Although the former type is very thin, its 300-dpi resolution is insufficient for a copier. The latter consists of plural reflective mirror imaging units, resulting in no chromatic aberration; however, high accuracy in the mirror shape and alignment, especially the tilt adjustment, is required. Therefore, in this report, we use refractive optics as imaging units in a compound eye scanner to lessen the sensitivity of assembly. Although refractive optics cause axial chromatic aberration, which appears as color blurring at the image’s edge, we suppress this effect by applying a wavefront coding (WFC) technique.

WFC, first reported by Dowski and Cathey,12 is effective for extending the DOF by distorting the wavefront with cubic-phase modulation and a successive deblurring process. Wach et al.13 showed that WFC also effectively suppresses axial chromatic aberration. Although cubic-phase WFC has a large effect on extending the DOF, the artifact in the deblurred image might be obtrusive when the restoration kernel mismatches the point spread function (PSF).14 The PSF of the cubic-phase WFC has direction dependence, and the modulation transfer function (MTF) along the diagonal direction tends to be null within the spatial-frequency pass band, which degrades the contrast of the restored image in the diagonal direction pattern.15 Therefore, various patterns of axially symmetric modulated WFC have been proposed, including a logarithmic function,16 a quartic function,17,18 and an annular phase mask.19

In this report, we present three key contributions: (a) a compound eye optical system can be applied to an image scanner product that requires compactness and high image quality, shown by specific design examples and the evaluation results of prototypes. (b) By applying a WFC technique to the compound eye optics, the imaging units can have good image quality despite their simple structure of just two plastic lenses. (c) Prototypes leveraging cubic and quartic WFC are compared in real images, for the first time to the best of our knowledge.

First, we discuss the optimal arrangement of our compound eye image scanner. We designed and fabricated two different layouts: a one-line arrangement of varying magnification imaging units and a two-line staggered arrangement of telecentric imaging units (Fig. 1). Second, we discuss the effects and side-effects of cubic- and quartic-phase-modulated WFC by comparing real images produced by prototypes. Although there has been much research on WFC regarding elemental technology and image simulation, there are only very few case examples of applying WFC in industry. A comparison of the characteristics of cubic and quartic WFC has been reported using simulation images.20 That study showed that cubic WFC extends the DOF farther, whereas quartic WFC does not generate angular-dependent image quality as cubic WFC does. Accordingly, we demonstrate a compound eye optical system with practical use of WFC that is suitable for a flatbed scanner with a large DOF.

Fig. 1

Two arrangements of compound eye image scanner: (a) one-line arrangement of varying magnification imaging units and (b) two-line staggered arrangement of telecentric imaging units.

OE_60_4_043103_f001.png

2.

Two Arrangements of Compound Eye Image Scanner

Figure 1 shows two different arrangements of our compound eye image scanner. Figure 1(a) shows a one-line arrangement of varying magnification imaging units, where all of the imaging units are aligned on a single line, creating a 310-mm field of view. Each imaging unit must cover a larger field of view than the diameter of the first lens so that no missing area is seen at the boundaries between imaging units. Therefore, it cannot be telecentric in the object space since the field of view grows with the object distance. Then the overlapping areas between the adjacent fields of view change with the object distance, as shown in Fig. 2, which illustrates three overlapped images by three imaging units in two different object distances. Image processing to combine adjacent unit images is performed in the following series. (1) Pattern matching is performed between the overlapped images. (2) The size of the overlapped width in the X direction is determined. (3) Unit images are resized in such a way that the size of those overlapped areas is identical. (4) The unit images are combined into an output image. Since this process is slightly complicated, it may cause some mistakes in particular cases.

Fig. 2

Image overlapping in one-line arrangement of varying magnification imaging units when object distance is (a) small and (b) large.

OE_60_4_043103_f002.png

On the other hand, Fig. 1(b) shows a two-line staggered arrangement of telecentric imaging units, which have telecentricity in the object space so that the field of view of each unit is stable regardless of the object distance. We previously reported its reflective mirror version.10,12 Since the diameter of the first lens is larger than the field of view due to telecentricity, the imaging units are aligned in a two-line staggered arrangement. As the object is scanned along the Y direction relative to the image scanner, the unit images shift one after the other with a gap in the two lines in the Y direction [Fig. 1(b)]. The image-combining processing for this arrangement is easier than that for the one-line arrangement because the image size does not change with the object distance. However, the optical design of the illumination is more severe because illuminance uniformity is required along the Y direction. Pattern-matching processing for the overlapping area remains necessary because the shift value between the images on the two lines may fluctuate slightly due to the scan speed fluctuation in the Y direction, which is discussed in Sec. 4.

3.

Experiment on One-Line Arrangement of Varying Magnification Imaging Units

3.1.

One-Line Arrangement without WFC: Prototype A

We first designed prototype A, which is an image scanner with a one-line arrangement but without WFC. The cross-sectional optical layout of the four imaging units in the XZ plane is shown in Fig. 3. Each unit is constructed of two lenses and an aperture stop that is placed directly above the second lens. Prototype A has the following target specifications: 600-dpi resolution (42.3-μm pitch), 1.2-mm DOF, and 310-mm field of view. Since the magnification ratio of each imaging unit is designed to be 1/2, the sensor pixel’s pitch is 21.15  μm. An image sensor uses three lines to acquire color, on which red, green, and blue color filters are formed. The field of view of each unit is 10.8 mm, and the imaging units are aligned in a 9.8-mm pitch, resulting in 1.0-mm overlapping areas at the boundaries of the imaging units. The number of imaging units needed to cover the 310-mm field of view is 32, and the numerical aperture is NA=0.1.

Fig. 3

One-line arrangement scanner in prototypes A and B: (a) optical layout and (b), (c) front surface sag of second lens in prototypes A and B along the X direction (solid line) and superimposed component of WFC [broken line in (c)].

OE_60_4_043103_f003.png

One key design guide in each imaging unit is that it should be nearly object-space telecentric. The angle between the principal ray launched from the edge of the field of view and the optical axis should be as small as possible because the pattern-matching process (discussed in Sec. 2) must be correctly performed. According to the change in the object distance, the smaller the change in the field of view is, the easier the pattern-matching process is. Suppose, for example, the object is a chart of a black-and-white grating pattern with a spatial frequency of 5.9 line-pairs/mm (lp/mm), which is equivalent to 300-dpi resolution. Then the image-matching processing may be inaccurate when the change in the field of view is larger than a 5.9-lp/mm, 169-μm period. The imaging unit must be as close to telecentric in the object space as possible so that the change in the overlapping area does not exceed 169  μm within the 1.2-mm DOF specification.

The uniformity of the optical characteristics in the field of view is another critical point in optical design for a compound eye image scanner. If such optical characteristics as MTF or a distortion degrade uniformity in the X direction, the unevenness is repeated with the period of the imaging unit, attracting the viewer’s notice. Therefore, we designed the first lens with a free-form surface to suppress unevenness.

This design’s prototype is shown in Fig. 4. Figure 4(a) shows the entire appearance of the imaging part, Fig. 4(b) shows a side view with an illumination module, and Fig. 4(c) shows the top view of the imaging part with its cover removed, where the first lenses are aligned in a one-line pattern. An example image taken by prototype A is shown in Fig. 5(a). Figure 6(a) shows images of a black-and-white grating pattern with 4.9  lp/mm at Zf=0, 0.6, and 1.2 mm, where Zf is the difference from the focal position shown in Fig. 3. Intensity profiles of the images along the X direction for blue (B), green (G), and red (R) are also shown in Fig. 6. Although their intensity profiles are almost the same at Zf=0, the contrast of B decreases faster than the other two colors with an increase in Zf, and the white part of the picture at Zf=1.2  mm is yellow.

Fig. 4

Prototype A: (a) appearance of imaging unit; (b) side view with illumination unit; and (c) array of first lenses.

OE_60_4_043103_f004.png

Fig. 5

“ABC” images by (a) prototype A and prototype B (b) before and (c) after deblurring process. Images taken at Zf=0.6, 0, and 0.6 mm. Each image size is 78×36  px (3.3  mm×1.5  mm in object space).

OE_60_4_043103_f005.png

Fig. 6

Images and profiles of black-and-white grating pattern at different object positions, Zf: (a) prototype A with 4.9  lp/mm and (b) prototype B after deblurring process with 5.7  lp/mm.

OE_60_4_043103_f006.png

The coloring of the small pitch grating is attributed to axial chromatic aberration. Figure 7(a) shows the calculated through-focus MTF in the B, G, and R colors at 4.9  lp/mm in the object space. The difference between the values at the maximum of the three graphs shows axial chromatic aberration, which was caused by the chromatic dispersion of the lens material. The differences in the MTF values among the three colors at Zf=0, 0.6, and 1.2 mm closely reflect the contrasts of the profiles in Fig. 6. Since the lenses are mass-produced by plastic injection molding, it is difficult to use achromatic lenses that are composed of two individual lenses made from glass with different amounts of dispersion. Therefore, we applied WFC, discussed below.

Fig. 7

Calculated through-focus MTF at 4.9  lp/mm in object space: (a) prototype A and (b) prototype B.

OE_60_4_043103_f007.png

3.2.

One-Line Arrangement with Cubic-Phase-Modulated WFC: Prototype B

Prototype B resolves the problem of chromatic aberration in prototype A by applying WFC with cubic-phase modulation, which should be added at the stop aperture to identically modulate an image everywhere in the field of view. Because the front surface of the second lens lies just under the stop aperture, the phase modulation of WFC can be superimposed on the surface. Since the lens is shaped by mold injection, replicating it is easy with phase modulation. Prototype B is identical to prototype A except for the function of the superimposed surface. A surface sag function for cubic-phase-modulated WFC (cubic WFC) is expressed as

Eq. (1)

Z=α(X3+Y3),
where X and Y are the horizontal coordinates of the surface in mm units and α is the coefficient of the cubic-phase modulation in mm2 units. The diameter of the stop aperture is 2.2 mm and α is set to 0.008  mm2. Figures 3(b) and 3(c) show the surface sag profile along the X direction in prototypes A and B. The broken line in Fig. 3(c) is the superimposed component of the cubic-phase modulation expressed by Eq. (1), which implies that its addition to the solid graph of Fig. 3(b) is the solid graph of Fig. 3(c). The maximum sag amount inside the stop aperture is 10.65  μm, which equals 10.3 wavelengths, using refractive index n=1.53 and wavelength λ=0.55  μm. The amount of phase difference is almost identical to that in an earlier work.13

Figure 8 shows spot diagrams in (a) prototype A without WFC and (b) prototype B with cubic WFC. Spot diagrams are distorted into triangle shapes by cubic WFC, and the differences in the spot size among colors or object distances are reduced in prototype B. Figure 7(b) shows the calculated through-focus MTF in B, G, and R colors at 4.9  lp/mm in the object space for prototype B. Compared to Fig. 7(a), the graphs are flat against the object distance, and the differences among colors are small in return for small peak values.

Fig. 8

Calculated spot diagrams by (a) prototype A without WFC and (b) prototype B with cubic WFC. Object positions are Zf=0.6, 0, and 0.6 mm, and colors are for blue (B), green (G), and red (R).

OE_60_4_043103_f008.png

Prototype B was composed by exchanging the second lenses for the cubic-phase-modulated ones. Figure 9 shows the images of a point source, made from a pinhole placed before an LED light source. The image shapes resemble the spot diagrams in Fig. 8(b).

Fig. 9

Measured PSF in prototype B from Zf=1.2 to 1.2 mm for blue, green, and red.

OE_60_4_043103_f009.png

The raw images of the “ABC” characters taken by prototype B are shown in Fig. 5(b), and the images restored by a deblurring process (noted in Appendix A) are shown in Fig. 5(c). Although the raw images by the cubic WFC [Fig. 5(b)] are more blurred than those without WFC [Fig. 5(a)], the restored images of Fig. 5(c) are clearer than those of Fig. 5(a).

Figure 6(b) displays images of a grating pattern and the profiles by prototype B, in which a deblurring process is performed to increase contrast. The images show no pseudo-color, and their profile shows no contrast difference among colors.

Figure 10(a) shows deblurred images of “289 dpi” at three different levels of Zf. An artifact is found near the oblique line of character “2” [Fig. 10(a-2)]. Figure 11(a) shows the corresponding MTF graphs at Zf=0.8  mm along the X and diagonal directions. Some of the diagonal MTFs have nearly zero values at a spatial frequency lower than the Nyquist frequency, which comes from the cubic-phase-modulated PSF. This situation accounts for the artifact.15

Fig. 10

Comparison of deblurred images: (a) prototype B: (a-1) “289 dpi” taken at Zf=0.8, 0, and 0.8 mm, where image size is 203×93  px (8.6  mm×3.9  mm in object space) and (a-2) magnification of “2” at Zf=0.8  mm; (b) prototype C: (b-1) “247 dpi” taken at Zf=0, 1, and 2 mm, where image size is 185×85  px (7.8  mm×3.6  mm in object space) and (b-2) magnification of “2” at Zf=0.

OE_60_4_043103_f010.png

Fig. 11

Calculated MTF: (a) prototype B at Zf=0.8  mm along (a-1) X direction and (a-2) diagonal direction and (b) prototype C with axisymmetric quartic WFC at Zf=0. Horizontal axes are spatial frequency in object space.

OE_60_4_043103_f011.png

3.3.

One-Line Arrangement with Quartic-Phase-Modulated WFC: Prototype C

Prototype C suppresses the artifact found in prototype B. The function of the quartic-phase-modulated WFC (quartic WFC) based on spherical aberration is axial symmetric.17 The following sag function describes the lens surface superimposed to produce quartic WFC:

Eq. (2)

Z=ar4+br2,
where r is the radial distance in mm units, and a and b are coefficients. The fourth power term produces spherical aberration with a side effect of the focal-point shift. The squared term is used to cancel the focal-point shift.

The basic lens structure before adding WFC modulation in prototype C was redesigned to extend the DOF specification to 2 mm. Figure 12(a) shows the ray trace of the lens design before adding WFC, resulting in the spot diagrams shown in Fig. 12(c). The front surface of the second lens is flat, located at the stop aperture. The added lens sag function that gives quartic WFC is expressed by Eq. (2) with coefficients of a=0.042  mm3 and b=0.015  mm1 [Fig. 12(b)]. The modulated spot diagrams by the WFC [Fig. 12(d)] yield only slight differences among the colors and object distances. Figure 11(b) shows the MTF in prototype C and shows no zero value of the MTF under the Nyquist frequency. Since the phase modulation in quartic WFC is axial symmetric, the MTF has no directional dependency. Figure 13 shows the through-focus MTF before and after adding the WFC modulation. The large difference in MTF among the colors shown in Fig. 13(a) is decreased by adding WFC, as shown by the solid and broken lines in Fig. 13(b). Since the ability to extend DOF is weaker in quartic WFC than in cubic WFC, the graphs in Fig. 13(b) are not flatter than those in Fig. 7(b). The broken lines of Fig. 13(b) show the expected MTF by performing the deblurring process for the WFC, showing that the MTF values are over 0.4 even at Zf=2  mm.

Fig. 12

Optical design of prototype C: (a) optical layout, where diameter of stop aperture is 1.4 mm and NA=0.078; (b) sag to add quartic WFC expressed in Eq. (2) to second lens; and spot diagrams (c) before and (d) after adding WFC.

OE_60_4_043103_f012.png

Fig. 13

Through-focus MTF in prototype C: (a) calculated MTF before adding WFC at 4.9  lp/mm and (b), (c) calculated and measured MTF at 4.9  lp/mm and 7.0  lp/mm, respectively. Solid and broken lines are calculated MTF before and after deblurring process, respectively. Solid and blank markers are measured MTF before and after deblurring process, respectively. Graph colors correspond to B, G, and R in image.

OE_60_4_043103_f013.png

Prototype C was then fabricated and the resulting pictures are shown in Figs. 10(b) and 14. The magnified picture in Fig. 10(b-2) shows that it no longer has an artifact around the edge of the character “2.” Figure 14 shows that the deblurring process produces clear images even for the fine structure of Chinese characters.

Fig. 14

Images of Chinese characters by prototype C taken at Zf=0, 1.1, and 2.2 mm: (a) before deblurring process and (b) after deblurring process. Image size is 260×190  px (11  mm×8  mm in object space).

OE_60_4_043103_f014.png

The measured MTF values at 4.9  lp/mm fit well with the simulation curve shown in Figs. 13(b) and 13(c). The striped black and white patterns with 4.9 and 7.0  lp/mm are read by prototype C, and the images are restored by the deblurring process. Then the contrasts of the wave patterns taken before and after the deblurring process are calculated [Eq. (3)] and defined as the measured MTF:

Eq. (3)

MTF=(maxmin)/(max+min),
where max and min are the maximum and minimum values of the waves of the striped pattern profile.

Although prototype C has good image quality within the specified DOF, it suffers from the image-combining process due to the compound eye system when the object distance is over the DOF range. Image-combining error may occur in rare cases such as when a repeated fine pattern exists on the overlapped area and the object distance exceeds the DOF. If the amount of the image’s shift on the overlapped area exceeds the period of the repeated pattern, it is difficult to determine the correct positions to combine. One solution is to get information of the correct-combining positions by adding range sensors. If the object distance near the overlapped area is known, the shift amount of the overlapped image can be determined. Such range sensors can be easily installed by adding point-source LEDs very close to the image sensor chips on the sensor substrate.21 However, we discuss another arrangement system for a compound eye image scanner in the next section because the prototype C system is complicated.

4.

Two-Line Staggered Arrangement with Quartic-Phase-Modulated WFC: Prototype D

A two-line staggered arrangement allows us to make a telecentric system in the object space because it produces space between adjacent objective lenses on one line. Since the image size is identical regardless of the object distance in object-telecentric systems, the image-combining process is easier than in a one-line arrangement system.

Figure 15(a) shows the ray trace layout of the object-telecentric system for prototype D. The numerical aperture is NA=0.047, which is smaller than prototype C to increase its DOF. Figures 15(b) and 15(c) show spot diagrams before and after adding the quartic-phase modulation, showing the WFC effect. Figure 15(d) shows through-focus MTF graphs at 4.9 and 7.5  lp/mm before adding the WFC, revealing a small DOF and large differences among the three colors. After adding the WFC [Fig. 15(e)], the graph widths increase in exchange for smaller peak values. The peak position of the graphs for the lower spatial frequency of 4.9  lp/mm is smaller than that of 7.5  lp/mm. The decrease is a feature of spherical aberration.

Fig. 15

Optical design of prototype D: (a) optical layout with NA=0.047; spot diagrams (b) before and (c) after adding WFC; and calculated through-focus MTF (d) before and (e) after adding WFC. Solid and broken lines are 7.5 and 4.9  lp/mm, respectively. Graph colors correspond to B, G, and R in the image.

OE_60_4_043103_f015.png

Figure 16(a) shows prototype D from the top with its white illumination unit. Rectangular apertures of the first lenses are aligned in a two-line staggered arrangement, and the boundaries between the apertures are overlapped in the X direction. Figure 16(b) depicts the flip side of prototype D with its sensor substrate removed, showing a two-line staggered array of the second lenses.

Fig. 16

Photos of prototype D: (a) top side with white illumination unit and (b) flip side where sensor substrate is removed.

OE_60_4_043103_f016.png

Here we discuss the required image processing package for our compound eye image scanner. An example of the raw image by prototype D is shown in Fig. 17(a). It has 28 imaging units, and every other image made by the imaging units is shifted in the Y direction. Figures 17(b) and 17(c) show magnified views of the rectangular areas in Figs. 17(a) and 17(b). Figure 17(b) shows the offset in the Y direction between adjacent images. The following image processing (1) to (5) is performed in sequence.

  • (1) Correction of chromatic aberration of magnification in the X direction. Figure 17(c) shows colored edges by chromatic aberration of magnification. This image processing corrects Figs. 17(c) to 17(d).

  • (2) Deblurring. This processing deblurs Figs. 17(d) to 17(e).

  • (3) Misalignment compensation of the optics assembly based on calibration measurement. A custom chart for this calibration is read by the prototype scanner to calculate the misalignment parameters.

  • (4) Combining position correction for scan speed fluctuation. The scan speed fluctuation in the Y direction causes the combining position to misalign between adjacent unit images. The misalignment amount is at most a few pixels in the Y direction. This processing compensates for the misalignment. Two parts of the adjacent unit pictures in the overlapped area are extracted. The degree of similarity is calculated at each shift step within a few pixels in the Y direction using a method of the sum of absolute differences. The matching position is determined as the point of the largest degree of similarity. The boundaries of each unit image are stitched using the matching position parameters.

  • (5) Image intensity matching between adjacent unit images. The differences of the 2-mm reading positions between adjacent imaging units in the Y direction may cause a slight image intensity difference. The entire image intensity distribution is fine-tuned to match the image intensities at the overlapped areas.

Fig. 17

Example of image at image processing steps, where imaging chart is Kodak TL-5003: (a) entire raw image; (b), (c) magnified views of rectangular areas in (a) and (b); (d) image after correction of chromatic aberration of magnification; and (e) image after deblurring.

OE_60_4_043103_f017.png

The final image after the above image processing from Fig. 17(a) is shown in Fig. 18(a). Figure 18(b) displays the magnification of the rectangular area in Fig. 18(a), and includes two boundaries, showing flawless image combining.

Fig. 18

Example of image after image processing: (a) entire restored image and (b) magnified view of rectangular area in (a).

OE_60_4_043103_f018.png

5.

Summary

We studied the most suitable arrangement of plural imaging units and WFC to suppress the effect of axial chromatic aberration for developing an image scanner with a large field of view and a large DOF. We fabricated four prototypes and compared the results.

Prototypes A, B, and C with one-line arrangement had different WFC types. Prototype A had no WFC, producing color blurring at the edges of an image when it was defocused. Prototype B with cubic WFC successfully suppressed the color blurring, although it produced a side effect of an artifact at the edge along the oblique directions. Prototype C with quartic WFC suppressed both the color blurring and the artifact in the oblique directions. However, the image-combining process made mistakes in some particular charts at large defocused positions since the imaging units in the one-line arrangement are forced to have varying magnification with a change in the object distance.

Prototype D had a two-line staggered arrangement of telecentric imaging units and quartic WFC. The telecentricity in the object space makes no errors in image combining, even at a large defocused position.

The above experimental results lead us to the following conclusions. We confirmed the suppression effect of axial color aberration by WFC. Although the DOF’s extension effect is larger in the cubic WFC than in the quartic WFC, the quartic WFC produces no artifact in the deblurred image, making it suitable for such human-viewing usages as a document copier. A one-line arrangement may be applied when the expected object range is small; a two-line staggered arrangement is suitable for a larger DOF.

Consequently, we developed a color image scanner with 600-dpi resolution and a large field of view of 310 mm for a flatbed scanner in a copier without any axial color aberration or artifact in the image with quartic WFC.

6.

Appendix A: Deblurring Process

A blurred image through WFC optics is restored by a deblurring process using Fourier transform. Blurred image B is expressed by the expression:

Eq. (4)

B=O*P,
where O is the original image, P is the PSF, and the asterisk (*) denotes convolution. The original image can be restored by the following expression by adding a Wiener filter to suppress the noise effect:

Eq. (5)

O=F1[F(B)F(P)|F(P)|2|F(P)|2+γ],
where F denotes the Fourier transform and γ is the signal-to-noise ratio parameter in the Wiener filter. Since the Fourier transform process requires computational resources, the process we performed was replaced by convolution:

Eq. (6)

O=B*F1[1F(P)|F(P)|2|F(P)|2+γ].

The term of the inverse Fourier transform is constant for blurred image B, making it possible to calculate it in advance and store it in memory. The smaller the matrix size of the kernel term is, the lighter the calculation power is. The matrix could be trimmed to become as small as possible without degrading the image quality.

References

1. 

J. Tanida et al., “Thin observation module by bound optics (TOMBO) concept and experimental verification,” Appl. Opt., 40 (11), 1806 –1813 (2001). https://doi.org/10.1364/AO.40.001806 APOPAI 0003-6935 Google Scholar

2. 

Y. Cheng et al., “Review of state-of-the-art artificial compound eye imaging systems,” Bioinspir. Biomim., 14 031002 (2019). https://doi.org/10.1088/1748-3190/aaffb5 1748-3182 Google Scholar

3. 

R. H. Anderson, “Close-up imaging of documents and displays with lens arrays,” Appl. Opt., 18 477 –484 (1979). https://doi.org/10.1364/AO.18.000477 APOPAI 0003-6935 Google Scholar

4. 

J. Meyer et al., “Optical cluster eye fabricated on wafer-level,” Opt. Express, 19 (18), 17506 –17519 (2011). https://doi.org/10.1364/OE.19.017506 OPEXFF 1094-4087 Google Scholar

5. 

K. Nagatani et al., “Document reading apparatus, having a body unit for holding apparatus components,” U.S. Patent No. 5,399,850 (1995).

6. 

I. Maeda, T. Inokuchi and T. Miyashita, “Optical imaging device,” U.S. Patent No. 4,776,683 (1988).

7. 

M. Kawazu and Y. Ogura, “Application of gradient-index fiber arrays to copying machines,” Appl. Opt., 19 1105 –1112 (1980). https://doi.org/10.1364/AO.19.001105 APOPAI 0003-6935 Google Scholar

8. 

A. Brückner et al., “Thin wafer-level camera lenses inspired by insect compound eyes,” Opt. Express, 18 (24), 24379 –24394 (2010). https://doi.org/10.1364/OE.18.024379 OPEXFF 1094-4087 Google Scholar

9. 

H. Kawano, “Lensless image scanner using multilayered aperture array for noncontact imaging,” Opt. Eng., 55 (10), 103106 (2016). https://doi.org/10.1117/1.OE.55.10.103106 Google Scholar

10. 

H. Kawano et al., “Compact image scanner with large depth of field by compound eye system,” Opt. Express, 20 13532 –13538 (2012). https://doi.org/10.1364/OE.20.013532 OPEXFF 1094-4087 Google Scholar

11. 

H. Kawano et al., “Practical design for compact image scanner with large depth of field by compound eye system,” Opt. Express, 22 18010 –18019 (2014). https://doi.org/10.1364/OE.22.018010 OPEXFF 1094-4087 Google Scholar

12. 

Jr. E. R. Dowski and W. T. Cathey, “Extended depth of field through wave-front coding,” Appl. Opt., 34 1859 –1866 (1995). https://doi.org/10.1364/AO.34.001859 APOPAI 0003-6935 Google Scholar

13. 

H. B. Wach, E. R. Dowski and W. T. Cathey, “Control of chromatic focal shift through wave-front coding,” Appl. Opt., 37 5359 –5367 (1998). https://doi.org/10.1364/AO.37.005359 APOPAI 0003-6935 Google Scholar

14. 

M. Demenikov and A. R. Harvey, “Image artifacts in hybrid imaging systems with a cubic phase mask,” Opt. Express, 18 (8), 8207 –8212 (2010). https://doi.org/10.1364/OE.18.008207 OPEXFF 1094-4087 Google Scholar

15. 

G. D. Muyo and A. R. Harvey, “Wavefront coding for athermalization of infrared imaging systems,” Proc. SPIE, 5612 227 –235 (2004). https://doi.org/10.1117/12.579738 PSISDG 0277-786X Google Scholar

16. 

N. George and W. Chi, “Extended depth of field using a logarithmic asphere,” J. Opt. A Pure Appl. Opt., 5 (5), S157 –S163 (2003). https://doi.org/10.1088/1464-4258/5/5/358 Google Scholar

17. 

S. Mezouari and A. R. Harvey, “Phase pupil functions for reduction of defocus and spherical aberrations,” Opt. Lett., 28 (10), 771 –773 (2003). https://doi.org/10.1364/OL.28.000771 OPLEDP 0146-9592 Google Scholar

18. 

S. Mezouari, G. Muyo and A. Harvey, “Circularly symmetric phase filters for control of primary third-order aberrations: coma and astigmatism,” J. Opt. Soc. Am. A, 23 (5), 1058 –1062 (2006). https://doi.org/10.1364/JOSAA.23.001058 JOAOD6 0740-3232 Google Scholar

19. 

M. Ohta et al., “Rotationally symmetric wavefront coding for extended depth of focus with annular phase mask,” Jpn. J. Appl. Phys., 54 09ME03 (2015). https://doi.org/10.7567/JJAP.54.09ME03 Google Scholar

20. 

T. Vettenburg, N. Bustin and A. Harvey, “Fidelity optimization for aberration-tolerant hybrid imaging systems,” Opt. Express, 18 9220 –9228 (2010). https://doi.org/10.1364/OE.18.009220 OPEXFF 1094-4087 Google Scholar

21. 

H. Kawano et al., “Large depth-of-field compound-eye image scanner using wavefront coding and range measurement,” in Proc. Opt.-Photonics Des. and Fabrication, 28S1 –S3 (2018). Google Scholar

Biography

Hiroyuki Kawano received his BS and MS degrees in physics from the University of Tokyo in 1994 and 1996, and his PhD in engineering from Kyoto University in 2011. He is an optical engineer at Mitsubishi Electric Corp., Amagasaki, Japan. His current research interests include optical design and imaging systems. He is a member of SPIE.

Shigeru Takushima received his BE and ME degrees in engineering from Osaka University in 2008 and 2010, and his PhD in engineering from Osaka University in 2021. He joined Mitsubishi Electric Corp., Amagasaki, Japan, in 2010 and has engaged in research and development of optical engineering. His current research interests include optical measurement and image processing.

Yoshitaka Toyoda received his BE and ME degrees in engineering from Osaka University in 2005 and 2007. He joined Mitsubishi Electric Corporation in 2007 and has engaged in research and development of image processing algorithms. He also joined Kamakura Works, Mitsubishi Electric Corporation in 2019. His current interest is image processing, image evaluation, and image exploitation solutions. He is a member of the Institute of Image Information and Television Engineers (ITE) Japan.

Miki Sugano received her BS degree in applied physics from Tohoku University in 1992. She is an image signal processing engineer at Mitsubishi Electric Corp., Amagasaki, Japan.

Taku Matsuzawa: Biography is not available.

CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Hiroyuki Kawano, Shigeru Takushima, Yoshitaka Toyoda, Miki Sugano, and Taku Matsuzawa "Compound eye image scanner optimally arranged for image combining and suppressing axial chromatic aberration by wavefront coding," Optical Engineering 60(4), 043103 (28 April 2021). https://doi.org/10.1117/1.OE.60.4.043103
Received: 31 December 2020; Accepted: 14 April 2021; Published: 28 April 2021
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
KEYWORDS
Prototyping

Scanners

Image processing

Eye

Modulation transfer functions

Chromatic aberrations

Image restoration

RELATED CONTENT


Back to Top