Color filter array

The Bayer color filter mosaic. Each two-by-two submosaic contains 2 green, 1 blue and 1 red filter, each covering one pixel sensor.

In photography, a color filter array (CFA), or color filter mosaic (CFM), is a mosaic of tiny color filters placed over the pixel sensors of an image sensor to capture color information.

Color filters are needed because the typical photosensors detect light intensity with little or no wavelength specificity, and therefore cannot separate color information.^[1] Since sensors are made of semiconductors they obey solid-state physics.

The color filters filter the light by wavelength range, such that the separate filtered intensities include information about the color of light. For example, the Bayer filter (shown to the right) gives information about the intensity of light in red, green, and blue (RGB) wavelength regions. The raw image data captured by the image sensor is then converted to a full-color image (with intensities of all three primary colors represented at each pixel) by a demosaicing algorithm which is tailored for each type of color filter. The spectral transmittance of the CFA elements along with the demosaicing algorithm jointly determine the color rendition.^[2] The sensor's passband quantum efficiency and span of the CFA's spectral responses are typically wider than the visible spectrum, thus all visible colors can be distinguished. The responses of the filters do not generally correspond to the CIE color matching functions,^[3] so a color translation is required to convert the tristimulus values into a common, absolute color space.^[4]

The Foveon X3 sensor uses a different structure such that a pixel utilizes properties of multi-junctions to stack blue, green, and red sensors on top of each other. This arrangement does not require a demosaicing algorithm because each pixel has information about each color. Dick Merrill of Foveon distinguishes the approaches as "vertical color filter" for the Foveon X3 versus "lateral color filter" for the CFA.^[5][6]

List of color filter arrays

Image	Name	Description	Pattern size (pixels)
	Bayer filter	Very common RGB filter. With one blue, one red, and two green.	2×2
	RGBE filter	Bayer-like with one of the green filters modified to "emerald"; used in a few Sony cameras.	2×2
	CYYM filter	One cyan, two yellow, and one magenta; used in a few cameras of Kodak.	2×2
	CYGM filter	One cyan, one yellow, one green, and one magenta; used in a few cameras.	2×2
	RGBW Bayer	Traditional RGBW similar to Bayer and RGBE patterns.	2×2
	RGBW #1	Three example RGBW filters from Kodak, with 50% white. (See Bayer filter#Alternatives)	4×4
	RGBW #2
	RGBW #3		2×4

Bayer CFA

A 2005 patent application depicting an arrangement of red, green, blue, and "white" sensor filters referred to there as "RGBW color filters having the Bayer pattern".

Main article: Bayer filter

The Bayer CFA is named for its inventor, Dr. Bryce E. Bayer from Eastman Kodak. It is realized by application of color filters over the photodiodes used in sensors, cameras, videocameras, and scanners, for creation of the color image.

RGBW sensor

An RGBW matrix (from Red, Green, Blue, White) is a CFA that includes "white" or transparent filter elements that allow the photodiode to respond to all colors of light; that is, some cells are "panchromatic", and more of the light is detected, rather than absorbed, compared to the Bayer matrix. Kodak announced several RGBW CFA patterns in 2007, all of which have the property that when the panchromatic cells are ignored, the remaining color filtered cells are arranged such that their data can be processed with a standard Bayer demosaicing algorithm.

CYGM sensor

A CYGM matrix (Cyan, Yellow, Green, Magenta) is a CFA that uses mostly secondary colors, again to allow more of the incident light to be detected rather than absorbed. Other variants include CMY and CMYW matrices.

Manufacture of the CFA

Diazonaphthoquinone (DNQ)-novolac photoresist is one material used as the carrier for making color filters from color dyes. There is some interference between the dyes and the ultraviolet light needed to properly expose the polymer, though solutions have been found for this problem.^[7] Color photoresists sometimes used include those with chemical monikers CMCR101R, CMCR101G, CMCR101B, CMCR106R, CMCR106G, and CMCR106B.^[8]

A few sources^[1][9] discuss other specific chemical substances, attending optical properties, and optimal manufacturing processes of color filter arrays.

For instance, Nakamura said that materials for on-chip color filter arrays fall into two categories: pigment and dye. Pigment based CFAs have become the dominant option because they offer higher heat resistance and light resistance compared to dye based CFAs. In either case, thicknesses ranging up to 1 micrometre are readily available.^[1]

Theuwissen says "Previously, the color filter was fabricated on a separate glass plate and glued to the CCD (Ishikawa 1981), but nowadays, all single-chip color cameras are provided with an imager which has a color filter on-chip processed (Dillon, 1978) and not as a hybrid."^[9] He provides a bibliography focusing on the number, types, aliasing effects, moire patterns, and spatial frequencies of the absorptive filters.

Some sources indicate that the CFA can be manufactured separately and affixed after the sensor has been manufactured,^[10][11][12] while other sensors have the CFA manufactured directly on the surface of the imager.^[12][13][14] Theuwissen makes no mention of the materials utilized in CFA manufacture.

At least one early example of an on-chip design utilized gelatin filters (Aoki et al., 1982).^[15] The gelatin is sectionalized, via photoliothography, and subsequently dyed. Aoki reveals that a CYWG arrangement was used, with the G filter being an overlap of the Y and C filters.

Filter materials are manufacturer specific.^[16] Adams et al. state "Several factors influence the CFA's design. First, the individual CFA filters are usually layers of transmissive (absorptive) organic or pigment dyes. Ensuring that the dyes have the right mechanical properties—such as ease of application, durability, and resistance to humidity and other atmospheric stresses—is a challenging task. This makes it difficult, at best, to fine-tune the spectral responsivities.".

Given that the CFAs are deposited on the image sensor surface at the BEOL (back end of line, the later stages of the integrated circuit manufacturing line), where a low-temperature regime must be rigidly observed (due to the low melting temperature of the aluminum metalized "wires" and the substrate mobility of the dopants implanted within the bulk silicon), organics would be preferred over glass. On the other hand, some CVD silicon oxide processes are low temperature processes.^[17]

Ocean Optics has indicated that their patented dichroic filter CFA process (alternating thin films of ZnS and Cryolite) can be applied to spectroscopic CCDs.^[18] Gersteltec sells photoresists that possesses color filter properties.^[19]

Some pigment and dye molecules used in CFAs

In U.S.P.# 4,808,501, Carl Chiulli cites the use of 5 chemicals, three of which are C.I. #12715, AKA Solvent Red 8; Solvent Yellow 88; and C.I. # 61551, Solvent Blue 36. In U.S.P. # 5,096,801 Koya et al., of Fuji Photo Film company, list some 150-200 chemical structures, mainly azo dyes and pyrazolone-diazenyl, but fail to provide chemical names, CAS Registry numbers, or Colour Index numbers.

Optically efficient CFA implementation

Nakamura^[1] provides a schematic and bibliographic items illustrating the importance of microlenses, their f-number, and the interplay with the CFA and CCD array.^[20] Further, a short discussion of anti-reflection films is offered,^[21] though Janesick's^[22] work appears is more concerned with photon–silicon interaction. Early work on microlenses^[23] and on the three-CCD/prism cameras^[24] stress the importance of a fully integrated design solution for CFAs. The camera system, as a whole, benefits from careful consideration of CFA technologies and their interplay with other sensor properties.

References

1. ^ ^{a b c d} Nakamura, Junichi (2005). Image Sensors and Signal Processing for Digital Still Cameras. CRC Press. ISBN 9780849335457. http://books.google.com/?id=aaTyk2USX1MC&pg=PT80. 
2. ^ "Color Correction for Image Sensors". Image Sensor Solutions: Application Note. Kodak. October 27 2003. http://www.kodak.com/ezpres/business/ccd/global/plugins/acrobat/en/supportdocs/ColorCorrectionforImageSensors.pdf. 
3. ^ Comparison of the spectral response of a Nikon D70 vs. Canon 10D, Christian Buil.
4. ^ Soo-Wook Jang, Eun-Su Kim, Sung-Hak Lee, and Kyu-Ik Sohng (2005). Adaptive Colorimetric Characterization of Digital Camera with White Balance. LNCS. 3656. Springer. pp. 712–719. doi:10.1007/11559573_87. ISBN 978-3-540-29069-8. ISSN 1611-3349. 
5. ^ "Digital Photography Essentials #003: "Color Separation"". Digital Outback Photo. http://www.outbackphoto.com/dp_essentials/dp_essentials_03/essay. 
6. ^ Thomas Kreis (2006). Handbook of Holographic Interferometry: Optical and Digital Methods. Wiley-VCH. ISBN 3527604928. http://books.google.com/?id=CNMPLjC0li8C&pg=PA77. 
7. ^ Miller Harris R. (1999). "Color filter array for CCD and CMOS image sensors using a chemically amplified, thermally cured, pre-dyed, positive-tone photoresist for 365 nm lithography". Proceedings of SPIE (International Society for Optical Engineering) 3678 (2): 1083–1090. doi:10.1117/12.350159. ISBN ISSN 0277-786X. http://cat.inist.fr/?aModele=afficheN&cpsidt=17387091. 
8. ^ Microelectronics Fabrication Facility, Hong Kong University of Science and Technology. http://www.mff.ust.hk/mffdoc/safety/msds.htm. 
9. ^ ^{a b} Theuwissen, Albert (1995). Solid-State Imaging with charge coupled devices. Kluwer Academic Publishers. ISBN 079233566. 
10. ^ Ishikawa et al. (1981). Color Reproduction of a Single Chip Color Camera with a Frame Transfer CCD. IEEE Journal of Solid-State Circuits, Vol. SC-16, No. 2, April 1981. 
11. ^ Takizawa et al. (1983). Field Integration Mode CCD Color Television Camera Using Frequency Interleaving Method. IEEE Transactions on Consumer Electronics, Vol. CE-29, No. 3, August 1983. 
12. ^ ^{a b} Knop and Morf (1985). A New Class of Mosaic Color Encoding Patterns for Single-Chip Cameras. IEEE Transactions on Electron Devices, Vol. ED-32, No. 8, August 1985. 
13. ^ Dillon et al. (1978). IEEE. 
14. ^ Tanaka et al. (1990). HDTV Single-Chip CCD Color Camera. IEEE Transactions on Consumer Electronics, Vol. CE-36, No. 3, August 1990. 
15. ^ Aoki et al. (1982). 2/3-Inch Format MOS Single-Chip Color Imager. IEEE Transactions on Electron Devices, Vol. ED-29, No. 4, April 1982. 
16. ^ Adams et al. (1998). Color Processing in Digital Cameras. IEEE Micro. 1998, Vol. 18, Issue 6. Pgs. 20-31.. 
17. ^ Xiao (2001). Introduction to Semiconductor Manufacturing. 
18. ^ "Dichroic Filter Array Patented Patterned Coatings Technology". Ocean Optics. http://www.oceanoptics.com/products//thinfilmsdfa.asp. 
19. ^ "Swiss made SU-8 Photoepoxy Functional Products". Gersteltec Engineering Solutions. http://www.gersteltec.ch/su-8-Functional/. 
20. ^ Agranov et al. (January 2003). "Crosstalk and Microlens Study in a Color CMOS Image Sensor". IEEE Transactions on Electron Devices 50 (1). ISBN 0018-9383. 
21. ^ Murakami et al. (2000). Technologies to Improve Photo-Sensitivity and Reduce VOD Shutter Voltage for CCD Image Sensors. IEEE Transactions on Electron Devices, Vol. 47, No. 8, August 2000. ISBN 0018-9383. 
22. ^ Janesick, James (2001). Scientific Charge Coupled Devices. SPIE. ISBN 0819436984. 
23. ^ Ishihara and Tanigaki (1983). A High Photosensitivity IL-CCD Image Sensor with Monolithic Resin Lens Array. IEEE International Electron Devices Meeting (IEDM) Technical Digest. ISBN 0000-0497. 
24. ^ Murata et al. (1983). Development of a 3-MOS Color Camera. SMPTE Journal, December, 1983. 

See also

• Bayer filter
• CYGM filter
• RGBE filter
• Foveon X3 sensor
• Three-CCD camera