Foveon X3 sensor

The Foveon X3 sensor is a CMOS [El Gamal, A., " [http://isl.stanford.edu/~abbas/group/papers_and_pub/iedm02.pdf Trends in CMOS Image Sensor Technology and Design] ", Stanford University (2002 or later). Retrieved March 3, 2007.] image sensor for digital cameras, designed by Foveon, Inc. and manufactured by National Semiconductor [http://www.national.com/news/item/0,1735,745,00.html Retrieved March 3, 2007.] and Dongbu Electronics. [http://www.dongbuelec.com/eng/news/inthenews_view.asp?idx=73&gopage=1 Retrieved March 3, 2007.] It uses an array of photosites, each of which consists of three vertically stacked photodiodes, that are organized in a two-dimensional grid. Each of the three stacked photodiodes responds to different wavelengths of light, i.e., each has a different spectral sensitivity curve. This is due to that fact that different wavelengths of light penetrate silicon to different depths. [El Gamal, "supra", p. 2.; A. Rush and P. Hubel, " [http://www.x3f.info/technotes/X3SensorCharacteristics.pdf X3 Sensor Characteristics] ", Foveon X3 Info Page (undated but ≥ 2001, based on n. 1), pp. 1-3 Retrieved March 6, 2007.] The signals from the three photodiodes are then processed, resulting in data that provides the three additive primary colors, red, green, and blue.

The development of the Foveon X3 technology is the subject of the 2005 book "The Silicon Eye" by George Gilder.

Operation

The diagram to the right shows how this works in graphic form. Depicted on the left is the absorption of colors of the spectrum according to their wavelength as they pass through the silicon wafer. On the right, a Foveon X3 layered sensor stack in the silicon wafer for each output pixel is shown depicting the colors it detects at each absorption level. The color purity and intensity of blue, green and red depicted for the sensors are for ease of illustration. In fact, the attributes of each output pixel that are reported by a camera using this sensor result from the camera's image processing algorithms that employ a matrix process to construct the single RGB color from the data sensed by the photodiode stack. [Rush and Hubel, "supra", pp. 3-5.]

Because the depth in the silicon wafer of each of the three layer Foveon X3 sensors is less than five micrometres, it has negligible effect on focusing or chromatic aberration. However, because the collection depth of the deepest sensor layer (red) is comparable to collection depths in other silicon CMOS and CCD sensors, some diffusion of electrons and loss of sharpness in the longer wavelengths occurs. [Ji Soo Lee, " [http://www.cse.yorku.ca/~visor/pdf/JiSoo_Lee_PhD.pdf Photoresponse of CMOS Image Sensors] ," Ph.D. dissertation, University of Waterloo, 2003]

Utilization

As of March, 2008, the Sigma SD14 digital SLR camera [http://www.dpreview.com/news/0702/07022008_sd14date.asp. Retrieved March 7, 2007.] the Polaroid X530 [ [http://www.polaroid.com/global/detail.jsp?PRODUCT%3C%3Eprd_id=845524441763611&FOLDER%3C%3Efolder_id=282574488338793&bmUID=12060862847796&bmLocale=en_US Polaroid Web site] Retrieved March 21. 2008] , and the Sigma DP-1 compact camera (released in Japan on 3 March, 2008) are the only consumer cameras shipping with a Foveon X3 sensor.

The Foveon X3 sensor is also used in the Hanvision [http://www.alt-vision.com/hvduo5m.htm HVDUO-5M] and [http://www.alt-vision.com/hvduo10m.htm HVDUO-10M] scientific and industrial cameras, though the sensors in these products, one of which is the same as in the Polaroid x530, are at end-of-life status. [ [http://www.foveon.com/article.php?a=226 Foveon Web site] Retrieved March 7, 2007.] It was also used in the Sigma SD9 and SD10 consumer digital SLR cameras. [ [http://www.dpreview.com/reviews/specs/Sigma/ DP Review overview of Sigma digital cameras] ] These cameras are no longer in production.

Comparison to Bayer filter sensors – operational differences

The operation of the Foveon X3 sensor is quite different from that of the Bayer filter image sensor more commonly used in digital cameras. In the Bayer sensor, each photosite in the array consists of a single light sensor (either CMOS or CCD) that, as a result of filtration, is exposed to only one of the three primary colors, red, green, or blue. Constructing a full color image from a Bayer sensor requires demosaicing, an interpolative process in which the output pixel associated with each photosite is assigned an RGB value based in part on the level of red, green, and blue reported by those photosites adjacent to it. The Foveon X3 sensor creates its RGB color output for each photosite by combining the outputs of each of the stacked photodiodes at each of its photosites. This operational difference results in several significant consequences.

Color artifacts

Because demosaicing is not required for the Foveon X3 sensor to produce a full-color image, the color artifacts ("colored jaggies") associated with that process are not seen. The separate anti-aliasing filter [See, "Optical anti-aliasing filter" section of anti-aliasing filter] commonly used [Though its use is almost universal with Bayer sensors in digital cameras, it is not absolutely necessary. Kodak once produced two digital cameras, the DCS Pro SLR/n and DCS Pro SLR/c ("Digital Photography Review" [http://www.dpreview.com/reviews/kodakslrc/page2.asp Kodak DCS Pro SLR/c Review] , June 2004, Retrieved March 3, 2007) using Bayer sensors without such a filter. However, [http://www.dpreview.com/reviews/kodakdcs14n/page22.asp significant moiré patterns were produced when photographing very fine detail] . Retrieved March 3, 2007.] to mitigate those artifacts in a Bayer sensor is not required. This is because little aliasing occurs when the photodiodes for each color, with the assistance of the microlenses integrate the optical image over a region almost as big as the spacing of sensors for that color. [Microlenses are commonly used in all types of image sensors in digital cameras; in Bayer-filter sensors, microlenses allow the area of the optical image being averaged (integrated) per sample to approach 25% for red and blue and 50% for green, resulting in very little anti-aliasing, while for Foveon X3 sensors the area being averaged can approach 100% for each color, resulting in a significant anti-alias filter effect.] [cite book
author = Brian W. Keelan
title = Handbook of Image Quality: Characterization and Prediction
publisher = Marcel–Dekker
year = 2004
url = http://books.google.com/books?vid=ISBN0824707702&id=E45MTZn17gEC&pg=RA1-PA388&lpg=RA1-PA388&ots=noDzLfu2ju&dq=spot+separation+in+optical+anti-aliasing+filters&sig=IWnjfbrjX-oMXNkeW2ZBxH_RBmg#PPA390,M1 | isbn = ISBN 0824707702
pages = 390
quote = increasing fill factor provides a more favorable exchange of sharpness and aliasing than does increasing spot separation, probably because of the poor stop-band characteristics of the birefringent filter]

Light gathering and low-light performance

Another difference is that more of the photons entering the camera will be detected by the Foveon X3 photosensor than is possible with a mosaic sensor. This is because each of the color filters overlaying each photosite of a mosaic sensor passes only one of the primary colors, absorbing the other two. The absorption of these colors reduces the total amount of light gathered by the sensor and destroys much of the information about the color of the light impinging on each sensor element. Although the Foveon X3 has greater light gathering ability, the color-indicating information in the sensor's raw data requires "aggressive" matrixing to produce color data in a standard color space, which can increase noise in low-light situations. [cite web | author = Brian Griffith | title = Know raw? Part 2 | work = Photostream on auspiciousdragon.net | date = 2007-07-05 | url = http://www.auspiciousdragon.net/photowords/?p=880 ]

patial resolution

According to Sigma Corporation, "there has been some controversy in how to specify the number of pixels in Foveon sensors." [cite web | url = http://www.cameratown.com/news/news.cfm/hurl/id%7C3599 | title = Sigma SD14 White Papers | accessdate = 2007-04-29 ] The argument has been over whether sellers should count the number of photosites, or the total number of photodiodes, as a megapixel count, and whether either of those should be compared with the number of photodiodes in a Bayer filter sensor or camera as a measure of resolution.

For example, the dimensions of the photosite array in the sensor in the Sigma SD10 camera are 2268 × 1512, and the camera produces a native file size of those dimensions (times three color layers). This amounts to approximately 3.4 million three-color pixels. However, it has been advertised as a 10.2 MP camera by taking account of the fact that each photosite contains stacked red, green, and blue color sensing photodiodes, or pixel sensors (2268 × 1512 × 3). By comparison, the dimensions of the photosite array in the 10.2 MP Bayer sensor in the Nikon D200 camera are 3872 × 2592, but there is only one photodiode, or one pixel sensor, at each site. The cameras have equal numbers of photodiodes, and produce similar RAW data file sizes, but the Bayer filter camera produces a larger native file size via demosaicing.

However, the actual resolution produced by the Bayer sensor is more complicated than the count of its photosites, or its native file size, might suggest. The reason has to do with both the demosaicing and the separate anti-aliasing filter commonly used to reduce the occurrence or severity of color moiré patterns that the mosaic characteristic of the Bayer sensor produces. The effect of this filter is to blur the image output of the sensor, thus producing a lower resolution than the photosite count would seem to imply. This filter is largely unnecessary with the Foveon X3 sensor and is not used. The earliest camera with a Foveon X3 sensor, the Sigma SD9, showed visible luminance moiré patterns, but not color moiré. [cite web | url = http://www.dpreview.com/reviews/SigmaSD9/page23.asp | title = Sigma SD9 Review | work = dpreview | author = Phil Askey | month = November | year = 2002] Subsequent X3-equipped cameras have less aliasing because they include microlenses, which provide an effective anti-aliasing filter by averaging the optical signal over an area commensurate with the sample density, which is not possible in any color channel of a Bayer-type sensor. Aliasing from the Foveon X3 sensor is "far less bothersome because it's monochrome" according to Norman Koren. [cite web | url = http://www.imatest.com/docs/print_sharpness.html | title = Sharpness: What is it and how is it measured? | work = Imatest docs | author = Norman Koren | accessdate = 2007-12-16] Therefore, in theory, it is possible for a Foveon X3 sensor with the same number of photodiodes as a Bayer sensor and no separate anti-aliasing filter to attain a higher spatial resolution than that Bayer sensor. Independent tests indicate that the "10.2 MP" array of the Foveon X3 sensor (in the Sigma SD10) has a resolution similar to a 5 MP ["Popular Photography & Imaging", Vol. 69, No. 6 (June, 2005), (table on p. 47).] or 6 MP ["Digital Photography Review", [http://www.dpreview.com/reviews/sigmasd10/page17.asp Sigma SD10 Review] , March 2004, Retrieved March 3, 2007.] Bayer sensor, and at at low ISO speed even similar to a 7.2 MP [c|net Reviews, [http://reviews.cnet.com/Sigma_SD10/4505-6501_7-30588638.html Sigma SD10] Retrieved March 6, 2007.] Bayer sensor.

With the introduction of the Sigma SD14, the 14 MP (4.7 MP red + 4.7 MP green + 4.7 MP blue) Foveon X3 sensor resolution is being compared favorably by reviewers to that of 10 MP Bayer sensors. For example, Mike Chaney of ddisoftware says, "the SD14 produces better photos than a typical 10 MP dSLR because it is able to carry sharp detail all the way to the 'falloff' point at 1700 LPI whereas contrast, color detail, and sharpness begin to degrade long before the 1700 LPI limit on a Bayer based 10 MP dSLR." [cite web | url = http://www.ddisoftware.com/sd14-5d/ | title = Sigma SD14 Resolution: 14 MP? 4.6 MP? How does the SD14 stack up against high end cameras like the Canon EOD 5D? | author = Mike Chaney | year = 2007] Another article judges the Foveon X3 sensor as roughly equivalent to a 9 MP Bayer sensor. [ [http://www.popphoto.com/howto/4276/foveon-x3-sensor-claims-put-to-the-test.html Foveon X3 Sensor Claims Put to the Test] ]

Comparison to Bayer filter sensors – noise

The Foveon X3 sensor, as used in the Sigma SD10 camera, has been characterized by two independent reviewers as noisier than the sensors in some other DSLRs using the Bayer sensor at higher ISO film speed equivalents. [See, "e.g.", c|net Reviews, [http://reviews.cnet.com/Sigma_SD10/4505-6501_7-30588638.html Sigma SD10] Retrieved March 6, 2007 and Steve's Digicams [http://www.steves-digicams.com/2003_reviews/sigma_sd10_pg7.html Sigma SD10 review] (November 28, 2003) Retrieved March 6, 2007.] Another has noted higher noise during long exposure times. [ Imaging Resource [http://www.imaging-resource.com/PRODS/SSD10/SD10A12.HTM Sigma SD10 review] (First posted 10-22-03.) Retrieved March 6, 2007. This observation is consistent with a comparison of the images, displayed in Digital Photography Review, taken by the Sigma SD10 http://www.dpreview.com/reviews/sigmasd10/page14.asp with those taken approximately contemporaneously of the same scene by the Bayer sensor equipped Nikon D70 http://www.dpreview.com/reviews/nikond70/page15.asp. Both retrieved March 6, 2007.] However, these reviewers offer no opinion as to whether this is an inherent property of the sensor or the camera's image processing algorithms.

More recently, one reviewer is judging the Sigma SD14 camera with the new 14 MP Foveon X3 sensor to have noise levels ranging from "very low" at the ISO 100 sensitivity equivalent to "Moderate" at the ISO 1600 equivalent using the camera's Raw image format. [cite web | url =http://www.popphoto.com/cameras/4277/camera-test-sigma-sd14.html | title = Camera Test: Sigma SD14 | author = Michael J. McNamara|month=July | year=2007 Retrieved November 26, 2007]

Comparison to Bayer filter sensors – actual samples

[http://www.sigma-sd14.com Sigma's SD14 site] has galleries of full-resolution images showing the color produced by the current state of Foveon technology. The 14-MP Foveon chip produces 4.7 MP native-size RGB files; 14-MP Bayer filter cameras produce a 14 MP native file size by interpolation (demosaicing). Direct visual comparison of images from 12.7-MP Bayer sensors and 14.1 MP Foveon sensors show Bayer images ahead on fine monochrome detail, such as the lines between bricks on a distant building, but the Foveon images are ahead on color resolution. [cite web | title = Sigma SD14 Resolution: 14 MP? 4.6 MP? | author = Mike Chaney | date = March 16 2007 | url = http://www.ddisoftware.com/sd14-5d/ | work = Digital Domain Inc.]

Notes

External links

* [http://www.sigma-sd14.com/sample-photo/index.html Sample gallery of Sigma SD14 with Foveon X3 sensor]
* [http://www.foveon.com/article.php?a=67 Foveon X3 technology page]
* [http://www.x3f.info/technotes/x3pixel/pixelpage.html Foveon X3 Pixel Page]
* [http://www.dpreview.com/news/0202/02021103foveonx3preview.asp DPReview Foveon X3 prototype preview]
* [http://www.foveonx3.org Foveon user community]
* [http://www.x3f.info/spp/v2_1/english.html Foveon/Sigma support/info site]
* [http://www.pbase.com/sigmadslr Sample Sigma/Foveon photos]
* [http://www.digicamreview.co.uk/photos/gallery/polaroid_x530 Sample Polaroid x530/Foveon photos]
* [http://www.dpreview.com/news/0609/06092604sigmadp1.asp Sigma DP1]