Image processing engine

Image processing engine

The image processing engine, or image processor, is an important component of a digital camera and plays a vital role in creating the digital image.

The image processing engine must perform a complex range of tasks.

The photodiodes employed in an image sensor are colour-blind by nature: they can only record shades of grey. To get colour into the picture, they are covered with different colour filters: red, green and blue (RGB) according to the pattern designated by the Bayer filter - named after its inventor. As each photodiode records the colour information for exactly one pixel of the image, without an image processor there would be a green pixel next to each red and blue pixel. (Actually, with most sensors there are two green for each blue and red diodes.)

The image processing engine comprises a combination of hardware processors and software algorithms. The image processor gathers the luminance and chrominance information from the individual pixels and uses it to compute/interpolate the correct colour and brightness values for each pixel. If it does this well, the result is an image with natural and pleasing colours, balanced contrast and appropriate sharpness.

This process, however, is quite complex and involves a number of different operations. Its success depends largely on the "intelligence" of the algorithms applied.

Demosaicing

As stated above, the image processor evaluates the colour and brightness data of a given pixel, compares them with the data from neighbouring pixels and then uses a demosaicing algorithm to produce and appropriate colour and brightness value for the pixel. The image processor also assesses the whole picture to guess at the correct distribution of contrast. By adjusting the gamma value (heightening or lowering the contrast range of an image's mid-tones) subtle tonal gradations, such as in human skin or the blue of the sky, become much more realistic.

Noise reduction

Noise is a phenomenon found in any electronic circuitry. In digital photography its effect is often visible as random spots of obviously wrong colour in an otherwise smoothly-coloured area. Noise increases with temperature and exposure times. When higher settings are chosen the electronic signal in the image sensor is amplified, which at the same time increases the noise level, leading to a lower signal-to-noise ratio. The image processor attempts to separate the noise from the image information and to remove it. This can be quite a challenge, as the image may contain areas with fine textures which, if treated as noise, may lose some of their definition.

Image sharpening

As the colour and brightness values for each pixel are interpolated some image softening is applied to even out any fuzziness that has occurred. To preserve the impression of depth, clarity and fine details, the image processor must sharpen edges and contours. It therefore must detect edges correctly and reproduce them smoothly and without over-sharpening.

Speed

With the ever higher pixel count in image sensors, the image processor's speed becomes more critical: photographers don't want to wait for the camera's image processor to complete its job before they can carry on shooting - they don't even want to notice some processing is going on inside the camera. Therefore, image processors must be optimised to cope with more data in the same or even a shorter period of time.

Individual manufacturers have named their image processing engines differently: Canon's is called DiG!C, Olympus' TruePic, and Panasonic's the VENUS Engine.

See also

*Image processing
*Digital image processing
*Digital image editing
*Demosaicing


Wikimedia Foundation. 2010.

Игры ⚽ Нужно решить контрольную?

Look at other dictionaries:

  • Signature image processing — (SIP) is a technology for analysing electrical data collected from welding processes usually automated, robotic welding. In developed countries, some form of welding is used in more than 50% of manufactured products. Acceptable welding requires… …   Wikipedia

  • Image retrieval — An image retrieval system is a computer system for browsing, searching and retrieving images from a large database of digital images. Most traditional and common methods of image retrieval utilize some method of adding metadata such as captioning …   Wikipedia

  • Venus Engine — The Venus processing engine for digital cameras is an image processing engine developed by Panasonic, and almost all of their Lumix cameras use a version of it. Image processors operate in four steps: receive data from the CCD sensor, create the… …   Wikipedia

  • Color image pipeline — An image pipeline or video pipeline is a term used to describe the components that are typically or commonly used between an image source (such as a camera, a scanner, or the rendering engine in a computer game), and an image renderer (such as a… …   Wikipedia

  • X Image Extension — X Image Extension, or XIE was an extension to the X Window System to enhance its graphics capability. It was intended to provide a powerful mechanism for the transfer and display of virtually any image on any X capable hardware. It was first… …   Wikipedia

  • Emotion Engine — The Emotion Engine is a CPU developed and manufactured by Sony and Toshiba for use in the Sony PlayStation 2 video game console. Mass production of the Emotion Engine began in 1999. Description The Emotion Engine consists of eight separate units …   Wikipedia

  • Montage Image Mosaic Software — Engine Mosaic image of the Pleiades star cluster created with Montage. The blue, green, and red channels of this three color image were made from B , R , and I band images, respectively, from the Digitized Sky Survey (DSS). Image credit: Inseok… …   Wikipedia

  • information processing — Acquisition, recording, organization, retrieval, display, and dissemination of information. Today the term usually refers to computer based operations. Information processing consists of locating and capturing information, using software to… …   Universalium

  • Automatic image annotation — (also known as automatic image tagging) is the process by which a computer system automatically assigns metadata in the form of captioning or keywords to a digital image. This application of computer vision techniques is used in image retrieval… …   Wikipedia

  • Content-based image retrieval — (CBIR), also known as query by image content (QBIC) and content based visual information retrieval (CBVIR) is the application of computer vision techniques to the image retrieval problem, that is, the problem of searching for digital images in… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”