- Noise reduction
Noise reduction is the process of removing noise from a signal.
All recording devices, both analogue or digital, have traits which make them susceptible to noise. Noise can be random or white noise with no coherence, or coherent noise introduced by the device's mechanism or processing algorithms.
In electronic recording devices, a major form of noise is hiss caused by random electrons that, heavily influenced by heat, stray from their designated path. These stray electrons influence the voltage of the output signal and thus create detectable noise.
In the case of photographic film and magnetic tape, noise (both visible and audible) is introduced due to the grain structure of the medium. In photographic film, the size of the grains in the film determines the film's sensitivity, more sensitive film having larger sized grains. In magnetic tape, the larger the grains of the magnetic particles (usually ferric oxide or magnetite), the more prone the medium is to noise.
To compensate for this, larger areas of film or magnetic tape may be used to lower the noise to an acceptable level.
- 1 In audio
- 2 In images
- 3 See also
- 4 References
- 5 External links
When using analog tape recording technology, they may exhibit a type of noise known as tape hiss. This is related to the particle size and texture used in the magnetic emulsion that is sprayed on the recording media, and also to the relative tape velocity across the tape heads.
Four types of noise reduction exist: single-ended pre-recording, single-ended hiss reduction, single-ended surface noise reduction, and codec or dual-ended systems. Single-ended pre-recording systems (such as Dolby HX Pro) work to affect the recording medium at the time of recording. Single-ended hiss reduction systems (such as DNR) work to reduce noise as it occurs, including both before and after the recording process as well as for live broadcast applications. Single-ended surface noise reduction (such as CEDAR and the earlier SAE 5000A and Burwen TNE 7000) is applied to the playback of phonograph records to attenuate the sound of scratches, pops, and surface non-linearities. Dual-ended systems (such as Dolby NR and dbx Type I and II) have a pre-emphasis process applied during recording and then a de-emphasis process applied at playback.
Dolby and dbx noise reduction system
While there are dozens of different kinds of noise reduction, the first widely used audio noise reduction technique was developed by Ray Dolby in 1966. Intended for professional use, Dolby Type A was an encode/decode system in which the amplitude of frequencies in four bands was increased during recording (encoding), then decreased proportionately during playback (decoding). The Dolby B system (developed in conjunction with Henry Kloss) was a single band system designed for consumer products. In particular, when recording quiet parts of an audio signal, the frequencies above 1 kHz would be boosted. This had the effect of increasing the signal to noise ratio on tape up to 10dB depending on the initial signal volume. When it was played back, the decoder reversed the process, in effect reducing the noise level by up to 10dB. The Dolby B system, while not as effective as Dolby A, had the advantage of remaining listenable on playback systems without a decoder.
Dbx was the competing analog noise reduction system developed by dbx laboratories. It used a root-mean-squared (RMS) encode/decode algorithm with the noise-prone high frequencies boosted, and the entire signal fed through a 2:1 compander. Dbx operated across the entire audible bandwidth and unlike Dolby B was unusable as an open ended system. However it could achieve up to 30 dB of noise reduction. Since Analog video recordings use frequency modulation for the luminance part (composite video signal in direct colour systems), which keeps the tape at saturation level, audio style noise reduction is unnecessary.
Dynamic Noise Reduction
Dynamic Noise Reduction (DNR) is an audio noise reduction system, introduced by National Semiconductor to reduce noise levels on long-distance telephony. First sold in 1981, DNR is frequently confused with the far more common Dolby noise reduction system. However, unlike Dolby and dbx Type I & Type II noise reduction systems, DNR is a playback-only signal processing system that does not require the source material to first be encoded, and it can be used together with other forms of noise reduction. It was a development of the unpatented Philips Dynamic Noise Limiter (DNL) system, introduced in 1971, with the circuitry on a single chip.
Because DNR is non-complementary, meaning it does not require encoded source material, it can be used to remove background noise from any audio signal, including magnetic tape recordings and FM radio broadcasts, reducing noise by as much as 10 dB. It can be used in conjunction with other noise reduction systems, provided that they are used prior to applying DNR to prevent DNR from causing the other noise reduction system to mistrack.
One of DNR's first widespread applications was in the GM Delco Bose car stereo systems in U.S. GM cars (later added to Delco-manufactured car stereos in GM vehicles as well), introduced in 1984. It was also used in factory car stereos in Jeep vehicles in the 1980s, such as the Cherokee XJ. Today, DNR, DNL, and similar systems are most commonly encountered as a noise reduction system in microphone systems.
A second class of algorithms work in the time-frequency domain using some linear or non-linear filters that have local characteristics and are often called time-frequency filters. Noise can therefore be also removed by use of spectral editing tools, which work in this time-frequency domain, allowing local modifications without affecting nearby signal energy. This can be done manually by using the mouse with a pen that has a defined time-frequency shape. This is done much like in a paint program drawing pictures. Another way is to define a dynamic threshold for filtering noise, that is derived from the local signal, again with respect to a local time-frequency region. Everything below the threshold will be filtered, everything above the threshold, like partials of a voice or "wanted noise", will be untouched. The region is typically defined by the location of the signal Instantaneous Frequency, as most of the signal energy to be preserved is concentrated about it.
Modern digital sound (and picture) recordings no longer need to worry about tape hiss so analog style noise reduction systems are not necessary. However, an interesting twist is that dither systems actually add noise to a signal to improve its quality.
Images taken with both digital cameras and conventional film cameras will pick up noise from a variety of sources. Many further uses of these images require that the noise will be (partially) removed - for aesthetic purposes as in artistic work or marketing, or for practical purposes such as computer vision.
In salt and pepper noise (sparse light and dark disturbances), pixels in the image are very different in color or intensity from their surrounding pixels; the defining characteristic is that the value of a noisy pixel bears no relation to the color of surrounding pixels. Generally this type of noise will only affect a small number of image pixels. When viewed, the image contains dark and white dots, hence the term salt and pepper noise. Typical sources include flecks of dust inside the camera and overheated or faulty CCD elements.
In Gaussian noise, each pixel in the image will be changed from its original value by a (usually) small amount. A histogram, a plot of the amount of distortion of a pixel value against the frequency with which it occurs, shows a normal distribution of noise. While other distributions are possible, the Gaussian (normal) distribution is usually a good model, due to the central limit theorem that says that the sum of different noises tends to approach a Gaussian distribution.
In either case, the noises at different pixels can be either correlated or uncorrelated; in many cases, noise values at different pixels are modeled as being independent and identically distributed, and hence uncorrelated.
In selecting a noise reduction algorithm, one must weigh several factors:
- the available computer power and time available: a digital camera must apply noise reduction in a fraction of a second using a tiny onboard CPU, while a desktop computer has much more power and time
- whether sacrificing some real detail is acceptable if it allows more noise to be removed (how aggressively to decide whether variations in the image are noise or not)
- the characteristics of the noise and the detail in the image, to better make those decisions
Chroma and luminance noise separation
In real-world photographs, the highest spatial-frequency detail consists mostly of variations in brightness ("luminance detail") rather than variations in hue ("chroma detail"). Since any noise reduction algorithm should attempt to remove noise without sacrificing real detail from the scene photographed, one risks a greater loss of detail from luminance noise reduction than chroma noise reduction simply because most scenes have little high frequency chroma detail to begin with. In addition, most people find chroma noise in images more objectionable than luminance noise; the colored blobs are considered "digital-looking" and unnatural, compared to the grainy appearance of luminance noise that some compare to film grain. For these two reasons, most photographic noise reduction algorithms split the image detail into chroma and luminance components and apply more noise reduction to the former.
Most dedicated noise-reduction computer software allows the user to control chroma and luminance noise reduction separately.
Linear smoothing filters
One method to remove noise is by convolving the original image with a mask that represents a low-pass filter or smoothing operation. For example, the Gaussian mask comprises elements determined by a Gaussian function. This convolution brings the value of each pixel into closer harmony with the values of its neighbors. In general, a smoothing filter sets each pixel to the average value, or a weighted average, of itself and its nearby neighbors; the Gaussian filter is just one possible set of weights.
Smoothing filters tend to blur an image, because pixel intensity values that are significantly higher or lower than the surrounding neighborhood would "smear" across the area. Because of this blurring, linear filters are seldom used in practice for noise reduction; they are, however, often used as the basis for nonlinear noise reduction filters.
Two measurements of the same physical quantity often exhibit different noise levels in different frequency ranges. Therefore, a single high-fidelity signal can be constructed by combining the low-noise parts of the signals in Fourier space. The strength of noise reduction by signal combination is that we do not see the loss of information that occurs in other noise-suppression approaches such as filtering or smoothing. Noise reduction by signal combination has found applications in in-car microphone systems, single molecule biophysics, chemometrics among other disciplines.
Another method for removing noise is to evolve the image under a smoothing partial differential equation similar to the heat equation which is called anisotropic diffusion. With a spatially constant diffusion coefficient, this is equivalent to the heat equation or linear Gaussian filtering, but with a diffusion coefficient designed to detect edges, the noise can be removed without blurring the edges of the image.
A median filter is an example of a non-linear filter and, if properly designed, is very good at preserving image detail. To run a median filter:
- consider each pixel in the image
- sort the neighbouring pixels into order based upon their intensities
- replace the original value of the pixel with the median value from the list
A median filter is a rank-selection (RS) filter, a particularly harsh member of the family of rank-conditioned rank-selection (RCRS) filters; a much milder member of that family, for example one that selects the closest of the neighboring values when a pixel's value is external in its neighborhood, and leaves it unchanged otherwise, is sometimes preferred, especially in photographic applications.
Median and other RCRS filters are good at removing salt and pepper noise from an image, and also cause relatively little blurring of edges, and hence are often used in computer vision applications.
Most general purpose image and photo editing software will have one or more noise reduction functions (median, blur, despeckle, etc.). Special purpose noise reduction software programs include Neat Image, Grain Surgery, Noise Ninja, DenoiseMyImage, GREYCstoration (now G'MIC), and pnmnlfilt (nonlinear filter) found in the open source Netpbm tools. General purpose image and photo editing software including noise reduction functions include Adobe Photoshop, GIMP, PhotoImpact, Paint Shop Pro, and Helicon Filter.
General noise issues
- ^ B. Boashash, editor, “Time-Frequency Signal Analysis and Processing – A Comprehensive Reference”, Elsevier Science, Oxford, 2003; ISBN 0080443354
- ^ B. Boashash, "Estimating and Interpreting the Instantaneous Frequency of a Signal-Part I: Fundamentals", Proceedings of the IEEE, Vol. 80, No. 4, pp. 519-538, April 1992, doi:10.1109/5.135376
- ^ Mashaghi et al. Noise reduction by signal combination in Fourier space applied to drift correction in optical tweezers, Rev. Sci. Instrum. 82, 115103 (2011)
- ^ Puyin Liu and Hongxing Li (2004). Fuzzy Neural Network Theory and Application. World Scientific. ISBN 9812387862. http://books.google.com/books?id=6p8fCgT0QNMC&pg=PA13&dq=%22rank+conditioned+rank+selection%22#PPA13,M1.
- Noise reduction for Pixel Sensors
- Recent trends in denoising tutorial
- Noise Reduction in photography
- Matlab software and Photoshop plug-in for image denoising (Pointwise SA-DCT filter)
- Matlab software for image and video denoising (Non-local transform-domain filter)
- Non-local image denoising, with code and online demonstration
Noise (in physics and telecommunications) General Noise in... Class of noise Engineering terms RatiosCarrier-to-noise ratio (C/N) · Carrier-to-receiver noise density (C/kT) · dBrnC · Eb/N0 (energy per bit to noise density) · Es/N0 (energy per symbol to noise density) · Modulation error ratio (MER) · Signal, noise and distortion (SINAD) · Signal-to-interference ratio (S/I) · Signal-to-noise ratio (S/N, SNR) · Signal to noise ratio (imaging) · Signal-to-noise plus interference (SNIR) · Signal-to-quantization-noise ratio (SQNR) Related topics Video processing Post-processing Special processing 24 to 30 fps conversion 30 to 24 fps conversionInverse telecine
Wikimedia Foundation. 2010.