Orthogonal array testing

See also: Latin square

Orthogonal array testing is a black box testing technique which is a systematic, statistical way of software testing .^{[1] [2]}It is used when the number of inputs to the system is relatively small, but too large to allow for exhaustive testing of every possible input to the systems.^[1] It is particularly effective in finding errors associated with faulty logic within computer software systems.^[1]Orthogonal arrays can be applied in user interface testing, system testing, regression testing, configuration testing and performance testing. The permutations of factor levels comprising a single treatment are so chosen that their responses are uncorrelated & hence each treatment gives unique piece of information. The net effect of organizing the experiment in such treatments is that the same piece of information is gathered in the minimum number of experiments.

Background

Orthogonal Vector

All orthogonal vectors exhibit orthogonality. Orthogonal vectors exhibit the following properties:

• Each of the vectors conveys information different from that of any other vector in the sequence, i.e., each vector conveys unique information therefore avoiding redundancy.
• On a linear addition, the signals may be separated easily.
• Each of the vectors is statistically independent of the others, i.e., the correlation between them is nil.
• When linearly added, the resultant is the arithmetic sum of the individual components.

Pairwise testing

Many faults in testing occur due to neglecting the test cases having combination of two test cases but when we go for pairwise testing combinations of two test cases is taken and tested and it covers most of test cases and is more effective since it covers most of the test cases.^[3] Tools for pairwise testing are available, and they are effective in their respective domain and the application where they are used.

Technique

Consider a system which has 3 parameters and each of them has 3 values. To test the all possible combination (i.e. exhaustive testing) we will need a set of 27 test cases.But instead of testing the system for each combination of parameters, orthogonal array select the combination effectively and uniformly. With orthogonal array technique we can maximize the test coverage while minimum number of test cases.^[4].We here assume that the pair that the test that maximizes interaction between the parameters, will have more defects and the technique works.^[4]

Orthogonal Array

Test case ↓	Parameter 1	Parameter 2	Parameter 3
1	1	1	3
2	1	2	2
3	1	3	1
4	2	1	2
5	2	2	1
6	2	3	3
7	3	1	1
8	3	2	3
9	3	3	2

Given that assumption, the table shows the set of nine combination of parameters which are sufficient to catch the fault considering the interaction of the input parameters, which is very effective and economical. The array is orthogonal because all possible pair-wise combinations between parameters occurs only once.^[4]
The given L9 Orthogonal Array assess result of test cases as follows,^[1]
Single Mode Faults - Single mode faults occur only due to one parameter. For example, in above Orthogonal array if test cases 7, 8 and 9 show error, we can expect that value 3 of parameter 1 is causing the error.Likewise we can detect as well as isolate the error.
Double Mode Fault - Double mode fault is caused by the two specific parameters values interacting together. Such a interaction is a harmful interaction between interacting parameters.
Multimode Faults - More than two interacting components if produce the consistent erroneous output, then it is a multimode fault. Orthogonal array detects the multimode faults.

Benefits

• Reduces testing cycle time and analysis is simpler.
• Balanced test cases ensure straightforward defect isolation and performance assessments. This provides a significant cost savings over pair-wise testing

Important Notes

• The only means to guarantee coverage of all defects is to test all possible combinations. As this is not feasible within budget and schedule, testers generally select a "sample: of the total test domain. Orthogonal arrays provide a means to effectively generate high coverage samples to validate the test domain.

References

1. ^ ^{a b c d} Pressman, Roger S (2005). Software Engineering: A Practitioner's Approach (6th ed.). McGraw-Hill. ISBN 0-07-285318-2. 
2. ^ cite web |url=https://paportal.phadkeassociates.net/learning.aspx |title=Planning Efficient Software Tests |first=Madhav S |last=Phadke |publisher=Phadke Associates, Inc. |quote=Numerous articles on utilizing Orthogonal Arrays for Software and System Testing.
3. ^ "Pairwise.org". http://www.pairwise.org/. 
4. ^ ^{a b c} Dustin, Elfriede. "Orthogonally Speaking". http://www.stickyminds.com/stickyfile.asp?i=3638556&j=94197&ext=.pdf.  (subscription required)

External links

• Rao, Calyampudi Radhakrishna (2009). "Orthogonal arrays". Scholarpedia, 4 (7): 9076. http://www.scholarpedia.org/article/Orthogonal_arrays. 
• Delius, Gustav W (May 2004). "Orthogonal Arrays (Taguchi Designs)". University of York. http://www.york.ac.uk/depts/maths/tables/orthogonal.htm. 
• Kuhfeld, Warren F. "Orthogonal Arrays". SAS Institute Inc. http://support.sas.com/techsup/technote/ts723.html. "SAS provides a catalog of over 117,000 orthogonal arrays." 
• Phadke, Madhav S. "Planning Efficient Software Tests". Phadke Associates, Inc.. https://paportal.phadkeassociates.net/learning.aspx. "Numerous articles on utilizing Orthogonal Arrays for Software and System Testing." 
• "rdExpert Software for Orthogonal Array Testing". Phadke Associates, Inc.. http://www.phadkeassociates.com/index_rdexperttestplanning.htm. "Commercial toolset for Orthogonal Array Testing." 

This statistics-related article is a stub. You can help Wikipedia by expanding it.v · Categories: Survival analysis Design of experiments Statistics stubs Wikimedia Foundation. 2010. Игры ⚽ Поможем сделать НИР Pale-headed Rosella Columbia Artists Management Look at other dictionaries: List of statistics topics — Please add any Wikipedia articles related to statistics that are not already on this list.The Related changes link in the margin of this page (below search) leads to a list of the most recent changes to the articles listed below. To see the most… …   Wikipedia Latin hypercube sampling — (LHS) is a statistical method for generating a distribution of plausible collections of parameter values from a multidimensional distribution. The sampling method is often applied in uncertainty analysis. The technique was first described by… …   Wikipedia MIMO — This article is about MIMO in wireless communication. For other uses, see MIMO (disambiguation). Understanding of SISO, SIMO, MISO and MIMO (note that the terms input and output refer to the radio channel carrying the signal, not to the devices… …   Wikipedia solids, mechanics of — ▪ physics Introduction       science concerned with the stressing (stress), deformation (deformation and flow), and failure of solid materials and structures.       What, then, is a solid? Any material, fluid or solid, can support normal forces.… …   Universalium Computed tomography — tomos (slice) and graphein (to write).Computed tomography was originally known as the EMI scan as it was developed at a research branch of EMI, a company best known today for its music and recording business. It was later known as computed axial… …   Wikipedia Principal component analysis — PCA of a multivariate Gaussian distribution centered at (1,3) with a standard deviation of 3 in roughly the (0.878, 0.478) direction and of 1 in the orthogonal direction. The vectors shown are the eigenvectors of the covariance matrix scaled by… …   Wikipedia List of terms relating to algorithms and data structures — The [http://www.nist.gov/dads/ NIST Dictionary of Algorithms and Data Structures] is a reference work maintained by the U.S. National Institute of Standards and Technology. It defines a large number of terms relating to algorithms and data… …   Wikipedia Список терминов, относящихся к алгоритмам и структурам данных —   Это служебный список статей, созданный для координации работ по развитию темы.   Данное предупреждение не устанавливается на информационные списки и глоссарии …   Википедия Список терминов — Список терминов, относящихся к алгоритмам и структурам данных   Это сл …   Википедия Medical ultrasonography — This article is about using ultrasound to image the human body. For imaging of animals in research, see Preclinical imaging. Sonography redirects here. For the tactile alphabet called sonography , see Night writing. Medical ultrasonography… …   Wikipedia 18+ © Academic, 2000-2024 Contact us: Technical Support, Advertising Dictionaries export, created on PHP, Joomla, Drupal, WordPress, MODx. Mark and share Search through all dictionaries Translate… Search Internet Share the article and excerpts Direct link … Do a right-click on the link above and select “Copy Link”