Experiment

"Experimental" redirects here. For the musical classification, see Experimental music.

For other uses, see Experiment (disambiguation).

Even very young children perform rudimentary experiments in order to learn about the world.

An experiment is a methodical procedure carried out with the goal of verifying, falsifying, or establishing the validity of a hypothesis. Experiments vary greatly in their goal and scale, but always rely on repeatable procedure and logical analysis of the results. A child may carry out basic experiments to understand the nature of gravity, while teams of scientists may take years of systematic investigation to advance the understanding of a phenomenon.

An experiment is a method of testing - with the goal of explaining - the nature of reality. Experiments can vary from personal and informal (e.g. tasting a range of chocolates to find a favourite), to highly controlled (e.g. tests requiring complex apparatus overseen by many scientists hoping to discover information about subatomic particles).

In the design of comparative experiments, two or more "treatments" are applied to estimate the difference between the mean responses for the treatments. For example, an experiment on baking bread could estimate the difference in the responses associated with quantitative variables, such as the ratio of water to flour, and with qualitative variables, such as strains of yeast. Experimentation is the step in the scientific method that helps people decide between two or more competing explanations – or hypotheses. These hypotheses suggest reasons to explain a phenomenon, or predict the results of an action. An example might be the hypothesis that "if I release this ball, it will fall to the floor": this suggestion can then be tested by carrying out the experiment of letting go of the ball, and observing the results. Formally, a hypothesis is compared against its opposite or null hypothesis ("if I release this ball, it will not fall to the floor"). The null hypothesis is that there is no explanation or predictive power of the phenomenon through the reasoning that is being investigated. Once hypotheses are defined, an experiment can be carried out - and the results analysed - in order to confirm, refute, or define the accuracy of the hypotheses.

Overview

Experiment is the step in the scientific method that arbitrates between competing models or hypotheses.^[1][2] Experimentation is also used to test existing theories or new hypotheses in order to support them or disprove them.^[3][4] An experiment or test can be carried out using the scientific method to answer a question or investigate a problem. First an observation is made. Then a question is asked, or a problem arises. Next, a hypothesis is formed. Then experiment is used to test that hypothesis. The results are analyzed, a conclusion is drawn, sometimes a theory is formed, and results are communicated through research papers.

A good experiment usually tests a hypothesis. However, an experiment may also test a question or test previous results. It is important that one knows all factors in an experiment. It is also important that the results are as accurate as possible. If an experiment is carefully conducted, the results usually either support or disprove the hypothesis. An experiment can never "prove" a hypothesis, it can only add support. However, one repeatable experiment that provides a counterexample can disprove a theory or hypothesis. An experiment must also control the possible confounding factors -- any factors that would mar the accuracy or repeatability of the experiment or the ability to interpret the results.

Francis Bacon was an English philosopher and scientist in the 17th century and an early and influential supporter of experimental science. He disagreed with the method of answering scientific questions by deduction and described it as follows: "Having first determined the question according to his will, man then resorts to experience, and bending her to conformity with his placets, leads her about like a captive in a procession."^[5] Bacon wanted a method that relied on repeatable observations, or experiments. He was notably the first to order the scientific method as we understand it today.

There remains simple experience; which, if taken as it comes, is called accident, if sought for, experiment. The true method of experience first lights the candle [hypothesis], and then by means of the candle shows the way [arranges and delimits the experiment]; commencing as it does with experience duly ordered and digested, not bungling or erratic, and from it deducing axioms [theories], and from established axioms again new experiments.

— Francis Bacon. Novum Organum. 1620.^[6]

When the problem or conditions do not permit a controlled experiment, such as in astronomical research, observational studies can be useful. For example, Tycho Brahe made careful observations and recorded measurements of stellar and planetary positions over time, which supported the Copernican theory of orbits and disproved Brahe's own hypothesis. After his death, Brahe's measurements proved useful in the development of Johannes Kepler's laws of planetary motion.

In the centuries that followed, important advances and discoveries were made by people who applied the scientific method in different areas. For example, Galileo Galilei was able to accurately measure time and experiment to make accurate measurements and conclusions about the speed of a falling body.Antoine Lavoisier was a French chemist in the late 1700s who used experiment to describe new areas such as combustion and biochemistry and to develop the theory of conservation of mass (matter).^[7] During the 1800s, Louis Pasteur used the scientific method to disprove the prevailing theory of spontaneous generation and to develop the germ theory of disease.^[8] Because of the importance of controlling potentially confounding variables, the use of well-designed laboratory experiments is preferred when possible.

Galileo Galilei

Measured fall time of a small steel sphere falling from various heights. The data is in good agreement with the predicted fall time of $\sqrt{2h/g}$, where h is the height and g is the acceleration of gravity.

Galileo Galilei was a scientist who performed many quantitative experiments addressing many topics. Using several different methods, Galileo was able to accurately measure time. Previously, most scientists had used distance to describe falling bodies using geometry, which had been used and trusted since Euclid.^[9] Galileo himself used geometrical methods to express his results. Galileo's successes were aided by the development of a new mathematics as well as cleverly designed experiments and equipment. At that time, another kind of mathematics was being developed—algebra. Algebra allowed arithmetical calculations to become as sophisticated as geometric ones. Algebra also allowed the discoveries of scientists such as Galileo—as well as later scientists like Newton, Maxwell and Einstein—to be later summarized by mathematical equations. These equations described physical relationships in a precise, self-consistent manner.

One prominent example is the "ball and ramp experiment."^[10] In this experiment Galileo used an inclined plane and several steel balls of different weights. With this design, Galileo was able to slow down the falling motion and record, with reasonable accuracy, the times at which a steel ball passed certain markings on a beam.^[11] Galileo disproved Aristotle's assertion that weight affects the speed of an object's fall. According to Aristotle's Theory of Falling Bodies, the heavier steel ball would reach the ground before the lighter steel ball. Galileo's hypothesis was that the two balls would reach the ground at the same time.

Other than Galileo, not many people of his day were able to accurately measure short time periods, such as the fall time of an object. Galileo accurately measured these short periods of time by creating a pulsilogon. This was a machine created to measure time using a pendulum.^[12] The pendulum was synchronized to the human pulse. He used this to measure the time at which the weighted balls passed marks that he had made on the inclined plane. He measured to find that balls of different weights reached the bottom of the inclined plane at the same time and that the distance traveled was proportional to the square of the elapsed time.^[13] Later scientists summarized Galileo's results as The Equation of Falling Bodies.^[14][15]

Distance d traveled by an object falling for time t where g is gravitational acceleration (~ 9.8 m/s2):

$\ d=\frac{1}{2}gt^2$

These results supported Galileo's hypothesis that objects of different weights, when measured at the same point in their fall, are falling at the same speed because they experience the same gravitational acceleration.

Antoine Lavoisier

Lavoisier and Laplace's ice calorimeter device

Antoine Lavoisier (1743–1794) was a French chemist regarded as the founder of modern chemistry. Lavoisier's experiments were among the first truly quantitative chemical experiments. He showed that, although matter changes its state in a chemical reaction, the quantity of matter is the same at the end as at the beginning of every chemical reaction. In one experiment, he burned phosphorus and sulfur in air to see whether the results further supported his previous conclusion (Law of Conservation of Mass). In this experiment, however, he determined that the products weighed more than the original phosphorus and sulfur. He decided to do the experiment again. This time he measured the mass of the air surrounding the experiment as well. He discovered that the mass gained in the product was lost from the air. These experiments provided further support for his Law of Conservation of Mass.

One of Lavoisier's experiments connected the worlds of respiration and combustion. Lavoisier's hypothesis was that combustion and respiration were one and the same, and combustion occurs with every instance of respiration. Lavoisier, working with Pierre-Simon Laplace, designed an ice calorimeter apparatus for measuring the amount of heat given off during combustion or respiration. This machine consisted of three concentric compartments. The center compartment held the source of heat, in this case, the guinea pig or piece of burning charcoal. The middle compartment held a specific amount of ice for the heat source to melt. The outside compartment contained packed snow for insulation. Lavoisier then measured the quantity of carbon dioxide and the quantity of heat produced by confining a live guinea pig in this apparatus. Lavoisier also measured the heat and carbon dioxide produced when burning a piece of charcoal in the calorimeter. Using this data, he concluded that respiration was in fact a slow combustion process. He also discovered through precise measurements that these processes produced carbon dioxide and heat with the same constant of proportionality. He found that for 224 grains of "fixed air" (CO₂) produced, 13 oz (370 g). of ice was melted in the calorimeter. Converting grains to grams and using the energy required to melt 13 oz (370 g). of ice, one can compute that for each gram of CO₂ produced, about 2.02 kcal of energy was produced by the combustion of carbon or by respiration in Lavoisier's calorimeter experiments. This compares well with the modern published heat of combustion for carbon of 2.13 kcal/g.^[16] This continuous slow combustion, which Lavoisier and Laplace supposed took place in the lungs, enabled the living animal to maintain its body temperature above that of its surroundings, thus accounting for the puzzling phenomenon of animal heat.^[17] Lavoisier concluded, "Lla respiration est donc une combustion," That is, respiratory gas exchange is combustion, like that of burning a candle.

Lavoisier was the first to conclude by experiment that the Law of Conservation of Mass applied to chemical change.^[18] His hypothesis was that the mass of the reactants would be the same as the mass of the products in a chemical reaction. He experimented on vinous fermentation. He determined the amounts of hydrogen, oxygen, and carbon in sugar. He weighed a quantity of sugar, added yeast and water in measured amounts, and allowed the mixture to ferment. Lavoisier measured the mass of the carbonic acid gas and water that were given off during fermentation and weighed the residual liquor, the components of which were then separated and analyzed to determine their elementary composition.^[19] In this way he controlled a couple of potential confounding factors. He was able to capture the carbonic acid gas and water vapor that were given off during fermentation so that his final measurements would be as accurate as possible. Lavoisier then concluded that the total mass of the reactants was equal to the mass of the final product and residue.^[20] Moreover, he showed that the total mass of each constituent element before and after the chemical change remained the same. Similarly, he demonstrated via experimentation that the mass of products of combustion is equal to the mass of the reacting ingredients.

Louis Pasteur

(Above) A swannecked flask is pictured with broth and no bacteria in it after being boiled to remove any germs or microorganisms. (Below) Another swannecked flask is pictured with outside contaminants in the air allowed in. This broth grows microorganisms.

Louis Pasteur, regarded as the "Father of Microbiological sciences and immunology," was a French biologist during the 19th century.^[21] He discovered and supported by experimental results the idea that disease-causing agents do not spontaneously appear but are alive and need the right environment to prosper and multiply. Stemming from this discovery, he used experiment to develop vaccines for chicken cholera, anthrax and rabies, and to develop methods for reducing bacteria in some food products by heating them (pasteurization). His work also led him to advocate (along with the English physician Dr. Joseph Lister) for antiseptic surgical techniques. Most scientists of that day believed that microscopic life sprang into existence from nonliving matter. This idea was called spontaneous generation.

Pasteur's observations of tiny organisms under the microscope caused him to doubt spontaneous generation. He designed an experiment to test it. His hypothesis was that life could not arise from where there is no life. He took care to control possible confounding factors. For example, he needed to make sure there was no life, even microscopic, in the flasks of broth he used as a test medium. He decided to kill any microscopic organisms already present by boiling the broth until he was confident that any microorganisms present were killed. Pasteur also needed to make sure that no microscopic organisms entered the broth after boiling, yet the broth needed exposure to air to properly test the theory. A colleague suggested a flask with a neck the shape of an "S" turned sideways. Dust (which Pasteur thought contained microorganisms) would be trapped at the bottom of the first curve, but the air would flow freely through.^[22]

Thus, if bacteria should really be spontaneously generated, then they should be growing in the flask after a few days. If spontaneous generation did not occur, then the contents of the flasks would remain lifeless. In the end, it was a complete success; not a single microorganism appeared in the broth. Then Pasteur allowed the dust containing the microorganisms to mix with the broth. In just a few days the broth became cloudy from millions of organisms growing in it. For two more years, he repeated the experiment in various conditions and locales to assure himself that the results were correct. In this way Pasteur supported his hypothesis that spontaneous generation does not occur.^[23] Despite the experimental results supporting his hypotheses and his success curing or preventing various diseases, correcting the public misconception of spontaneous generation was a slow, difficult process.

As he worked to solve specific problems, Pasteur's notions were sometimes corrected by the results of his experiments, such as when he was asked to find the cause of disease devastating the French silkworm industry in 1865. After a year of diligent work he correctly identified a culprit organism and gave practical advice for developing a healthy population of moths. However, when he tested his own advice, he found disease still present. It turned out he had been correct but incomplete – there were two organisms at work. It took two more years of experimenting to find the complete solution.^[24]

Observational science

Observational science is used when it is impractical to fit a system into a laboratory setting. It can also be used when confounding factors are either limited or known well enough to analyze the data in light of them. In order for an observational science to be valid, the confounding factors must be known and accounted for.

Astronomy

One such observational scientist was Tycho Brahe. Brahe's observations of stellar and planetary positions were noteworthy both for their accuracy and quantity.^[25] His celestial positions were much more accurate than those of any predecessor or contemporary. In an observatory funded for him by King Frederick II of Denmark, Brahe built the largest observing instruments yet constructed.^[26] Because of the large size of this equipment, Brahe was able to measure angles to an accuracy of better than 0.1 degree. This was more accurate than any previous observations, and close to the limit that the human eye can observe.^[27] In this way, Brahe was able to make observations about stellar and planetary positions in a lab setup.

Brahe himself was not a Copernican but proposed a system in which the Sun and Moon orbited the Earth, while the other planets orbited the Sun. His system provided a safe position for astronomers who were dissatisfied with older models but were reluctant to accept the Earth's motion. It gained a considerable following after 1616 when Rome decided officially that the heliocentric model was contrary to both philosophy and Scripture, and could be discussed only as a computational convenience that had no connection to fact. His system also offered a major innovation: while both the geocentric model and the heliocentric model as set forth by Copernicus relied on the idea of transparent rotating crystalline spheres to carry the planets in their orbits, Brahe eliminated the spheres entirely.

Johannes Kepler used the accurate observations of Brahe to discover the shape of Mars's orbit. His first hypothesis was that the orbit was circular. After four years of research and testing 70 different combinations of circles and epicycles, he devised a shape that would fit Mars's orbit. However, the model was accurate to only 0.13 degrees.^[28] Kepler knew that Brahe's observations could be used to develop an orbit shape more accurate than this. Kepler eventually decided to try various oval shaped orbits. This implied that the speed of the planet changed as it traveled around the oval. After nine years, he found that elliptical orbits fit satisfactorily with the observed path of Mars. He found that this shape worked not only for Mars, but also for every planet that Brahe had observed.^[28]

Biology

Observational studies are not experiments. By definition, observational studies lack the manipulation required for Baconian experiments. In addition, observational studies in biological systems often involve variables that are challenges to quantify or control. Nevertheless, observational studies are used because it is sometimes too difficult (too expensive, or too much time required) or unethical to conduct longitudinal experiments with human or animal subjects. In these situations, observational studies have value because they often suggest hypotheses that can be tested with randomized experiments or by collecting fresh data.

In providing therapies for human subjects, for example in psychology or health care, it is unethical to provide a substandard treatment to patients. Therefore, ethical review boards are supposed to stop clinical trials and other experiments unless a new treatment is believed to offer benefits as good as current best practice.^[29] It is also unethical and often illegal to conduct randomized experiments on the effects of substandard or harmful treatments, such as the effects of ingesting arsenic on human health. To understand the effects of such exposures, scientists use observational studies.

Observational studies are limited because they lack the statistical properties of randomized experiments. In a randomized experiment, the method of randomization specified in the experimental protocol guides the statistical analysis, which is usually specified also by the experimental protocol.^[30] Without a statistical model that reflects an objective randomization, the statistical analysis relies on a subjective model.^[30] Inferences from subjective models are unreliable in theory and practice.^[31] In fact, there are several cases where carefully conducted observational studies consistently give wrong results, that is, where the results of the observational studies are inconsistent and also differ from the results of experiments. For example, epidemiological studies of colon cancer consistently show beneficial correlations with broccoli consumption, while experiments find no benefit.^[32]

A particular problem with observational studies involving human subjects is the great difficulty attaining fair comparisons between treatments (or exposures), because such studies are prone to selection bias, and groups receiving different treatments (exposures) may differ greatly according to their covariates (age, height, weight, medications, exercise, nutritional status, ethnicity, family medical history, etc.). In contrast, randomization implies that for each covariate, the mean for each group is expected to be the same. For any randomized trial, some variation from the mean is expected, of course, but the randomization ensures that the experimental groups have mean values that are close, due to the central limit theorem and Markov's inequality. With poor randomization, the systematic variation in covariates between the treatment groups (or exposure groups) makes it difficult to separate the effect of the treatment (exposure) from the effects of the other covariates, most of which have not been measured. The mathematical models used to analyze such data must consider each differing covariate (if measured), and the results will not be meaningful if a covariate is neither randomized nor included in the model.

To avoid these conditions that render an experiment far less useful, physicians conducting medical trials, say for U.S. Food and Drug Administration approval, will quantify and randomize the covariates that can be identified. Researchers attempt to reduce the biases of observational studies with complicated statistical methods such as propensity score matching methods, which require large populations of subjects and extensive information on covariates. Outcomes are also quantified when possible (bone density, amount of some cell or substance in the blood, physical strength or endurance, etc.) and not based on a subject's or a professional observer's opinion. In this way, the design of an observational study can render the results more objective and therefore more convincing.

See also: Hierarchy of evidence and Quasi-empirical methods

Natural experiments

Main article: Natural experiment

The term "experiment" usually implies a controlled experiment, but sometimes controlled experiments are prohibitively difficult or impossible. In this case researchers resort to natural experiments or quasi-experiments. Natural experiments rely solely on observations of the variables of the system under study, rather than manipulation of just one or a few variables as occurs in controlled experiments. To the degree possible, they attempt to collect data for the system in such a way that contribution from all variables can be determined, and where the effects of variation in certain variables remain approximately constant so that the effects of other variables can be discerned. The degree to which this is possible depends on the observed correlation between explanatory variables in the observed data. When these variables are not well correlated, natural experiments can approach the power of controlled experiments. Usually, however, there is some correlation between these variables, which reduces the reliability of natural experiments relative to what could be concluded if a controlled experiment were performed. Also, because natural experiments usually take place in uncontrolled environments, variables from undetected sources are neither measured nor held constant, and these may produce illusory correlations in variables under study.

Much research in several important science disciplines, including economics, political science, geology, paleontology, ecology, meteorology, and astronomy, relies on quasi-experiments. For example, in astronomy it is clearly impossible, when testing the hypothesis "suns are collapsed clouds of hydrogen", to start out with a giant cloud of hydrogen, and then perform the experiment of waiting a few billion years for it to form a sun. However, by observing various clouds of hydrogen in various states of collapse, and other implications of the hypothesis (for example, the presence of various spectral emissions from the light of stars), we can collect data we require to support the hypothesis. An early example of this type of experiment was the first verification in the 17th century that light does not travel from place to place instantaneously, but instead has a measurable speed. Observation of the appearance of the moons of Jupiter were slightly delayed when Jupiter was farther from Earth, as opposed to when Jupiter was closer to Earth; and this phenomenon was used to demonstrate that the difference in the time of appearance of the moons was consistent with a measurable speed.

Field experiments

Main article: Field experiment

Field experiments are so named in order to draw a contrast with laboratory experiments. Often used in the social sciences, and especially in economic analyses of education and health interventions, field experiments have the advantage that outcomes are observed in a natural setting rather than in a contrived laboratory environment. However, like natural experiments, field experiments suffer from the possibility of contamination: experimental conditions can be controlled with more precision and certainty in the lab.

See also

• Design of experiments
• Experimental physics
• List of experiments
• Long-term experiment
• True experiment

References

1. ^ Cooperstock, Fred I. General Relativistic Dynamics: Extending Einstein's Legacy Throughout the Universe. Page 12. World Scientific. 2009. ISBN 978-981-4271-16-5
2. ^ Griffith, W. Thomas. The Physics of Everyday Phenomena: A Conceptual Introduction to Physics. Page 4. New York: McGraw-Hill Higher Education. 2001. ISBN 0-07-232837-1.
3. ^ Devine, Betsy. Fantastic realities: 49 mind journeys and a trip to Stockholm. Page 62. Wilczek, Frank. World Scientific. 2006. ISBN 978-981-256-649-2
4. ^ Griffith, W. Thomas. The Physics of Everyday Phenomena: A Conceptual Introduction to Physics. Page 3. New York: McGraw-Hill Higher Education. 2001. ISBN 0-07-232837-1.
5. ^ Bacon, Francis. Novum Organum. In Durant, Will. The Story of Philosophy. Page 101. Simon & Schuster Paperbacks. 1926. ISBN 978-0-671-69500-2
6. ^ Durant, Will. The Story of Philosophy. Page 101 Simon & Schuster Paperbacks. 1926. ISBN 978-0-671-69500-2
7. ^ Bell, Madison Smartt. Lavoisier in the Year One. Page 57. W.W. Norton & Company, Inc. 2005. ISBN 0-393-05155-2
8. ^ Dubos, Rene J. Louis Pasteur: Free Lance of Science. Page 155. De Capo Press. 1986. ISBN 978-0-306-80262-1
9. ^ Drake, Stillman; Swerdlow, Noel M.; Levere, Trevor Hardly. Essays on Galileo and the history and philosophy of science, Volume 3. Page 22. University of Toronto Press. 1999. ISBN 978-0-8020-4716-8.
10. ^ Solway, Andrew. Exploring forces and motion. Page 17. The Rosen Publishing Group. 2007. ISBN 978-1-4042-3747-6
11. ^ Stewart, James. Redlin, Lothar. Watson, Saleem. College Algebra. Page 562. Cengage Learning. 2008. ISBN 978-0-495-56521-5
12. ^ Massachusetts Medical Society, New England Surgical Society. The Boston Medical and Surgical Journal, Volume 125. Page 314. Cupples, Upham & Co. 1891
13. ^ Tiner, John Hudson. Exploring the World of Physics: From Simple Machines to Nuclear Energy. New Leaf Publishing Group. 2006. ISBN 0-89051-466-6
14. ^ Longair, M.S. Theoretical concepts in physics: an alternative view of theoretical reasoning in physics. Page 37. Cambridge University Press. 2003. ISBN 978-0-521-52878-8
15. ^ Schutz, Bernard F. Gravity from the ground up. Page 3. Cambridge University Press. 2003. ISBN 978-0-521-45506-0
16. ^ Holmes, Frederic Lawrence. Lavoisier and the chemistry of life: an exploration of scientific creativity. Page 188 Univ. Wisconsin Press. Reprint. 1987. ISBN 978-0-299-09984-8; The published value of the heat of combustion for carbon is usually expressed as 393.5 kJ/mol; unit conversion yields the figure in units for comparison of 2.13 kcal/g
17. ^ Holmes, Frederic Lawrence. Lavoisier and the chemistry of life: an exploration of scientific creativity. Page 197. Univ. Wisconsin Press. Reprint. 1987. ISBN 978-0-299-09984-8.
18. ^ Bell, Madison Smartt. Lavoisier in the Year One. Page 44. W.W. Norton & Company, Inc. 2005. ISBN 0-393-05155-2
19. ^ Holmes, Frederic Lawrence. Lavoisier and the chemistry of life: an exploration of scientific creativity. Page 382 Univ. Wisconsin Press. Reprint. 1987. ISBN 978-0-299-09984-8.
20. ^ Bell, Madison Smartt. Lavoisier in the Year One. Page 92W.W. Norton & Company, Inc. 2005. ISBN 0-393-05155-2
21. ^ Simmers, Louise. Simmers-Nartker, Karen. Diversified Health Occupations. Page 10. Cengage Learning 2008. ISBN 978-1-4180-3021-6
22. ^ Dubos, Rene J. Louis Pasteur: Free Lance of Science. Page 169. Da Capo Press. 1986. ISBN 978-0-306-80262-1
23. ^ Debré, Patrice. Louis Pasteur. Page 300. JHU Press, 2000. ISBN 978-0-8018-6529-9
24. ^ Dubos, Rene J. Louis Pasteur: Free Lance of Science. Page 210. Da Capo Press. 1986. ISBN 978-0-306-80262-1
25. ^ Noel Swerdlow, Astronomy in the Renaissance, pp. 187-230 in Christopher Walker, ed., Astronomy before the Telescope, (London: British Museum Press, 1996), pp. 207-10.
26. ^ Kupelis, Theo. Kuhn, Karl F. In Quest of the Universe. Page 55. Jones and Bartlett Publishers. 2007. ISBN 978-0-7637-4387-1.
27. ^ Kupelis, Theo. Kuhn, Karl F. In Quest of the Universe. Page 55. Jones and Bartlett Publishers. 2007. ISBN 9870763743871
28. ^ ^{a b} Kupelis, Theo. Kuhn, Karl F. In Quest of the Universe. Page 57. Jones and Bartlett Publishers. 2007. ISBN 9870763743871
29. ^ Bailey, R. A (2008). Design of Comparative Experiments. Cambridge University Press. ISBN 978-0-521-68357-9. http://www.maths.qmul.ac.uk/~rab/DOEbook/.  Pre-publication chapters are available on-line.
30. ^ ^{a b} *Hinkelmann, Klaus and Kempthorne, Oscar (2008). Design and Analysis of Experiments, Volume I: Introduction to Experimental Design (Second ed.). Wiley. ISBN 978-0-471-72756-9. http://books.google.com/books?id=T3wWj2kVYZgC&printsec=frontcover&cad=4_0. 
31. ^ David A. Freedman, R. Pisani, and R. A. Purves. Statistics, 4th edition (W.W. Norton & Company, 2007) [1] ISBN 978-0-393-92972-0
32. ^ David A. Freedman (2009) Statistical Models: Theory and Practice, Second edition, (Cambridge University Press) [2] ISBN 978-0-521-74385-3

External links

• Lessons In Electric Circuits - Volume VI - Experiments
• Trochim, William M., Experimental Design, The Research Methods Knowledge Base, 2nd Edition. (version current as of July 11, 2006 (2006 -07-11)^[update]).
• Description of weird experiments (with film clips)
• Science Experiments for Kids
• Concept Development and Experimentation
• Shadish, William R., Thomas D. Cook, and Donald T. Campbell. 2002. Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin. 623 p.
• Guide for Understanding and Implementing Defense Experimentation (GUIDEx), The Technical Cooperation Program, 2006
• Experiment in Physics from Stanford Encyclopedia of Philosophy