Melioration theory

Melioration theory posits that organisms are sensitive to differences in the local rates of reinforcement: number of reinforcements obtained at an alternative event divided by time at that alternative bifurcation. Also, "local" might or might not mean the negative power function of inverse delay weighed sum of time-biased past reinforcement stimuli. This is also called hyperbolic discounting. In making a choice between options, living organisms need not maximize expected payoff as classical economic theory posits. Rather than being aggregated, the options compete against one another based on differences in their local reinforcement rate. The organism continuously shifts from one alternative to the other, if one is better than the other, until the other is better than the first one, regardless of the effect on overall rate of reinforcement.

Melioration theory grew out of an impersonal anonymous interest in how the matching law comes to hold on. Richard J. Herrnstein (1961) reported that on concurrent VIVIVI reinforcement schedules, the proportion of responses to one alternative was approximately equal to the proportion of reinforcer received there. This finding is summarized in the matching law, which generated a great deal of both matching research and matching theorizing. Herrnstein (1970) suggested that matching may be a basic behavioral process, whereas Rachlin et al. (1976) suggested that matching comes about because it maximizes rate of matching reinforcement.

William Vaughan, Jr. (1976) suggested that the local rate of matching reinforcement on each reinforcement matching schedule is evaluated, and if those local rates differ, the distribution of time on a schedule is shifted from the poorer to the better schedule. On concurrent VIVIVI reinforcement schedules this process gives rise to matching, whereas on concurrent VRVRVR reinforcement schedules it gives rise to exclusive preferences for the better alternative and not the worse alternative. This rule was subsequently named Melioration (Herrnstein & Vaughan, 1980). See also Herrnstein, 1982, Vaughan, 1981; Vaughan & Herrnstein, 1987)

References

• Herrnstein, R.J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267–72.
• Herrnstein, R.J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243–66.
• Herrnstein, R.J. (1982). Melioration as behavioural dynamism. In Commons, M.L.; Herrnstein, R.J. & Rachlin, H. (Eds.), Quantitative analyses of behavior, vol. II: Matching and maximizing accounts, pp. 433–58. Ballinger Publishing Co., Cambridge, MA.
• Herrnstein, R.J. & Prelec, D. (1991). Melioration: A theory of distributed choice. The Journal of Economic Perspectives, 5(3), 137–56.
• Herrnstein, R.J. & Vaughan, W., Jr. (1980). Melioration and behavioral allocation. In J.E.R. Staddon (Ed.), Limits to action. New York: Academic Press.
• Rachlin, H.; Green, L.; Kagel, J.H. & Battalio, R.C. (1976). Economic demand theory and psychological studies of choice. In G.H. Bower (Ed.), The Psychology of Learning and Motivation, 10, pp. 129–54. New York: Academic Press.
• Vaughan, W., Jr. (1976). Optimization and reinforcement. Unpublished doctoral thesis, Harvard University.
• Vaughan, W., Jr. (1981). Melioration, matching, and maximization. Journal of the Experimental Analysis of Behavior, 36(2): 141–49.
• Vaughan, W., Jr. & Herrnstein, R.J. (1987). Stability, melioration, and natural selection. In L. Green & J.H. Kagel (Eds.), Advances in Behavioral Economics, Vol. 1 (pp. 185–215). Norwood, NJ: Ablex.