Psychology and Neuroscience Faculty Database
Psychology and Neuroscience
Arts & Sciences
Duke University

 HOME > Arts & Sciences > pn > Faculty    Search Help Login pdf version printable version 

Publications [#287966] of John E. Staddon

search PubMed.

Chapters in Books

  1. Davis, DGS; Staddon, JER "Memory for Reward in Probabilistic Choice: Markovian and Non-Markovian Properties."  BRILL, January, 1990: 37-64. [Gateway.cgi], [doi]
    (last updated on 2024/03/29)

    Abstract:
    AbstractPigeons were rewarded with food for pecking keys in various forms of two-armed bandit situation for an extended series of daily sessions in two experiments. The average daily preference (S=R/[R+L]) is very well fit by a markovian linear model in which predicted preference today is an average of predicted preference yesterday and reinforcement conditions today: s(N+1) = as(N) + (1-a)A(N+1), where A(N+1) is set equal to 1 when all rewards are for the Right response, and 0 when all are for the Left, and a is a longterm memory parameter. This linear model explains some apparent paradoxes in earlier reports of memory effects in two-armed bandit experiments. Nevertheless, closer examination of the details of preference changes within each experimental session showed several kinds of non-markovian effects. The most important was a regression at the beginning of each experimental session towards a preference characteristic of earlier sessions (spontaneous recovery). This effect, but not a smaller, less reliable non-markovian reminiscence effect, is consistent with a very simple rule, namely that the effect on preference of each individual reward for a Right or Left response is inversely related to how long ago the reward occurred. Thus, animals learn to prefer the rewarded side each day because these rewards are recent; but they regress to earlier preferences overnight because the most recent rewards become relatively less recent with lapse of time.


Duke University * Arts & Sciences * Faculty * Staff * Grad * Postdocs * Reload * Login