click below
click below
Normal Size Small Size show me how
Learning exam 2
Shedules of Reinforcement and Choice Behavior
Question | Answer |
---|---|
cumulative record | graphical representation of how a response is repeated over time, passage of time on (x-axis) and total cumulative number of responses have occurred up to a particular point (y-axis) |
Concurrent-chain schedule of reinforcement | participant is permitted to choose during the first link which of several simple reinforcement schedules will be in effect in the second link. Once a choice has been made, the rejected alternatives are not available till the next trial. |
Concurrent schedule | reinforcement procedure in which the participant can choose any one of two or more simple reinforcement schedules that are available simultaneously. Concurrent schedules allow for the measurement of direct choice between schedule alternatives. |
Continuous reinforcement (CRF) | A schedule reinforcement in which every occurrence of the instrumental response produces the reinforcer |
fixed-interval scallop | The gradually increasing rate of responding that occurs between successive reinforcements on a fixed-interval schedule. |
Fixed-interval schedule (FI) | reinforcement schedule in which a fixed number of responses must occur in order for the next response to be reinforced. |
Intermittent reinforcement/ partial reinforcement | schedule of reinforcement in which only some of the occurrences of the instrumental response are reinforced. The instrumental response is reinforced occasionally, or intermittently. |
Fixed-ratio schedule (FR) | reinforcement schedule in which a fixed number of responses must occur in order for the next response to be reinforced. |
Inter-response time (IRT) | The interval between one response and then next. IRTs can be differentially reinforced in the same fashion as other aspects of behavior, such as response force or variability. |
Interval schedule | A reinforcement schedule in which a response in reinforced only if it occurs after a set amount of time following the last reinforcer or start of the trial. |
Limited hold | a restriction on how long a reinforcer remains available. In order for a response to be reinforced, it must occur before the end of the limited-hold period. |
Matching law | rule for instrumental behavior, proposed by R.J. Herrnstien, states that the relative rate of responding on a particular response alternative equals the relative rate of reinforcement for that response alternative. |
Post-reinforcement pause | A pause in responding that typically occurs after the delivery of the reinforcer on fixed-ratio and fixed-interval schedules of reinforcement. |
Ratio run | high and invariant rate of responding observed after the post reinforcement pause on fixed-ratio schedules. The ratio run ends when the necessary number of responses have been performed, and the participant is reinforced. |
Ratio schedule | reinforcement schedule in which reinforcement depends only on the number of responses the participant performs, irrespective of when those responses occur. |
Ratio strain | Disruption of responding that occurs when a fixed-ratio response requirement is increased too rapidly. |
Response-rate schedule | reinforcement schedule in which response is reinforced depending on how soon that response is made after the previous occurrence of the behavior. |
Schedule of reinforcement | program, or rule, that determines how and when the occurrence of a response will be followed by the delivery of the reinforcer. |
Undermatching | less sensitivity to the relative rate of reinforcement than predicted by the matching law. |
Value discounting function | the mathematical function that describes how reinforcer value decreases as a function of how long one has to wait for delivery of the reinforcer. |
Variable-interval schedule (VI) | A reinforcement schedule in which reinforcement is provided for the first response that occurs after a variable amount of time from the last reinforcer or the start of the trial. |
Variable-ratio schedule (VR) | reinforcement schedule in which the number of responses necessary to produce reinforcement varies from trial to trial. The value of the schedule refers to the average number of responses needed for reinforcement. |
Behavioral bliss point | the preferred distribution of an organism’s activities before and instrumental conditioning procedure is introduced that sets constraints and limitations on response allocation |
Consummatory response theory | a theory that assumes that species-typical consummatory responses (eating, drinking and the like) are critical features of reinforcers |
Demand curve | the relation between how much of a commodity is purchased and the price of the commodity |
Differential probability principle/ Premack principle | reinforcement depends on how much more likely the organism is to perform the reinforcer response than the instrumental response before an instrumental conditioning procedure is introduced. |
Disequilibrium model | Model used in applied behavior analysis that assumes that reinforcement effects are produced by restricting access to the reinforcer response below the rate of this response during a nonconstrained free baseline period. (response deprivation hypothesis) |
Elasticity of demand | the degree to which price influences the consumption or purchase of a commodity. If price has a large effect on consumption, elasticity of demand is high. If price has a small effect on consumption, elasticity of demand is low. |
Minimum-deviation model | Model of instrumental behavior, according to which participants respond to a response-reinforcer contingency in a manner that gets them as close as possible to their behavioral bliss point. |
Response-deprivation hypothesis | explanation of reinforcement according to which restricting access to a response below its baseline rate of occurrence (response deprivation) is sufficient to make the opportunity to perform that response and effective positive reinforcer. |
appetitive stimulus | A pleasant or satisfying stimulus that can be used to positively reinforce an instrumental response |
aversive stimulus | A unpleasant or annoying stimulus that can be used to punish an instrumental response. |
accidental reinforcement/ adventitious reinforcement | An instance in which the delivery of a reinforcer happens to coincide with a particular response, even though that response was not responsible for the reinforcer presentation. |
Avoidance | An instrumental conditioning procedure in which the instrumental response prevents the delivery of an aversive stimulus. |
Belongingness | The theoretical idea, originally proposed by Thorndike, that an orgasm's evolutionary history makes certain responses fit or belong with certain reinforces. Belongingness facilitates learning. |
conditioned reinforcer/ secondary reinforcer | A stimulus that becomes an effective reinforcer because of its association with a primary or unconditioned reinforcer. |
contiguity/ temporal contiguity | The occurrence of two events, such as response and reinforcer, very close together in time. |
differential reinforcement of other behavior (DRO) | A instrumental conditioning procedure in which a positive reinforcer is periodically delivered only if the participant does something other than the target response. |
discrete-trial-procedure | A method of instrumental conditioning in which the participant can perform the instrumental response only during specified periods, usually determined either by placement of the participant in an experimental chamber, or by the presentation of a stimulus. |
escape | An instrumental conditioning procedure in which the instrumental response terminates an aversive stimulus. (negative reinforcement) |
free-operant procedure | Method of instrumental conditioning that permits repeated performance of the instrumental response without intervention by the experimenter. (compare with discrete-trial procedure) |
instinctive drift | A gradual drift of instrumental behavior away from the responses required for reinforcement to species-typical, or instinctive, responses related to the reinforcement and to other stimuli in the experimental situation. |
instrumental behavior | An activity that occurs because it is effective in producing a particular consequence or reinforcer |
interim response | Response that increases in frequency after the delivery of a periodic reinforcer, and then declines as time for the next reinforcer approaches. |
latency | time between the start of a trial (or start of the stimulus) and the instrumental response. |
law of effect | Thorndike, response in the presence of a stimulus is followed by a satisfying event, the association between the stimulus and the response will be strengthened; if the response is followed by an annoying event, assoication will be weakened. |
learned-helplessness effect | Interference with the learning of new instrumental responses as a result of exposure to inescapable and unavoidable aversive stimulation. |
learned-helplessness hypothesis | theoretical idea that assumes that during exposure to inescapable and unavoidable aversive stimulation participants learn that their behavior does not control environmental events. reduces motivation to respond and disrupts subsequent instrumental cond. |
magazine training | A preliminary stage of instrumental conditioning in which a stimulus is repeatedly paired with the reinforcer to enable the participant to learn to go and get the reinforcer when it is presented. |
marking procedure | instrumental response is immediately followed by a distinctive event ( the participant is picked up or a flash of light is presented) that makes the instrumenal response more memorable and helps overcome the deleterious effects of delayed reinforcement. |
negative contrast | Less responding for a less desired or small reinforcer following previous experience with a more desired or large reinforcer that in the absence of such prior experience. |
negative reinforcement | instrumental conditioning procedure in which there is a negative contingency between the instrumental response and an aversive stimulus. If the instrumental response is not performed, the aversive stimulus is presented. |
omission training (negative punishment) | instrumental cond. procedure in which the instrumental response prevents the delivery of a reinforcing stimulus. (differential reinforcement or other behavior) |
Operant response | response defined by the effect it produces in the environment. Examples include pressing a lever and opening a door. Any sequence of movements that depresses the lever or opens the door constitutes and instance of that particular operant. |
positive contrast | a greater response for a favorable or larger reinforcer following previous experience with a less desired or small reinforcer, than in the absence of such prior experience. |
positive reinforcement | positive contingency between the instrumental response and a reinforcing stimulus. If the participant performs the response, it receives the reinforcing stimulus; if the participant does not perform the response, no reinforcing. |
negative reinforcement | positive contingency between the instrumental response and aversive stimulus. If the participant performs the instrumental response, it receives the aversive stimulus; if the participant does not perform the response the aversive stimulus is presented. |
response-reinforcer contingency | the relation of a response to a reinforcer defined in terms or the probability of getting reinforced for making the response as compared to the probability of getting reinforced in the absence of the response. |
running speed | how fast and animal moves down a runway |
shaping | reinforcement of successive approximations to a desired instrumental response |
superstitious behavior | Behavior that increases in frequency becasue of accidental parings of the delivery of a reinforcer with occurrences of the behavior. |
temporal relation | the time interval between an instrumental response and the reinforcer. |
terminal response | response that is most likely at the end of an interval between successive reinforcements that are presented at fixed intervals. |
Punishment (positive punishment) | An instrumental conditioning procedure in which there is a positive contingency between the instrumental response and an aversive stimulus. If the participant performs the instrumental response, it receives the stimulus. If not, it doesn't receive it. |
melioration | A mechanism for achieving matching by responding so as to improve the local rates of reinforcement for response alternatives. |