click below
click below
Normal Size Small Size show me how
Tut 3 - lrnng animls
| Term | Definition |
|---|---|
| CC | two stimuli associated NS + US Bell NS + Food US -> Salivation UR Bell CS -> Salivation CR |
| CC elicited behaviour | autonomic passive, reflexive |
| OC | behaviour is strengthened or weakened based on consequences ACTIVE subject ACTIVE performs behaviour to receive outcomes |
| BF SKINNER | SKINNER BOX (OC) |
| SKINNER BOX | OPERANT CHAMBER |
| Operant chamber | lever/bar - press by rat to get food food hopper - delivers food magazine sound - conditioned reinforcer (sound predicts FOOD) stimulus cues - lights, tones for signalling |
| SNIFFY VIRTUL RAT | classical and operant conditioning magazine training shaping reinforcement schedules extinction cumulative recorder |
| sniffy virtual rat cumulative recorder | track sniffy's responses over time (steeper slope = higher response rate) go down to go up |
| MAGAZINE TRAINING | Solve the credit assignment problem help rat learn what action earned the reward how: pair sound magazine (CS) with food (US) |
| how: pair sound magazine (CS) with food (US) | sound predicts FOOD PAIRS = PREDICTIONS |
| dog training analogy (magazine training) | clicker training click CS food US us eventually becomes cs |
| shaping behaviour | technique - reinforce successive approximations of target behaviour steps - REWARD small steps (standing) -> only REWARD LEVER PRESS |
| shaping behaviour broken down | primary reinforcer: food secondary reinforcer: magazine sound (paired with food) anything paired w FOOD |
| Operant conditioning extinction | Reduction in behaviour Reinforcement is removed |
| standard extinction | BOTH food magazine sound REMOVED Behaviour GRADUALLY DECLINES |
| Extinction burst | Initial spike response (frustration) |
| Extinction - REMOVE ONLY FOOD - MAGAZINE SOUND HEARD ONLY | SLOWER extinction SOUND still has reinforcing value initially denial that there is no food (Continues the process) |
| RAT HEARS MAGAZINE SOUND | REINFORCES (VERY MUCH) GRADUALLY DECLINES (slow) |
| Reinforcement schedules | continuous reinforcement CRF partial reinforcement PRF |
| continuous reinforcement CRF | fast acquisition learning rapid extinction continues, FAST LEARNING, FAST EXTINCTION |
| partial reinforcement PRF | reinforce some responses more resistant to extinction partial reinforcement extinction effect PREE - by reinforcing some responses, the responses become more resistant to extinction SOME = NO EXTINCTION (RATS HAVE HOPE) |
| Types Partial Reinforcement PRF | Fixed Ratio (Variable Ratio) - BEST Fixed Interval Variable Interval |
| Fixed Ratio | Reward after fixed number of responses (FR10) High rate pattern and pause after reward Resistance to extinction is moderate |
| VIRTUAL REALITY (VR) (VARIABLE RATIO) | THE BEST |
| Variable Ratio | Reward after average number of responses (VR25) Pattern is high and steady rate Resistance to extinction is very high |
| Fixed Interval | Reward after fixed time (FI30s) Pattern is "scalloped" response Resistance to extinction is low |
| Variable Interval | Reward after varying times (VI60s) Pattern is steady response Resistance to extinction is high |
| Variable reinforcement schedules | Better than fixed reinforcement schedules |
| VR USED | GAMBLING, ADDICTIVE BEHAVIOUR (RESISTANT TO EXTINCTION) |
| OPERANT consequences (4) | Positive reinforcement (good) Negative reinforcement (good) Positive punishment (bad) Negative punishment (bad) |
| Positive Reinforcement | Add pleasant stimulus to increase behaviour Praise after cleaning room |
| Negative Reinforcement | Remove aversive stimulus to increase behaviour Take aspirin to remove headache (Look key words) removing headache (REMOVE) |
| Positive Punishment | Add aversive stimulus to decrease behaviour Burn after touching stove touching stove (ADD) |
| Negative Punishment | Remove pleasant stimulus to decrease behaviour Lose phone for breaking rules LOSE (REMOVE) |
| The four operant consequences | JUST ONE READ SENTENCE |
| Reinforcement | GOOD |
| Punishment | BAD |
| Positive | ADD |
| Negative | REMOVE |
| Second order conditioning | Lever press -> magazine sound -> food |
| Lever press | Indirectly linked to food VIA CONDITIONED REINFORCER (MAGAZINE SOUND) |
| Lever press -> food | use condition reinforcer |
| second order conditioning broken down | useful for shaping complex behaviours |
| standard extinction | food and sound is BOTH REMOVED Fast extinction after burst (always burst) |
| not standard extinction - sound remains, remove food | only food removed slower extinction rat more persistent denial of food removal |
| After PRF (Partial reinforcement schedule) esp VR (Variable ratio) | irregular reinforcement history -> long persistance of behaviour Variable > Fixed Partial > Continuous |