click below
click below
Normal Size Small Size show me how
PSY 410 Exam 3
Operant Conditioning, Memory Consolidation, Cognitive Control
| Question | Answer |
|---|---|
| what is operant conditioning (as a learning procedure)? | learning procedure where the the presentation of a reinforcer is contingent on the performance of the response |
| what types of response performances does each reinforcement schedule elicit? | -Variable ratio and variable interval have more linear responding (people keep responding because the reward is less predictable) -variable interval has the biggest dips in responding |
| how does intensity affect responding | the intensity of the stimulus will increase responding |
| what does it mean if an organism is responding on a response-outcome manner | R-->O is goal-directed, organism has learned the outcome is dependent on their response. If the outcome changes, the organism may no longer respond |
| what does it mean if an organism is responding in a stimulus-response manner | S-->R is habit, organism has learned to associate the stimulus with the response and behave in a more automatic way |
| what is the goal criterion and how is it tested | -goal criterion = measurable standard to determine if a goal has been acheived -tested in rats using food, if they keep eating after satiety they are acting habitually |
| what is the contingency criterion and how is it tested | -contingency criterion = assessing relationship between response and outcome -testing if the response is the same after goal has been devalued, if responding changes, then behavior is goal-directed |
| what role does the infralimbic cortex play in operant conditioning | -subdivision of the medial prefrontal cortex -involved in habit formation -lesions of IL cortex shift behavior towards goal-directed |
| What area of the brain is activated in patients with OCD and does this relate more to goals or habits | -OCD patients show hyperactivation of the orbitofrontal cortex & caudate nucleus (part of dorsomedial striatum circuit) -relates more to habits (compulsive & repetitive behaviors) |
| What role does the dorsolateral striatum play in operant conditioning? | -dorsolateral striatum (DLS) is essential for habit learning & expression -when training on a task increases, behavior shifts more towards habit -DLS encodes S-->R associations |
| what tests are used to determine if brain regions influence goal-directed or habitual behavior? | -outcome devaluation test -contingency degradation test: relationship between response and outcome is broken by rewarding randomly and independent of responding |
| What area of the brain is activated in addicts? Does this relate more to goals or habits? | -addicts show increased DLS activity -indicative of habits |
| In humans, what is the equivalent area of the infralimbic cortex in rats? | -subgenual anterior cingulate cortex (sgACC) in humans is equivalent to infralimbic cortex in rats |
| In humans, what is the equivalent area of the dorsolateral striatum in rats? | -putamen is human equivalent of dorsolateral striatum in rats |
| what role does consolidation play in learning and memory? | -without consolidation, newly learned info is vulnerable to interference or disruption |
| what role do corticosteroids and epinephrine play in consolidation? | -corticosteroids and epinephrine are stress hormones -epinephrine enhances consolidation, especially in amygdala corticosteroids modulate consolidation in amygdala and hippocampus |
| what compound is essential for long-term memory | CaMK2 |
| what role does the amygdala play in consolidation? | -modulatory hub for consolidation -not permanent storage for memories -basolateral amygdala (BLA) is somewhat involved in spatial memory and cued tasks |
| when would the hippocampus be influenced by consolidation | -spatial learning and memory -declarative memories, especially episodic -important in early consolidation |
| when would the dorsal striatum be influenced by consoliidation | -NOT involved in spatial memory -important for cued tasks -important for proedural/implicit memories, especially habit and skill learning |
| what role does CaMK2 play in consolidation | -increases AMPA -critical for long-term potentiation |
| how is consolidation studied? | -protein synthesis inhibitors -electroshock therapy -lesions -pharmacological agents -optogenetics -sleep deprivation |
| who are Edvard Moser, May-Britt Moser, and John O'Keefe? | -John O'Keefe discovered place cells in the hippocampus -Mosers discovered grid cells in the entorhinal cortex |
| What are place cells, how were they observed, and in what brain region? | -fire when an animal occupies a certain location -observed via single-unit electrophysiological recordings -found in dorsal hippocampus |
| What are grid cells, how were they observed, and in what brain region? | -grid cells fire at multiple locations in a hexagonal pattern -observed via single-unit recordings -located in the medial entorhinal cortex |
| What are direction cells (head direction cells), how were they observed, and in what brain region? | -fire when animal's head points in a specific direction, like a neural compass -observed using electrophysiological recordings in rats -found in thalamus, retrosplenial cortex, and dorsal striatum |
| What are time cells, how were they observed, and in what brain region? | -fire at specific moments, encoding passage of time -observed using electrophysiological recordings performing delay tasks (tasks with a timed pause) -found in hippocampus and medial entorhinal cortex -same circuitry that maps space also maps time |
| Who is Henry Molaison (H.M.), and what did studies of his amnesia tell us about long-term memory? pt1 | -had epilepsy, surgical removal of medial temporal lobes (hippocampus and surrounding) -developed anterograde amnesia -intact short-term/working memory (could hold a convo) -retained non-declarative memory -mems from before surgery were fine |
| what did studies of H.M. amnesia tell us about long-term memory? pt2 | -patient HM proved that hippocampus is essential for forming new declarative memories |
| what is skill learning | -gradual acquisition of motor skills through practice -a form of implicit memory, does not require conscious awareness -dependent on dorsal striatum and cerebellum |
| What are episodic and semantic memory, and which brain regions are involved? | -episodic memory: recalling personal experiences. Depends on hippocampus and medial temporal lobe -semantic memory: general factual knowledge. Depends on neocortex (temporal and prefrontal areas) -both are forms of declarative memory |
| What is sensory memory? | -two forms, iconic and echoic -iconic memory is visual and lasts around 0.5 seconds -echoic memory is auditory and lasts around 3-4 seconds |
| what is short-term memory? | -holds a small amount of info in an accessible state for a brief period -usually holds ~7 items -depends on prefrontal cortex -does not require protein synthesis |
| why is the basolateral amygdala important in operant conditioning? | -high BLA activity favors goal-directed responding -suppression of BLA (and increase of infralimbic cortex) favors habits |
| evidence of BLA importance | -BLA lesions in rats make them insensitive to outcome devaluation |
| why is BLA important in consoldiation? | -acts as a modulator, doesn't store memories BUT determines how strongly a memory is consolidated somewhere else -mediated by norepinephrine -projects to hippocampus and dorsal striatum |