What is Operant What is Operant Conditioning?Conditioning?

Operant ConditioningOperant Conditioning

A type of learning in which the A type of learning in which the frequency of a behavior depends on the frequency of a behavior depends on the consequence that follows that behaviorconsequence that follows that behavior

The frequency will increase if the The frequency will increase if the consequence is reinforcing to the consequence is reinforcing to the subject.subject.

The frequency will decrease if the The frequency will decrease if the consequence is not reinforcing to the consequence is not reinforcing to the subject.subject.

Operant ConditioningOperant Conditioning

Operant ConditioningOperant Conditioning

Operant ConditioningOperant Conditioning

Operant ConditioningOperant Conditioning

Edward Thorndike (1874-1949)Edward Thorndike (1874-1949)

Author of the law of effect, the principle Author of the law of effect, the principle that forms the basis of operant that forms the basis of operant conditioningconditioning

Behaviors with favorable consequences Behaviors with favorable consequences will occur more frequently.will occur more frequently.

Behaviors with unfavorable Behaviors with unfavorable consequences will occur less frequently.consequences will occur less frequently.

Created puzzle boxes for research on Created puzzle boxes for research on catscats

Thorndike’s Puzzle BoxThorndike’s Puzzle Box

B.F. Skinner (1904-1990)B.F. Skinner (1904-1990)

Developed the fundamental Developed the fundamental principles and techniques of principles and techniques of operant conditioning and devised operant conditioning and devised ways to apply them in the real ways to apply them in the real worldworld

Designed the Skinner Box, or Designed the Skinner Box, or operant chamberoperant chamber

Skinner BoxSkinner Box

Reinforcement/PunishmentReinforcement/Punishment

Reinforcement - Any consequence Reinforcement - Any consequence that that increasesincreases the future likelihood of the future likelihood of a behaviora behavior

Punishment - Any consequence that Punishment - Any consequence that decreasesdecreases the future likelihood of a the future likelihood of a behaviorbehavior

The subject determines if a The subject determines if a consequence is reinforcing or consequence is reinforcing or punishingpunishing

ReinforcementReinforcement

Positive ReinforcementPositive Reinforcement

In operant conditioning, anything In operant conditioning, anything that increases the likelihood of a that increases the likelihood of a behavior by following it with a behavior by following it with a desirable event or statedesirable event or state

The subject receives something The subject receives something they wantthey want

Will strengthen the behaviorWill strengthen the behavior

Positive ReinforcementPositive Reinforcement

Negative ReinforcementNegative Reinforcement

In operant conditioning, anything In operant conditioning, anything that increases the likelihood of a that increases the likelihood of a behavior by following it with the behavior by following it with the removal of an removal of an undesirableundesirable event or event or statestate

Something the subject doesn’t like Something the subject doesn’t like is removedis removed

Will strengthen the behaviorWill strengthen the behavior

Negative ReinforcementNegative Reinforcement

Positive/Negative Positive/Negative ReinforcementReinforcement

Negative Reinforcement QuizNegative Reinforcement Quiz1. If you were asked for another word for 1. If you were asked for another word for negative negative

reinforcementreinforcement what would you select? what would you select?

2. When you supply negative reinforcement, it usually 2. When you supply negative reinforcement, it usually results in results in a.a. Weakening a behavior you want weakenedWeakening a behavior you want weakenedb.b. Strengthening a behavior you want strengthenedStrengthening a behavior you want strengthened

3. Do people usually look forward to receiving negative 3. Do people usually look forward to receiving negative reinforcement?reinforcement?

4.4. Do you anticipate regularly supplying positive Do you anticipate regularly supplying positive reinforcement to those you might manage in the reinforcement to those you might manage in the future?future?

5. Do you anticipate regularly supplying negative 5. Do you anticipate regularly supplying negative reinforcement to those you might manage in the reinforcement to those you might manage in the future?future?

Reinforcement: Reinforcement: Immediate Versus Immediate Versus Delayed ReinforcementDelayed Reinforcement

Immediate/Delayed ReinforcementImmediate/Delayed Reinforcement

Immediate reinforcement is more Immediate reinforcement is more effective than delayed effective than delayed reinforcementreinforcement

Ability to delay gratification Ability to delay gratification predicts higher achievementpredicts higher achievement

Reinforcement: Primary Reinforcement: Primary Versus Secondary Versus Secondary ReinforcementReinforcement

Primary ReinforcementPrimary Reinforcement

Something that is naturally Something that is naturally reinforcingreinforcing

Examples: food, warmth, water, Examples: food, warmth, water, etc.etc.

The item is reinforcing in and of The item is reinforcing in and of itselfitself

Secondary ReinforcementSecondary Reinforcement

Something that you have learned to Something that you have learned to value value

Money is a good exampleMoney is a good example

Punishment:Punishment:The Process of PunishmentThe Process of Punishment

Types of PunishmentTypes of Punishment

An undesirable event following a An undesirable event following a behaviorbehavior

A desirable state or event ends A desirable state or event ends following a behaviorfollowing a behavior

Punishment:Punishment:Problems With PunishmentProblems With Punishment

Negative Effects of PunishmentNegative Effects of Punishment

Doesn’t prevent the undesirable Doesn’t prevent the undesirable behavior when away from the behavior when away from the punisherpunisher

Can lead to fear, anxiety, and Can lead to fear, anxiety, and lower self-esteemlower self-esteem

Children who are punished Children who are punished physically may learn to use physically may learn to use aggression as a means to solve aggression as a means to solve problems.problems.

Positive Effects of PunishmentPositive Effects of Punishment

Punishment can effectively control Punishment can effectively control certain behaviors.certain behaviors.

Especially useful if teaching a Especially useful if teaching a child not to do a dangerous child not to do a dangerous behaviorbehavior

Most still suggest reinforcing an Most still suggest reinforcing an incompatible behavior rather than incompatible behavior rather than using punishmentusing punishment

Reinforcement Procedures:Reinforcement Procedures:ShapingShaping

ShapingShaping

Reinforcement of behaviors that are Reinforcement of behaviors that are increasingly similar to the desired oneincreasingly similar to the desired one

The operant technique used to establish a new The operant technique used to establish a new behaviorbehavior

Reinforcement Procedures: Reinforcement Procedures: Discrimination and ExtinctionDiscrimination and Extinction

DiscriminationDiscrimination

Ability to distinguish between two Ability to distinguish between two similar signals or stimulisimilar signals or stimuli

Learning to respond to one stimuli Learning to respond to one stimuli but not to a similar stimulibut not to a similar stimuli

ExtinctionExtinction

In operant conditioning, the loss of In operant conditioning, the loss of a behavior when consequence a behavior when consequence follows it.follows it.

The subject no longer responds The subject no longer responds since the reinforcement or since the reinforcement or punishment has stopped.punishment has stopped.

Schedules of ReinforcementSchedules of Reinforcement

Continuous reinforcementContinuous reinforcement

In operant conditioning, a schedule In operant conditioning, a schedule of reinforcement in which a reward of reinforcement in which a reward follows every correct responsefollows every correct response

Most useful way to establish a Most useful way to establish a behaviorbehavior

The behavior will extinguish The behavior will extinguish quickly once the reinforcement quickly once the reinforcement stops.stops.

Partial ReinforcementPartial Reinforcement

In operant conditioning, a schedule In operant conditioning, a schedule of reinforcement in which a reward of reinforcement in which a reward follows only some correct follows only some correct responsesresponses

Includes the following types:Includes the following types:Fixed-interval and variable Fixed-interval and variable

intervalintervalFixed-ratio and variable-ratioFixed-ratio and variable-ratio

Fixed-Interval ScheduleFixed-Interval Schedule

In operant conditioning, a partial In operant conditioning, a partial reinforcement schedule that reinforcement schedule that rewards only the first correct rewards only the first correct response after some defined period response after some defined period of timeof time

i.e. weekly quiz in a classi.e. weekly quiz in a class

Variable-Interval ScheduleVariable-Interval Schedule

In operant conditioning, a partial In operant conditioning, a partial reinforcement schedule that reinforcement schedule that rewards the first correct response rewards the first correct response after an unpredictable amount of after an unpredictable amount of timetime

i.e. “pop” quiz in a classi.e. “pop” quiz in a class

Fixed-Ratio ScheduleFixed-Ratio Schedule

In operant conditioning, a partial In operant conditioning, a partial reinforcement schedule that reinforcement schedule that rewards a response only after some rewards a response only after some defined number of correct defined number of correct responsesresponses

The faster the subject responds, the The faster the subject responds, the more reinforcements they will more reinforcements they will receive.receive.

Variable-Ratio ScheduleVariable-Ratio Schedule

In operant conditioning, a partial In operant conditioning, a partial reinforcement schedule that rewards an reinforcement schedule that rewards an unpredictable number of correct responsesunpredictable number of correct responses

This schedule is very resistant to extinction.This schedule is very resistant to extinction. Sometimes called the “gambler’s schedule”; Sometimes called the “gambler’s schedule”;

similar to a slot machinesimilar to a slot machine

Schedules of ReinforcementSchedules of Reinforcement

New Understandings of Operant New Understandings of Operant Conditioning: Conditioning: The Role of CognitionThe Role of Cognition

Latent LearningLatent Learning

Learning that occurs but is not apparent until Learning that occurs but is not apparent until the learner has an incentive to demonstrate itthe learner has an incentive to demonstrate it

Tolman and Honzik’s study on maze learningTolman and Honzik’s study on maze learning

Cognitive MapCognitive Map

A mental representation of a placeA mental representation of a place Experiments showed rats could Experiments showed rats could

learn a maze without any learn a maze without any reinforcementsreinforcements

Overjustification EffectOverjustification Effect

Effect of promising a reward for Effect of promising a reward for doing what one already likes to dodoing what one already likes to do

The reward may lessen and replace The reward may lessen and replace the person’s original, natural the person’s original, natural motivation, so that the behavior motivation, so that the behavior stops if the reward is eliminatedstops if the reward is eliminated

New Understandings of Operant New Understandings of Operant Conditioning:Conditioning:The Role of BiologyThe Role of Biology

Biological PredispositionBiological Predisposition

Research suggests some species Research suggests some species are biologically predisposed to are biologically predisposed to learn specific behaviorslearn specific behaviors