6 Things You Might Not Know About Clicker Training (6/6)

In this series I will be sharing 6 interesting facts I didn’t know about when I started using positive reinforcement in training animals. This is part 6. This one is really an eye-opener! This is a phenomenon you only see in R+ training!

Some of these are common misunderstandings people have about clicker training while others are facts most equestrians don’t know at all.

The goal of this blog is to help more people understand how well positive reinforcement (R+) works in training our horses. I want every one to know that clicker training offers more great benefits besides training your goal behaviour. Positive side-effects you won’t get in negative reinforcement (R-) based training methods (traditional and natural horsemanship). I wish I had known these benefits earlier in life.

#6 Horses increase the criteria

Your horse will do more and more for one click, if you know how. He will raise the criteria of the behaviour on his own in order to ‘train you to click’.

That is very unconventional in horse training! And scary too: “What if you are being trained by your horse instead of the other way around?! That is outrageous! You will loose your leadership!”

To tell you the truth: horses are training us. From day 1. Now you realize this, you can use this knowledge and turn it into a mutual benefit! Since we- clicker trainers- are encouraging and reinforcing the animal’s initiative he will be very likely to show you what else he can do.

At first you click and reinforce every step towards the goal behaviour. Once a behaviour is consistent, you can change to a variable reward schedule. This is where the fun part start: the experimenting! I love this part! Once the behaviour will be on a more unpredictable reinforcement schedule your horse will figure out that the more effort he will put into the exercise the more likely it is to receive an appetitive.

Video of a horse increasing her own criteria

In this video you can see how this works: First Kyra gets clicks and reinforcers for ‘walking around each cone’. Soon she figures out that she can influence the click and getting it sooner by getting to the cone faster! Now my more-whoa-than-go-horse offers a trot! By herself!

I reinforce this with clicks and treats. Now the criterion is raised. By Kyra! I  click less often (variable reward schedule) and I got a canter! Bingo! Kyra raised her criteria again! This is how you can work together with your horse in training.

The behaviours trot and canter are put on cue. Then I click only for cued behaviour. Final step in training is to fade out the clicks (but not completely appetitive reinforcers). How you can use this is in your own training is what I teach in the 8 week online Ultimate Horse Training Formula course.

Influencing the clicks and reinforcers will keep your horse very much engaged and enthusiast in training. He will offer better quality behaviour or longer duration by himself. As trainer you can easily capture this with a click and reinforcer. Tadaa, now the criterion has been raised. By the horse!

Something I have never seen in negative reinforcement (traditional/NH) training methods. Yes, I have seen horses run faster because the threat of the aversive increased (e.g. giving a second leg aid and then a ‘tap’ with the whip), but that only lasted for a short period of time. It wasn’t the lasting change that we see in R+ training.

Soon the horse will figure out how to offer a minimum of behaviour: just enough to avoid the aversive.

Think back or look around you: How often did you have to give a leg aid twice or three times because you thought your horse ‘didn’t pay attention’? How many horses do you know that get ‘deaf’ for light leg aids and even spurs? Maybe horses know us better than we know ourselves…

Read the other articles in this series:

part 1 of 6 Things You Might Not Know About Clicker Training
part 2
part 3
part 4
part 5
part 6

Sandra Poppema, BSc
Founder of HippoLogic
Enhancing Horse-Human connections through clicker training

***NEW***

Have you heard of the HippoLogic Clicker Challenge Community?

Register today for our Online Equine Clicker Challenge Community
Each month a new Clicker Challenge
Goal: Develop your clicker skills in a fun & supportive community
Discover your strengths and boost your confidence in your Clicker Skills each month. I guarantee you that you will walk away with practical tweaks that you can apply to all your other training and that your horse loves to work with YOU!

Follow my blog  on Bloglovin

 

“There is nothing wrong with Negative Reinforcement applied properly”

Said someone once to me. I didn’t say anything, but my body screamed: ‘Yes, there is….‘

Although I couldn’t explain in words why I felt that way, now I do. Since it was hard to catch it in words, it is a long explanation, so please get seated.

When I talk about horse training, I like to use the scientific definitions in order to keep the language as clear as possible and to avoid emotional and subjective projection. Let’s start with some definitions because this statement (“There is nothing wrong with R- applied properly”) is one that causes a lot of commotion among horse people.

Myth Monday: ‘Clicker Trainers don’t use Pressure’

There is a huge misunderstanding about the word ‘pressure‘ in the horse world. I hear people who want to start positive reinforcement training but they hesitate: ‘How can I start clicker training my horse and don’t use any pressure? Isn’t that impossible?’ Yes, training a horse without pressure is impossible, but let me explain the difference between using pressure as cue and using pressure as reinforcer.

Definitions

Let’s discuss some definitions before I debunk the myth that +R trainers don’t use pressure.

What is ‘pressure’ according to the Cambridge Academic Content Dictionary:

Pressure (force): the force produced by pressing against something: air/blood/water pressure. Pressure is also the force that is put on a surface with reference to the area of the surface.

Pressure is per definition not ‘bad’.

Pressure can be 3 things for the horse:

1. pressure is  ‘unpleasant’
2. pressure is ‘neutral’ or
3. pressure is ‘pleasant’.

It can also happen that the association with pressure changes due to the horses training.

Pleasant pressure

Examples of pressure that feel good are mutual grooming, rubbing against a fence or horses that are playfully pushing each other.

Unpleasant pressure

Pressure that is aversive can be a kick or a bite or being chased away from the herd.

Neutral pressure

Pressure can also be neutral in the beginning: it doesn’t give the horse a good or a bad feeling or it doesn’t have a good or bad association yet.

I have trained horses with NH and traditional methods in the past. These methods use pressure as an aversive. Some horses don’t experience pressure as an aversive that they naturally want to avoid. Some horses (especially Fjorden horses, Halfingers and Friesians I worked with) need really strong pressure in order to learn to yield. The light pressure in the beginning is ‘neutral’ and in order to teach them to yield I had to make it unpleasant so they learn to anticipate on only association (‘light, gentle touch will turn into aversive if I don’t yield’).

Negative reinforcement (R-): A behaviour is strengthened by removing an unpleasant or painful (=aversive) stimulus.

Natural horsemanship & traditional training

In natural horsemanship and traditional methods it is this ‘pressure’ that makes the horse yield.

In traditional and natural horsemanship methods pressure is used in an accumulating way until it is aversive enough for the horse to yield. Then the pressure is released in order to make the wanted behaviour stronger.

For instance when a horse doesn’t respond to a light pressure of the riders legs (calf) to go forward, the rider builds up the pressure by squeezing harder or using his spurs. If that doesn’t work the leg aid is followed by a tap with the whip (which can be painful, try it on your own skin).

In this way the trainer teaches the horse to anticipate on the riders light leg aids. If the light leg aid isn’t aversive in the first place it is followed by more pressure until the horse moves forward. The light pressure of the leg becomes an aversive in itself: the horse has learned to associate the leg aid with an aversive to which he wants to anticipate with yielding. Which isn’t the case at all in positive reinforcement training.

Positive reinforcement (R+): A behaviour is strengthened by adding a pleasant (=appetitive) stimulus.

Positive reinforcement (clicker) training

In positive reinforcement training the desired behaviour is trained first. Only if the behaviour is established, a cue is added. The cue can be anything.

So in positive reinforcement training the trainer will teach the horse to move forward first and will use appetitives to reinforce the forward movement. The trainer can induce the forward movement in different ways, according to the situation (capturing, targeting, shaping or luring or moulding*). There is no use of pressure yet.

After the behaviour is established you add the cue. The behaviour already has a strong positive reinforcement history (going forward is strongly associated with pleasurable rewards). If the cue ‘light pressure of the calf’ is added to the forward movement, the rider is using pressure.

The pressure cue is only chosen if it is not aversive. If the leg pressure is considered aversive the trainer will either choose a different cue or can choose to counter condition the pressure cue first and make it neutral or change it to a pleasurable sensation before using it.

This cue will always has the same amount of pressure. If the horse isn’t responding to it, the pressure will not be accumulated. Why not? Because this changes the cue and therefor will not be understood by the horse (stronger leg pressure or a tap with the whip is not associated with going forward).

Differences in using pressure in R- and R+

In R- the pressure is used to teach a horse behaviours. The pressure is released to make the behaviour stronger. Therefore the pressure is associated with an aversive stimulus. If the cue wasn’t aversive, the horse wouldn’t have learned to yield/anticipate to it.

In R+ the pressure cue is added only after the behaviour is established with pleasurable stimuli. The pressure is therefor not associated with an aversive. The pressure cue that is chosen is not aversive in itself and it is trained with appetitives.

Behaviours that are trained with pressure and release and then rewarded with a treat or scratch at the end, are not considered positive reinforcement.

Conclusion

Pressure can be aversive, neutral or appetitive.

It is the trainers responsibility to turn a neutral pressure or aversive pressure cue in a way that it is useful for communication and becomes appetitive (associated with something pleasurable). That can only be achieved with positive reinforcement, not with traditional or natural horsemanship methods.

My goal is not to avoid pressure, my goal is to understand what association the horse has with pressure and make it a pleasurable way to communicate.

*) Attention! With moulding behaviour pressure is used, but it is never aversive. If the pressure in moulding turns aversive it is not moulding anymore, but ‘forcing a behaviour’.

SAFE THE DATE: MARCH 6, 2019

Ultimate Horse Training Formula, Your Key to Succes 

• Want to get the results in training you really, really want?
• Want train your horse with confidence?
• Want to learn all there is to know about training your horse with positive reinforcement?

Join this online course and participate for free in all future live classes. Click here

Clicker Training Mastery (online course) starts March 6, 2019

Sandra Poppema, B.Sc.

I help horse owners get the results in training they really, really want with joy and easy for both horse and human. I always aim for win-win!

Sign up for HippoLogic’s newsletter (it’s free and it comes with a gift) or visit HippoLogic’s website and join my online course Ultimate Horse Training Formula in which you learn the Key Lessons, Your Key to Success in Clicker Training.

Follow my blog  on Bloglovin

 

Reflections on +R vs -R (positive reinforcement vs negative reinforcement)

How valuable is a behaviour to you when it is associated by the horse with aversives (-R, negative reinforcement)?

Is a behaviour that is associated with something pleasurable /appetitives (+R, positive reinforcement) worth less, or more to you?

Or do you not care at all what your horse’s associations are with your ways of getting the behaviour?

In other words: do you care for the result more than the way you got the result?

The carrot (click) or the stick…

Which one do you prefer?

 

Sandra Poppema

For tailored advise, please visit my website and book your personal consult!

Follow my blog with Bloglovin

 

Natural Horsemanship vs Clicker Training

What I really liked about the Natural Horsemanship method I followed in the late nineties, was the step-by-step program I bought. It was very practical because it described the horse behaviour in advance: I could expect this, this and this. Fan-tas-tic! I just had to follow the steps and boom! “Friendship” and “Partnership” where delivered.

Step-by-step program
When things didn’t work out the way the book described you could look up “pitfalls” and read where you skipped a step and what you had to work on. Great. It worked. Best thing of all, I didn’t have to think for myself anymore. It was all in the levels. If it really didn’t work out “I was just not ready for the next level”.

A new way
The biggest struggle when I started clicker training in the late nineties was that there was no “method”, no step-by-step program to follow and few people to turn to for advice. There were only a few rules to follow: pinpoint the wanted behaviour with a bridge signal and let the bridge always be followed by a reward. The receiver determines the reward.

Not many experts available
The only source of knowledge that I had in the late nineties was an Yahoo email group. It was in English and this is not my first language, so that was a huge threshold to turn to for questions and advice. I was lucky to learn from someone who had followed a course about training sea mammals with positive reinforcement and that I had studied Learning theory during my bachelors in Animal Management. This made it much easier for me to understand the whole science behind positive reinforcement.

Outside the box
Not only did my clicker training journey come without a map and a clear road to follow, I had to learn to think outside the box. It was so completely different from all the things I had learned about horses in the previous 25 years and at the same time it made so much sense emotionally: looking forward to earning a reward versus avoiding an aversive.

Times changed
I am glad to see that there is so much information available for passionate horse owners and riders who like to start training their horses with rewards. There are books, clinics and also a lot of instructors and horse trainers who are available all over the world. It is still a minority but who knows what happens in a few more years. Internet is one of the blessings in spreading information these days.

Sandra Poppema