Category: horse behaviour

Posted on

Is the avoidance of an aversive a reward?

Is release of pressure a reward?

Following on from the previous post I have been researching the role of dopamine in emotional reactions. A very limited literature search – the subject is vast and I am not an expert. There are of course other hormones and neurotransmitters involved in all processes.

Dopamine is a neurotransmitter involved in movement via the substantia nigra, but dopamine is also produced by the ventral tegmental area of the brain. It is this area that seems to be stimulated when a reward is received or anticipated. Dopamine in these instances make us feel good. (1)

In horse training, when using the addition of an aversive stimulus to initiate a behaviour, e.g traditional and natural horsemanship, it is the removal of the aversive stimulus that is reinforcing. This is negative reinforcement as described in learning theory.

Research has shown that a transient release of dopamine occurs when an aversive stimuli is removed. (1)

So if this is correct then it may be a reward, but horses don’t seem to actively seek the application of an aversive event to gain that “reward”. They actively learn to avoid the aversive stimulus, by complying at the first indication (a cue) that an aversive stimulus might follow if they don’t comply.

Research goes further to explain this phenomenon –

“a new theoretical explanation of conditioned avoidance: (1) fear is initially conditioned to the warning signal and dopamine computes this fear association as a decrease in release, (2) the warning signal, now capable of producing a negative emotional state, suppresses dopamine release and behavior, (3) over repeated trials the warning signal becomes associated with safety rather than fear; dopaminergic neurons already compute safety as an increase in release and begin to encode the warning signal as the earliest predictor of safety (4) the warning signal now promotes conditioned avoidance via dopaminergic modulation of the brain’s incentive-motivational circuitry.” (2)

It is clear from the above that if we use aversive stimuli we must put a cue in place to predict the aversive – so the horse can avoid the application of the aversive.

When we use appetitive stimuli to reinforce a behaviour it is the anticipation of the appetitive that initiates the release of dopamine. (1) So horses actively seek the reward and can get quite animated in doing this and may offer more than we expect.

So in training should we limit the use of aversive stimuli and increase the use of appetitive stimuli?
Horses may feel good if they avoid an aversive stimulus but how do they feel during the conditioning (training) process.

Hence the title “Is the avoidance of an aversive a reward?”

All these are fascinating questions and I do not know the answers – but it does make me more aware of how and why horses learn and how they may feel about the process.

References
(1) https://www.psychologytoday.com/blog/mouse-man/200904/what-is-dopamine
(2) http://www.ncbi.nlm.nih.gov/pubmed/23759871

Posted on

What’s in a word?

What is in a word?

Take learning theory and peoples interpretations, some say release of pressure is a reward some say it is a relief at best.

What is certain is that in operant conditioning terms it is negative reinforcement, therefore for the release/relief to happen there has to be an aversive stimulus applied first. Once the animal complies with our request the stimulus is removed.

So it may be leg aids – use and remove as soon as the horse complies, it may be ground work – apply an aversive stimulus to form a behaviour e.g teaching a horse to back up. Often people teach back up using a light touch on the chest – getting firmer until the horse backs, the pressure is removed on the slightest of movements.

I don’t wish to argue about various methods of horsemanship – it is a personal choice but the more I learn about the emotions involved the more I wish to use positive reinforcement as much as possible.

We do live in a world where most people use aversive stimuli to form behaviours, so our horses need to understand other peoples cues.

Dictionary defintions:

Reinforcement – The action or process of reinforcing or strengthening; The process of encouraging or establishing a belief or pattern of behaviour

Stimuli – A thing that arouses activity or energy in someone or something; a spur or incentive; A thing or event that evokes a specific functional reaction in an organ or tissue

Reward – A thing given in recognition of service, effort, or achievement; A fair return for good or bad behaviour:

Relief – A feeling of reassurance and relaxation following release from anxiety or distress; The alleviation of pain, discomfort, or distress

Release – Allow or enable to escape from confinement; set free: Allow (something) to move, act, or flow freely; Remove restrictions or obligations from (someone or something) so that they become available for other activity: Allow (something) to return to its resting position by ceasing to put pressure on it:

Aversive – Someone or something that arouses a strong dislike or disinclination.

References
http://www.oxforddictionaries.com

http://www.equitationscience.com/aversive-stimuli – some are challenging the notion that horses are not safe unless we use negative reinforcement.

Connection Training
Academy of Positive Horsemanship

Read and decide, which would you prefer for yourself? Also worth looking at the emotions involved in negative versus positive reinforcement.

http://www.thehorse.com/articles/33927/study-human-interaction-shapes-horses-negative-emotions

Jaak Panksepp describes the 7 basic emotional systems all mammals exhibit.
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3181986/

Posted on

How Horses Learn, Feel and Communicate

This is the feedback I gave Jo Hughes about the course I am studying:

How Horses Learn, Feel & Communicate

I am studying a course run by Jo Hughes of the Academy of Positive Horsemanship, on how animals learn, feel and communicate.
This is an extremely useful course for anyone who has contact with horses, we all need to learn to communicate and ethically train horses. Horses are learning all the time – whether we are actively doing a training sessions or just taking them to and from the field and stable.
This course is a mixture of video presentations, articles from various websites and questions to get us thinking about why we do what we do and how the horse may feel about this. The scientific content is at a level anyone can understand.
One example is looking at videos of flood desensitisation and assessing the possible emotions felt by the horse. Then we had to find videos to illustrate this technique. It was a bit daunting as sometimes it is difficult to decide what is or is not flooding. P.S flooding is not a technique that is recommended.
Jo is very patient and makes excellent videos presentations, she is always willing to answer questions, and assist in our training problems.
I can whole heartedly recommend this course.
Gill Langridge

If you wish to know more go to her website and sign up for the next course.
Academy of Positive Horsemanship

We owe it to our horses to learn as much as possible, the more tools in our toolbox the better able we are to pick the best for our horse.

There are no rules or methods, only principles – every horse is different and we need to be flexible in our handling and training.

The more I learn, the more I realise there is to learn, happy learning to everyone, where ever you are on your lifelong journey of never ending self-improvement.

Posted on

Tolerance

Tolerance
1.
“a fair, objective, and permissive attitude toward those whose opinions, differ from one’s own.” online dictionary definition.

Whilst my understanding of how animals learn gets deeper I find it really difficult to be tolerant with some aspects of horse training.

People who don’t understand the reasons for how a horse learns have some excuse for using techniques that may cause the horse distress. However there are people who understand operant and classical conditioning but still deliberately train horses using aversive stimuli.

Some say horses can’t be trained any other way – but why is that? All other animals on the planet can be trained using appetitives rather than aversive stimuli.

Take trailer loading – I hear people say make the outside of the trailer more uncomfortable than the inside. Why not turn it round and make the inside of the trailer more appetitive than the outside?

We can alter how the horse feels about anything using systematic desensitisation and counter conditioning.

This is not to say we must all be “fluffy bunny huggers” and let the horse do exactly what he wants without due regard for our and his safety.

We can train safety using positive reinforcement just as well, if not better, than if we use negative reinforcement.

Given a choice what would your horse choose – the relief from something he doesn’t like or a reward of something he likes.

It is the horse who decides what is aversive and what is appetitive.

Anytime you train and trigger a flight response (fear response) then you have used an aversive stimulus. I hear people say we don’t train with fear but how do you get a horse to do something he finds innately frightening, if you don’t use positive reinforcement? You add a more aversive stimulus than the stimulus of the frightening thing. How can that be good for the horses emotional wellbeing?

If you know please tell me!

The next module in Jo Hughes’ course is on affective neuroscience – how animals express emotions.

I am also going to a lecture by Jaak Panksepp in April – really looking forward to learning more.

Jack Panksepp has done a lot to help people understand emotions, and many have come to accept animals as sentient beings.

P.S I still use some negative reinforcement, as I ride other peoples horses, but it does not feel right to me to tap a horse with a whip or to use spurs.
Conventional aids can be taught using postive reinforcement.
The world is changing, as we know more about how animals feel and learn.

Posted on

Flood Desensitising

Learning theory is fascinating as is equine behaviour analysis. Learning to look analytically at horse behaviour and the interaction between horse and humans is a sometimes distressing process, seeing videos of flood desensitisation and realising that at some point in the past you have done a similar type of training is very upsetting.

Flooding is a form of habituation and is classical conditioning, designed to stop a horse reacting to a stimulus. Horses are neophobic so are innately afraid of any new stimulus.

Even done well with animals it may never work, we have better ways to desensitise and habituate horses to novel stimuli.

Flooding entails applying an aversive (remember this is anything the horse perceives as a threat) stimulus at full intensity for as long as it takes the horse to habituate. Take note of the word perceives – it is the horse, not us, who decides what is aversive.

Inadvertant flooding can be as simple as clipping a horse whilst restrained – if he calms down during the process he may habituate or he may be worse the next time you try to clip. Many sedate to clip but the fear is still there, this happened to a horse I know – he had been twitched by a previous owner to be clipped, he is now so sensitive to the sight and sound of the clippers it is going to take a long time to regain his trust.

More extreme examples are putting a saddle on a horse whilst it is still anxious about the process and sending him round an arena – so he can buck if he feels the need to get the aversive stimulus off his back.

When watching horses see if they do that to each other and the answer is no – a horse may move another horse from a resource he wants but the pressure is not unrelenting – horses are gentle creatures and really just want to survive with out us chasing them round.

Posted on

Thoughts on Desensitisation.

As I am doing a course with Jo Hughes of The Academy of Positive Horsemanship I am reading Dr. Jenifer Ziligs book How to Train Animals 101. The more I learn the more there is to be considered when training horses. Everything we do with them is teaching them something.

Although the course hasn’t got to desensitisation yet I have been seeing more and more videos of people flood desensitising horses.

Some ways to desensitise:
Habituation – exposure over time, also called passive desensitisation. A horse over time habituates to his environment and the weaker the stimulus the more rapid and persistent is the habituation.
This process can be very slow and if we wish horses to habituate to aversive stumuli e.g for possible medical intervention then counter-conditioning with systematic desensitisation is useful.

Counter-conditioning – this is classical conditioning using a reward to change the horses perception of a stimulus. “associating stimuli of opposite value, the combination of which acts to nullify the value towards neutral” (Dr. J. Zeligs – Animal Training 101)

Also 2 ways to approach stimulus exposure:

Systematic desensitisation – using small approximations of the stimulus, can be used with counter conditioning.

Flooding – unrelenting exposure to the stimulus – this is not a recommended technique.

More on flooding by Helen Spence – Flooding and Learned Helplessness

Also from Dr.Sue McDonnell about “sacking out” often used as a euphemism for flooding.
“Unpredictable Fear”

Recently I read this statement:

“Sometimes a horse will put up the greatest resistance just before he comes through. I call it ‘the darkest hour before the dawn’. When the horse has tried all the avenues of his natural instinct of self-preservation and puts up its greatest resistance; is when people will usually give-up or get mad. If they would just be patient, the horse is about to come around.'” – Tom Dorrance.

I would like to deconstruct this statement and ask why the horse feels he needs to take flight or to fight.

The horse has 4 reactions to a fearful situation: first they may freeze – look at the threat, then they may try to flee, if flight isn’t successful – as in a confined space – they may try to fight the threat.
If the threatening predator is still present after all these attempts the horse may give in and freeze or try appeasement behaviours to look less of a threat to the predator.
Then they appear submissive but can actually be in a state of learned helplessness.

In the above scenario the human is the predator – so what happened to the natural horsemanship principle that we should not act like a predator?

The above is a classic way to flood desensitise a horse – don’t give up until the horse gives in – as we all know flooding done incompletely may make the horse put up an even bigger fight next time. The problem is that flooding may never work even if done to the point of the horse giving in.

Why put a sensitive animal like a horse through such a process? If this was done to a deer or other prey animal it would be called cruelty.

So next time you go to a clinic or watch a video of horses being trained try to analyse what is actually happening not what the trainer says is happening.

Posted on

Benny and Dougal

We spent Christmas and New Year in Devon with our daughter Sam. Sam has Benny and Dougal – the 2 cobs.
I rode Dougal a couple of times but the weather wasn’t very conducive to going too far.
On the last ride Sam and I went round the block and half way we had a tractor behind us and needed to get on the grass verge to let it pass. There were 2 ponies coming in the opposite directions who also had to come on the verge. Once the tractor had passed, Benny and Dougal tried to follow the other ponies and took a bit of persuading that they weren’t going the same way. We stood on the verge until they calmed down and reassured them.
We decided to walk the ride as Dougal was still a little excited after seeing the other ponies. Dougal jogged a little and Benny had to trot to catch up. They walked through the ford which was flowing well.
They were possibly a bit lively due to being in all night – the other rides had been afternoon ones.
Benny has settled well, although still hasn’t been out very far on his own.

Posted on

Horse Charming

Max Easey – horse charmer extraordinaire has a website. An excellent resource for all your horse charming needs.

Horse Charming

Max has studied with some of the best positive reinforcement trainers both in the UK and the USA. As a linguist Max can explain in ways we can understand, making the learning process both educational and pleasurable.

Posted on

Cognitive-Dissonance Theory

Reading through my Udemy psychology course I have got to the part about Cognitive-Dissonance Theory. This may explain why some people may be uncomfortable with the How Animal Learn course.
Where there is a discrepancy between behaviours and beliefs/attitudes there is dissonance. So people reduce this dissonance by avoiding the behaviour or changing attitudes.
Asking why you do what you do creates opportunites for recognising inconsistencies and you try to find ways to avoid these inconsistencies.
So people try and expain away behaviours (ways of training) which they have just heard are not in the animals best interest and so justify their actions.
Or they change what they do to restore consistency and avoid the dissonance.
All the course does is to present the scientific facts, it is up to us as individuals to decide whether the way we train our animals fits in wth this.

Posted on

Out of the comfort zone.

Interesting post from a friend today on Facebook about how her “How Animals Learn” course and posts made some people feel uncomfortable. Why? We need this information so we can make informed choices, life is never just black or white.
We are all learning all the time, the more information we have the better able we are to assess the horse and what he/she needs with regards to training and general care.
If the theory behind how animals learn is uncomfortable then it may be due to misunderstanding, misinterpretation or even misleading ways we have been taught in the past.
We all use learning theory in our everyday life without even knowing we do so, but when someones explains why it works that can makes us really think about what we do and why.

If I praise someone for a job well done or remove toys from my child to punish a behaviour I don’t want reinforcing, it all uses quadrants of operant conditioning. Whether it is viewed as reinforcing or punishment is up to the individual concerned. If my child didn’t want the toys anyway it may not be punishing but can be neutral or reinforcing so they misbehave again.

Take time to read and learn about how our horses, dogs, cats, children learn, it does make life a lot easier as we can pick the type of learning appropriate for each individual.