Mojo’s Progress.

Mojo’s is much more relaxed with being fly sprayed.
Below is a short clip of him being sprayed in his field.

When I first got Mojo he was petrified of the fly spray, he nearly squashed me when I sprayed him in the stable. This is 12 weeks after starting systematic desensitisation and counter conditioning.
There is still a little worry present when the spray blows in to his face. I will continue this process until he is happy to have his feathers sprayed directly too.
All care and training is done at liberty so he is free to leave at any time.

 

The Plan

Well I now have a plan for Mojo. He needs more confidence to explore on his own, he is quite happy to follow and be told what to do, but he now needs to learn he has a choice. I need to make him a toy box to spark his curiosity, also some novel objects to use in desensitising him to being randomly touched all over. This will all take time – he is totally unconfident on his own, he will follow on a lead rope and if I use targets at this stage he may well follow but still not be completely unafraid.

I need to spend time desensitising to touch before completing the fly spray desensitising.
Also his feather mite problem needs addressing before doing the foot handling training.

I will take him for walks around the wood to get him confident – it took a long time to get him to the field without resorting to escalating negative reinforcement. A little negative reinforcement – in the form of pressure on the lead rope and immediate release when he walked forward was needed, as he wasn’t confident to walk through the woods without the support of another horse.

Catherine Bell gave me some good advice – I now need to remember it all and write a proper shaping plan.

Catherine put some objects in the school to let him look at and approach if he wanted, he did walk over the tarp when I had him online. He was not confident to approach the bunting, but he didn’t spook or run away.

At liberty he investigated the bag with the objects in, then wandered off to eat the grass at the edge of the school.

The school sessions will be at liberty so he can investigate on his own, also the desensitising sessions will be with out the counter conditioning – we don’t want him to feel he has to put up with being touched, fly sprayed etc because he wants the treats. We can cause horses to approach fearful things with clicker and target training but it may not help them overcome their fear, this is a form of approach-avoidance conflict.

I get the feeling he would do things if I insisted but he would not be completely comfortable and it is so easy for these types of horses to be pushed to and over threshold. There were no big signs of fear or anxiety just very subtle facial expressions – a little triangulation above his eye, a little flaring of the nostrils and some forced exhalation but not exactly snorting.

Conditioning the bridge signal

To commence reward based training with Mojo I have first to classically condition the bridge signal. A bridge signal is to tell the horse he has done the correct behaviour, it is applied as soon as the behaviour we want occurs – the reward can then be given once the horse is calm and relaxed e.g not mugging or looking for the reward.

To condition the signal we start with the unconditioned stimulus(UCS) (food or scratches etc) and get an unconditioned response (UCR) – the horse accepting the reward. We then pair the UCS with a neutral stimulus (NS) (the bridge signal) – this can be a verbal noise or a clicker. The NS then becomes a conditioned stimulus and the UCR becomes a conditioned response as it becomes associated with the reward. So the bridge signal says “yes that is what I want”.

I decided to use a clicker to mark as a bridge signal.

Day 1

My first clicker session with Mojo didn’t go too well. My aim was to classically condition him to the clicker – so pairing the sound with the reward. However poor Mojo jumped and ran off when I clicked, it was a rather loud clicker – so now I have a softer sounding one to use to desensitise him to the sound before going any further.

Day 2

I have just been down to see him and his owner was there so we took him to the indoor school and I tried with the quieter clicker and he was fine. A few times with that and I tried the louder one and again no reaction apart from looking for a treat. I got him to stand nice and calm with his head straight. So I now feel happier about it all.

For more information about the terms used here Karen Pryor as a list which I found useful.

Clicker Training glossary

Jo Hughes is in the process of making a video to show how to get the head straight and to help with impulse control – so I will watch that before doing any more with Mojo. I am away for a week so will recommence once I come back. Mojo is out in the field all day and night, so is enjoying just being a horse with his friends. I will of course go and see him in the field before I go.

Conditioning the bridge signalConditioning the bridge signal
Conditioning the bridge signal

New Loan Horse

I have a new loan horse, Mojo, he is a 9 year old Irish cob abut 15.1 and piebald.
He belongs the the lady whose horse I was having lessons on and he was her daughters horse. Mojo is however a little on the sensitive side with regards to being touched. So I will spend time assessing this and doing systematic desensitisation and counter conditioning. Mojo was the field companion of Benny so I do know him quite well.

A picture of Mojo in a bluebell wood.
Mojo in the bluebells.

The 5 Freedoms

How often do we hear people say they use aversive stimuli (pressure/release) because horses use it between themselves? Well yes they do but it is a threat behaviour – they give fair warning too – ears back, a slight shift in weight before a kick. Horses know these signals and can get out of the way. We don’t have ears that move or tails that swish but we can use our larger brains to find a way to communicate that doesn’t involve threats and escalating pressure. It isn’t easy which is why many don’t even try or go back to using aversive stimuli even when they have learned how the horse perceives these aversives.

If we use negative reinforcement and most of us do in some form then we need to be mindful of the fact and make sure we release effectively.
Personally I don’t like to hit my horse with the clip on the end of the rope – which is advocated by some genres of horsemanship, but I do ride traditionally trained horses and so use conventional aids – negative reinforcement, leg on – leg off etc.
It is the understanding of how classical and operant conditioning works that is useful for us, to enable us to choose wisely and ethically.

What I learned at the recent Thinking Horsemans weekend was that we have a duty of care and only we can decide what we are happy to do with our horses, but it is important to be able to read the horses body language – and their emotional state before any training can begin and assess it as we progress.

It was interesting that one speaker suggested that round penning was punishment based – yes horses send other horses away but that is as a punishment, so why do we then think it good to send horses away on a circle so they can be persuaded to follow us?

I love that most reward based training starts with the horse at liberty – giving the horse a choice. I missed the second day but there was a talk about autonomy – with a scale where reinforcement and punishment was at one end of the scale and autonomy at the other end. If a horse is on line it has no choice but to stay (unless like Benny they learn to use their size to leave). Leaving tells us a lot about our relationship.

The 5 Freedoms of welfare can be used to assess whether our training is ethical.

1. Freedom from hunger and thirst. Don’t train when the animal is hungry or thirsty, they will not concentrate and may mug you if you are using positive reinforcement with food rewards.

2. Freedom from discomfort. Check that the horse has all their needs met – environmental (is it a safe area to train in) as well as physical e.g back, teeth,feet and tack are comfortable.

3. Freedom from pain – don’t add aversive stimuli if this will cause pain to the animal – e.g hitting the horse with a whip or line to insist on a behaviour. Don’t use positive punishment unless in an absolute emergency where the horse is inadequately trained.

4. Freedom to behave normally, don’t insist on a horse looking straight ahead if there are distractions – it is normal behaviour to orient towards any possible scary stimulus in the environment.

5. Freedom from fear and distress, are you sure your training doesn’t cause a fear response? Sending a horse out in a round pen uses the fear response and is punishment. Using aversive stimuli to drive the horse forward initiates the flight response, e.g traditional lunging, and natural horsemanship circling.

I am sure you can all think of other examples.

R.I.P Merlina

Poor Merlina didn’t have the best start in life, imported as a 3 year old and jumped early – my daughter Liz and I bought her at 6 for dressage. Mel hated dressage but seemed to like jumping. It wasn’t until we got the BSJA paper work that we found out she had 5 owners and 6 riders since being imported from Holland.

Our instructor thought she had been schooled a lot in draw reins and we went back to basics with her. On arriving her default behaviour was to rear – any scary situation – even on line she was straight up in the air. Ridden she bronced – true rodeo style. Also she would rear and the fly buck.
Oh how I wish we had known then what we know now.

Every physical thing checked and after some physio she seemed fine – went jumping again – up to Newcomer level.

Then she had a slip over a fence and it all started again – £1000’s later, after a bone scan we found she had almost kissing spines and sacro-iliac joint strain.

Liz ran out of money and so sent her to be a companion – unfortunately the person we sent her to was not honest and sold her. It took us 3 years to get her back, her back seemed much better and, after veterinary clearance, Liz started riding her again. Confidence was an issue for Liz as there were memories of hospital visits and back pain. Mel was fine as long as there was no pressure to perform.

Liz made the decision to send her to be re-started by Parelli professional – Merlina came back and Liz did some low level jumping and dressage and then decided not to ride her any more.

Merlina went to be a therapy horse at Equine Partners – an equine assisted learning program in West Sussex. This is run by Liz’s in-laws so Merlina was still in the family.

Last year Liz got her back as Merlina was not longer required by Equine Partners – she has been living happily on the South Downs since then.

A collage of images of Merlina
A collage of images of Merlina.

Fear

We all know that horses are innately neophobic, any new stimuli or stimuli out of context may well trigger this fear.

We owe it to our horses therefore to learn as much as possible about equine behaviour, body language and emotions. I am just coming to the end of a course on How Horses Learn, Feel and Communicate – run by Jo Hughes.

Whatever variety of horsemanship you follow – it is an excellent course. I have had horses for over 20 years and ridden for 40 years but still learned a great deal.

The module on emotions (affective neuroscience) is fascinating so even if you can’t commit to a 12 week course then there are videos and articles by Jaak Panksepp to explore.

I was not aware of the 7 emotional systems and that any aversive stimulus triggers the FEAR system. So it does seem to bit illogical to train an already fearful animal with aversive stimuli, but this is what traditional and natural horsemanship and even the equitation science people teach.

So if you do nothing else go and learn how the emotions differ between positive and negative reinforcement and decide for yourself. Study equine body language – especially the subtle signs of stress and fear.

No-one is saying you need to change how you interact with your horses but it gives you more tools to decide what is best for any particular horse at any time.

I did find limitations in certain horsemanship programmes when confronted with a horse who so obviously hated pressure (as Benny did). Maybe that was due to my lack of understanding or skill but learning about how pressure/release works and the difference it makes to the horse when you use positive reinforcement made a huge difference to Benny.

Many traditional and natural horsemen and women do use positive reinforcement and the horse world is slowly catching up with the rest of the animal training world.

Science moves on all the time and the Skinnerian models of learning theory may well be superseded, as we learn more about the emotional minds of animals (ourselves included).

So we do need to keep an open mind, don’t be afraid of what you may learn. I learned a lot from traditional and natural horsemanship but it didn’t provide all the answers.

Is the avoidance of an aversive a reward?

Is release of pressure a reward?

Following on from the previous post I have been researching the role of dopamine in emotional reactions. A very limited literature search – the subject is vast and I am not an expert. There are of course other hormones and neurotransmitters involved in all processes.

Dopamine is a neurotransmitter involved in movement via the substantia nigra, but dopamine is also produced by the ventral tegmental area of the brain. It is this area that seems to be stimulated when a reward is received or anticipated. Dopamine in these instances make us feel good. (1)

In horse training, when using the addition of an aversive stimulus to initiate a behaviour, e.g traditional and natural horsemanship, it is the removal of the aversive stimulus that is reinforcing. This is negative reinforcement as described in learning theory.

Research has shown that a transient release of dopamine occurs when an aversive stimuli is removed. (1)

So if this is correct then it may be a reward, but horses don’t seem to actively seek the application of an aversive event to gain that “reward”. They actively learn to avoid the aversive stimulus, by complying at the first indication (a cue) that an aversive stimulus might follow if they don’t comply.

Research goes further to explain this phenomenon –

“a new theoretical explanation of conditioned avoidance: (1) fear is initially conditioned to the warning signal and dopamine computes this fear association as a decrease in release, (2) the warning signal, now capable of producing a negative emotional state, suppresses dopamine release and behavior, (3) over repeated trials the warning signal becomes associated with safety rather than fear; dopaminergic neurons already compute safety as an increase in release and begin to encode the warning signal as the earliest predictor of safety (4) the warning signal now promotes conditioned avoidance via dopaminergic modulation of the brain’s incentive-motivational circuitry.” (2)

It is clear from the above that if we use aversive stimuli we must put a cue in place to predict the aversive – so the horse can avoid the application of the aversive.

When we use appetitive stimuli to reinforce a behaviour it is the anticipation of the appetitive that initiates the release of dopamine. (1) So horses actively seek the reward and can get quite animated in doing this and may offer more than we expect.

So in training should we limit the use of aversive stimuli and increase the use of appetitive stimuli?
Horses may feel good if they avoid an aversive stimulus but how do they feel during the conditioning (training) process.

Hence the title “Is the avoidance of an aversive a reward?”

All these are fascinating questions and I do not know the answers – but it does make me more aware of how and why horses learn and how they may feel about the process.

References
(1) https://www.psychologytoday.com/blog/mouse-man/200904/what-is-dopamine
(2) http://www.ncbi.nlm.nih.gov/pubmed/23759871

What’s in a word?

What is in a word?

Take learning theory and peoples interpretations, some say release of pressure is a reward some say it is a relief at best.

What is certain is that in operant conditioning terms it is negative reinforcement, therefore for the release/relief to happen there has to be an aversive stimulus applied first. Once the animal complies with our request the stimulus is removed.

So it may be leg aids – use and remove as soon as the horse complies, it may be ground work – apply an aversive stimulus to form a behaviour e.g teaching a horse to back up. Often people teach back up using a light touch on the chest – getting firmer until the horse backs, the pressure is removed on the slightest of movements.

I don’t wish to argue about various methods of horsemanship – it is a personal choice but the more I learn about the emotions involved the more I wish to use positive reinforcement as much as possible.

We do live in a world where most people use aversive stimuli to form behaviours, so our horses need to understand other peoples cues.

Dictionary defintions:

Reinforcement – The action or process of reinforcing or strengthening; The process of encouraging or establishing a belief or pattern of behaviour

Stimuli – A thing that arouses activity or energy in someone or something; a spur or incentive; A thing or event that evokes a specific functional reaction in an organ or tissue

Reward – A thing given in recognition of service, effort, or achievement; A fair return for good or bad behaviour:

Relief – A feeling of reassurance and relaxation following release from anxiety or distress; The alleviation of pain, discomfort, or distress

Release – Allow or enable to escape from confinement; set free: Allow (something) to move, act, or flow freely; Remove restrictions or obligations from (someone or something) so that they become available for other activity: Allow (something) to return to its resting position by ceasing to put pressure on it:

Aversive – Someone or something that arouses a strong dislike or disinclination.

References
http://www.oxforddictionaries.com

http://www.equitationscience.com/aversive-stimuli – some are challenging the notion that horses are not safe unless we use negative reinforcement.

Connection Training
Academy of Positive Horsemanship

Read and decide, which would you prefer for yourself? Also worth looking at the emotions involved in negative versus positive reinforcement.

http://www.thehorse.com/articles/33927/study-human-interaction-shapes-horses-negative-emotions

Jaak Panksepp describes the 7 basic emotional systems all mammals exhibit.
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3181986/

Flood Desensitising

Learning theory is fascinating as is equine behaviour analysis. Learning to look analytically at horse behaviour and the interaction between horse and humans is a sometimes distressing process, seeing videos of flood desensitisation and realising that at some point in the past you have done a similar type of training is very upsetting.

Flooding is a form of habituation and is classical conditioning, designed to stop a horse reacting to a stimulus. Horses are neophobic so are innately afraid of any new stimulus.

Even done well with animals it may never work, we have better ways to desensitise and habituate horses to novel stimuli.

Flooding entails applying an aversive (remember this is anything the horse perceives as a threat) stimulus at full intensity for as long as it takes the horse to habituate. Take note of the word perceives – it is the horse, not us, who decides what is aversive.

Inadvertant flooding can be as simple as clipping a horse whilst restrained – if he calms down during the process he may habituate or he may be worse the next time you try to clip. Many sedate to clip but the fear is still there, this happened to a horse I know – he had been twitched by a previous owner to be clipped, he is now so sensitive to the sight and sound of the clippers it is going to take a long time to regain his trust.

More extreme examples are putting a saddle on a horse whilst it is still anxious about the process and sending him round an arena – so he can buck if he feels the need to get the aversive stimulus off his back.

When watching horses see if they do that to each other and the answer is no – a horse may move another horse from a resource he wants but the pressure is not unrelenting – horses are gentle creatures and really just want to survive with out us chasing them round.