Wednesday, June 02, 2010

Ebbinghaus: the Parrot Sketch

One of the most dispiriting things about working in learning is the lack of decent theoretical underpinnings. In such an environment it’s understandable that people will try and make use of whatever theories are available to justify a particular practice. I still attend conferences where people are using Kolb’s learning cycle, Honey & Mumford’s Learning Styles or Maslow’s Hierarchy of Needs to explain what they are doing. These approaches, whilst seductive, are now decades old and have been almost entirely discredited since their creation. They were all well-intentioned, but it is as if we forget that they were the first unsteady steps in a relatively new discipline.

There are some other notable additions to the usual suspects: Atkinson & Shiffrin’s ‘Stage Theory of Memory’ (1968) and Craik & Lockhart’s (1972) ‘Levels of Processing’ model. Both have intuitive appeal: the first suggests that we transfer items into long-term memory by repeating them (like we would a telephone number), the latter that processing something semantically is better than just looking at it or hearing it. But the first model predicts that if you gag a person they would be unable to remember anything, whilst the latter predicts that even a boring lecture is more memorable than being in a car accident. Both are misleading.

The study I would like to look at here, though, is that by Ebbinghaus (1885) – a study that I have been using over the last year to illustrate an important distinction between formal and informal learning (even though it’s actually completely unscientific by modern standards). Most commonly I use this work to illustrate the pattern of forgetting common to many formal learning contexts. Specifically, Ebbinghaus tried to learn completely meaningless lists of letters, then noticed that almost all of the information was forgotten very quickly.













The diagrams above illustrate two outcomes of Ebbinghaus’ experiments. The first is the well-known forgetting curve. 
The second shows how many repetitions he needed to relearn the list over time. It is possible to interpret this last study to mean that regular repetition of information – or even learning by rote - is the key to effective learning. This is not merely wrong, but a dangerous interpretation, supporting the case for ‘drilling’ students or encouraging them to learn ‘parrot fashion’. I’d like to explain why this is a misleading reading:

Ebbinghaus’ study is illustrative of something interesting, but not what one might expect. For the purposes of his study he tried to memorise ‘trigrams’ – random sequences of three letters (such as DYV). Since these were deliberately meaningless the results say almost nothing about natural/normal learning, since almost everything we learn is meaningful – indeed that is how we are designed (I can guess what he would find if one of the trigrams were FBI, for example – and if he actually experimented on participants). What Ebbinghaus demonstrated is that we are cognitive misers, i.e. that the mind rejects – or spits out - anything that is not useful/meaningful much as the human digestive tract would reject something indigestible. His experiment is roughly equivalent to feeding people glass beads. It does, of course, throw a critical light on formal learning, where people are indeed routinely force-fed large amounts of stuff which is not obviously significant to them – but, as I have argued elsewhere, conventional formal learning is a strange cultural practice that has little to do with learning – and basically we should stop doing it. I heard a similar point being made by Sir Ken Robinson on the TED site.

What is interesting about his work is that he begins to touch on the way that you can add meaning to information, namely by testing people. To put it crudely: the information before you may be meaningless but if I have you at gunpoint and you have to score 60% or more to live, then it is surprising how much you can memorise. People respond well to challenges – their self-esteem may be at stake, and sometimes their standing within a group. The mere act of being threatened with a test is what keeps much formal learning afloat. Since he was testing himself, there is little doubt he knew what was coming – and given that it was he was both experimenter and subject it is hard to imagine that the results lacked any personal significance.

So I think one should be careful about a reading of Ebbinghaus. It doesn’t really demonstrate that regular repetition is the golden path to learning – but rather that tests can give even meaningless stuff a kind of significance. I do think that if organisations want their employees to remember meaningless stuff then ‘apprentice’ style challenges would be a good way to do it. But then I think they shouldn’t really be getting employees to learn meaningless stuff in the first place (that’s why informal learning is 85% of the cake, after all). Or, to put it another way, if I want to eat fish then I will learn how to fish.

It is certainly possible that going over material in some way will improve memory, but not simply through the power of repetition – if this were the case I would remember the hymns I sang at school, or my railcard ID. Some forms of repetition – especially elaboration - will almost certainly improve learning but only because they build the Affective Context of the information, not simply because one is ‘going over’ the information. Good teachers know that getting students to debate how they feel about topics is a far more effective approach than simply getting them to write it down. Most students learn most in the run-up to their exams – when they are really anxious – but effective teachers can get students to care about the subject-matter way in advance. Good learning is inspired by great teachers – and great teachers aren’t using rote learning.

There are practical reasons for making this point; with most of our training we don’t have the opportunity to force employees to rehearse it at regular intervals. I’m not sure I’d want to – imagine having to repeat the same Safety Training every month. What we try to do is make the information stick first time round, and this can be done in a whole host of ways, all of which have affective context in common (such as making it relevant, using memorable examples, delivering it in context, encouraging people to think about it and delivering it passionately and authentically). When we conducted our own research we found that the vast majority of the things BBC staff remembered were one-off experiences. One colleague will never forget the teacher who told him ‘you will never succeed at anything’. Look back at your own memories, if you don’t believe me. For my part I confess that I can no longer recall my times’ tables – despite rehearsing them thousands of times. I do recall quite vividly the time when we kept a pet crow in a school desk.

In conclusion, there is a familiar pattern at work here: if you focus only on what happens to information, instead of what learners are actually learning, then you will never understand the process. Learning is no more the transfer of information than cookery is the transfer of calories.

This parrot is definitely dead.

5 comments:

  1. This reminds me of some of the distinctions people draw between pedagogy and andragogy. Andragogy is different, go some of the arguments, because adults need to know why they're learning what they're learning, have prior experience to draw on etc (That's a very lazy 'etc' but the whole thing makes me weary.)

    It makes just as much sense to say that 'andragogy' is a description of the 'real' world whereas 'pedagogy' applies to an educational setting.

    One of the primary functions of school (and, whisper it, Higher Education) is to provide a place to be right in. Pedagogy is a closed loop - but it's okay because schools 'give even meaningless stuff a kind of significance.'

    (And, to be honest, I don't really have a problem with this - in schools. Extended neoteny is one of our greatest inventions. I loved the artificiality of times tables in a way that I'll never quite love working out my tax return.)

    Anyway, what I'm trying to say is Ebbinghaus makes sense in school. It's chock full of meaningless triples - and this is relatively okay, as it goes.

    But Ebbinghaus in the real world makes less sense. Learning something (and being able to use this learning as a lever to 'move' a real world problem) is a complex issue. Expecting people to 'learn' something through repetition is an attempt to defer complexity. You're right, we should be tackling complexity head-on and trying to design sticky learning.

    At the BBC, have you ever, as an experiment, given a 'Learning Objective' to your trailer/advert makers? I'd be fascinated to see an expert in 'sticky' content production go head-to-head with a Learning Professional. The differences/similarities would be instructive.

    Wow, that was a long comment.

    Here's me having a crack at Conservation of Complexity for learning on my blog.

    ReplyDelete
  2. Anonymous9:06 AM

    Great piece Nick. Although you know I agree with you, there is at least one field in which spaced learning of stuff that is initially meaningless can be useful: language learning. Indeed, the only way I have ever been able to learn vocabulary is through mnemonic tricks to give a jumble of meaningless syllables word some initial meaning, followed by repetition to embed it in my brain.

    ReplyDelete
    Replies
    1. Thanks for your comment Don - although I'm pretty sure that I know some of the mnemonic tricks you allude to, and that they aren't at all the same as spaced repetition :o) I know what you mean, though - as your excellent Clerihew example showed, we can learn things in a single experience if the significance (i.e. affective context) is strong enough. If not, it may take a few goes. If - like my hymns at school - there is almost no significance, repetition does very little at all.

      Delete
  3. Nick, I believe there are good theoretical underpinnings in our field. What is dispiriting is how hard you have to work to find and make sense of them. For example, this work explains why Ebbinhgaus' work may not be so valuable: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4492928/.

    There are other works that help us understand the nuances (and the nuances themselves are sometimes difficult to understand) of expertise, perception, memory, cognition, and so on and the application of these nuances to organizational learning rather than higher education. A recent paper by Eduardo Salas and fellow researchers shows what research finds are ways to get good outcomes from training (see: http://www.psychologicalscience.org/index.php/publications/journals/pspi/training-and-development.html).

    I personally find the research on expertise in professions especially useful, and filled with valuable information for those of us in organizational learning. The finding that expertise is relatively rare is depressing. But we can foster it... we usually don't (normally).

    Patti

    ReplyDelete
  4. Hi Patti. I appreciate the links. Both seem to illustrate the central problem however: namely that of propping up a model that doesn't really work. Though I sometimes cite Ebbinghaus it's kind of a silly piece of research and serves mainly to expose the hidden assumption about learning that persists to this day. His research uses 'junk data' - trigrams - which are of no significance to the learner. As a consequence it tells us next to nothing about real world learning - except that people forget useless information. It is the deepest of ironies that for this reason it tells us quite a lot about modern education. The 'before and after' training idea won't surprise many people - and sure, we've had some success in using technology to build apps that in turn build habits. Again, though, the central problem is overlooked: most learning happens at point of need, as a result of a pattern of concerns. Insofar as the training event is content (rather than learner-) centric it will have poor outcomes. True, a proper initial assessment can make a big difference - this is why we use the Concern-Task-Resource model - but never a 'TNA' (since the answer is normally performance support rather than training and training is plagued by the 'knowledge transfer' delusion). You're right, there's plenty of research out there - but without sound theoretical underpinnings it's often pointed in the wrong direction, I find. Good to hear from you! Thanks for writing.

    ReplyDelete