References and Trust
A while back I had an interesting Twitter discussion about the problems with assessment in education, and how different approaches might be useful. The others involved (@richardtibbles and @informededu) were much more organised than I am so have long since moved on, after blogging about it. David suggested this concept originally at his blog and here is Richard’s much prompter response. Belatedly, however, I’ve typed up my own somewhat confused viewpoint. It’s more philosophical than practical…
What We Already Do
I like talking about ideas. Something that’s really important to me is getting my facts straight, and I’m a firm believer in checking what I’m saying and correcting myself when needed, which is fairly often. For example, I expressed surprise to a student who told me that he could download Wikipedia to his phone and access it offline. This seemed unlikely to me, but he was absolutely right. (Let’s take a moment to consider that today’s mobile phones usually have enough memory for millions of pages of text information). So I apologised to him in front of the class, and put the link on my page on the VLE.
What this was leading to is that to check an idea, I look for the facts. I don’t think much of personal authority – that will be the science background and general stubbornness – but I appreciate the value of a personal reputation. And so I always want to check the references. In lessons I’ll do this by regularly including links on my teacher’s page, even though I know relatively few kids will bother to use the VLE to that extent. Online, I love having the ability to include links on my blog posts and more recently in my tweets. Whenever I link to a website, news story or blog I am referring to them. In a way, I am demonstrating that I trust them.
When we suggest other people who might be interesting as part of ‘Follow Friday’ by tagging their IDs with #ff, we are giving them a reference. We possibly, almost certainly in my case, haven’t met them ‘in real life’. When we retweet someone’s idea, message or link we are also vouching for them, or at least the idea. Our commentary shows why we are doing so, which can be for both good or bad reasons! I suspect I’m not the only one who looks at those individuals a person follows, before I follow them in turn. We are trying to get a feel for how our peers judge a person. (If you’ve no idea what I’m on about because you’re not on Twitter, check out this post, one of many suggesting why it may be useful for educators.)
Google is based on the idea that the ‘worth’ of a website can be determined by how many others link to it. Whether we agree or disagree with the result, it can hardly be denied that it has been an effective approach.The links I make in blog posts are also references, although they lack academic rigour. The same could be said of my blogroll in a general way. I don’t read everything written on these blogs, but I’m saying by including them that “these people are worth a look.”
Blurbs on a book cover are also a recommendation, tapping into the human assumption that we can trust what people say. Suggesting that ‘if you liked X you may like Y’ gives us a comparison, tells us why this is being recommended. It amuses my family that I can rarely spend time in a bookshop without giving and receiving suggestions from other customers. There’s some evidence (such as this survey from an advertising company) suggesting that this makes a bigger impact if the recommendation seems personal. From a science point of view this is the danger of anecdotes – that we give higher credence to isolated facts than a bigger picture would justify. It seems unlikely that we are actually going to change human nature, though. I remember reading about ‘Salesmen’, people who would spend a lot of time recommending products or concepts, from the book The Tipping Point. I don’t know if more recent research still shows that a small number of people do a lot of recommending. Twitter and the rest of the internet has given us all the chance to be persuaders.
Why It’s Useful (Here comes the Science Bit)
If one bird in a flock starts flapping, so do the others. Flapping is infectious. Mass panic may result from a minor cause, an example of something we call emergence. We tend to act like this more when it involves problems than benefits, probably because in an evolutionary sense we are fine-tuned to trust others when they hint at danger. The Tiger That Isn’t is a great bok explaining the mathematical reasons for the human ability to spot patterns so well. If others in a group are acting scared, then maybe we need to be scared too. All kinds of superstitions, tragedies and historical events have happened because we, like so many other species, have evolved to ‘follow the crowd’. It’s not always right. But it’s right often enough that overall, on average, in the long-term, it’s a useful adaptation. This is why we trust other people’s opinions, modified by who they are. Humans rely on reputation to ‘filter’ our opinions of other people, as ideas like the Prisoner’s Dilemma show. So how could we use the idea of reputation to help when it seems that academic achievements don’t tell us everything we need to know?
Giving Online References
During the discussion, we commented that the best evidence of competence would be to show what is actually produced. It’s expected that photographers and artists will take a portfolio to interviews – why not others? This develops quite quickly into the idea that it shouldn’t be hard, in some professions, to have a permanent online portfolio of your achievements. Everyone who has an ‘About’ page on their blog does this in some way. Adding speaking engagements, videos of what they’ve done or bibliographies extends this. Of course, your online presence can be negative too; just think about advice given to job-seekers about checking what strangers can see on their FaceBook page. I Google myself fairly regularly to see what my students would find, assuming they were ever that bored.
My blog could be seen as a portfolio of what I do and how I do it. If, of course, I planned to use it that way. At the moment I blog and tweet discreetly. I’m sure it’s possible to find out, if you’re so inclined. I’m sure people who know me in person might be able to recognise my personality in my comments, but I’m equally sure the chances are pretty slim of anyone doing so accidentally. This has been a deliberate choice so that I can say what I like, although I try very hard to stay professional. But many other educators (and others) use their blogs as an ongoing record. Their choice and, I’m sure, a very effective one. The potential for this strikes me as so significant that my wife and I are currently considering grabbing ‘named’ domains for our sons,so they have that opportunity in the future.
I’ve given written references for kids. Not often, as I’m perfectly happy to stay as a ‘form tutor’ in our pastoral system, but a few kids from my DofE groups have asked. I gave a personal reference for a friend of mine as I’d also worked with him; it’s odd in a way that I couldn’t honestly write, “Look, he’s godless father to my son, a great cook and I’d trust him with my last penny. Just hire him!” Instead I had to comment on his personal qualities, of which he has many. I still treasure the testimonial I was given by an editor at the end of a work experience, back in my university days. I didn’t continue in journalism or use the letter she wrote me, but the idea was fantastic. (Thanks, Vanessa!) We rely on word of mouth to choose electricians and builders, mechanics and masseurs, presumably because you can’t demonstrate those skills on a webpage or a quarter-page advert. So why not give professional and character references online?
I imagine some kind of social networking site. It would need to use real names and have a contact email address for verification, but that’s not impractical these days. You would recommend or vouch for other people, and say why or what for. Categories of recommendation would be easy enough to evolve, or it could be a simple paragraph, perhaps with hashtags of some kind. Etiquette would probably include listing any potential conflicts of interest. There wouldn’t need to be a limit to the number of recommendations, but viewers would be able to see how many people you gave these recommendations to. It would need to show if these recommendations were reciprocal. And at the same time, they would be able to see who recommended you. These references could have an expiration date, or be ongoing until you cancelled them. I imagine that those taking part would also need to be able to refuse references from other members too.
As I commented at the time, this is not a million miles from the concept of ‘Whuffie’ (Wiki explanation here) as suggested by Cory Doctorow. I don’t know whether trying to define this in numbers would be useful. Maybe members would get a score for the number of actual recommendations they have, and a cumulative one where a bonus score is added on, based on how many each ‘referee’ has. The more recommendations a person had in their field, the more their opinion would be seen as significant in turn. I’m sure some people’s judgements would be seen as more ‘valuable’ than others, something we already see with advertising. Some of this will depend on the reader or viewer, of course; I am far more likely to seek out a book if it has been recommended by Neil Gaiman (author of American Gods, which I think is fantastic) than Stephanie Meyer (I found The Host only okay and couldn’t make myself read the Twilight books), while others would say the opposite. Students applying to university are limited with the number of referees they can give; imagine if instead they could show off the opinions of their current employer, fellow volunteers, youth leaders or subject teachers.
This kind of system would offer everyone the chance to offer testimonials, in a rather more constructive way than FaceBook’s ‘Like’ button. I think to be useful it would have to be combined with exam results and standardised assessments rather than stand alone. (Although it’s not hard to imagine an automated system to include the exam results as part of the list of recommendations.) A good postal system allowed us to move from the written testimonial system to one where we responded to individual requests for information. Now the web would give us the chance to combine the best of both worlds, in the same way that small deli shops can now do a lot of business nationally via a website. Like all teachers I treasure the ‘thank you’ notes a few students have given me over the past few years, and the comments at parents’ evenings. Imagine how valuable it would be to be able to offer that kind of ongoing recommendation for somebody, backed up by your own long-term presence online. I’d like to feel that by sharing my good opinion of my students I’d helped them, somehow. Wouldn’t you?
Filed under: careers, teaching, web | Leave a Comment
Tags: assessment, careers, exams, references, teaching, testimonials, Tipping Point