Written by Carl Davidson, Head of Insight at Research First
“I daresay you haven’t had much practice… why, sometimes, I’ve
believed as many as six impossible things before breakfast”
― Lewis Carroll, Through the Looking-Glass,
There really is no polite way to say this: the world is awash with bullshit. We can dress this up in all the ‘post-truth’ and ‘alternative facts’ packaging we want, but it’s much more useful not to mince our words. After all, one of the golden rules of psychology is that ‘to name it is to tame it’. Working in the world of research and policy, we confront this problem every day. We see it in ‘voodoo polls’ that take on the appearance of science without any of the substance. And we see it in ‘experts’ who clearly have no idea about how little they really know.
Facts may be stubborn things but assertions are clearly more of a push-over. As Oliver Wendell Holmes Jnr put it, “certitude is not the test of certainty”. The key is not to dismiss all research and evidence but to be clear about when you can trust it.
Back in the mid nineties Carl Sagan compiled a ‘Baloney Detection Kit’ that remains a great resource for anyone dealing with claims made from evidence. It also outlines a number of the common rhetorical tricks that get rolled out to shift your attention away from the quality of the research. There is a version of that article on Research First’s website (here: http://www.researchfirst.co.nz/uploads/The%20Fine%20Art%20of%20Baloney%20Detection.pdf), and we have a shorter, easier to use, checklist version you can use too (here: http://www.researchfirst.co.nz/uploads/files/users/30375/RF_Research_Ninja.pdf).
But fact-checking is only part of the way to hold back the tide of bullshit. As well as being able to check the quality of the evidence used to support an argument, we need to be able to interrogate the quality of thinking that sits behind it. This is the notion of ‘critical thinking’, which is the art of thinking about thinking. What critical thinking often shows us is that the weakest part of an argument is not the facts it ends up with but the assumptions it starts with. There is nothing hard about critical thinking, but it is a skill that needs instruction and practice. Given how often we see the need for this in the organisations we work with, we now offer a range of seminars in how to improve your critical thinking (see a list here: http://www.researchfirst.co.nz/index.php?page=seminars).
It may be unfashionable to say this but I can’t help thinking that the best way to beat back the wave of bullshit washing over the world is by encouraging more students to study the liberal arts and the humanities. These subjects let us see where our current ideas fit within a historical and philosophical context, while training graduates how to balance open-mindedness and scepticism. In this regard, these disciplines aren’t about anything in particular so much as a way to think about everything. And make no mistake, it is very much a ‘discipline’. These subjects teach how to ask difficult questions and mistrust easy answers. They also show how every solution creates new problems. As Seneca said, nobody was ever wise by chance.
If it’s true that many of living in the West have ‘lost faith in our own future’ (or, in 2017, think they are about to) then it’s time to rethink that future. To do that, what we need are people who can call that future to a higher standard. Which means, now more than ever, we need more Arts graduates.
Research First is PRINZ’s research partner, and specialises in impact measurement, behaviour change, and evidence-based insights.
Image credit: iStock