Skip to content

Week 3

Check it: catch a confident mistake


Colm asked a chat assistant for four sources for his society newsletter. Back came a neat list, with authors, years, titles and even page numbers. He went to borrow the first book from the library, and the catalogue had never heard of it. The second source was a real journal, but no article by that name had ever appeared in it. Two of the four did not exist.

The book calls this a confident mistake: an answer that sounds sure of itself and is wrong. A made-up reference arrives in the same tidy layout as a real one, so you can't tell by looking.

Try it in five minutes

Ask an assistant for one source on a subject you know well. Search for its exact title, in quote marks, in a library catalogue or on the web. If it gave a link, open it and find the sentence the answer relies on. Then give it one mark: real and relevant, real but wrong, or invented.

Asking the assistant whether it's sure won't settle it, because you'd be asking the tool that made the mistake to mark its own work. From the book (chapter 9): 'Sounding sure is not evidence.'

Check names, dates, numbers, quotes and sources first.

Read more in chapter 9, Check it.