Chapter 6
Know it: name the tool before you trust it
The chapter in a minute
- The Ladder Loop has five steps in a ring: Know it, Brief it, Limit it, Check it and Keep it, with Keep it leading back to Know it.
- Know it means naming the kind of tool, its strengths and its typical mistakes before you rely on it.
- Each kind has its usual mistakes. A chat assistant without search knows nothing about today, and search with AI answers can get its links wrong.
- Different kinds of tool can see different amounts, from what you type to your connected accounts and pages on the web.
- Checklist question 1 is 'Do I know what kind of tool this is, and what it does well and badly?'
Try it now
Make a tool card
0 of 7 steps done
Step 1 of 7
Choose one AI tool you use or would like to use. Write your own name for it at the top of the card.
Try this
Try this, from the book
Pick one AI tool you use. Search its help pages for what it can see, and read the first page you find. Note whether it mentions files, memory or connected apps.
Tools and settings, as of a date
The book points to the ‘Tool list’ section of the companion page. Here it is in full, with the date each detail was checked. Open it on the companion page
Chapter 6 points here. The chapter says the table has no brand names and that this page keeps a dated list of current examples of each kind.
Each kind of tool sees a different amount. The tool's own help pages say what it can see, and the chapter promised links to them. Wording, product names, settings and availability change often, so every row has its check date.
| Kind of tool | Current example | What its help page says it can see | Page and date |
|---|---|---|---|
| Chat assistant | ChatGPT (OpenAI) | What you attach to a conversation: documents, spreadsheets, presentations, images and audio. Some can remember details between chats if memory is on. | "Uploading files and audio to ChatGPT" (opens in a new tab). Checked 2 November 2026 (page showed "Updated: 2 days ago"). |
| Chat assistant | Claude (Anthropic) | What you attach to a chat: documents such as PDF, Word and spreadsheet files, and images. | "Upload files to Claude" (opens in a new tab). Checked 2 November 2026 (page dated 23 July 2026). |
| Search with AI answers | AI Overviews in Google Search | Information from a range of sources on the web, with links to it | "Find information in faster & easier ways with AI Overviews in Google Search" (opens in a new tab). Checked 2 November 2026. |
| Assistant built into an app, at work | Microsoft Copilot | Work content you have permission to see, such as your emails, chats and documents | "Data, Privacy, and Security for Microsoft Copilot" (opens in a new tab). Checked 2 November 2026 (page last updated 18 August 2026). |
| Assistant built into an app, personal | Gemini with Connected Apps | Apps you connect, such as email and calendar, which you can disconnect "anytime". | "Use & manage Connected Apps in Gemini" (opens in a new tab). Checked 2 November 2026. |
| Screen and camera | Gemini Live | Your camera or your whole screen while you share it. Sharing stops when the screen locks or the chat is put on hold, and does not restart by itself. | "Talk naturally with Gemini Live" (opens in a new tab). Checked 2 November 2026 (Android phone and tablet version). |
| Agent in your browser | Claude in Chrome | Sees what is on the page and can act on it: reading, clicking, typing and filling in forms. It pauses to ask when something needs your approval. Paid plans only. | "Get started with Claude in Chrome" (opens in a new tab). Checked 2 November 2026 (page showed "Updated this week"). |
Other help pages the chapter draws on:
- OpenAI, "Does ChatGPT tell the truth?" (opens in a new tab) (page showed "Updated: 10 days ago"). Checked 2 November 2026.
- Connected apps are unavailable on gemini.google.com when the Keep Activity setting is off. Google help page "Use & manage Connected Apps in Gemini" (opens in a new tab). Checked 2 November 2026.
Two notes about change: the workplace assistant was renamed in 2026 (Microsoft's privacy page is now titled "Data, Privacy, and Security for Microsoft Copilot" and has moved to a new address), and one provider's agent product was withdrawn (see "Agent options").
Agent benchmark figures
Stanford HAI, The 2026 AI Index Report (opens in a new tab), chapter 2, section 2.6: agents fail roughly one in three attempts on structured benchmarks. On a test of 369 real computer tasks the best result rose to 66.3% against about 72% for people. On web tasks, success rose from about 15% in 2023 to 74.3% in early 2026, against a human baseline of 78.2%. Original benchmarks: OSWorld (opens in a new tab) and WebArena (opens in a new tab).
Checked: 2 November 2026. The 2026 report is still the newest edition.
Citation error figures
- Columbia Journalism Review, Tow Center, "AI Search Has a Citation Problem" (opens in a new tab), 6 March 2025. Eight tools, 1,600 queries: more than 60% wrong overall, 37% to 94% wrong by tool.
- The EBU and BBC news study (see "How it works").
Checked: 2 November 2026. Neither study has a newer round.
From the book
A tool's kind tells you which mistakes to expect. Ask question 1 before you rely on an answer, and treat a quick no as a reason to slow down.
Sources
- Enable and use web search (opens in a new tab) · Anthropic, 2026
- Get started with Claude in Chrome (opens in a new tab) · Anthropic, 2026
- News Integrity in AI Assistants: An international PSM study (opens in a new tab) · Fletcher, James and Verckist, Dorien, 2025
- GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment (opens in a new tab) · Ghosh, Dhruba and Hajishirzi, Hanna and Schmidt, Ludwig, 2023
- Find information in faster & easier ways with AI Overviews in Google Search (opens in a new tab) · Google, 2026
- Talk naturally with Gemini Live (opens in a new tab) · Google, 2026
- Use & manage Connected Apps in Gemini (opens in a new tab) · Google, 2026
- The 2026 AI Index Report (opens in a new tab) · Stanford Institute for Human-Centered Artificial Intelligence, 2026
- AI Search Has A Citation Problem (opens in a new tab) · Jaźwińska, Klaudia and Chandrasekar, Aisvarya, 2025
- Racial disparities in automated speech recognition (opens in a new tab) · Koenecke, Allison and Nam, Andrew and Lake, Emily and Nudell, Joe and Quartey, Minnie and Mengesha, Zion and Toups, Connor and Rickford, John R. and Jurafsky, Dan and Goel, Sharad, 2020
- Careless Whisper: Speech-to-Text Hallucination Harms (opens in a new tab) · Koenecke, Allison and Choi, Anna Seo Gyeong and Mei, Katelyn X. and Schellmann, Hilke and Sloane, Mona, 2024
- Data, Privacy, and Security for Microsoft Copilot (opens in a new tab) · Microsoft, 2026
- Introducing ChatGPT search (opens in a new tab) · OpenAI, 2024
- Does ChatGPT tell the truth? (opens in a new tab) · OpenAI, 2026
- Memory in ChatGPT (opens in a new tab) · OpenAI, 2026
- Uploading files and audio to ChatGPT (opens in a new tab) · OpenAI, 2026