30% off your first 3 months

Get the deal

Asking about what is on screen beats describing it

by DuckyHelperNov 12, 20264 min read
AI on your computer

TL;DR:

  • When you describe a problem you filter it through what you think matters, and you often leave out the one detail that does.

  • Letting the assistant look at the screen removes copying, retyping and guessing, and keeps the exact wording.

  • Showing is only right when the screen holds nothing private you would not want shared. Close what does not belong.

"My computer shows a warning and I don't know what it means." That sentence is what most of us type when we are stuck. It is also nearly useless, because it leaves out the warning's actual words, which program showed it, and what you were doing. The person or tool helping has to ask three questions before they can start.

The short answer

A screen already contains the answer to most of those questions. If the helper can look at it, you do not have to translate it into words first. The translation is where details disappear: you summarise, you shorten, you rephrase an error code from memory.

Asking with the screen in view means the question can be as short as "what does this warning mean?". The word "this" carries everything the screen shows.

What happens step by step

  1. You ask a short question while the problem is visible.

  2. The assistant takes a snapshot of the screen, at that moment only.

  3. It reads the details you would have skipped: exact message, program name, buttons offered, even the file in the title bar.

  4. It answers about that specific case rather than about warnings in general.

  5. If it needs something more, it asks one precise question instead of three vague ones.

Walk-through: "what does this warning mean?"

Imagine a message that reads, "This file type may harm your computer. Keep or discard?" You are downloading a spreadsheet template.

If you describe it: "It says the file might harm my computer." A helper must now guess. Is that the download bar in a browser? Is it a spreadsheet macro warning? The right advice is different for each.

If the assistant sees it, it can notice details: the warning came from the browser's download bar, the file name ends in .xlsm, and the name suggests a template from a site you recently opened. It can explain that .xlsm files can contain macros (small programs), that browsers warn about that type, and that the careful choice is to keep it only if you trust where it came from. It can also point out that the buttons are "Keep" and "Discard" and say which one you should choose if unsure.

Every one of those details came from the screen. None of them would have survived the sentence "it says the file might harm my computer".

What you save by showing

  • Copying and pasting, which often cannot select the text in a dialog at all.

  • Back and forth. One question and one answer replace a short interview.

  • Misunderstandings. "The red one" and "the top button" mean different things to different people. Looking at it settles which.

  • Memory errors. You see the real message, not the version you remember.

How to ask well when the screen is shared

A short question works best, but put the goal in it. Compare "Fix this" with "I want these dates to sort in order. Why don't they?". The second gives the assistant a target, and the screen supplies the evidence.

If the first answer does not fit, say what is different and ask again. Because the assistant can look again, the second round is faster than starting over with a new description.

What it cannot do

  • See what is not on screen. If the real cause is in another window or a setting you did not open, say so, or open it.

  • Judge safety for certain. It can explain a warning and give a careful default, but it cannot verify that a file is clean.

  • Read your mind about the goal. Tell it what you were trying to do. That is the one detail the screen may not show.

Tip: Add the goal to the question: "I'm trying to download a template. What does this warning mean?" The screen shows the problem, and your words give the purpose.

Privacy and control

Showing the screen means showing everything on it. Before you ask, look at the whole display, not just the part you care about. Close the banking tab, the open email and the notification from a friend. Then ask.

Check, with any tool, when it captures and what it keeps. DuckyHelper looks only while the pill is open and for that answer, and when idle it is not watching.

Try it yourself

Next time something confuses you, first write the question the old way, as a description. Then, before sending it, look at the screen and list three details the description left out. Those are the details a screen-seeing helper would have had for free.

You can download DuckyHelper and try this on a real warning: press fn on a Mac, or Ctrl+Shift+Space on Windows and Linux, and ask. It has a 10 minute try with no card.

Frequently asked questions

Is it better than searching for the error?

Searching needs you to type the message exactly. Showing the screen skips that, and the answer is about your case.

What if the screen has private information?

Close or hide it before asking. A tool should only capture when you ask, but you decide what is visible.

Should I still describe my goal?

Yes. The screen shows the state, but only you know what you were trying to do.

Get started

DuckyHelper can
do more

It sees your screen and works in any app you use. Try it for 10 minutes, no card.

Get it for Mac, Windows or Linux

Share

Questions and jobs

Do anything

Ask it a question or hand it a job, in any app.

Doing jobs for you is in early access on Mac. Asking works on Mac, Windows and Linux.