30% off your first 3 months

Get the deal

An assistant that only looks when you ask

by DuckyHelperNov 12, 20264 min read
AI on your computer

TL;DR:

  • An assistant that looks only when asked has a clear start and a clear stop, and does nothing while idle.

  • Opening a pill with a key press makes the boundary visible: while it is open it listens, and when you close it the question is over.

  • Check for visible signals, a way to cancel, and what the product says about idle behaviour.

There are two broad designs for an assistant that can see your screen. One watches all the time, so it is ready for anything. The other does nothing until you ask. The second is easier to trust, because you can always say exactly when it was looking.

This article explains the second design: what it does, how to recognise it, and why a visible pill you open with one key press is such a clean way to draw the line.

Two designs, one question

The question to ask of any screen-aware tool is simple: when is it looking at my screen, and when is it listening? There are only a few honest answers. "Always" is one. "Only while the pill is open" is another. "Only after I click a button" is a third. Vague answers like "when needed" deserve a follow-up question.

Always-on watching has a real use, like a tool that reacts to something as it happens. But for a helper you ask questions, it means a constant stream of everything on your screen, including the parts you did not mean to share.

Walk-through: asking a question and closing the pill

Here is what a press-to-ask moment looks like from your side. You are reading a chemistry worksheet and get stuck on question 4.

  1. Idle: Nothing is listening and nothing is capturing your screen. The assistant is just ready.

  2. Press: You press the key and a pill opens. Now, and only now, it listens to your voice and looks at the screen.

  3. Ask: "What is this question asking me to find?" You can point at the question with your cursor.

  4. Close: You press the key again or close the pill. Listening stops. The assistant works from what it heard and saw during that moment.

  5. Answer: It answers out loud and may mark the screen. When the answer ends, it goes back to idle.

Every step has a visible edge. You know when it started because you pressed. You know when it stopped because you closed the pill. There is nothing to wonder about at 2 p.m. while you are on a different task.

Why a visible pill beats a hidden mode

A hidden toggle, a mode you switch on and may forget about, relies on you remembering to turn it off. A pill relies on what you can see: if it is open, it is listening, and if it is closed, nothing is heard or seen. You stop it by pressing the key again or closing the pill, and the open pill sits on your screen as a reminder until you do.

It also helps with shared spaces. If someone walks into the room while you are working, a closed pill makes it obvious that the assistant is not running.

What to look for in any assistant

  • A visible state: something on screen that shows listening, thinking and idle differently.

  • A way to stop instantly, not buried in a menu.

  • A plain statement from the maker about what happens when idle. If you cannot find one, treat that as a finding.

  • Controls in your operating system that you can use to revoke screen or microphone access.

What idle should really mean

Idle should mean more than "the window is closed". The microphone should not be recording, no screenshots should be taken in the background, and nothing should be sent anywhere. These are the same three things you would check on a camera with a cover over the lens: is it recording, is it sending, and can I see that for myself.

If a maker describes idle behaviour in specific terms, you can test it. Open your activity monitor, watch the assistant while you do nothing, and notice whether it is using the microphone or sending data. A quiet idle is what a well-built tool looks like.

What this does not guarantee

Looking only when asked limits when your screen is captured, not what is on it. If you ask a question with a private message open, that message can be in the picture. The habit of closing or hiding private windows before you ask is still yours to keep.

Tip: Before asking, glance at what is visible. If something private is open, close it or move it off screen. It takes two seconds.

Privacy and control

DuckyHelper is built on the open-pill idea. Nothing is heard or seen when you are idle, and each answer covers only the moment you asked. The key is fn on a Mac and Ctrl+Shift+Space on Windows and Linux. For the longer version, read when DuckyHelper looks at your screen.

Try it yourself

Try this with any assistant: open it, then do nothing for a minute and check its indicator. Ask a question and watch what changes. Then look in your operating system's privacy settings and find the screen and microphone lists. If you can follow the story from start to finish, the design is doing its job.

Frequently asked questions

Does "only when I ask" mean nothing is stored?

Not necessarily. It means capture happens only on request. What is kept afterwards is a separate question to check in the privacy page.

Can I still use a voice assistant without looking at my screen?

Yes. You can ask general questions without pointing at anything, and close private windows first if you want to be sure.

What if I press the key by accident?

Press the key again or close the pill and the moment ends. If something private was open, treat it like you would any accidental share.

Get started

DuckyHelper can
do more

It sees your screen and works in any app you use. Try it for 10 minutes, no card.

Get it for Mac, Windows or Linux

Share

Questions and jobs

Do anything

Ask it a question or hand it a job, in any app.

Doing jobs for you is in early access on Mac. Asking works on Mac, Windows and Linux.