TL;DR:
An assistant can read foreign text on your screen and give you a translation, even in an image where you cannot select text.
Context changes meaning. Tell it what the text is, such as a menu or a contract.
Be careful with allergies, legal text and false friends. Translation is a guide, not a guarantee.
You are looking at a menu in a language you do not read, or a web page, or a form. You cannot copy the text out, because it is an image. A screen-aware assistant can read what you see and tell you what it means without you moving anything to another tool.
The short answer
It looks at the screen, reads the text in the picture, translates it, and shows or says the result. The most useful form is in-place translation: the meaning appears next to the original, so you can match each line to what you see.
What happens step by step
Read the picture. Text recognition turns the pixels into characters, in the original language.
Work out the language and the kind of text. A menu, a sign and a legal notice call for different word choices.
Translate. Each line is translated using the lines around it, not word by word.
Present it. Either beside the original or read aloud.
You check anything that matters. Prices, ingredients, dates.
Walk-through: a menu in another language
Say you see this Spanish menu section and ask, "Translate this menu, I am vegetarian."
On the menu | Translation | Note |
|---|---|---|
Sopa del día | Soup of the day | Ask which soup it is |
Tortilla española | Spanish omelette | In Spain, a potato and egg omelette |
Ensalada mixta | Mixed salad | May include tuna or egg in some places |
Pollo asado | Roast chicken | Not vegetarian |
Menú del día | Set meal of the day | A fixed-price meal |
Look at what context did. Tortilla alone could mean a flatbread, which it does in Mexico, but with española on a menu in Spain it is an omelette. A good tool uses surrounding words to decide, which is why you should tell it where you are and what the text is.
Note too that the translation of Ensalada mixta carries a caution. "Mixed" is accurate but says nothing about what is in the mix. A translation tells you what words mean, not what is in the bowl.
Context changes the answer
Say what kind of text it is: menu, street sign, email, legal notice.
Say where it is from if you know. Words differ between countries that share a language.
Say who it is for. A formal letter and a chat message want different tones.
Errors to watch for
False friends. Spanish embarazada means pregnant, not embarrassed. Words that look alike can mean different things.
Idioms. A literal translation of a saying makes no sense. Ask "what is the meaning, not the words?".
Misread text. In a photo, glare, small print or decorative fonts can change letters, and a misread word translates into nonsense.
Names and prices. Dish names should stay in the original so you can ask a person. Check numbers by eye.
Allergies and legal text: Do not rely on a machine translation for an allergy, a medical instruction or a contract. Ask a person who speaks the language, or use an official translation.
Asking better questions about foreign text
A translation is a starting point. Follow it with questions: "Is this word formal or casual?", "Would a local say it like this?", "What is the literal meaning and what is the intended meaning?" These get at what a plain translation leaves out.
For learning, ask for the word-by-word breakdown of one line rather than the whole page. Seeing that sopa del día is soup, of the, day builds the vocabulary you need to read the next menu without help.
And when the text matters, translate twice: ask for the translation, then ask the assistant to translate its English back into the original language. If the result is far from the original, something was lost, and you know where to look.
What it cannot do
It cannot promise a dish is free of an ingredient. It can only translate the words printed.
It struggles with handwriting, stylised fonts and very low-quality images.
It may translate into a register that is too formal or too casual for your situation.
It cannot catch a mistake in the original text.
Privacy and control
Translating a page means the assistant reads it. If the text is private, such as a letter or a form with your details, think about whether you are comfortable sharing it. Know whether your tool looks only when you call it.
DuckyHelper sees your screen and can draw on it, and it only listens or looks while the pill is open and for that answer.
Try it yourself
Find a short page in a language you do not read. Tell the assistant what it is, ask for the meaning line by line, and pick one phrase to check in a dictionary.
Frequently asked questions
Does translation work on images?
Often, because the tool reads the text from the picture first. Quality depends on how clear the image is.
Is machine translation good enough for school work?
It helps you understand. For submitted work, follow your teacher's rules, and learn the words rather than copy them.
Get started
