What is Poinky?
Poinky is a voice-driven assistant for Mac that answers questions about the screen, explains with sketches, and can interact with on-screen controls. It is designed for people who want help while working in apps, reading pages, or completing routine computer tasks without switching to a separate chat window. It requires macOS 26 or later and uses Claude through Claude Code with a Pro or Max plan, or an Anthropic API key; some functions need Claude Code.
Poinky Features:
Screen Questions: Hold Control and Option to ask aloud about the current screen, or drag to circle the specific area you mean.
Voice Sketches: Poinky speaks its explanation while drawing step-by-step sketches, and can present a 3D model that you can spin.
Guided Clicks: For requests such as finding an export command, Poinky circles each click target and pauses for you to act.
On-Screen Actions: It can type text into apps or forms, and asks for confirmation before sending an item such as an email.
Explainer Videos: Ask for a video on a topic to create a narrated, animated explainer that opens full screen when ready.
Local Voice Input: Speech is transcribed on your Mac, while screenshots are sent to Claude only when you ask a question.
Poinky Benefits:
Less App Switching: Getting help beside the work in progress makes it easier to resolve a question without copying details into another chat.
Clearer Explanations: Pairing spoken guidance with sketches gives users a visual reference they can follow while learning an unfamiliar idea.
Fewer Missed Steps: Marked targets and pauses between actions can make multi-step navigation easier to follow.
Faster Routine Entry: Having Poinky enter requested text can cut down on repetitive typing when drafting messages or completing forms.
Control Before Sending: Requiring approval before a message is sent leaves the final decision with the user and reduces accidental sends.
Use Cases:
Understand Screen Content: Ask what a chart, table, or diagram on a webpage means, then follow an explanation tied to the material on screen.
Find App Controls: Learn an unfamiliar app by asking where to find a setting or export option and following the marked clicks.
Draft Messages: Describe an email you want entered, review the draft, and confirm before it is sent.
Learn a New Topic: Request a short narrated visual explainer when a written answer alone is not enough to clarify a subject.
Work on a Project: Ask Claude Code to investigate or fix a project while you work, using Poinky's background agents.

