Hey Mint
Basics

Talking to Mint

One continuous conversation, by voice or by typing. Follow-ups carry on the task you are in, and the last few turns survive a restart.

Basics

Waking Mint and asking

Say “Hey Mint”, then ask in your own words. Your words appear in a caption beside the orb as you speak; Mint's reply is captioned the same way.

A request from start to finish. Your words rise in word by word, the orb thinks (eyes up), turns into the Slack icon while opening it, shows a ✓, and captions its reply.
To do thisDo this
Wake it“Hey Mint”, click the orb, or ⌘J and type
Keep goingJust carry on talking; no need to say “Hey Mint” again while it is awake
Talk over itStart talking while it speaks: it stops and listens (echo cancellation keeps its own voice out)
Send it to sleep“bye”, “that's all”, “good night”, “chalo bye”; it also sleeps after 12 quiet seconds
From a script.venv/bin/python -m mint --say "what's on my calendar today?"
  • what's on my calendar today?
  • and what about tomorrow?
  • open Slack and go to the on-call channel
  • what was that date again?
  • bye
It is one conversation. “No, the other project” or “add cheese to that list” continue what you were doing. After a restart, the last few turns (within six hours) and a running summary carry over.
Basics

Stopping it

“Stop”, “cancel”, “never mind” or “hold on” halts everything at once, including clicks and keys already queued. The ■ button in the chat does the same.

“Stop.” Mint was about to click Send; the orb flashes red and nothing more happens.
  • stop
  • cancel that
  • never mind
  • hold on
Basics

The chat window

Press ⌘J (or click the orb) to open the chat. Everything said is there, every action with a ✓ or ✗, and a box to type in. Typing never turns the microphone on.

The chat opening. The conversation, the list of actions, and the typing box.

The buttons along the top

ButtonWhat it does
👁 EyeShow or hide Mint in screen sharing (red when visible)
⋯ MoreSummarise and compact, clear the chat, start a new session
☾ MoonSend Mint to sleep
🎙 MicMicrophone on or off
🔊 SpeakerSpoken replies on or off
⚙ SettingsSettings, voice training, quitting
✕ CloseClose the chat (Esc works too)

Keeping it tidy

  • summarise and compact the session
  • clear the chat
  • start a new session

Compact writes a short summary and restarts Mint with just that as context. Clear empties the window but keeps memory. New session saves this conversation to memory and starts fresh.

Basics

Changing how Mint behaves

Mint changes its own settings when you ask, and tells you what it changed.

SayWhat changes
“don't speak, just chat” / “you can speak again”Spoken replies off / on
“turn off the mic”Microphone off (then you type)
“make it pink”, “use the aurora theme”Theme
“move to the top left”Where the orb lives
“hide the face”The orb's face
“use a deeper voice”, “talk slower”, “switch to Puck”Voice and speaking style
  • don't speak, just chat
  • make it pink
  • move to the top left
  • use a deeper voice
  • talk slower
Basics

Languages and names

Mint understands English and Hindi, and the two mixed. Names from your accounts, Slack channels and routines are given to the transcriber as vocabulary, so it spells them right. When it mishears, tell it once (see Words it gets wrong).