The Nexus emblem

How Nexus works

From "Hey Nexus" to an answer, one step at a time.

Architecture · How Nexus works · Security · Privacy · AI-assisted development

Meet Nexus is who she is. This page is what happens, step by step, when you talk to her.

One request, start to finish

  1. Listening for her name. Each speaker's own computer listens for "Hey Nexus" and nothing else. Until it hears her name, nothing is recorded, kept or sent anywhere. The mute button on a speaker turns its microphone off.
  2. Turning speech into text. Once she's been called, what you say is turned into text on that speaker's computer. The audio itself is never kept, and never leaves the house.
  3. One answer, not two. Both speakers report how clearly they heard you, and only the closest one answers.
  4. Who's talking. A short voice print tells Jeremy and Candice apart. It only changes how she speaks to you (Candice gets the sweet Nexus); it never unlocks anything.
  5. Working out what you want. The text goes to her language model on the Hive, together with her personality and what she remembers about the household. She decides whether you want a conversation, an answer, a look-up, or something done in the house.
  6. Checking permission. House actions can only be things Jeremy has put on her approved list: run a routine, switch a light group, start music. Anything else is refused, however it's worded.
  7. Doing it. Approved actions go to the home automation platform, which carries them out. Look-ups go out through privacy guards (see Privacy).
  8. Answering. She replies in her own voice, made on the Hive, through the speaker that heard you. Important news can also reach the right person's phone.

The same brain, other doors

What she can't do