Every serious product in this platform can see, hear, or act because something in the lab learned to first. This is the playful end of the portfolio — voice assistants, avatars, game coaches, learning agents — and it's also the proving ground for every way of seeing, hearing, and acting the rest of the company inherits.
The voice assistant is complete and working: a wake word opens a real conversation — not a one-shot command — that stays open for follow-ups until you go quiet, all running through the platform's supervised action layer.
The face of the assistant and the lock on its hands. A 3D talking-head avatar with lip-sync floats on the desktop, while an identity check — your voice plus your face — sits between any sensitive suggestion and the moment it happens. Locked by default and verified: no match, no action. It turns "a human approved" into "the authorized human, verified live, approved."
Built for a kid's Fortnite sessions: a real-time squad coach that sees the screen, hears the party chat, and calls out what matters — watching and listening only, never touching the controls.
Computer vision on a local graphics card reads the screen every ~1.5 seconds, about 0.3 seconds per look, with a cloud backup — timed so callouts stay current, not stale.
The coach hears the game's own sound: party voice chat is transcribed live by on-device speech recognition, so it reacts to "enemy north" like a teammate — and knows who said it by their voice.
Spoken callouts under ten words, a pause between them, and a hard bias toward silence in lobbies — a good squadmate mostly stays quiet.
The ambitious cousin of the coach: a game agent that learns by watching how a human plays. Every session banks matched-up video and controller input — what was on screen, and what the human actually did — into a growing training library.
None of this ships as a product, and that's by design. The lab is where ways of seeing, self-improving training loops, wake-word ergonomics, and verified human-approval controls get invented cheaply — on games and desktop assistants — before the serious products bet on them. The weather platform's prediction-grading loop, the AI's sense wiring, and the voice-and-face identity check all trace back here.
The lab's one rule: watching and listening are free, acting is controlled. Everything here can see and hear on your own hardware, but anything that acts goes through the same human-approval and identity-check discipline as the rest of the platform.
On-device speech recognitionNatural computer voiceLocal computer visionDesktop overlayVoice + face verification