Skip to content
VISION Docs

User Flow

This page walks through the most common VISION interactions from the user’s perspective.

Voice Command Flow

Every voice interaction follows this pattern:

1.  User presses and holds the button
    • Glasses vibrate once (confirming recording started)


2.  User speaks the command
    • "What do you see?"
    • "Navigate to the pharmacy"
    • "Send message"


3.  User releases the button
    • Glasses vibrate twice (recording ended)


4.  Glasses understand the command
    • Matches spoken words to the closest known command
    • Usually takes under 10 seconds total


5.  The right module runs
    • Scene is described, or route starts, or message is sent


6.  Glasses speak the result
    • User can TAP to skip sentences
    • Or DOUBLE-TAP to stop entirely
    • Or TRIPLE-TAP to cancel

First-Time Setup Flow

1.  Power on the glasses
    • "Setting up your VISION glasses"


2.  Glasses connect to WiFi and the cloud
    • Each step is announced by voice


3.  No account paired yet?
    • "Waiting for phone pairing..."
    • User opens the mobile app → Pair Device → shows QR code
    • Glasses detect the phone and sync the account


4.  Welcome
    • "Welcome, [your name]!"


5.  All systems come online
    • Cameras, GPS, face recognition, messaging, etc.


6.  Ready
    • "All set! Hold button and tell me what you need."
User: "Navigate to the pharmacy"
  │
  ├─ Already navigating?
  │   ├─ Yes → "You're navigating to [place]. Cancel?"
  │   │         ├─ "Yes" → cancel, start new destination flow
  │   │         └─ "No"  → continue current route
  │   └─ No  → continue
  │
  ├─ Route is found → "Navigate to Guardian Pharmacy, 800m away"
  │
  ├─ While walking:
  │   ├─ Approaching turn → "In 50 meters, turn right"
  │   ├─ Off-route → "You're off course. Recalculating..."
  │   ├─ Stationary too long → "Need help?"
  │   └─ Arrived → "You've reached your destination"
  │
  └─ Caretaker sees live map in the app the whole time

Messaging Flow (VIP → Caretaker)

User: "Send message"
  │
  ├─ Multiple caretakers?
  │   ├─ Yes → "Say 1 for Mum, 2 for Dad"
  │   │         └─ user says number
  │   └─ No  → use the default caretaker
  │
  ├─ "Hold button and speak your message"
  ├─ User records their voice message
  ├─ "Message sent to Mum"
  │
  └─ Caretaker's phone: push notification → new voice message

Messaging Flow (Caretaker → VIP)

Caretaker sends a message from the app
  │
  ├─ Message arrives in the cloud
  ├─ Glasses detect it
  ├─ "New message from Mum"
  │
  └─ VIP can listen now, or say "Check messages" later

Face Recognition Flow (Automatic)

Glasses are on
  │
  ├─ Familiar faces list loaded from the cloud
  ├─ Dedicated camera watches for faces
  │
  └─ Continuously:
      ├─ Faces detected in view
      ├─ Each face compared to the familiar list
      │
      ├─ Match found?
      │   ├─ Yes → "I see [name]"
      │   │         (multiple matches = announced one after another)
      │   └─ No  → silent, ignored
      │
      └─ No-repeat cooldown keeps announcements calm

Document Scanning Flow

User: "Scan document"
  │
  ├─ Camera takes a clear photo
  ├─ Text is extracted via AI
  ├─ Text is read aloud via voice
  │   • User can tap to skip sentences
  │
  ├─ A short summary is generated
  ├─ Photo, text, and summary saved to mobile app
  │
  └─ User can revisit or share anytime

Obstacle Detection Flow

User: "Start detection"
  │
  ├─ Ultrasonic sensor + camera work together
  │
  └─ Continuously:
      ├─ Obstacle detected
      │
      ├─ Very close (arm's length)?
      │   ├─ "DANGER — person, arm's length away!"
      │   ├─ Glasses vibrate rapidly
      │   └─ Warning repeats quickly
      │
      ├─ About one step away?
      │   └─ "CAUTION — chair, one step away"
      │
      ├─ A couple of steps away?
      │   └─ "Chair ahead"
      │
      └─ A few meters away?
          └─ Calm single notice

Glasses ↔ App Sync Flow

┌──────────────┐                            ┌──────────────┐
│   GLASSES    │         Cloud Sync         │  MOBILE APP  │
├──────────────┤                            ├──────────────┤
│ Face seen    ├──► saved in cloud ◄────────┤ Show in feed │
│              │                            │              │
│ Location log ├──► saved in cloud ◄────────┤ Show on map  │
│              │                            │              │
│ Document scan├──► saved in cloud ◄────────┤ Show in docs │
│              │                            │              │
│ Recognize    │◄─── new face added ◄───────┤ Add face     │
│ new face     │                            │              │
│              │◄──── new message ◄─────────┤ Send message │
│ Announce msg │                            │              │
│              │                            │              │
│ Status       ├──► heartbeat ◄─────────────┤ Show status  │
│ update       │                            │              │
└──────────────┘                            └──────────────┘


Both sides stay in sync with real-time cloud updates.
No direct phone ↔ glasses connection needed after pairing.