Sukanth for Media Lab! - 1. Smart Glasses Works

Always on AIs and Softwares for the ultimate Heads Up eXperiences.

What did you get done? - Elon AI

April 2025

An AI version of Elon Musk in your smart glasses, helping you become your most productive self.

Install Now and Start Using!

What if an AI version of Elon existed in your smart glasses to hold you accountable?

Elon proactively checks to ask what you’ve accomplished. Elon keeps track of your to-dos and completed tasks, so when someone asks what you got done this week, you can simply ask Elon to summarise it for you.

Ask Elon to check whether if you have active to-dos.

Elon intervenes to ask about your productivity updates.
Ask Elon to check what you've got done already.
Check what Elon has tracked for you using a webview.

Sukanth's Role [Sole Developer]: Systems & Pipelines Design, Cloud Deployment (Google Cloud - Compute Engine), Docker Containerization, Hosting and Routing (CloudFlare), Database Management (Supabase), Smart Glasses Interfacing Software Development, Web Interface Software Development, Prompt Engineering and Interaction Design.

Webview Interface

HUX - Heads Up eXperience

July 2024

An always on AI companion for Human Computer Environment Interaction

Eye gaze directed Querying on a live video feed

Summarizing changes in the environment outside the user's selective attention.

Left shows overall image from a wearable camera; Right shows Region of Interest

The system processes scene images through VLMs to create structured memory entries. The system extracts regions of interest, generates detailed descriptions, and stores contextual information with retrieval keywords.

Keywords provide multiple semantic entry points that enable fast initial filtering before LLM-based re-ranking, acting as efficient "hooks" for diverse natural language queries to match the same memory.

ChatGlasses

June 2025

Smart Glasses native real-time chat for connecting with friends who have smart glasses.

Install Now and Start Using!

ChatGlasses won $5000 USD Grant from Mentra, a Y Combinator backed company based out of San Francisco.

Webview: Store contacts of friends who have SmartGlasses.

Webview: Chat history based on the voice transcripts.

Start real-time chat by saying "Chat [friend name]" - example: "Chat Alice."

(SmartGlasses view)

Check if friends are online by saying "Friends"

(SmartGlasses view)

QR-Auth for Smart Glasses

May 2025

Open your web dashboard and authenticate your identity by scanning the QR code while wearing camera enabled smart glasses.

[ login using smart glasses ]

Open to use by others - GitHub Link

Sequence Diagram outlines a system where a web session is authenticated by scanning a QR code using AR glasses, which capture frames and detect the encoded session payload. The glasses send a signed token back to the server, which verifies it and grants the browser an authenticated session.

Scan to login

Authenticate using your smart glasses identity.

(smart glasses as key)

Camera enabled smart glasses.

DocDoc

September 2025

DocDoc, a system that automatically creates patient records from live data collected by doctors' wearables, then integrates into existing EMR systems after AI-driven analysis. The manual record-keeping process we observed were error-prone, time-consuming, and deeply frustrating for doctors who wanted to focus on patients, not written paperwork. I conducted hands-on demos with clinicians, iterated the prototypes based on informed feedbacks.

Contributors: Sukanth Kalivarathan, Nakkeeran Raveendran

Healthcare professional wearing smart glasses. (Camera, Microphone and Speakers).

*Consent seeked for photography

Sukanth's Role: Systems & Pipelines Design, Cloud Deployment (Google Cloud - Compute Engine), Docker Containerization, Hosting and Routing (CloudFlare), Database Management (Supabase), Smart Glasses Interfacing Software Development, Web Interface Software Development, Prompt Engineering and Interaction Design.

JIPMER, a leading Indian Government Hospital at Pondicherry, India

Automated Patient Record from Transcriptions, EMR integration.

WhatsApp Video 2025-10-22 at 03.03.37 (2).mp4

One of the first prototypes of DocDoc.

Healthcare professional wearing smart glasses interacting with a patient while logging to the backend system.

*Consent seeked for photography and transcription.

Advisory by Mr. Paras Chopra

ExoMem

April 2025

Exo Memory: Transcriptions to Memory Clusters

The Memory Aid for Smart Glasses turns real-time user speech into a structured, queryable long-term memory system.

Live audio from the wearable is streamed and transcribed instantly. An LLM processes the transcription to identify meaningful information and generate raw memory entries tied to each user, to create a user model.

A custom distillation converts these raw entries into structured memory units containing summaries, entities, timestamps, importance scores, and relational links. These units form a graph-based memory cluster, where related memories connect through semantic edges.

This cluster enables efficient retrieval, making it possible for AI agents to access relevant past information without brute-forcing entire logs. The result is a lightweight, persistent, and evolving memory graph that scales with months or years of user interactions.

The user memory model is context-agnostic and can be integrated with any external data source.

Sukanth's Role [Sole Developer]: Systems & Pipelines Design, Smart Glasses Interfacing Software Development

Data Structure:

{

"id": "m015", "type": "note", "timestamp": "1712863421.586004",

"summary": "User corrected their mother's birthday to April 13th.",

"entities": {

"people": ["User's Mom"],

"topics": ["Birthday", "Date correction", "Personal info"]

"reinforcement": 0.8,

"links": [

{"target_id": "m014", "relation": "technical_related"},

{"target_id": "m003", "relation": "goal_conflict"}

]

}

Page updated

Google Sites

Report abuse