Always on AIs and Softwares for the ultimate Heads Up eXperiences.
Always on AIs and Softwares for the ultimate Heads Up eXperiences.
What did you get done? - Elon AI
April 2025
An AI version of Elon Musk in your smart glasses, helping you become your most productive self.
What if an AI version of Elon existed in your smart glasses to hold you accountable?
Elon proactively checks to ask what you’ve accomplished. Elon keeps track of your to-dos and completed tasks, so when someone asks what you got done this week, you can simply ask Elon to summarise it for you.
Ask Elon to check whether if you have active to-dos.
Elon intervenes to ask about your productivity updates.
Ask Elon to check what you've got done already.
Check what Elon has tracked for you using a webview.
Sukanth's Role [Sole Developer]: Systems & Pipelines Design, Cloud Deployment (Google Cloud - Compute Engine), Docker Containerization, Hosting and Routing (CloudFlare), Database Management (Supabase), Smart Glasses Interfacing Software Development, Web Interface Software Development, Prompt Engineering and Interaction Design.
Webview Interface
HUX - Heads Up eXperience
July 2024
An always on AI companion for Human Computer Environment Interaction
Eye gaze directed Querying on a live video feed
Summarizing changes in the environment outside the user's selective attention.
Left shows overall image from a wearable camera; Right shows Region of Interest
The system processes scene images through VLMs to create structured memory entries. The system extracts regions of interest, generates detailed descriptions, and stores contextual information with retrieval keywords.
Keywords provide multiple semantic entry points that enable fast initial filtering before LLM-based re-ranking, acting as efficient "hooks" for diverse natural language queries to match the same memory.
ChatGlasses
June 2025
Smart Glasses native real-time chat for connecting with friends who have smart glasses.
Sukanth's Role [Sole Developer]: Systems & Pipelines Design, Cloud Deployment (Google Cloud - Compute Engine), Docker Containerization, Hosting and Routing (CloudFlare), Database Management (Supabase), Smart Glasses Interfacing Software Development, Web Interface Software Development
ChatGlasses won $5000 USD Grant from Mentra, a Y Combinator backed company based out of San Francisco.
Webview: Store contacts of friends who have SmartGlasses.
Webview: Chat history based on the voice transcripts.
Start real-time chat by saying "Chat [friend name]" - example: "Chat Alice."
(SmartGlasses view)
Check if friends are online by saying "Friends"
(SmartGlasses view)
QR-Auth for Smart Glasses
May 2025
Open your web dashboard and authenticate your identity by scanning the QR code while wearing camera enabled smart glasses.
[ login using smart glasses ]
Sequence Diagram outlines a system where a web session is authenticated by scanning a QR code using AR glasses, which capture frames and detect the encoded session payload. The glasses send a signed token back to the server, which verifies it and grants the browser an authenticated session.
Sukanth's Role [Sole Developer]: Systems & Pipelines Design, Cloud Deployment (Google Cloud - Compute Engine), Docker Containerization, Hosting and Routing (CloudFlare), Database Management (Supabase), Smart Glasses Interfacing Software Development, Web Software Development, Computer Vision
Scan to login
Authenticate using your smart glasses identity.
(smart glasses as key)
Camera enabled smart glasses.
DocDoc
September 2025
DocDoc, a system that automatically creates patient records from live data collected by doctors' wearables, then integrates into existing EMR systems after AI-driven analysis. The manual record-keeping process we observed were error-prone, time-consuming, and deeply frustrating for doctors who wanted to focus on patients, not written paperwork. I conducted hands-on demos with clinicians, iterated the prototypes based on informed feedbacks.
Contributors: Sukanth Kalivarathan, Nakkeeran Raveendran
Healthcare professional wearing smart glasses. (Camera, Microphone and Speakers).
*Consent seeked for photography
Sukanth's Role: Systems & Pipelines Design, Cloud Deployment (Google Cloud - Compute Engine), Docker Containerization, Hosting and Routing (CloudFlare), Database Management (Supabase), Smart Glasses Interfacing Software Development, Web Interface Software Development, Prompt Engineering and Interaction Design.
JIPMER, a leading Indian Government Hospital at Pondicherry, India
Automated Patient Record from Transcriptions, EMR integration.
One of the first prototypes of DocDoc.
Healthcare professional wearing smart glasses interacting with a patient while logging to the backend system.
*Consent seeked for photography and transcription.
Advisory by Mr. Paras Chopra
ExoMem
April 2025
The Memory Aid for Smart Glasses turns real-time user speech into a structured, queryable long-term memory system.
Live audio from the wearable is streamed and transcribed instantly. An LLM processes the transcription to identify meaningful information and generate raw memory entries tied to each user, to create a user model.
A custom distillation converts these raw entries into structured memory units containing summaries, entities, timestamps, importance scores, and relational links. These units form a graph-based memory cluster, where related memories connect through semantic edges.
This cluster enables efficient retrieval, making it possible for AI agents to access relevant past information without brute-forcing entire logs. The result is a lightweight, persistent, and evolving memory graph that scales with months or years of user interactions.
The user memory model is context-agnostic and can be integrated with any external data source.
Sukanth's Role [Sole Developer]: Systems & Pipelines Design, Smart Glasses Interfacing Software Development
Data Structure:
{
"id": "m015", "type": "note", "timestamp": "1712863421.586004",
"summary": "User corrected their mother's birthday to April 13th.",
"entities": {
"people": ["User's Mom"],
"topics": ["Birthday", "Date correction", "Personal info"]
},
"reinforcement": 0.8,
"links": [
{"target_id": "m014", "relation": "technical_related"},
{"target_id": "m003", "relation": "goal_conflict"}
]
}