bytjn1416124 / SmartGlassesManager

The home page for your smart glasses. Write 1 app that runs on any pair of smart glasses.

SmartGlassesManager

The most important app for smart glasses.

Users

The SmartGlassesManager gives you access to a huge number of applications for your smart glasses. This includes search engine, language translation, ChatGPT conversations, note-taking, intelligent assistants, etc. applications not available anywhere else.

Developers

Building apps that run on a smart phone and stream data to smart glasses is hard, but it’s how today’s lightweight smart glasses work. We handle the connection, UI, data streaming, and transcription, allowing you to rapidly develop smart glasses applications that run on any pair of smart glasses.

Industry

Your smart glasses won’t see massive consumer adoption if third party developers can’t make awesome apps for your hardware. The SmartGlassesManager is a middleware which already supports many apps and makes it easy for developers to build more. That means, if you add support to your hardware for a single application – the SmartGlassesManager – your glasses will instantly support a plethora of consumer-facing applications.

How?

The Smart Glasses Manager is an app that solves some major problems in the smart glasses industry.

The problems:

• it's hard to write smart glasses applications
• we want multiple different apps to run on our phone, and all of them to display on our smart glasses.
• only 1 app can connect to the glasses at any 1 time
• something has to manage connecting to the glasses, the UI, which app is displaying, voice commands, streaming data back and forth, etc.

The solution:

The Smart Glasses Manager is that 1 app. It connects to the glasses, handles the UI, and displays information from various third-party apps directly on your smart glasses. This enables developers to write 1 app that will automagically work on any pair of smart glasses that the SmartGlasssesManager supports.

This project is being built by TeamOpenSmartGlasses.

Architecture

1. Android native smart phone server (WIS fork)
2. A native Android library that third parties app call to send data to smart glasses through the ASP server
3. Android native smart glasses thin client (WIS fork)gg
4. MCU C/++ smart glasses thin client (OSSG fork)

ASP server Features

1. Connect smart phone to smart glasses
   • likely BLE, maybe WiFi
   • Android smart glasses
   • microcontroller smart glasses
2. Receive audio from glasses
3. Transcribe audio
4. Share transcription with other apps on the same device
5. Receive data from other apps on the same device, send this data to be displayed on smart glasses
6. UI, voice command

Fork of the Wearable Intelligence System

This repo is a fork of the Wearable Intelligence System. The Wearable Intelligence System was started at Emex Labs by Cayden Pierce. This repo has a lot of the history cleaned to make it easier to manage, see the WIS repo for full history.

How To Use

You will need two pieces of hardware to run the system:

1. ASP - Android Smart Phone
2. Smart Glasses or similiar wearable. This can include:
   • ASG - Android Smart Glasses (Android or microcontroller based)
   • Activelook glasses
   • Audio glasses (WIP)
   • Bluetooth earpiece/earbuds (WIP)

Install / Use

Install

1. On your Android smart phone, flash the ASP app from Android Studio, the releases page, or from Google Play.
   • Play Store: Coming soon
   • Github latest release
2. If using Android Smart Glasses, then on your smart glasses, download or flash the ASG client app:
   • Github latest release
3. • Launch the "Smart Glasses Manager" app on your smart phone
   • Accept permissions.
   • If using Android Smart Glasses -> Tap "Start Wifi Hotspot", turn on (configure password if necessary) your wifi hotspot, then go "Back" to return
     • Connect smart glasses WiFi to the smart phone WiFi hotspot
     • Enable mobile data (or wifi sharing) on Android smart phone
     • Start ASG application on smart glasses
     • The phone connection icon will be green if the glasses are connected to your phone. If you speak, you'll see a live transcript on the smart glasses screen.
   • If using Bluetooth Smart Glasses -> Turn on Bluetooth on phone.
4. Tap "Connect Smart Glasses" and choose your glasses.
5. Setup complete.

Normal Use

Here's how to launch the system after you've already done the initial setup above:

1. Launch "Smart Glasses Manager" app on smart phone
2. Enable mobile hotspot on smart phone with the "Start WiFi Hotspot" button
3. Connect Android smart glasses to Android smart phone WiFi hotspot.
4. Launch "WIS" app on smart glasses.
5. Verify system is running by the "Smart Glasses Conection Indicator" icon turning white on the smart glasses HUD.

Documentation / Developers

(WIP) Here are the docs: https://github.com/TeamOpenSmartGlasses/SmartGlassesManager/wiki

Authors

The system is fully open source and built by TeamOpenSmartGlasses. We're a team building open source smart glasses technology to enhance user's intelligence in daily life. Join us: https://discord.gg/5ukNvkEAqT

The TeamOpenSmartGlasses members who are contributing to this project include:

• Cayden Pierce - Emex Labs
• Alex Israelov - http://www.alexisraelov.com/

We are building a community that is building cognitive augmentation technologies together.