Repository navigation
docs(connectors): survey voice wearables for the next connector - #53
Conversation
Compares Omi, Mentra Live/MentraOS, Brilliant Labs Halo, Even Realities G1/G2, Plaud NotePin, Limitless Pendant, Bee, OpenGlass and DIY XIAO ESP32-S3 designs on availability, transport, third-party audio access, platforms, SDK and code licenses, authentication, background limits, and offline/BYOK feasibility. Each fact is labelled documented, reported, or unverified, from primary vendor, SDK, protocol and repository sources. Recommends MentraOS as the next connector, with Brilliant Labs Halo as the runner-up, and states the tradeoffs and the open account-boundary question. Closes october-dev#13
harshsaver
left a comment
There was a problem hiding this comment.
Thanks @nikhilcrypto0, this is careful work. I spot-checked every GitHub citation and the main vendor pages. Omi's codec table and the v1.0.3 Opus default, the Mentra PCM/LC3 wording and MICROPHONE permission, the Halo/Alif license quotes, Plaud's proprietary-binaries line, Limitless's 2-hour Ogg Opus export, Bee's processed-data-only proxy and the OpenGlass move all match their sources. The D/R/U labelling is a useful convention.
Please fix the Mentra recommendation before merge:
-
Recommend the Mentra Bluetooth SDK, not
session.mic.onAudioChunk()(lines 24, 50–53, 128).onAudioChunkis the Miniapp SDK. Mentra's overview says it is beta, that "there is currently no way to distribute a miniapp built with the Miniapp SDK", and that miniapps run inside the Mentra App. For Mentra Live it says: "we recommend using the Mentra Bluetooth SDK."- A Murmur connector can't live inside the Mentra App, so the Bluetooth SDK is our path.
-
Resolve the account-boundary U (lines 60–61, 144–146). The sources you already cite answer it:
- The Mentra Live page says the Bluetooth SDK controls the mics, works offline and doesn't depend on Mentra cloud.
- The starter kit's
docs/audio-guide.mddocuments continuousmic_pcm/mic_lc3events. docs/api-reference.mdlistssampleRate,channelsandencodingon those events.- There is also
docs/mentra-live-ble-wire-protocol.md.
The real remaining open item is the license of the published SDK artifacts (
com.mentra:bluetooth-sdk,MentraBluetoothSDK,@mentra/bluetooth-sdk). Please apply the same test you used for Plaud. -
Narrow "one connector reaches a whole device category" (lines 137–138). The starter kit's
docs/hardware-integration.mdand audio guide list microphones only for Mentra Live and G2. Mark Z100/G1 audio as U.
Optional nits:
- Line 8: name the three candidates that "lost new-sale availability within ~nine months", or drop the claim (Bee's acquisition was July 2025, and the table still shows it as buyable).
- Lines 40, 56, 121: star counts and "active" will go stale. Drop or date them.
- Unlabelled or unsourced cells: line 28 "Closed", line 31 "Parts only", the "BYOK follows" inference at 58–59, and Bee "Buy new: Yes (R)" at line 29.
- Line 66: Halo shipments reportedly began in early August. Say that precisely.
- Line 90: Plaud's README advertises "Real-time recording with live PCM waveform". Mention it next to "live stream U".
- Line 48: Mentra Live retail ships to the US only.
…ccount boundary Addresses the october-dev#53 review: - Recommend Mentra Live through the Mentra Bluetooth SDK (mic_pcm, 16 kHz 16-bit mono; mic_lc3) instead of the beta, non-distributable Miniapp SDK. - Replace the account-boundary U: the Bluetooth SDK works offline without Mentra-hosted cloud. Record the published SDK licenses (Apache-2.0 source, Maven POM, and iOS package; npm metadata says MIT) and mark the bundled lc3Lib and silero licenses U. - Narrow device reach to Mentra Live and G2 microphones; G1 and Z100 are U. - Name the availability changes, date repository activity, label the remaining cells, cite Bee's own store, Halo's early-August shipments, Plaud's live PCM waveform, and Mentra's US-only retail shipping.
|
Thanks for checking every source. All three points and the optional nits are addressed.
Optional nits
|
harshsaver
left a comment
There was a problem hiding this comment.
Thanks @nikhilcrypto0, all three points are resolved. I re-checked the new claims against their sources:
- Mentra overview: the Miniapp SDK is beta and not distributable, and Mentra recommends the Bluetooth SDK.
- Mentra Live page: the offline / no-Mentra-cloud quote and US-only retail shipping.
- Starter kit: the
mic_pcm16 kHz / 16-bit / mono values, themic_lc3fields, the Live and G2 hardware table, and iOS 15.1+. - Licenses: Apache-2.0 for the SDK source
LICENSE, the Maven POM and the iOS repo. npm 3.1.1 declares MIT.lc3Libandsileroare in the Android module. - Halo $399 and "early August", Bee $49.99 with Amazon branding, the Plaud README quotes, and the repo dates.
Everything matches. Merging.
Two small optional follow-ups, fine to leave for the implementation PR:
- Line 160: Plaud's
blePcmDatais also a documented stream with a format, so consider "the only candidate besides Omi with a documented microphone stream that needs no vendor account or proprietary binaries". - Lines 170-171 (License details): the Android Maven artifact depends on Google's
play-services-locationandplay-services-base, which are proprietary, and all published Maven versions are beta or dev builds. Worth listing next to thelc3Lib/sileroitem.
Closes #13
Adds
docs/connectors/wearable-survey.md, which compares nine devices or projects and recommends one next connector.Acceptance criteria
LICENSEfiles. Press coverage is used only for the two acquisitions and is labelled R.LICENSEfile or the README's own license statement.session.mic.onAudioChunk(), Apache-2.0, sold today, and it abstracts Mentra Live, Even Realities G1/G2 and Vuzix Z100). Runner-up: Brilliant Labs Halo.Findings that change the picture
session.mic.onAudioChunk()and arrives as PCM or LC3 depending on the phone's mic mode. A connector must readformat/sampleRateper chunk rather than assume 16 kHz. It requires theMICROPHONEmanifest permission.Verification
Licenses, stars, last push and archive status were read from the GitHub API on 2026-09-25 for every cited repository. The load-bearing claims were re-fetched from the primary pages:
Open question for the next step
Whether
onAudioChunkneeds a Mentra account, miniapp registration or the Mentra app, and whether the Bluetooth SDK starter kit reaches the microphone directly, is unverified. The survey marks it as the first task of any MentraOS connector, because it decides whether the connector can run fully locally.