feat(voiceclaw): Edge voice processing — local VAD, KWS, ASR, TTS with privacy routing#3
Open
HenryZ838978 wants to merge 1 commit intoOpenBMB:mainfrom
Open
feat(voiceclaw): Edge voice processing — local VAD, KWS, ASR, TTS with privacy routing#3HenryZ838978 wants to merge 1 commit intoOpenBMB:mainfrom
HenryZ838978 wants to merge 1 commit intoOpenBMB:mainfrom
Conversation
…routing VoiceClaw brings local VAD, KWS (keyword spotting), ASR, and TTS to EdgeClaw using sherpa-onnx-node. Integrates with GuardClaw's three-tier privacy system to ensure voice data stays on-device for S2/S3 scenarios. Key features: - Silero VAD for real-time speech detection (~0ms latency) - Keyword spotting for configurable wake words - Multi-backend ASR: SenseVoice, Whisper, Paraformer (all local ONNX) - Multi-backend TTS: VITS, MatchaTTS, edge-tts - Voice privacy router: forces local ASR/TTS based on S1/S2/S3 level - WebSocket audio server for browser microphone streaming - Session state machine with barge-in detection - Browser test console with VU meter and event logging - Full test suite for VAD engine and privacy manager Privacy guarantee: for S2/S3 sessions, raw audio NEVER leaves the device. 17 files, 2423 lines of TypeScript + HTML. Made-with: Cursor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
VoiceClaw is a new extension that adds edge-side voice processing to EdgeClaw, closing the audio privacy gap that exists when voice data is sent to cloud STT/TTS providers before any privacy checks.
Key Features
Privacy Guarantee
Integrates with GuardClaw's existing three-tier privacy system via OpenClaw plugin hooks.
What's Included
extensions/voiceclaw/— 17 files, ~2400 lines of TypeScript + HTMLTechnical Choices
Test Plan
pnpm vitest run extensions/voiceclaw/test/pnpm openclaw gateway runand verify VoiceClaw bannerhttp://localhost:8501/voiceclaw/and test microphone streaming