Marius Mutu
4be70440e8
Squashed branch: voice/dave-recv → master. Closes Pas 12 (DAVE E2E) and lands voice-mode UX polish + verbal voice control on top of the Pas 1-10 scaffolding already on master. ## DAVE E2E receive-side decrypt (e4f3177) Vendored fork: discord-ext-voice-recv 0.5.3a+echo.dave1. Patches the receive pipeline to handle Discord's mandatory DAVE encryption on voice gateway v=8. - `_maybe_dave_decrypt`: uses davey.can_passthrough(user_id) as primary gate, falls through to dave.decrypt for DAVE-epoch peers, drops on decrypt failure without killing the reader thread. - VAD fix: silero-vad v5+ requires exactly 512 samples; our 100ms window (1600 samples) was silently raising ValueError → STT never fired. Now slice into 512-sample chunks. - Whisper: bumped beam_size 1→5 and added RO initial_prompt. - Tests: 11 DAVE unit tests + 2 callback integration tests + contract test with fork-version guard. ## Voice UX polish (d1bc77e) - Killed the 3s "mă gândesc" filler (always collided with Claude p50 4-7s). - Barge-in via `ttsq.clear()` at top of `on_segment_done`. - DTX silence-flush poller (200ms tick) — Discord stops sending RTP packets when silent, so the inline silence-check in sink.write() never fired for trailing audio; background thread handles it. - `EchoStreamingAudioSource.read()` non-blocking — old `get_frame(timeout=0.1)` wrecked Discord's 20ms cadence and the client interpreted bursts as stuttering (Marius heard "4 de minute" instead of full sentence). - RO time expansion: 23:09 → "douăzeci și trei și nouă minute". - Supertonic Unicode sanitize centralized in tools/tts.py. - Whisper local_files_only=True — no HF metadata GET on each startup. - Diagnostic logging through sink → VAD → Claude stream → TTS chain. ## Voice mode iteration (e589e48) - `personality/VOICE_MODE.md` — voice-tailored system prompt (short, no markdown, no abbreviations, time without seconds, distances in "mii"/"milioane"); plumbed via build_system_prompt(voice_mode=True). - Isolated voice session key `voice:<channel_id>` — voice doesn't share context with text adapter on the same channel; auto-applied without /clear ceremony. /clear drops both keys. - Metric units + Romanian thousands (normalize.py): "384.000 km" → "trei sute optzeci și patru de mii de kilometri" with feminine-correct pluralization and "de" particle for ≥20. - `/voice setvoice <M1-F5>` slash command with native autocomplete; swaps live + persists voice.default_voice to config.json. - Verbal voice change (src/voice/voice_commands.py + 29 tests) — "schimbă vocea pe M5", "voce em cinci", with permissive substring fallback for Whisper-mangled forms like "Mâcinci"=M5 and "unul cinci"=M5. Whisper initial_prompt now lists voice vocabulary to bias STT toward clean outputs. - Fast barge-in: VAD ≥2 consecutive windows (~200ms) on Marius's user while Echo has pending TTS frames → cut him off mid-sentence so user doesn't wait the full silence + STT cycle. Acoustic echo bleed-through still requires headphones (no AEC). ## Test suite 130 voice + router tests pass (test_voice_recv_dave, test_voice_session_cleanup, test_voice_adapter_contract, test_voice_normalize, test_voice_commands, test_router). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
123 lines
2.5 KiB
JSON
123 lines
2.5 KiB
JSON
{
|
|
"bot": {
|
|
"name": "Echo",
|
|
"default_model": "sonnet",
|
|
"owner": "949388626146517022",
|
|
"admins": [
|
|
"5040014994"
|
|
]
|
|
},
|
|
"channels": {
|
|
"echo-core": {
|
|
"id": "1471916752119009432",
|
|
"default_model": "sonnet"
|
|
},
|
|
"echo-work": {
|
|
"id": "1466726254312030259",
|
|
"default_model": "sonnet"
|
|
},
|
|
"echo-sprijin": {
|
|
"id": "1466739361503772864",
|
|
"default_model": "sonnet"
|
|
},
|
|
"echo-self": {
|
|
"id": "1466739112747864175",
|
|
"default_model": "sonnet"
|
|
}
|
|
},
|
|
"telegram_channels": {},
|
|
"whatsapp": {
|
|
"enabled": true,
|
|
"bridge_url": "http://127.0.0.1:8098",
|
|
"owner": "40723197939",
|
|
"admins": []
|
|
},
|
|
"whatsapp_channels": {
|
|
"echo-test": {
|
|
"id": "120363424350922235@g.us",
|
|
"default_model": "sonnet"
|
|
}
|
|
},
|
|
"heartbeat": {
|
|
"enabled": false,
|
|
"interval_minutes": 120,
|
|
"channel": "echo-core",
|
|
"model": "haiku",
|
|
"quiet_hours": [
|
|
23,
|
|
7
|
|
],
|
|
"checks": {
|
|
"email": true,
|
|
"calendar": true,
|
|
"kb_index": true,
|
|
"git": false
|
|
},
|
|
"cooldowns": {
|
|
"email": 1800,
|
|
"calendar": 1800,
|
|
"kb_index": 14400,
|
|
"git": 14400
|
|
}
|
|
},
|
|
"newsletter_cercetasi": {
|
|
"enabled": true,
|
|
"cron": "0 17 * * 4,5,1",
|
|
"channel": "echo-core"
|
|
},
|
|
"allowed_tools": [
|
|
"Read",
|
|
"Edit",
|
|
"Write",
|
|
"Glob",
|
|
"Grep",
|
|
"WebFetch",
|
|
"WebSearch",
|
|
"Bash(python3 *)",
|
|
"Bash(.venv/bin/python3 *)",
|
|
"Bash(pip *)",
|
|
"Bash(pytest *)",
|
|
"Bash(git *)",
|
|
"Bash(npm *)",
|
|
"Bash(node *)",
|
|
"Bash(npx *)",
|
|
"Bash(systemctl --user *)",
|
|
"Bash(trash *)",
|
|
"Bash(mkdir *)",
|
|
"Bash(cp *)",
|
|
"Bash(mv *)",
|
|
"Bash(ls *)",
|
|
"Bash(cat *)",
|
|
"Bash(chmod *)",
|
|
"Bash(docker *)",
|
|
"Bash(docker-compose *)",
|
|
"Bash(docker compose *)",
|
|
"Bash(ssh *@10.0.20.*)",
|
|
"Bash(ssh root@10.0.20.*)",
|
|
"Bash(ssh echo@10.0.20.*)",
|
|
"Bash(scp *10.0.20.*)",
|
|
"Bash(rsync *10.0.20.*)"
|
|
],
|
|
"discord": {
|
|
"email_webhook_url": "https://discord.com/api/webhooks/1496421990846697583/OM8z1eBsJC6-UB9-Zi5RkHP23NNv9UrEznRMx4Y3wSWOFmLazPoi-8_iEKMp0Qgsqr-m"
|
|
},
|
|
"ollama": {
|
|
"url": "http://10.0.20.161:11434"
|
|
},
|
|
"voice": {
|
|
"allowed_user_ids": [
|
|
"949388626146517022"
|
|
],
|
|
"user_name": "Marius",
|
|
"default_voice": "M5",
|
|
"auto_leave_minutes": 5
|
|
},
|
|
"paths": {
|
|
"personality": "personality/",
|
|
"tools": "tools/",
|
|
"memory": "memory/",
|
|
"logs": "logs/",
|
|
"sessions": "sessions/"
|
|
}
|
|
}
|