fix(desktop): stop pinning local models in memory and cap audio buffers
Some checks failed
ci / 정본·보안·린트·타입·테스트 (push) Successful in 56s
ci / .NET API 서버 테스트 (push) Successful in 10s
deploy-site / deploy (push) Successful in 38s
ci / 모바일 린트·타입·Jest (push) Successful in 44s
ci / 워크스페이스 빌드 검증 (push) Successful in 54s
ci / Supabase Edge Functions + Cloudflare Worker (push) Successful in 22s
portable-unsigned / portable-windows (push) Failing after 35s
release / release-windows (push) Failing after 13s

The PC-wide slowdown was not a leak but model residency: boot warmup loaded
gemma4:e4b (~11.6 GB RAM incl. 5.9 GB pinned host buffer, no mmap on Windows
CUDA) and kept it for 30m, next to the large-v3 sidecar. Measured on the HEAD
build: free RAM 7.9 GB -> 32 MB within 20 s; after this change 10.8 GB with no
Ollama model loaded until typing starts.

- single LOCAL_LLM_KEEP_ALIVE (10m) for every local request; no boot warmup
- unload this app's resident Ollama models (keep_alive 0) on quit
- sidecar POST /unload for the aux slot; captions release it on stop
- partial dictation copies only the tail window, not the whole recording
- cap the voice-conversation listen buffer at 5 minutes
- mic test: generation guard so re-entry cannot orphan lease/timers
- startRealtime: single-flight and removeChannel to stop duplicate bindings
- meeting WAV save writes header and PCM without a concat copy

Docs: AI-01 policy note, GAP-PERF-01 with remaining work.
This commit is contained in:
Yun Chan 2026-10-11 11:35:15 +09:00
parent a7c0d6fb21
commit d63854db67
19 changed files with 268 additions and 45 deletions

View file

@ -17,8 +17,14 @@ let testLastRms = 0
* 잡고 있는 참조를 빼앗아 그쪽 마이크가 조용히 끊긴다 — 테스트는 자기 임대만 놓는다.
*/
let testLease: CaptureLease | null = null
/**
* 테스트 세대. acquire() 를 기다리는 사이 테스트가 다시 시작·중지되면 앞선 호출은 낡은 것이다 —
* 예전엔 모듈 변수를 덮어써 첫 호출의 interval·리스너·임대가 고아로 남아 마이크가 앱 종료까지 켜졌다.
*/
let testGeneration = 0
function stopAudioTest(): void {
testGeneration += 1
const service = getAudioCaptureService()
if (testAudioHandler) {
service.off('audio-data', testAudioHandler)
@ -67,9 +73,16 @@ export function registerAudioHandlers(): void {
try {
// 이전 테스트가 진행 중이면 정리
stopAudioTest()
const generation = testGeneration
const service = getAudioCaptureService()
testLease = await service.acquire()
const lease = await service.acquire()
if (generation !== testGeneration) {
// 기다리는 사이 새 테스트가 시작됐거나 중지됐다 — 이 임대는 바로 놓는다
await lease.release().catch(() => { /* ignore */ })
return ipcSuccess({ averageLevel: 0, peakLevel: 0, hasAudio: false })
}
testLease = lease
// 오디오 데이터에서 RMS 추적
testAudioHandler = (payload: { buffer: Buffer; timestamp: number }) => {