feat: ship Wave 5-6 multi-surface hygiene, optimization, and bug fixes
This commit is contained in:
parent
01ef3293cf
commit
66b6b45ba9
399 changed files with 17828 additions and 11330 deletions
|
|
@ -16,7 +16,7 @@
|
|||
|
||||
**Main entry** `src/main/index.ts`: sets app name/AppUserModelId, disables GPU acceleration, EPIPE/uncaught handlers, registers `d3ro-voice://` deep-link protocol (Supabase OAuth implicit + PKCE), single-instance lock, then `bootstrap()` + `setupLifecycle()`. The explicit manual-QA argument `--preview-update-dialogs` is isolated before protocol registration/bootstrap: it bypasses the single-instance lock, invokes the real update-dialog prompter for four consent/restart variants, touches no feed/download/install/settings state, then quits. This path is unit-tested, but its packaged native dialogs still require an external-terminal visual run.
|
||||
|
||||
**Bootstrap** `src/main/bootstrap.ts`: ordered `BootstrapStep[]` — logger, config, **database (critical)**, license, create-windows (critical), tray, **ipc-handlers (critical)**, custom-instructions, voice-commands, sound-effects, auto-launch, popup-preload, key-bindings, voice-mode, stt-warmup, llm-polling, meeting-summary-wiring, meeting-mode, cloud-sync, auto-update. Wires VoiceMode events to sound + history persistence, and subscribes to `KeyBindingService` `triggered` for the `history-popup` / `command-popup` actions (`bootstrap.ts:159`) — those two were hardcoded accelerators before and are now rebindable like everything else.
|
||||
**Bootstrap** `src/main/bootstrap.ts`: ordered `BootstrapStep[]` — logger, config, **database (critical)**, license, create-windows (critical), tray, **ipc-handlers (critical)**, custom-instructions, voice-commands, sound-effects, auto-launch, popup-preload (no-op at boot since 2026-11-13; popups are created lazily on first demand), key-bindings, voice-mode, stt-warmup (only when `sttProvider === 'local'`), llm-polling, meeting-summary-wiring, meeting-mode, cloud-sync, auto-update. Wires VoiceMode events to sound + history persistence, and subscribes to `KeyBindingService` `triggered` for the `history-popup` / `command-popup` actions (`bootstrap.ts:159`) — those two were hardcoded accelerators before and are now rebindable like everything else. `ConfigEffects` also propagates `inputTelemetryEnabled` / `inputTelemetryPaused` dynamically to `InputTelemetryService.applyConfig`.
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -27,11 +27,11 @@ Singleton + `EventEmitter` pattern (`getXService()` accessors).
|
|||
### Core voice pipeline
|
||||
| Service | Purpose |
|
||||
|---|---|
|
||||
| `VoiceModeService` | Orchestrator: 9-state `RecognitionState` + 4-state `AudioState`, dual-condition flush, action queue. Events: session-started/completed/cancelled, transcription-update, audio-level, recognition/audio-state-changed, premium-llm-fallback, error |
|
||||
| `AudioCaptureService` | Mic PCM16 16kHz mono (bundled SoX on Windows, node-record-lpcm16 elsewhere). Spawns hidden (`windowsHide`); a missing SoX fails with the exact fix command |
|
||||
| `LocalSTTService` | faster-whisper Python sidecar manager (state machine, dual-flush, model download/cancel, background warm-up, live partial transcription). Connects over IPv4 loopback (`getSidecarBaseUrl`) and fails fast with an actionable message when the bundled engine or virtualenv is missing |
|
||||
| `VoiceModeService` | Orchestrator: 9-state `RecognitionState` + 4-state `AudioState`, dual-condition flush, action queue, and secure audio buffer zeroing (`secureWipeAudioChunks` / `secureZeroBuffer`) on cancel/cleanup (2026-11-13 `W5-01`). Events: session-started/completed/cancelled, transcription-update, audio-level, recognition/audio-state-changed, premium-llm-fallback, error |
|
||||
| `AudioCaptureService` | Mic PCM16 16kHz mono (bundled SoX on Windows, node-record-lpcm16 elsewhere) with `secureWipeAudioChunks` on stop/dispose. Spawns hidden (`windowsHide`); a missing SoX fails with the exact fix command |
|
||||
| `LocalSTTService` | faster-whisper Python sidecar manager (state machine, dual-flush, model download/cancel, background warm-up, live partial transcription, `sidecarBaseUrl` getter for `POST /diarize`, and **2026-11-13** `releasePrimaryModel()` / 15-min `IDLE_MODEL_UNLOAD_MS` timer via `POST /unload` `{ slot: "primary" }` so switching to cloud STT or going idle frees the 1.6–3.1 GB Whisper model while keeping the sidecar HTTP server alive for `/uia/focus`). Connects over IPv4 loopback (`getSidecarBaseUrl`) and fails fast with an actionable message when the bundled engine or virtualenv is missing |
|
||||
| `KeyBindingService` | uiohook-napi global hooking for **keyboard and mouse**, driven by the `@d3ro/core/keybinding` contract: 6 rebindable actions (dictation, hands-free, command, caption, history-popup, command-popup), several bindings per action, structural reserved-combo checks. Events: `triggered` (in-process payload carries `actionId`, `type` (`pressed`/`released`), `isDoublePress`, `holdMode`, `timestamp`; the renderer-facing `keybinding:triggered` event is the narrower `KeyBindingTriggeredEvent`, `keybinding.ts:1092`), `changed`, `error`. `globalShortcut` is used only to mute the macOS system beep, and only for accelerators it registered itself. Mouse events cannot be suppressed by uiohook, so a bound button also performs its native action |
|
||||
| `TextInsertService` | Clipboard save→set→Ctrl+V→restore via nut-js |
|
||||
| `TextInsertService` | Clipboard save→set→Ctrl+V→restore (`NutKeyboardPort`: uses native `koffi` Win32 `SendInput` via `utils/win32-unicode-input.ts` on Windows without loading `@nut-tree-fork/nut-js`; `nut-js` used on macOS/Linux) |
|
||||
| `SoundEffectService` | Preloaded WAV feedback (start/stop/error/cancel/chime) |
|
||||
|
||||
### STT engine layer (`services/stt/`)
|
||||
|
|
@ -47,21 +47,21 @@ Singleton + `EventEmitter` pattern (`getXService()` accessors).
|
|||
|---|---|
|
||||
| `LocalLLMService` | Ollama REST (models, pull w/ progress, server start, NDJSON streaming). The 2026-09-22 runaway guard gives each request its own `AbortController` (external caller signals are relayed and detached on completion), requires `done` before an NDJSON stream succeeds, and clears incomplete streams. Generation/stream requests are bounded to 2048 tokens / 120 s; chat is bounded to 512 / 60 s. Ollama server spawn and polling are deduplicated, and lifecycle dispose terminates owned work. |
|
||||
| `PremiumLLMService` | Claude via Supabase `llm-proxy`, local fallback |
|
||||
| `OnlineLLMService` | JWT-authenticated .NET backend client |
|
||||
| `OnlineLLMService` | JWT-authenticated .NET backend client; **2026-11-13 (`W5-01`):** applies reversible `redactPII` / `redactPIIMessages` before cloud dispatch and `rehydrateText` on completion (`pii-zdr-wiring.test.ts` 3/3 PASS) |
|
||||
| `llm-prompts.ts` | **SSOT for prompt resolution, placeholder substitution, and argument placement.** `resolveSystemPrompt` (`:118`) maps an `LLMAction` to its base prompt and handles `custom` explicitly instead of dropping silently to `refine`. `renderInstructionPrompt` (`:78`) substitutes `{{text}}` / `{{userPrompt}}` / `{{targetLanguage}}` and **warns by name** for any placeholder left standing rather than letting it reach the model. `buildInstructionInvocation` (`:101`) decides where an instruction goes in `processText(text, action, targetLanguage, customPrompt)`: the instruction becomes the **system prompt** and the transcript the **text**, except for instructions that spell out `{{text}}`, which keep the old meaning for backward compatibility. `resolveTargetLanguage` (`:50`) is the one place translate targets are decided (still `English`, see `11` GAP-LLM-01). **All three LLM entry paths call the same functions** — `VoiceModeService` (`:838`), `ChainService` (`:196`), and the `LLM.PROCESS` IPC handler (`llm-handlers.ts:96`) — so no caller re-implements the rules |
|
||||
|
||||
### Memory & knowledge
|
||||
| Service | Purpose |
|
||||
|---|---|
|
||||
| `HistoryService` | SQLite history CRUD/search/stats |
|
||||
| `UnifiedSearchService` | Read-only SQLite search across history title/content and meeting title/transcript; merges newest-first results without changing either schema |
|
||||
| `UnifiedSearchService` | Read-only SQLite search across history title/content and meeting title/transcript/memos; **2026-11-13:** uses FTS5 `tokenize = 'trigram'` virtual tables (`history_fts`, `meeting_sessions_fts`, `meeting_memos_fts`) for queries of ≥3 characters with automatic trigger sync and `<3`-char `LIKE` fallback |
|
||||
| `DictionaryService` | Custom vocabulary CRUD/search + cloud sync hooks + JSON/CSV import/export (`dictionary:import`/`export`, save/open dialogs) |
|
||||
| `MemoService` | Memo tags over history (`memo_tags`) |
|
||||
| `RAGService` | Local RAG: `nomic-embed-text` embeddings, cosine search over `rag_chunks` |
|
||||
| `RAGService` | Local RAG: `nomic-embed-text` embeddings, cosine search over `rag_chunks` (**2026-11-13:** `SqliteChunkStore` persists binary `Float32Array` `embedding_blob` alongside JSON fallback, caches `StoredChunk[]` in a DB-scoped `WeakMap` for zero-`JSON.parse` queries, and wraps `removeDocument` in a transaction) |
|
||||
| `CustomInstructionService` | User LLM commands (5 built-ins) |
|
||||
| `VoiceCommandService` | Keyword → command rule matching |
|
||||
| `ChainService` | Multi-step LLM pipelines (LLMChain). Each step resolves its instruction through `llm-prompts.ts` (`ChainService.ts:196`); before that, chain steps sent placeholders through unsubstituted |
|
||||
| `ScreenContextService` | Active-window + selected-text context |
|
||||
| `ScreenContextService` | Active-window + selected-text context (on Windows uses `sendWin32CopyChord()` via `koffi` `SendInput` without loading `nut-js`) |
|
||||
|
||||
### Phase 10+ features
|
||||
| Service | Purpose |
|
||||
|
|
@ -78,7 +78,7 @@ Singleton + `EventEmitter` pattern (`getXService()` accessors).
|
|||
### Phase 12–15
|
||||
| Service | Purpose |
|
||||
|---|---|
|
||||
| `MeetingModeService` | Meeting recording and existing-media import: live/file transcript, normalized meeting audio, timestamp memos, doc generation/export, diarization. `meeting/imported-recording.ts` maps file-transcription segments to the canonical meeting transcript. Account revision checks before/after WAV copy and after transcription reject even A→B→A changes; unsuccessful imports remove only their own generated audio. Since 2026-11-05 refined caption lines reach the meeting transcript (`meetingMode:segmentUpdated`) instead of the raw text, and auto-polish receives the learned-vocabulary block |
|
||||
| `MeetingModeService` | Meeting recording and existing-media import: live/file transcript, normalized meeting audio (`meeting/disk-wav-audio-sink.ts` `DiskWavAudioSink` streams PCM16 directly to disk with `O(1)` memory and backpatches the 44-byte RIFF/WAV header on `finalize()`, 2026-11-13 `GAP-PERF-01`), timestamp memos (`meeting_memos.revision` CAS synced), doc generation/export, and speaker diarization (`diarizeSession` calls sidecar `POST /diarize` via `LocalSTTService.sidecarBaseUrl` — pyannote.audio when installed + energy-VAD acoustic turn segmentation — and falls back to LLM speaker estimation while preserving `[화자 N]` markers across `polishTranscript`, `GAP-MTG-02`). `meeting/imported-recording.ts` maps file-transcription segments to the canonical meeting transcript. Account revision checks before/after WAV copy and after transcription reject even A→B→A changes; unsuccessful imports remove only their own generated audio. Since 2026-11-05 refined caption lines reach the meeting transcript (`meetingMode:segmentUpdated`) instead of the raw text, and auto-polish receives the learned-vocabulary block |
|
||||
| `MeetingDocTemplateService` | Meeting-doc templates (built-ins + CRUD) |
|
||||
|
||||
### Input intelligence (2026-09-21; Local Flow Intelligence extension 2026-09-22)
|
||||
|
|
@ -92,7 +92,7 @@ Singleton + `EventEmitter` pattern (`getXService()` accessors).
|
|||
| `utils/win32-foreground.ts` | Foreground window title/pid/exe/bounds and active thread Korean IME state (`isForegroundKoreanIme` via `GetGUIThreadInfo` + `ImmGetDefaultIMEWnd` + `SendMessageTimeoutW(WM_IME_CONTROL)`) via `koffi` FFI into user32/kernel32/imm32 (chosen over `get-windows`, which needs an install script this repo does not run). |
|
||||
| `sidecar/uia_bridge.py` | Windows UIA snapshot (`uiautomation` 2.0.29, comtypes) on a dedicated COM-initialised thread with a 1.5 s budget; never walks the UIA tree (Chrome/VS Code tree walks take 10-30 s). Uses `GetVisibleRanges()` / tail slicing `[-MAX_TEXT_CHARS:]` for large terminal scrollback buffers and `ExpandToEnclosingUnit(..., waitTime=0)` to avoid `uiautomation.py`'s default 500 ms sleep on Windows Terminal. Warm calls measure 0-15 ms. |
|
||||
|
||||
**2026-10-31 구조 경계:** `suggestion/SuggestionModelRequest.ts`가 prefill/지시형 모델 요청 구성, 후보 파싱, 지어낸 사실·문맥 복사 검증을 소유한다. `suggestion/FirstCandidateRunner.ts`는 첫 후보의 최대 2회 요청, 빈 prefill·사실 검증 재시도와 내용을 노출하지 않는 진단 로그를 담당한다. `_handleGenerationFailure`는 오류·시간 초과·빈 후보의 개인 후보 유지 → 로컬 기억 폭백 → 실패 종료 순서를 한 곳에서 보장한다. `_startGenerationSession`은 취소기·세대 토큰·타임아웃을 포함한 `GenerationSession`을 반환하고, `_prepareFirstCandidate`는 기억 수집·오타 교정·모델 요청과 첫 응답을 `FirstCandidatePreparation`으로 반환하며 실패 시에도 폭백용 기억 문맥을 보존한다. `_isGenerationResultCurrent`는 세대 불일치·문맥 경과·접두 변경을 순서대로 검사하고, `_publishFirstCandidate`는 개인 후보 병합·성공 기록·후속 채우기 시작을 담당하고, `_appendFilledCandidate`는 후속 후보의 추가·개인화 재정렬·표시·세션 행 후보 수 갱신을 한 곳에서 처리한다. `SuggestionService`는 입력 정책, 세대/취소, 표시, 수락만 조율한다. 모델 요청과 로컬 기억 게시는 각각 `SuggestionModelRequestInput`·`LocalMemoryPublication` 객체를 사용하며, 동작 변경 없는 순수 리팩토링이다.
|
||||
**2026-10-31..11-13 구조 경계:** `suggestion/SuggestionModelRequest.ts`가 prefill/지시형 모델 요청 구성, 후보 파싱, 지어낸 사실·문맥 복사 검증을 소유한다. `suggestion/FirstCandidateRunner.ts`는 첫 후보의 최대 2회 요청, 빈 prefill·사실 검증 재시도와 내용을 노출하지 않는 진단 로그를 담당한다. `suggestion/suggestion-policy-helpers.ts`(2026-11-13 `W5-11`/`G7`)는 오타 교정 문맥 적용(`applyCorrectionToContext`), 중복 판정(`sameCandidateText`/`isDuplicateCandidateText`), 개인화 후보 재정렬(`rerankFilledCandidates`), 정책 정규화(`normalizeSuggestionPolicyConfig`), 결정 입력 시그니처(`buildDecisionInputSignature`), 터미널 커서 연속성 복원(`resolveTerminalTypingContext`) 등 순수 함수를 소유한다. `_handleGenerationFailure`는 오류·시간 초과·빈 후보의 개인 후보 유지 → 로컬 기억 폴백 → 실패 종료 순서를 한 곳에서 보장한다. `_startGenerationSession`은 취소기·세대 토큰·타임아웃을 포함한 `GenerationSession`을 반환하고, `_prepareFirstCandidate`는 기억 수집·오타 교정·모델 요청과 첫 응답을 `FirstCandidatePreparation`으로 반환하며 실패 시에도 폴백용 기억 문맥을 보존한다. `_isGenerationResultCurrent`는 세대 불일치·문맥 경과·접두 변경을 순서대로 검사하고, `_publishFirstCandidate`는 개인 후보 병합·성공 기록·후속 채우기 시작을 담당하고, `_appendFilledCandidate`는 후속 후보의 추가·개인화 재정렬·표시·세션 행 후보 수 갱신을 한 곳에서 처리한다. `SuggestionService`는 입력 정책, 세대/취소, 표시, 수락만 조율한다. 모델 요청과 로컬 기억 게시는 각각 `SuggestionModelRequestInput`·`LocalMemoryPublication` 객체를 사용하며, 동작 변경 없는 순수 리팩토링이다.
|
||||
|
||||
The existing `input-telemetry-handlers` and `suggestion-handlers` IPC extensions expose the receipt and the flow/suggestion summaries. Receipt reads or deletes report an IPC error when storage access fails; they do not return invented counts or claim a purge succeeded. The receipt is local-only: `input_activity`, `typing_samples`, and `suggestions` retain 30 days; `personal_phrases` has no age-based automatic expiry and is removed by individual deletion, delete-all, or consent withdrawal. Smart Exclusion never records password evidence and recommends only the current app after at least four observations, zero readable results, and a problematic ratio of at least 75%; its one-click action adds an exclusion and never auto-excludes. Shortcut Safety Audit is core `auditKeyBindingMap` applied by the Settings UI; it surfaces invalid/conflict issues while preserving the existing hold/double-press exceptions.
|
||||
|
||||
|
|
@ -114,9 +114,9 @@ The existing `input-telemetry-handlers` and `suggestion-handlers` IPC extensions
|
|||
|---|---|
|
||||
| `AdMediationEngine` | Multi-ad mediation + header bidding |
|
||||
| `AdSettlementService` | Revenue settlement, withholding, payout ledger |
|
||||
| `BaseAdAdapter` / `UnavailableAdAdapter` | Adapter contract + fail-closed base |
|
||||
| `BaseAdAdapter` / `UnavailableAdAdapter` | Adapter contract + fail-closed base + declarative `UNAVAILABLE_AD_NETWORK_SPECS` / `createUnavailableAdAdapters()` registry (2026-11-13: consolidated 9 empty subclass files into one table-driven registry) |
|
||||
| `DirectHouseSponsorAdapter` | **Real configurable adapter**: bids/reports against an operator HTTPS `endpointUrl` (`AdNetworkConfig.endpointUrl`), validates creatives, fail-closed (`adapter_not_configured`) when unconfigured |
|
||||
| 9 placeholder adapters (AppLovin, Carbon, EthicalAds, GoogleAdManager, InMobi, Mintegral, Playwire, PubMatic, Unity) | Extend `UnavailableAdAdapter` — registered, no live bids (`provider_not_integrated`) |
|
||||
| 9 unavailable network specs (AppLovin, Carbon, EthicalAds, GoogleAdManager, InMobi, Mintegral, Playwire, PubMatic, Unity) | Instantiated via `createUnavailableAdAdapters()` — registered, no live bids (`provider_not_integrated`) |
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -149,7 +149,7 @@ Registry: `src/main/ipc/index.ts` calls 31 `registerXHandlers()` in fixed order.
|
|||
| `rag-handlers` | RAG |
|
||||
| `stt-handlers` | STT |
|
||||
| `suggestion-handlers` | SUGGESTION + POPUP_SUGGESTION |
|
||||
| `support-handlers` | SUPPORT |
|
||||
| `support-handlers` | SUPPORT (`redactPII(..., 'mask')` applied to diagnostic descriptions and logs before ticket creation, 2026-11-13 `W5-01`) |
|
||||
| `system-handlers` | SYSTEM |
|
||||
| `template-handlers` | DICTATION_TEMPLATE |
|
||||
| `voice-action-handlers` | VOICE_ACTION |
|
||||
|
|
@ -168,7 +168,7 @@ Preload exposes **`window.electronAPI`** with 37 namespaces: `platform, audio, c
|
|||
|
||||
## 4. Windows & popups
|
||||
|
||||
`windows/WindowManager.ts` creates 7 windows: main (borderless, custom TitleBar; macOS `hiddenInset`), recording-tip, result-popup, history-popup, command-popup, caption-overlay, suggestion-overlay. Injects popup theme CSS + i18n strings; 2-phase resize. `windows/TrayManager.ts` — tray icon + menu + double-click show.
|
||||
`windows/WindowManager.ts` manages 7 windows: main (borderless, custom TitleBar; macOS `hiddenInset`) created at boot, and 6 vanilla popups (`recording-tip`, `result-popup`, `history-popup`, `command-popup`, `caption-overlay`, `suggestion-overlay`) created **lazily on first demand** (`peekHistoryPopupWindow` / `peekCommandPopupWindow` inspect existing windows without instantiating hidden Chromium renderers at startup). Injects popup theme CSS + i18n strings via `@d3ro/i18n/main`; 2-phase resize. `windows/TrayManager.ts` — tray icon + menu + double-click show.
|
||||
|
||||
**Popup invariants** (each shipped broken once — do not regress):
|
||||
|
||||
|
|
@ -191,7 +191,7 @@ Vanilla popups (`src/renderer/popups/`):
|
|||
|
||||
## 5. Renderer IA
|
||||
|
||||
Routing is state-based in `renderer/navigation/app-navigation.tsx` (`AppRoute`, params, history/back), no react-router. `Ctrl+K` opens the search route and `Ctrl+1..3` opens Home/Records/Meetings.
|
||||
Routing is state-based in `renderer/navigation/app-navigation.tsx` (`AppRoute`, params, history/back), no react-router. `Ctrl+K` opens the search route and `Ctrl+1..3` opens Home/Records/Meetings. **Since 2026-11-13**, `AppLayout.tsx` keeps `HomePage` eager for instant first paint and code-splits the 7 secondary pages (`UnifiedSearchPage`, `HistoryPage`, `MeetingModePage`, `VoiceConversationPage`, `CommandsPage`, `DictionaryPage`, `KnowledgeBasePage`) plus 6 modals (`SettingsModal`, `OnboardingModal`, `OllamaGuideModal`, `SupportModal`, `LicenseModal`, `RewardedQuotaModal`) via `React.lazy` + conditional mounting, cutting the initial renderer JS chunk from `4,596.8 KB` to `1,591.3 KB` (`-65.4%`).
|
||||
|
||||
| Page | Route | Feature |
|
||||
|---|---|---|
|
||||
|
|
@ -204,7 +204,7 @@ Routing is state-based in `renderer/navigation/app-navigation.tsx` (`AppRoute`,
|
|||
| `KnowledgeBasePage` | knowledge | Local RAG: add/index docs, semantic query, reindex/remove |
|
||||
| `MeetingModePage` | meetings | Meeting studio: live or imported-media transcript with progress/cancel, linked audio, memos, minutes/doc generation/export, diarization |
|
||||
|
||||
Modals/components: `SettingsModal` (tabs General/Audio/STT/LLM/Input/License/Cloud/About), `LicenseModal`, `LicenseTab`, `CloudSyncSection`, `InputInsightsPanel` (consent + suggestion policy + weekly insights + learned phrases), `InputConsentPanel` (receipt + current-app exclusion recommendation), `InputInsightsView` (flow, friction and app-quality summaries), `OnboardingModal`, `UpgradePromptModal`, `ProBadge`, `TemplateSection`, `FileDropZone`, `OllamaGuideModal`, `CodexOAuthGuideModal`, `TitleBar`, `StatusBar`, meeting components (9), voice-conversation, payment (`CheckoutModal`, `checkout-flow.ts`), support (`SupportModal`), ads (`AdBanner`, `RewardedQuotaModal`), shared cards.
|
||||
Modals/components: `SettingsModal` (`349` lines after 2026-11-13 `W5-11`/`G7` extraction into `components/settings/{GeneralSettingsTab,AudioSettingsTab,LlmSettingsTab,AboutSettingsTab,settings-model-helpers}.ts(x)` alongside `SttSettingsTab`, `InputInsightsPanel`, `LicenseTab`, `CloudSyncSection`), `LicenseModal`, `InputConsentPanel` (receipt + current-app exclusion recommendation), `InputInsightsView` (flow, friction and app-quality summaries), `OnboardingModal`, `UpgradePromptModal`, `TemplateSection`, `FileDropZone`, `OllamaGuideModal`, `CodexOAuthGuideModal`, `TitleBar`, meeting components (`TranscriptTab` + `EditableSegment` include color-coded speaker badges and multi-speaker filter chips, 2026-11-13 `GAP-MTG-02`), voice-conversation, support (`SupportModal`), ads (`AdBanner`, `RewardedQuotaModal`), shared cards.
|
||||
|
||||
Key-binding UI lives in `components/keybinding/` (`Keycap`, `KeyBindingPicker`, `KeyBindingField`, `translation-key`), embedded in the Settings **General** tab (`SettingsModal.tsx:239`) — one field per action plus a global on/off switch. The picker offers both key recording and a searchable grouped dropdown (MUI `Autocomplete` over `KEY_CATALOG`, `KeyBindingPicker.tsx:536`). It replaced `HotkeyRecordModal`. `renderer/utils/format-hotkey.ts` is now a 17-line platform adapter only; key names, modifier glyphs, and join rules come from `@d3ro/core/keybinding`.
|
||||
|
||||
|
|
@ -212,7 +212,7 @@ Hooks: `useRealtimeConversation` (OpenAI Realtime WebRTC), `useLicenseState`, `u
|
|||
|
||||
Test-facing surface (stable, Playwright E2E depends on these): `AppSidebar` `nav-*` buttons expose `data-testid="nav-${route}"` + `aria-current="page"`; `SettingsModal` tabs expose `data-testid="settings-tab-${id}"`; onboarding mode cards expose `onboarding-mode-local|online`; `EmptyStateCard` exposes `empty-state-card`. Add a testid before writing an E2E journey; do not select by MUI classes.
|
||||
|
||||
DB schema (`src/main/db/schema.ts`, drizzle SQLite): `history`, `dictionary`, `stats`, `memo_tags`, `daily_usage`, `rag_documents`, `rag_chunks`, `meeting_sessions`, `meeting_memos`, `meeting_documents`, `input_activity` (hour × app counters), `typing_samples`, `personal_phrases`, `suggestions`.
|
||||
DB schema (`src/main/db/schema.ts`, drizzle SQLite): `history`, `dictionary`, `stats`, `memo_tags`, `daily_usage`, `rag_documents`, `rag_chunks` (incl. `embedding_blob` Float32 binary vector), `meeting_sessions`, `meeting_memos` (incl. immutable `revision` CAS counter, 2026-11-13 `GAP-SYNC-08`), `meeting_documents`, `input_activity` (hour × app counters), `typing_samples`, `personal_phrases`, `suggestions`, `phrase_edges`, `sync_outbox`, `sync_state`, plus FTS5 `tokenize = 'trigram'` virtual tables `history_fts`, `meeting_sessions_fts`, and `meeting_memos_fts` (`db/index.ts`: WAL + `synchronous = NORMAL` + `temp_store = MEMORY` + `cache_size = -16000` + `mmap_size = 67108864`). `PersonalGraphService.indexText` and `runMaintenance` execute inside single SQLite transactions, and `InputTelemetryService` only attaches high-frequency `mousemove`/`wheel` hooks and `_flushTimer` when `inputTelemetryEnabled && !inputTelemetryPaused`.
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -253,7 +253,7 @@ DB schema (`src/main/db/schema.ts`, drizzle SQLite): `history`, `dictionary`, `s
|
|||
|---|---|
|
||||
| App entry / deep links | `src/main/index.ts` |
|
||||
| Bootstrap order | `src/main/bootstrap.ts` |
|
||||
| IPC registry | `src/main/ipc/index.ts` |
|
||||
| IPC registry | `src/main/ipc/index.ts`, `src/main/ipc/renderer-broadcast.ts` (`safeSendToRenderer`, `broadcastToAllWindows` SSOT across 9 IPC/bootstrap modules) |
|
||||
| IPC channel SSOT | `packages/core/src/ipc-channels.ts` |
|
||||
| Key-binding contract SSOT | `packages/core/src/keybinding.ts` (catalog, actions, validation, conflicts, formatting, parsing) |
|
||||
| Input intelligence domain SSOT | `packages/core/src/input-intelligence.ts` (key classification, typed delta, suggestion policy, overlay anchoring, flow/friction aggregation, phrase decay/ranking, provenance and exclusion recommendation) |
|
||||
|
|
@ -269,7 +269,7 @@ DB schema (`src/main/db/schema.ts`, drizzle SQLite): `history`, `dictionary`, `s
|
|||
| LLM prompt / placeholder SSOT | `src/main/services/llm-prompts.ts` (shared by `VoiceModeService`, `ChainService`, `ipc/llm-handlers.ts`) |
|
||||
| DB schema | `src/main/db/schema.ts` |
|
||||
| Renderer shell / routes | `src/renderer/components/AppLayout.tsx` |
|
||||
| Unified search | `src/main/services/UnifiedSearchService.ts`, `src/main/ipc/unified-search-handlers.ts`, `src/renderer/pages/UnifiedSearchPage.tsx` |
|
||||
| Unified search & hardening anchors | `src/main/services/UnifiedSearchService.ts` (FTS5→`LIKE` fallback + sort indexes), `src/main/ipc/unified-search-handlers.ts`, `src/renderer/pages/UnifiedSearchPage.tsx`, `src/main/services/rag/chunk-store.ts`, `src/main/services/meeting/disk-wav-audio-sink.ts`, `src/renderer/utils/error-message.ts` |
|
||||
| Update feed SSOT | `src/main/update-feed.ts` |
|
||||
| Update policy SSOT | `release/update-policy.json` + `src/main/update-policy.ts` |
|
||||
| Path/loopback resolution | `src/main/utils/paths.ts`, `src/main/utils/loopback.ts` |
|
||||
|
|
@ -278,3 +278,5 @@ DB schema (`src/main/db/schema.ts`, drizzle SQLite): `history`, `dictionary`, `s
|
|||
2026-11-01 verification: source A/B 2/17 before vs 17/17 current; real MP3/M4A conversion 2/2; account-switch regression 3/3 after reproducing all three failures; local packaged STT transcribed the synthetic 8.498 s fixture exactly. Windows 1.16.0 installer, portable and runtime are published; the rebuilt sidecar passed separate-process startup/health and the packaged Windows keyboard N-API binding loaded successfully without starting hooks. Required sidecar minimum 1.16.0 delivers CPU budgeting and terminal UIA changes. [Recovery evidence](../evidence/2026-11-01-completion.md).
|
||||
|
||||
2026-11-02 verification: installed 1.16.0 passed the actual Electron picker→timestamped transcript→local minutes/action-item journey. Native Korean IME passed 7/7 under bounded 100% CPU and 7/7 with a direct 9.389 s `gemma4:e4b` cold-load request overlapping two typing cases. The Latin-layout control exposed next-key/backspace interleaving; source now waits 140 ms at boundaries and batches the current trailing correction region after a 650 ms pause. Full desktop 2,773 tests and production build pass. The fix was published as Windows v1.16.1 on 2026-11-04; the installed-app Latin control still needs a new GUI run. Synthetic WinForms input is not physical-keyboard/Chromium/terminal proof. [Verification evidence](../evidence/2026-11-02-verification.md).
|
||||
|
||||
2026-11-14 verification (Wave 6 WS1/WS2 hygiene, optimization & bug hunt): unified `safeSendToRenderer` and `broadcastToAllWindows` across 9 IPC/bootstrap modules into `src/main/ipc/renderer-broadcast.ts`; wired `OnlineLLMService` stream abort (`_abortController` in `chatStream`), `401` token reset, empty `data.text` guard, and `D3ROError` wrapping; fixed `UnifiedSearchService` `meetingTotal` double-counting, `startedAt`/`createdAt desc` sort order, runtime FTS5-to-`LIKE` fallback (`hasAllFtsTables`), and DB indexes (`idx_meeting_sessions_started_at`, `idx_meeting_memos_created_at`); exported `invalidateEmbeddedChunksCache` across `rag/chunk-store.ts`, `rag/retrieval.ts`, `sync/sync-adapters.ts`, and `db/index.ts`, cleared redundant cached `embedding` JSON strings after `Float32Array` decode, and guarded malformed Float32 buffers; added `MAX_WAV_DATA_BYTES = 0xffffffff - 36` uint32 guard and post-`openSync` fd cleanup in `disk-wav-audio-sink.ts`; closed timer/popup hide-show races across `AdMediationEngine`, `AudioCaptureService`, `LocalLLMService`, `disposeAudioHandlers`, `bootstrap.ts`, and `WindowManager.ts`; hardened `sidecar/main.py` (`UploadFile.close()`, `<2`/odd-byte PCM handling, `_watch_disconnect`, `/shutdown` `_download_thread` join). Renderer added `src/renderer/utils/error-message.ts` (`toErrorMessage`), unified meeting/pull models, guarded non-finite dates (`formatters.ts`, `UnifiedSearchPage.tsx`), cleaned unmount/sequence/timer/listener paths across pages/modals/hooks, and hardened all 6 vanilla JS popups (`beforeunload` listener/timer cleanup, `textContent = ''`, `result-popup` `prepareVersion`/`isVisible`/rAF cancel, `caption-overlay` per-line `fadeTimer`, bounds clamps). `@d3ro/desktop` Vitest **210 files / 2,865 tests PASS**, sidecar Python `unittest` **33/33 PASS**, `npm run build` + `npm run check:desktop-renderer` (`7 page(s)`) PASS; interactive Electron GUI checks remain `[~]`.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue