feat: ship Wave 5-6 multi-surface hygiene, optimization, and bug fixes

This commit is contained in:
Yun Chan 2026-11-14 11:51:41 +09:00
parent 01ef3293cf
commit 66b6b45ba9
399 changed files with 17828 additions and 11330 deletions

View file

@ -20,7 +20,7 @@ Status quick-reference: `[x]` done+verified · `[~]` partial/unverified · `[ ]`
| CAP-04 | Recording waveform + level meter | [x] | [x] | [x] | [-] | Desktop 9-bar cos distribution; mobile audio level; the recording-tip popup bundle and its on-disk assets are verified by `scripts/ci/verify-desktop-renderer-bundles.mjs` |
| CAP-05 | Device/mic selection | [x] | [ ] | [~] | [-] | Desktop config; mobile uses system default |
| CAP-06 | System/loopback audio capture | [x] | [-] | [ ] | [-] | Desktop only (caption source); mobile policy-limited |
| CAP-07 | Local Whisper STT | [x] | [-] | [x] | [-] | Desktop ships the faster-whisper sidecar (`resources/sidecar`, built by `sidecar:build`, verified by `scripts/ci/verify-sidecar-bundle.mjs`), warms it up at app start, and connects over IPv4 loopback; mobile on-device Whisper (supported devices) **2026-10-30: sidecar/cpu_budget.py applies the same bounded worker policy to primary/auxiliary Whisper models and CPU fallback; budget and constructor regression tests pass. 2026-11-01: rebuilt sidecar startup/health passed and runtime 1.16.0 is published; actual high-load typing remains open (GAP-INPUT-11).** |
| CAP-07 | Local Whisper STT | [x] | [-] | [x] | [-] | Desktop ships the faster-whisper sidecar (`resources/sidecar`, built by `sidecar:build`, verified by `scripts/ci/verify-sidecar-bundle.mjs`), warms it up at app start **only when `sttProvider === 'local'`**, unloads the primary Whisper model (`POST /unload` `slot:"primary"`) on cloud-provider switch or after 15 min idle while keeping `/uia/focus` alive, and connects over IPv4 loopback; mobile on-device Whisper (supported devices) **2026-10-30: sidecar/cpu_budget.py applies the same bounded worker policy to primary/auxiliary Whisper models and CPU fallback; budget and constructor regression tests pass. 2026-11-01: rebuilt sidecar startup/health passed and runtime 1.16.0 is published; actual high-load typing remains open (GAP-INPUT-11).** |
| CAP-08 | Cloud STT (multi-provider) | [x] | [x] | [x] | [x] | Desktop 6 providers + D3RO Cloud; web/mobile via `stt-proxy`; .NET internal gateway |
| CAP-09 | STT auto-fallback + fail-closed | [x] | [x] | [x] | [x] | `STTManager`; SSOT R-021/R-022 GREEN |
| CAP-10 | STT model download/management UI | [x] | [-] | [~] | [-] | Desktop model manager + onboarding; mobile bundled model |
@ -68,7 +68,7 @@ Status quick-reference: `[x]` done+verified · `[~]` partial/unverified · `[ ]`
| MEM-12 | Voice actions (OS automation) | [x] | [x] | [x] | [x] | Desktop `VoiceActionService`; web `ActionRunner` (simulated); mobile `ActionsScreen` |
| MEM-13 | Cross-surface data sync | [~] | [x] | [x] | [x] | **Desktop rewritten 2026-09-27** (`services/sync/SyncEngine.ts`): persistent outbox (offline/restart safe), server-clock keyset cursors per user DB with pagination, pending local edits never overwritten by pull, deletions both ways through `sync_tombstones`, per-row failure isolation, Realtime that actually connects (`ws` transport). Covers history (+title/favorite), dictionary, meetings, meeting memos/documents, memo tags, custom commands, dictation + meeting-doc templates; plus device registration. Evidence: `apps/desktop/tests/main/sync/SyncEngine.test.ts` (20) + `apps/desktop/tests/integration/cross-device-sync.supabase.test.ts` (5, local Supabase stack). `[~]` until migration `20260927000034` is deployed to production and a desktop build is exercised against a phone (GAP-SYNC-05); knowledge/audio/settings still local (GAP-SYNC-06) **2026-09-27 second batch:** knowledge base, recordings (upload + remote playback) and the mobile `user_settings` fields that mean the same thing on both sides (ko/en locale, system/light/dark theme, auto-polish on/off, active user command) now sync too; remote setting changes reach the open window (`app:dataChanged`, `config:changed`). Production DB is at migration `0035` and all Edge Functions are redeployed from the repo |
| MEM-14 | Memo tag search | [x] | [ ] | [x] | [x] | |
| MEM-15 | Unified record + meeting search | [~] | [ ] | [x] | [-] | Shared `@d3ro/core/types` result contract. **2026-10-30 (`GAP-UX-05`):** Mobile (`unified-search-service.ts`, `UnifiedSearchScreen.tsx`) now supports `AbortSignal`/`AbortController` in-flight cancellation, `transcripts` segment table search (`searchTranscriptSegments`), and bounded payload projection (`boundPayloadText`), verified by `unified-search-service.test.ts` + 320dp dark/411dp light runtime journeys (`[x]`). Desktop (`UnifiedSearchService.ts`) searches `history`, `meetings`, `meetingMemos`, and timed transcript segments (`UnifiedSearchService.test.ts` 12/12 PASS; `[~]` pending Electron `Ctrl+K` manual check). |
| MEM-15 | Unified record + meeting search | [~] | [ ] | [x] | [-] | Shared `@d3ro/core/types` result contract. **2026-10-30 (`GAP-UX-05`):** Mobile (`unified-search-service.ts`, `UnifiedSearchScreen.tsx`) now supports `AbortSignal`/`AbortController` in-flight cancellation, `transcripts` segment table search (`searchTranscriptSegments`), and bounded payload projection (`boundPayloadText`), verified by `unified-search-service.test.ts` + 320dp dark/411dp light runtime journeys (`[x]`). Desktop (`UnifiedSearchService.ts`) searches `history`, `meetings`, `meetingMemos`, and timed transcript segments — **upgraded 2026-11-13 with SQLite FTS5 `tokenize = 'trigram'` virtual tables (`history_fts`, `meeting_sessions_fts`, `meeting_memos_fts`) and `<3`-char `LIKE` fallback, and hardened 2026-11-14 (Wave 6 WS1) with `startedAt`/`createdAt desc` sort indexes (`idx_meeting_sessions_started_at`, `idx_meeting_memos_created_at`), `meetingTotal` double-count fix, and `hasAllFtsTables` runtime FTS5→`LIKE` fallback** (`UnifiedSearchService.test.ts` 17/17 + `sqlite-optimizations.test.ts` 4/4 PASS; `[~]` pending Electron `Ctrl+K` manual check). |
---
@ -83,7 +83,7 @@ Status quick-reference: `[x]` done+verified · `[~]` partial/unverified · `[ ]`
| MTG-05 | Document generation (minutes/report/idea-note/mindmap) | [x] | [x] | [x] | [x] | Edge `generate-meeting-document`; SSOT F-011 GREEN |
| MTG-06 | Document edit (Markdown) | [x] | [x] | [x] | [x] | Desktop editor; web `document-editor` |
| MTG-07 | Export PDF/DOCX/TXT/Markdown | [x] | [~] | [x] | [x] | Desktop `ExportMenu`; web markdown; mobile print/DOCX chooser (SSOT data portability GREEN) |
| MTG-08 | Speaker diarization | [~] | [ ] | [ ] | [ ] | Desktop `phase-15.5` (LLM estimate + pyannote prep); mobile SSOT H-014 pending |
| MTG-08 | Speaker diarization | [~] | [x] | [x] | [-] | **2026-11-13 (`GAP-MTG-02`, SSOT `H-014`):** Desktop `sidecar/main.py` `POST /diarize` (pyannote.audio when installed + acoustic energy-VAD turn segmentation fallback) wired via `LocalSTTService.sidecarBaseUrl` into `MeetingModeService._diarizeTranscript` with LLM fallback, `stripInventedMarkers({ allowSpeakerMarkers })`, and `@d3ro/core/meeting-transcript` speaker utilities (`extractTranscriptSpeakers`, `filterTranscriptEntriesBySpeaker`, `formatSpeakerBadgeLabel`). Speaker badges and multi-speaker filter chips shipped and unit-tested across Desktop (`TranscriptTab.tsx` / `EditableSegment.tsx`), Web (`live-transcript-list.tsx`), and Mobile (`MeetingDetailScreen.tsx`, `meetings.test.ts` 18/18 PASS). Desktop remains `[~]` pending a live multi-speaker audio GUI run. |
| MTG-09 | Audio seek ↔ transcript timestamp | [x] | [x] | [x] | [-] | **2026-10-30 (`GAP-MTG-01` `[x]`):** Desktop (`TranscriptTab.tsx` / `EditableSegment.tsx`), Web (`meeting-audio-player.tsx` ↔ `live-transcript-list.tsx`), and Mobile (`meetings-service.ts`, `MeetingDetailScreen.tsx`) parse `[MM:SS]` / `timestamp_ms` segments, seek audio on badge tap, and highlight the active transcript segment (`__tests__/meetings.test.ts` PASS). |
| MTG-10 | Meeting list search/filter/sort | [~] | [ ] | [~] | [x] | Basic lists; advanced filters pending |
| MTG-11 | Meeting AI chat over transcript | [x] | [ ] | [ ] | [x] | Desktop `MeetingChatPanel` + `MEETING_CHAT` |
@ -198,7 +198,7 @@ end-to-end behaviour has **not been verified by typing in a real app** (`11` GAP
|---|---|---|---|---|---|---|
| SHELL-01 | Settings / preferences | [x] | [~] | [x] | [x] | **2026-09-28 개편:** 데스크톱 설정은 모달이 아니라 메인 창 전체 화면 라우트(`settings`) — 왼쪽 세로 탭 8개 + 본문 `components/settings/SettingsRows`(구획 h3 + 라벨·설명/컨트롤 행). 일반 탭에 키 바인딩 편집기(CAP-16). 이전 기록: Desktop tabbed modal; the General tab hosts the whole key-binding editor (CAP-16: global on/off switch + one `KeyBindingField` per action, grouped voice/window — `SettingsModal.tsx:239`), which is also the first settings entry point the `command` action ever had; web theme/i18n; mobile `SettingsScreen` |
| SHELL-02 | Theme system (6 themes) | [x] | [x] | [x] | [-] | `theme.ts` SSOT |
| SHELL-03 | i18n (12 locales) | [x] | [~] | [~] | [-] | `@d3ro/i18n`; all 12 catalogs (`ko`, `en`, `ja`, `zh`, `zh-TW`, `es`, `fr`, `de`, `pt`, `ru`, `vi`, `th`) are synchronized to 2,742 keys and guarded by `i18n-locale-parity.test.ts` (15/15 PASS), including the updater dialog keys added on 2026-11-04. Catalog parity is not surface exposure: web has no locale selector and mobile currently exposes ko/en only (`GAP-I18N-03`, SSOT `O-012`), so those surfaces remain `[~]`. |
| SHELL-03 | i18n (12 locales) | [x] | [x] | [~] | [-] | `@d3ro/i18n`; all 12 catalogs (`ko`, `en`, `ja`, `zh`, `zh-TW`, `es`, `fr`, `de`, `pt`, `ru`, `vi`, `th`) pruned of 253 dead keys to **2,500 keys × 12 locales** and guarded by `npm run check:i18n` (`scripts/ci/check-i18n-contract.mjs`), `sync-i18n-locales.mjs --check`, `packages/i18n/__tests__/locale-contract.test.ts` (15/15 PASS), and `i18n-locale-parity.test.ts` (15/15 PASS). **2026-11-13 (`GAP-I18N-03`, SSOT `O-012`):** split into dynamic 10-locale web/renderer chunks (`@d3ro/i18n`), zero-React single-locale Node loader (`@d3ro/i18n/main`), and 12-locale Metro `inlineRequires` React Native entry (`index.native.tsx`). Web exposes a 12-locale `LocaleSwitcher` in the app shell with storage persistence (`locale-switcher.test.tsx` 3/3 PASS); Mobile exposes all 12 locales across `OnboardingScreen`, `SettingsScreen`, and `AccountScreen` + Android `localeFilters` for all 12 resource qualifiers (`verify-mobile-build-config.mjs` enforced; `[~]` on mobile pending physical-device non-ko/en visual pass). |
| SHELL-04 | Onboarding / first-run | [x] | [ ] | [~] | [-] | Desktop model bootstrap (`onboarding.llmModelSize` aligned to 4.0GB `gemma4:e4b`, `GAP-UX-07` `[x]`); mobile audience/theme/locale. **2026-11-01:** 신규 사용자 목적지를 persistence 전에 준비하도록 수정하고 Fold6에서 `.2` fresh auth/signup/invite/small-screen 4/4 PASS (`fold6-20261101-fix1`); latest `.3` first-run auth and retry fail at onboarding visibility (`fold6-20261101-mtg13`). Exact `.3` APK now passes isolated API 34 emulator fresh auth 37 s / signup 50 s with restart persistence; personal Fold6 data was preserved and its separate failures remain open. |
| SHELL-05 | Accessibility / reduced motion | [~] | [~] | [~] | [-] | Desktop reduced-motion honored. Mobile source labels/roles and 48dp tests plus 2026-11-04 inspected-route UIAutomator/font-scale/rotation evidence are partial GREEN; the AdMob SDK descendant exposed one unlabeled clickable WebView. Manual TalkBack/focus order, reduced-motion/app-wide coverage, and iOS remain ([evidence](../evidence/2026-11-04-mobile-runtime-a11y.md)). |
| SHELL-06 | System tray / background | [x] | [-] | [-] | [-] | Desktop tray |
@ -206,7 +206,7 @@ end-to-end behaviour has **not been verified by typing in a real app** (`11` GAP
| SHELL-08 | Auto-update | [x] | [-] | [!] | [-] | Desktop electron-updater; Forgejo canonical feed; channels + mandatory/major-vs-delta policy (`release/update-policy.json`); mobile store updates **2026-10-24 UI:** updates are now visible in the app, not only through native dialogs. Settings → About opens with an Updates section (`components/settings/UpdateSection.tsx`): status, progress bar, last check, and Check / Download / Restart-to-install buttons. A title-bar chip (`components/shell/UpdateChip.tsx`) appears only while an update is available, downloading or ready, and opens that tab. IPC `appUpdate:getStatus|check|download|install` plus the `appUpdate:statusChanged` event; state comes from `UpdateService.getStatus()`. A skipped version still shows, and downloading it manually clears the skip. Dev and portable builds show "disabled". **2026-11-04:** native consent/restart dialogs resolve `getPopupTranslator()` at each prompt, so a runtime locale change is not cached; ko→en behavior is covered by `update-dialog-i18n.test.ts`. The isolated `--preview-update-dialogs` packaged-QA entry calls the real prompter without updater/feed/install side effects and is covered by entry/prompt tests. The current-source package/ABI passed, but the native dialog appearance and interaction remain an external-desktop gate (`GAP-QA-04`). |
| SHELL-09 | Support / diagnostics | [x] | [ ] | [ ] | [x] | Desktop `SupportModal` (`support-handlers.ts` strict-typed, `GAP-REL-15` `[x]`); admin `/support` fail-closed `content_reports` & support console (`GAP-SHELL-01` `[x]`). |
| SHELL-10 | Download center / releases | [-] | [x] | [-] | [x] | Web `/download`, admin `/releases`, Forgejo |
| SHELL-11 | Landing site / legal pages | [-] | [-] | [-] | [-] | `site/` — the only landing/download/legal/invite/assetlinks surface (Wave 3, 2026-09-26: copies in api-server wwwroot and apps/web removed; 404.html; hero loops a copy of the app recording capsule). Prices/URLs from `packages/core` plan-catalog/web-urls — see `design.md`. **2026-10-28 designpaca audit:** flat header (`Header.tsx` blur removed), WCAG AA contrast verified across all 14 routes (`ko`..`vi`, `privacy`, `terms`, `delete-account`, `accept-invite`), `legal.css` explicit `font-weight: 500/600` (no `>=700` fallback), `accept-invite` polite Korean register (`해요체`) and `--faint`/`--accent` AA contrast. |
| SHELL-11 | Landing site / legal pages | [-] | [-] | [-] | [-] | `site/` — the only landing/download/legal/invite/assetlinks surface (Wave 3, 2026-09-26: copies in api-server wwwroot and apps/web removed; 404.html; hero loops a copy of the app recording capsule). Prices/URLs from `packages/core` plan-catalog/web-urls — see `design.md`. **2026-10-28 designpaca audit:** flat header (`Header.tsx` blur removed), WCAG AA contrast verified across all 14 routes (`ko`..`vi`, `privacy`, `terms`, `delete-account`, `accept-invite`), `legal.css` explicit `font-weight: 500/600` (no `>=700` fallback), `accept-invite` polite Korean register (`해요체`) and `--faint`/`--accent` AA contrast. **2026-11-13 (`W5-12`):** `typecheck:site`, `lint:site` (`--max-warnings=0`), and `site` production build wired into root `verify:all` and `.forgejo/workflows/ci.yml`. **2026-11-14 (Wave 6 `WS4`):** `AppLoopDemo.tsx` separates `isHidden`/`isOutOfViewport` with `IntersectionObserver` guard, and `Download.tsx`/`Footer.tsx` upgrade external links to `rel="noopener noreferrer"`. |
| SHELL-12 | Notifications (in-app / desktop) | [x] | [ ] | [x] | [x] | Desktop events; mobile push |
| SHELL-13 | Desktop/mobile information architecture (2026-09-28) | [x] | [-] | [x] | [-] | 1급 홈·기록·회의 + 2급 도구. Desktop: `renderer/navigation/app-navigation.tsx`, `AppSidebar`, status bar removed. Mobile: visible Home/Records/Meetings/More tabs, hidden Record route, floating three-action Record FAB, More tool/account grouping; full Jest and the canonical 320dp dark/411dp light runtime journeys are GREEN (`11` GAP-UX-04). `DashScreen`/`WorksHubScreen` were removed; WorksHub-only local filter/pinning was intentionally retired while every destination remains in tabs/More and user content is untouched. Decision SSOT: root `design.md`. |
| SHELL-14 | Home ("오늘") | [x] | [-] | [x] | [-] | Desktop `pages/HomePage.tsx`: recording key, starts, blockers, summary, recent 6/4, file transcription, bounded usage. Mobile `HomeScreen`: today summary, recent records 5/meetings 3, unified-search and plan entry; canonical 320dp dark and 411dp light runtime journeys GREEN. |
@ -232,7 +232,7 @@ end-to-end behaviour has **not been verified by typing in a real app** (`11` GAP
| INFRA-11 | Docker + NAS deploy | [x] | `docker-compose.nas.yml`, `scripts/deploy-nas.*` |
| INFRA-12 | Cloudflare edge + tunnel | [x] | `server/cloudflare-worker`, Cloudflare Tunnel `kd-nas` |
| INFRA-13 | Site deploy (Cloudflare Pages) | [x] | `.forgejo/workflows/deploy-site.yml`; the unused GitHub Pages workflow was removed in Wave 3 |
| INFRA-17 | Test hygiene gate (TDD policy) | [x] | `scripts/ci/check-test-hygiene.mjs` (`npm run test:hygiene` + `:test`), wired into `.forgejo/workflows/ci.yml` quality and `.gitlab-ci.yml` validate. Rules: `.only`, reason-less `.skip()`, trivial assertions, `isVisible()`-gated assertions, machine paths, `waitForTimeout`, `.e2e.test.ts`, `e2e/` 밖의 `*.spec.ts`, assertion-free files. Applied policy + deletion/consolidation log: `docs/tdd-red/06-repo-application.md`. |
| INFRA-17 | Test hygiene & TDD v2.0 gates | [x] | `scripts/ci/check-test-hygiene.mjs` (`test:hygiene`), `check-protected-tests.mjs` (`check:protected-tests`), `check-test-quality.mjs` (`test:quality`), `check-i18n-contract.mjs` (`check:i18n`), `check-ds-contract.mjs` (`check:ds-contract`), `run-affected-tests.mjs` (`test:affected`), `verify-desktop-installer-smoke.mjs` (`release:installer:smoke`), and `@d3ro/core/ports` (`Clock`/`Random` deterministic ports) — all equipped with `--self-test` and wired into `verify:all`, `.forgejo/workflows/ci.yml`, `release-desktop.mjs`, and `.forgejo/workflows/release.yml`. Applied policy: `docs/tdd-red/06-repo-application.md`, `07-revamp-plan.md`. |
| INFRA-15 | Update & release system | [x] | Canonical Forgejo feed + channels/policy (`release/update-policy.json`, `src/main/update-policy.ts`), canonical publisher `scripts/ci/publish-forgejo-release.mjs`, legacy GitLab mirror; `npm run release:metadata:test`. v1.1.0 was published to Forgejo on 2026-09-15; product version moved to `1.2.0` as a forward-fix with CI-only publication, a same-version re-release guard, and download centers that link the feed instead of repository paths. `1.3.0` (2026-09-18) carries the local-STT fixes; Windows publication still needs the CI signing secrets (`11` GAP-REL-02). |
| INFRA-16 | Desktop STT engine packaging | [x] | `apps/desktop/scripts/setup-sidecar.mjs` + `build-sidecar.mjs`, `electron-builder.yml` `extraResources` (`sidecar-dist/sidecar` → `resources/sidecar`, `resources/ffmpeg`), and `scripts/ci/verify-sidecar-bundle.mjs` run in `package-windows`/`package-macos` before electron-builder. Verified on the real bundle: `sidecar.exe` + `_internal` including `faster_whisper/assets/silero_vad_v6.onnx`, plus a packaged-engine transcription round-trip on GPU. |
| INFRA-17 | 서명 없는 배포 채널 (portable + Scoop) | [x] | `scripts/ci/build-portable.mjs` (95MiB 7z 분할 볼륨 + Scoop 매니페스트), `scripts/ci/publish-portable-release.mjs`, `scripts/local/install-d3ro-voice.ps1`, `bucket/` 버킷, `.forgejo/workflows/portable.yml`; 7z 분할 볼륨(Scoop, 162MiB) + zip 분할 부품(수동 설치, 243MiB, 7-Zip 불필요); updater feed와 분리. 2026-09-18 `portable-1.3.1` 게시 + 실제 설치 검증. |