d3ro-voice/apps/desktop/tests/main
Yun Chan 03cd8bf890 feat(desktop): screen text capture (OCR) overlay with selectable text
A rebindable screen-ocr action (default Ctrl+Alt+O) freezes the monitor under the cursor and
covers it with a focusable overlay. Text is selected by flow drag, rectangle drag, double/triple
click, Shift+click or Ctrl+A, then copied, saved as PNG or searchable PDF, translated,
summarized, read aloud, opened as a link or searched.

- Selection, text assembly and the PDF document are pure functions in @d3ro/core/screen-ocr,
  shared by the main process and the overlay.
- Recognition uses Windows.Media.Ocr through powershell.exe -EncodedCommand with 2x upscaling;
  the capture reaches disk only as a temp PNG that is removed right after recognition.
- Capture uses GDI BitBlt for the target monitor (39 ms) because desktopCapturer captured all
  three monitors and took 2.9 s when DXGI duplication timed out.
- The accelerator is reserved only where the feature is available, so macOS does not swallow
  the key for a feature it cannot run (fails closed with a message).

Map: CAP-17 [~], GAP-OCR-01 (live hotkey journey not yet driven in the running app),
GAP-OCR-02 (macOS engine, mixed-language accuracy).
2026-11-20 15:16:37 +09:00
..
db feat: ship Wave 5-6 multi-surface hygiene, optimization, and bug fixes 2026-11-14 11:51:41 +09:00
ipc fix(desktop): harden cancellation, dispose, and lifecycle races across main services 2026-11-14 15:26:18 +09:00
services feat(desktop): screen text capture (OCR) overlay with selectable text 2026-11-20 15:16:37 +09:00
sync refactor(desktop): structure suggestion pipeline and restore test gates 2026-10-31 23:14:11 +09:00
utils feat(commands): multi-select ordered command pipeline with step reordering and single-pass composition (AI-05, AI-07) 2026-10-31 02:54:54 +09:00
windows feat(desktop): screen text capture (OCR) overlay with selectable text 2026-11-20 15:16:37 +09:00
app-identity.test.ts fix(desktop): align runtime AppUserModelId with electron-builder appId 2026-09-28 02:16:18 +09:00
config-effects-overlay-redteam-r2-1.test.ts fix(desktop): harden session, meeting, caption and LLM lifecycles; route LLM calls through the gateway 2026-09-28 02:16:15 +09:00
db-open-atomic-redteam-r2-1.test.ts fix(desktop): harden session, meeting, caption and LLM lifecycles; route LLM calls through the gateway 2026-09-28 02:16:15 +09:00
index-activate-redteam-r3-4.test.ts fix: red-team round 3 hardening across desktop, mobile, core and server 2026-09-28 20:45:52 +09:00
index-update-dialog-preview.test.ts chore: land in-progress workspace changes before 1.16.2 2026-11-05 21:58:44 +09:00
install-kind.test.ts fix(update): re-evaluate policy on every update transition and skip NSIS updater on portable installs 2026-09-28 02:16:18 +09:00
safe-filename.test.ts
shutdown-registry.test.ts
suggestion-overlay-policy.test.ts
update-dialog-preview.test.ts chore: land in-progress workspace changes before 1.16.2 2026-11-05 21:58:44 +09:00
update-policy-redteam-r3-5.test.ts fix(ci): point release-metadata checks at the relocated update and publish guards 2026-09-28 20:55:11 +09:00
update-policy.test.ts fix(update): never offer a lower or equal version on prerelease channels 2026-10-20 16:34:48 +09:00
update-session.test.ts fix(update): re-evaluate policy on every update transition and skip NSIS updater on portable installs 2026-09-28 02:16:18 +09:00
update-signature.test.ts feat(release): one-command desktop release with Ed25519-signed update metadata 2026-10-18 07:06:55 +09:00