d3ro-voice/docs/map
Yun Chan 03cd8bf890 feat(desktop): screen text capture (OCR) overlay with selectable text
A rebindable screen-ocr action (default Ctrl+Alt+O) freezes the monitor under the cursor and
covers it with a focusable overlay. Text is selected by flow drag, rectangle drag, double/triple
click, Shift+click or Ctrl+A, then copied, saved as PNG or searchable PDF, translated,
summarized, read aloud, opened as a link or searched.

- Selection, text assembly and the PDF document are pure functions in @d3ro/core/screen-ocr,
  shared by the main process and the overlay.
- Recognition uses Windows.Media.Ocr through powershell.exe -EncodedCommand with 2x upscaling;
  the capture reaches disk only as a temp PNG that is removed right after recognition.
- Capture uses GDI BitBlt for the target monitor (39 ms) because desktopCapturer captured all
  three monitors and took 2.9 s when DXGI duplication timed out.
- The accelerator is reserved only where the feature is available, so macOS does not swallow
  the key for a feature it cannot run (fails closed with a message).

Map: CAP-17 [~], GAP-OCR-01 (live hotkey journey not yet driven in the running app),
GAP-OCR-02 (macOS engine, mixed-language accuracy).
2026-11-20 15:16:37 +09:00
..
00-index.md docs(wave7): record peer-swarm bug fixes, metrics, and map sync 2026-11-14 15:41:48 +09:00
01-system-overview.md chore(ops): the admin console lives only at d3ro-admin.chanpaca.net; release admin.chanpaca.net 2026-09-26 23:11:46 +09:00
02-infrastructure.md fix(ops): send apikey with push drain, read the web push public key from release/, record 2026-11-17 backlog evidence 2026-11-20 15:16:19 +09:00
03-shared-packages.md docs(wave7): record peer-swarm bug fixes, metrics, and map sync 2026-11-14 15:41:48 +09:00
04-desktop-app.md feat(desktop): screen text capture (OCR) overlay with selectable text 2026-11-20 15:16:37 +09:00
05-web-app.md docs(wave7): record peer-swarm bug fixes, metrics, and map sync 2026-11-14 15:41:48 +09:00
06-mobile-app.md fix(ops): send apikey with push drain, read the web push public key from release/, record 2026-11-17 backlog evidence 2026-11-20 15:16:19 +09:00
07-api-server.md docs(wave7): record peer-swarm bug fixes, metrics, and map sync 2026-11-14 15:41:48 +09:00
08-admin-console.md docs(wave7): record peer-swarm bug fixes, metrics, and map sync 2026-11-14 15:41:48 +09:00
09-supabase-backend.md fix(ops): send apikey with push drain, read the web push public key from release/, record 2026-11-17 backlog evidence 2026-11-20 15:16:19 +09:00
10-feature-catalog.md feat(desktop): screen text capture (OCR) overlay with selectable text 2026-11-20 15:16:37 +09:00
11-gap-backlog.md feat(desktop): screen text capture (OCR) overlay with selectable text 2026-11-20 15:16:37 +09:00
12-update-protocol.md docs: record the 1.1.0 release and add the infrastructure map 2026-09-16 23:27:52 +09:00