DualPiP v1.7 Release Notes

This update introduces ASR (Automatic Speech Recognition) live captions, generating real-time AI subtitles for any web video with full Learning Mode and AI translation support. It also adds online subtitle search, local subtitle import, and a completely rebuilt AI translation architecture.

1.7.0 - 2026-05-29

• Deepgram Cloud Recognition: Real-time WebSocket streaming with sub-300ms latency, supporting 22+ languages with automatic detection.
• Local Whisper Recognition: Connect to locally deployed OpenAI-compatible Whisper servers for privacy-friendly, offline speech recognition.
• Streaming + Pre-download Dual Modes: Auto mode tries WebSocket streaming first, falls back to pre-download batch recognition when streaming is unavailable.
• Learning Mode Integration: ASR captions fully support Learning Mode subtitle panel, AB loop repeat, and all learning features.
• AI Translation Bilingual Captions: Combine ASR captions with AI translation to generate real-time bilingual subtitles.
• Keyboard Shortcuts: Press Shift+A in the PiP window to toggle ASR, or configure a global shortcut via chrome://extensions/shortcuts.
• ASR Settings Page: Add, edit, and manage speech recognition providers with language, capture mode, and other configuration options.

• Online Subtitle Search: Search and download subtitles directly from the PiP subtitle menu, supporting DualPiP built-in, OpenSubtitles, and SubDL sources.
• Local Subtitle Import: Import local subtitle files in SRT/VTT/ASS/SSA/SUB formats.
• Smart Identification: Automatically detects video IMDb ID, TMDb ID, and title for precise search results.
• Search Settings: Configure custom API keys, with source switching via dropdown menu that remembers your choice.
• Free users can search subtitles unlimited times, with 2 downloads per day.

• Rebuilt AI translation architecture with separate provider and model management, 30+ preset AI providers for one-click setup.
• Support for custom API parameters, request headers, and disabling model thinking.
• Added context history for improved consistency in continuous subtitle translation.
• Automatic video title detection combined with TMDB information for better translation quality.
• Per-provider daily usage statistics and quota limits (request count and token limits).
• Persistent notification badge in the PiP window when usage quota is reached.

• Screenshot button moved to the settings menu for a cleaner control bar.
• Fit-to-window button now displayed by default.
• Learning Mode guide page redesigned with two-column layout and responsive small-window support.
• DRM-protected videos automatically fall back to standard Picture-in-Picture mode.
• Cross-origin PiP now shows a login prompt for unauthenticated users.

• Fixed black screen when using PiP on certain streaming sites (e.g. friDay Video).
• Fixed cross-origin video prompt overlay not being clickable.
• Fixed subtitles not applying correctly after free user downloads.
• Fixed missing login prompt when backend returns 401 unauthorized.
• Fixed Learning Mode guide page overflowing in small windows.