DualPiP v1.7 Release Notes

This update introduces ASR (Automatic Speech Recognition) live captions, generating real-time AI subtitles for any web video with full Learning Mode and AI translation support. It also adds online subtitle search, local subtitle import, and a completely rebuilt AI translation architecture.

• Improved service reliability

• Fixed floating button not displaying correctly in the control bar on some configured sites
• Fixed floating button not appearing on SPA pages without requiring a page refresh
• Fixed black screen on thumbnail preview during PiP gesture seek
• Fixed multiple login windows opening when multiple RabbitPair extensions are installed

• PiP quick-access button: a floating button appears at the top-left corner of videos — hover to enter Picture-in-Picture instantly.
• Multi-video page support (e.g. X/Twitter): each video gets its own PiP button.
• Automatically insert a PiP button into the player control bar on configured sites.
• New "Show PiP Quick Button" toggle in Settings to disable all quick-access buttons.
• Right-click the quick button to choose "Hide on this site".

• Fixed Picture-in-Picture launch from the popup sometimes failing silently.
• Fixed screenshot capture failing on certain videos.

• Added danmaku (floating comments) and subtitle support for Douyin and TikTok.

• Improved stability.
• Smoother progress bar updates.

• Fixed an issue where, after refreshing certain sites, the caption count badge was inaccurate, captions briefly disappeared, or subtitles were missing from the menu.
• Fixed an issue where a line could no longer be translated after its pre-translation failed.
• Fixed an occasional issue where the PiP progress bar stopped updating.
• Fixed an issue on Disney+ where rewinding jumped back to the start of the video and the position/duration were shown incorrectly.
• Fixed an issue where the original subtitles didn't return automatically after turning off live captions.
• Fixed shortcuts being triggered by accident while typing in the subtitle search box (e.g. accidentally closing PiP or jumping the playback position).

• More video player support: added subtitle detection for Shaka Player, DPlayer, XGPlayer, Bitmovin, OpenPlayer, MediaElement.js, Flowplayer, and Fluid Player.
• Native track fallback: when a player has no observable subtitle DOM (e.g. players rendering via ::cue), DualPiP now automatically reads the video's native text tracks to show bilingual subtitles.
• Pro expiry auto-fallback notice: when AI translation becomes unavailable due to membership expiration, DualPiP automatically switches to a free translation service and displays a one-time notification.

• Redesigned caption menu: subtitles are now grouped into "Basic Captions" (free) and "Advanced Captions" (Pro) for a clearer view of available options.
• Smarter upgrade prompts: the old pop-up nudges have been replaced with a subtle "Advanced Captions available" badge that appears only when relevant, reducing interruptions.
• Smoother translation display: a brief render buffer prevents translated text from flashing in before you've finished reading the original line.
• Auto-hide native captions in PiP: the browser's built-in subtitle rendering is now hidden while our overlay is active, preventing duplicate captions.

• Fixed OBS subtitles stopping updates after enabling translation.

• Clearer live caption startup: status hints ("Connecting", "Listening…", "Recognizing…") now appear while captions start, and you're alerted when speech is detected but nothing is transcribed — a sign the recognition language may be set incorrectly.
• Live captions on protected videos (e.g. Netflix): when the audio can't be captured, a clear tip now guides you to turn off your browser's hardware acceleration and try again.
• Simpler live caption provider setup: advanced options are now collapsed and the API key field is focused automatically, with clearer messages when settings are invalid or a connection fails.

• Fixed Netflix live captions sometimes repeatedly showing outdated subtitles.

• YouTube Ad Skipping: Upon entering Picture-in-Picture (PiP) mode, the "Skip" button automatically appears in the bottom-right corner of the PiP window, allowing you to skip ads directly without switching back to the webpage.
• Danmaku Source Switching: A new "Other" section has been added to the options page, allowing you to choose the Bilibili danmaku source: "Webpage" (default; matches the webpage display exactly) or "API" (fetches full danmaku data; remains visible even when minimized).

• Real-time subtitles (cloud-based recognition) now require logging in to use.
• Subtitle search is now a free feature: Available after logging in; supports the use of your own OpenSubtitles/SubDL API keys and removes the daily download limit.
• Automatic subtitle activation is now a free feature and enabled by default: Automatically enables the site's native subtitles when watching on streaming platforms, eliminating the need for manual activation.

1.7.10 - 2026-06-20

• Fixed new-video subtitles failing to load or display after switching videos or auto-playing the next episode (including YouTube, Netflix, and other streaming sites).
• Fixed automatic intro-skipping and auto-play of the next episode sometimes not working while a streaming video plays in Picture-in-Picture in the background.
• Fixed Picture-in-Picture disappearing about a second after opening, making playback impossible.
• Fixed "Automatically enter Picture-in-Picture when switching tabs" sometimes not working.

• Reduced default permissions: tabCapture-related permissions are now requested on demand, only when generating live captions for protected videos.

1.7.9 - 2026-06-16

• Retired the "In-Page Bilingual Subtitles" feature: the Chrome Web Store's single-purpose policy requires the extension to focus on its core Picture-in-Picture capability, or it risks being removed from the store. For that reason, we removed the option that overlaid bilingual subtitles directly on a website's own player without entering Picture-in-Picture.
• Rest assured, the bilingual subtitle experience is fully preserved: bilingual subtitles, subtitle translation, and subtitle download all keep working once you enter Picture-in-Picture.
• This capability isn't going away — it's just moving: we're building a dedicated new extension focused on web video (with mobile support coming), where in-page bilingual subtitles will return. We apologize for any inconvenience and thank you for your understanding.

• Fixed the progress-bar thumbnail preview still showing the blurred free-version effect after signing in to a paid membership, which previously required reopening Picture-in-Picture to update.
• Fixed thumbnail previews not appearing or loading slowly when long-pressing and dragging to scrub on some sites (e.g. Netflix).

1.7.8 - 2026-06-15

• Added a "Play Video in Picture-in-Picture" right-click menu, so you can jump into PiP directly from any page without opening the popup (can be turned on or off in settings).
• Added "Prefer official subtitles for translation": when a video has official subtitles in your target language, they're used directly as the translation — more accurate and natural than machine translation.
• Multi-language subtitles on more sites: a video's subtitle languages are now fetched and cached automatically for easy switching and translation. Added support for Amazon Prime Video, Dailymotion, and Udemy, full language coverage for Bilibili, plus more streaming sites via generic HLS/DASH parsing.

• Picture-in-Picture now launches faster after clicking the extension icon, with unnecessary detection delays removed.
• Streamlined the popup by removing the captions / danmaku / thumbnail status indicators.
• Redesigned the account area to clearly show your membership status: Free, Trial (with days remaining), Pro, and Lifetime.
• Added a "Sign in / Free trial" entry when logged out, plus a permanent "Upgrade Pro" entry for free and trial users.
• Merged "Smart sentence merging" and "Smart segmentation" into a single "Smart Sentences" toggle that adapts automatically to different subtitle sources.
• Redesigned the translation panel: clicking the translate button now opens the full panel directly, with services grouped into "AI Translation" and "Free Services", plus a highlight cue when no service is selected.
• Renamed "Chrome Built-in" to "Built-in AI Translation" with a "Free · Offline" tag for clarity.
• Language selection lists now show each language in its own native name (e.g. 日本語, Español), with duplicate Chinese entries removed.

• Fixed inaccurate membership and trial status shown in the popup.

1.7.7 - 2026-06-12

• Screenshot button is back in the player control bar.
• Added a screenshot keyboard shortcut (Shift+S by default, customizable), with support for a browser-wide global shortcut.
• Subtitle menu now includes a permanent "Live Captions" entry, with helpful guidance when no subtitles are detected.
• Subtitle "smart segmentation" is now off by default and can be enabled in subtitle style settings.

• Fixed subtitles being out of sync and always showing the previous line (YouTube / Bilibili).
• Fixed subtitles from the previous video lingering after auto-playing the next one.
• Fixed YouTube pre-roll ad subtitles mixing into the main video's subtitles.
• Fixed Bilibili videos not resuming after being paused.
• Fixed Bilibili danmaku gradually disappearing in Picture-in-Picture when the browser window is minimized.
• Fixed danmaku still showing the previous video's comments after Bilibili playlist auto-play.

1.7.6 - 2026-06-09

• Fixed trial members being unable to use PRO features such as speech recognition.
• Fixed PiP window showing blank or video not appearing after opening Picture-in-Picture.
• Fixed video unexpectedly pausing while in Picture-in-Picture.
• Fixed long-press speed gesture misfiring and the speed indicator not disappearing.

1.7.5 - 2026-06-07

• Live Captions now includes a free "DualPiP Cloud" trial mode — no configuration needed, with a usage countdown timer and expiration guidance.
• Notification center now supports card-style messages.

• When subtitle search yields no results, users are now guided to try Live Captions as an alternative.
• PiP window minimum width now dynamically adapts to screen resolution for better display across different devices.

• Fixed an issue where the PiP window occasionally appeared blank with the video not moved in.
• Fixed PiP video not automatically replacing after navigating to a different page.
• Fixed video buffering or freezing after being moved to Picture-in-Picture.
• Fixed notification center link buttons not displaying correctly.

1.7.4 - 2026-06-05

• Auto Live Captions: ASR subtitles now start automatically when no traditional subtitles are detected.
• Added "Auto ASR for this site" toggle in the PiP Live Captions menu for easy per-site management.

• New guided onboarding page for first-time users with interactive step-by-step setup.
• ASR language preference is now remembered per site, prioritizing site-specific language over global default.
• Improved Live Captions matching accuracy for X (Twitter) timeline videos.
• Optimized resource loading strategy, reducing reliance on proxy servers.

• Fixed media resource requests failing on X (Twitter) videos.

1.7.3 - 2026-06-03

• Improved stability of PiP video playback after switching browser tabs.
• Improved rendering performance of the translation service settings page.
• Improved interaction experience of the add model dialog.
• Live captions now follow the subtitle style settings (font, color, size, etc.).
• Added Live Captions shortcut key (Shift+A) display and customization in Options and PiP settings.
• Toggling Live Captions now shows a toast notification with current recognition language.
• Added browser language compatibility hint for the multilingual mode in language list.
• Karaoke Mode renamed and added an "Off" option.
• Added content scope description to the subtitle search panel.
• Improved scrolling behavior for long bilingual Live Captions.

• Fixed subtitle style settings not taking effect on first click.
• Fixed Live Captions overflowing when text wraps to multiple lines.
• Fixed Learning Mode subtitle list not updating highlight correctly during gaps between subtitles.

1.7.2 - 2026-05-31

• Translation service settings now use a tabbed layout for a clearer, more focused experience.
• Adding a model now supports dropdown selection, with the ability to automatically fetch available models from the provider.
• Live captions language support expanded to over 50 languages.
• Live captions preload mode now compatible with more video platforms.

1.7.1 - 2026-05-30

• Improved ASR provider settings with model selection and multi-provider switching.

• Fixed ASR live captions not displaying translations correctly for certain languages.
• Fixed ASR auto mode incorrectly identifying live streams as on-demand videos.

1.7.0 - 2026-05-29

• Deepgram Cloud Recognition: Real-time WebSocket streaming with sub-300ms latency, supporting 22+ languages with automatic detection.
• Local Whisper Recognition: Connect to locally deployed OpenAI-compatible Whisper servers for privacy-friendly, offline speech recognition.
• Streaming + Pre-download Dual Modes: Auto mode tries WebSocket streaming first, falls back to pre-download batch recognition when streaming is unavailable.
• Learning Mode Integration: ASR captions fully support Learning Mode subtitle panel, AB loop repeat, and all learning features.
• AI Translation Bilingual Captions: Combine ASR captions with AI translation to generate real-time bilingual subtitles.
• Keyboard Shortcuts: Press Shift+A in the PiP window to toggle ASR, or configure a global shortcut via chrome://extensions/shortcuts.
• ASR Settings Page: Add, edit, and manage speech recognition providers with language, capture mode, and other configuration options.

• Online Subtitle Search: Search and download subtitles directly from the PiP subtitle menu, supporting DualPiP built-in, OpenSubtitles, and SubDL sources.
• Local Subtitle Import: Import local subtitle files in SRT/VTT/ASS/SSA/SUB formats.
• Smart Identification: Automatically detects video IMDb ID, TMDb ID, and title for precise search results.
• Search Settings: Configure custom API keys, with source switching via dropdown menu that remembers your choice.
• Free users can search subtitles unlimited times, with 2 downloads per day.

• Rebuilt AI translation architecture with separate provider and model management, 30+ preset AI providers for one-click setup.
• Support for custom API parameters, request headers, and disabling model thinking.
• Added context history for improved consistency in continuous subtitle translation.
• Automatic video title detection combined with TMDB information for better translation quality.
• Per-provider daily usage statistics and quota limits (request count and token limits).
• Persistent notification badge in the PiP window when usage quota is reached.

• Screenshot button moved to the settings menu for a cleaner control bar.
• Fit-to-window button now displayed by default.
• Learning Mode guide page redesigned with two-column layout and responsive small-window support.
• DRM-protected videos automatically fall back to standard Picture-in-Picture mode.
• Cross-origin PiP now shows a login prompt for unauthenticated users.

• Fixed black screen when using PiP on certain streaming sites (e.g. friDay Video).
• Fixed cross-origin video prompt overlay not being clickable.
• Fixed subtitles not applying correctly after free user downloads.
• Fixed missing login prompt when backend returns 401 unauthorized.
• Fixed Learning Mode guide page overflowing in small windows.